2024-04-17T19:38:14.776 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-17T19:38:14.776 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/pdonnell-2024-04-17_17:06:06-fs-wip-pdonnell-testing-20240417.021458-debug-distro-default-smithi/7660584 --description fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/mds_creation_retry} --owner scheduled_pdonnell@teuthology --name pdonnell-2024-04-17_17:06:06-fs-wip-pdonnell-testing-20240417.021458-debug-distro-default-smithi --verbose -- /home/teuthworker/archive/pdonnell-2024-04-17_17:06:06-fs-wip-pdonnell-testing-20240417.021458-debug-distro-default-smithi/7660584/orig.config.yaml 2024-04-17T19:38:14.820 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T19:38:14.908 INFO:teuthology.run:Config: -mds_creation_failure: - workunit: clients: all: - fs/misc/trivial_sync.sh archive_path: /home/teuthworker/archive/pdonnell-2024-04-17_17:06:06-fs-wip-pdonnell-testing-20240417.021458-debug-distro-default-smithi/7660584 branch: wip-pdonnell-testing-20240417.021458-debug description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/mds_creation_retry} email: pdonnell@redhat.com first_in_suite: false job_id: '7660584' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: pdonnell-2024-04-17_17:06:06-fs-wip-pdonnell-testing-20240417.021458-debug-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-pdonnell-testing-20240417.021458-debug ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: f3a98d3f110319c567ec86bf70955c141495ccf6 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: f3a98d3f110319c567ec86bf70955c141495ccf6 subvolume_version: 1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240417.021458-debug sha1: f3a98d3f110319c567ec86bf70955c141495ccf6 owner: scheduled_pdonnell@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 4494 sha1: f3a98d3f110319c567ec86bf70955c141495ccf6 sleep_before_teardown: 0 subset: 496/512 suite: fs suite_branch: wip-pdonnell-testing-20240417.021458-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_f3a98d3f110319c567ec86bf70955c141495ccf6/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: f3a98d3f110319c567ec86bf70955c141495ccf6 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi018.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDh5kEc2zS1ZRggRbLPcFuwkQqj3DnLuCu1P1YrnNPz1+lhRW72pshOVBz5u2MiU83+1QuogDToLrG/a1rOrD08= smithi173.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAmYi2nGk2H6Y33Nu+FL7jQzpRgEP2bQWs2ya5yLaNDQHs8Et/xbY7W1pDwe5paWCUA9bi6dZmI+EEPWT9wqA1c= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 6c637841c215537a4502385240412f1966e0faab timestamp: 2024-04-17_17:06:06 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-17T19:38:14.908 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_f3a98d3f110319c567ec86bf70955c141495ccf6/qa; will attempt to use it 2024-04-17T19:38:14.909 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_f3a98d3f110319c567ec86bf70955c141495ccf6/qa/tasks 2024-04-17T19:38:14.909 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-17T19:38:14.911 INFO:teuthology.task.internal:Checking packages... 2024-04-17T19:38:14.935 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'f3a98d3f110319c567ec86bf70955c141495ccf6' 2024-04-17T19:38:14.935 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-17T19:38:14.935 INFO:teuthology.packaging:ref: None 2024-04-17T19:38:14.935 INFO:teuthology.packaging:tag: None 2024-04-17T19:38:14.935 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240417.021458-debug 2024-04-17T19:38:14.935 INFO:teuthology.packaging:sha1: f3a98d3f110319c567ec86bf70955c141495ccf6 2024-04-17T19:38:14.935 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-pdonnell-testing-20240417.021458-debug 2024-04-17T19:38:15.162 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3146-gf3a98d3f-1jammy 2024-04-17T19:38:15.164 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-17T19:38:15.170 INFO:teuthology.task.internal:no buildpackages task found 2024-04-17T19:38:15.171 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-17T19:38:15.215 INFO:teuthology.task.internal:Saving configuration 2024-04-17T19:38:15.233 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-17T19:38:15.248 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-17T19:38:15.273 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi018.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-04-17_17:06:06-fs-wip-pdonnell-testing-20240417.021458-debug-distro-default-smithi/7660584', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-17 19:32:53.036757', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBDNWFiv/0fp1SD8H9fz0ZO3K+6+REPt87foNcauyB+E'} 2024-04-17T19:38:15.297 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi173.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-04-17_17:06:06-fs-wip-pdonnell-testing-20240417.021458-debug-distro-default-smithi/7660584', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-17 19:32:53.035090', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDsPS+lrJJj/5oZ6LRpY+jLexEIQiD6ehO1lumQF55OA'} 2024-04-17T19:38:15.298 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-17T19:38:15.304 INFO:teuthology.task.internal:roles: ubuntu@smithi018.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-04-17T19:38:15.304 INFO:teuthology.task.internal:roles: ubuntu@smithi173.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-04-17T19:38:15.304 INFO:teuthology.run_tasks:Running task console_log... 2024-04-17T19:38:15.428 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3ce195b3a0>, signals=[15]) 2024-04-17T19:38:15.428 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-17T19:38:15.434 INFO:teuthology.task.internal:Opening connections... 2024-04-17T19:38:15.435 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi018.front.sepia.ceph.com 2024-04-17T19:38:15.437 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T19:38:15.517 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi173.front.sepia.ceph.com 2024-04-17T19:38:15.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T19:38:15.600 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-17T19:38:15.606 DEBUG:teuthology.orchestra.run.smithi018:> uname -m 2024-04-17T19:38:15.612 INFO:teuthology.orchestra.run.smithi018.stdout:x86_64 2024-04-17T19:38:15.612 DEBUG:teuthology.orchestra.run.smithi018:> cat /etc/os-release 2024-04-17T19:38:15.657 INFO:teuthology.orchestra.run.smithi018.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-17T19:38:15.657 INFO:teuthology.orchestra.run.smithi018.stdout:NAME="Ubuntu" 2024-04-17T19:38:15.657 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION_ID="22.04" 2024-04-17T19:38:15.657 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-17T19:38:15.657 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION_CODENAME=jammy 2024-04-17T19:38:15.657 INFO:teuthology.orchestra.run.smithi018.stdout:ID=ubuntu 2024-04-17T19:38:15.657 INFO:teuthology.orchestra.run.smithi018.stdout:ID_LIKE=debian 2024-04-17T19:38:15.657 INFO:teuthology.orchestra.run.smithi018.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-17T19:38:15.657 INFO:teuthology.orchestra.run.smithi018.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-17T19:38:15.658 INFO:teuthology.orchestra.run.smithi018.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-17T19:38:15.658 INFO:teuthology.orchestra.run.smithi018.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-17T19:38:15.658 INFO:teuthology.orchestra.run.smithi018.stdout:UBUNTU_CODENAME=jammy 2024-04-17T19:38:15.658 INFO:teuthology.lock.ops:Updating smithi018.front.sepia.ceph.com on lock server 2024-04-17T19:38:15.681 DEBUG:teuthology.orchestra.run.smithi173:> uname -m 2024-04-17T19:38:15.686 INFO:teuthology.orchestra.run.smithi173.stdout:x86_64 2024-04-17T19:38:15.686 DEBUG:teuthology.orchestra.run.smithi173:> cat /etc/os-release 2024-04-17T19:38:15.733 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-17T19:38:15.733 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="Ubuntu" 2024-04-17T19:38:15.733 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="22.04" 2024-04-17T19:38:15.733 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-17T19:38:15.733 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_CODENAME=jammy 2024-04-17T19:38:15.733 INFO:teuthology.orchestra.run.smithi173.stdout:ID=ubuntu 2024-04-17T19:38:15.733 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE=debian 2024-04-17T19:38:15.733 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-17T19:38:15.733 INFO:teuthology.orchestra.run.smithi173.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-17T19:38:15.733 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-17T19:38:15.733 INFO:teuthology.orchestra.run.smithi173.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-17T19:38:15.734 INFO:teuthology.orchestra.run.smithi173.stdout:UBUNTU_CODENAME=jammy 2024-04-17T19:38:15.734 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server 2024-04-17T19:38:15.764 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-17T19:38:15.773 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-17T19:38:15.814 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-17T19:38:15.815 DEBUG:teuthology.orchestra.run.smithi018:> test '!' -e /home/ubuntu/cephtest 2024-04-17T19:38:15.817 DEBUG:teuthology.orchestra.run.smithi173:> test '!' -e /home/ubuntu/cephtest 2024-04-17T19:38:15.821 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-17T19:38:15.858 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-17T19:38:15.858 DEBUG:teuthology.orchestra.run.smithi018:> test -z $(ls -A /var/lib/ceph) 2024-04-17T19:38:15.866 DEBUG:teuthology.orchestra.run.smithi173:> test -z $(ls -A /var/lib/ceph) 2024-04-17T19:38:15.883 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-17T19:38:15.957 INFO:teuthology.run_tasks:Running task kernel... 2024-04-17T19:38:15.971 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-04-17T19:38:15.971 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-04-17T19:38:15.971 DEBUG:teuthology.orchestra.run.smithi018:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-17T19:38:15.972 DEBUG:teuthology.orchestra.run.smithi173:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-17T19:38:15.976 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T19:38:15.976 DEBUG:teuthology.orchestra.run.smithi018:> uname -r 2024-04-17T19:38:15.977 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T19:38:15.978 DEBUG:teuthology.orchestra.run.smithi173:> uname -r 2024-04-17T19:38:16.026 INFO:teuthology.orchestra.run.smithi173.stdout:5.15.0-56-generic 2024-04-17T19:38:16.026 INFO:teuthology.orchestra.run.smithi018.stdout:5.15.0-56-generic 2024-04-17T19:38:16.026 INFO:teuthology.task.kernel:Running kernel on smithi173: 5.15.0-56-generic 2024-04-17T19:38:16.027 DEBUG:teuthology.orchestra.run.smithi173:> sudo apt-get clean 2024-04-17T19:38:16.027 INFO:teuthology.task.kernel:Running kernel on smithi018: 5.15.0-56-generic 2024-04-17T19:38:16.027 DEBUG:teuthology.orchestra.run.smithi018:> sudo apt-get clean 2024-04-17T19:38:16.158 DEBUG:teuthology.orchestra.run.smithi173:> sudo apt-get update 2024-04-17T19:38:16.159 DEBUG:teuthology.orchestra.run.smithi018:> sudo apt-get update 2024-04-17T19:38:16.319 INFO:teuthology.orchestra.run.smithi018.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-17T19:38:16.319 INFO:teuthology.orchestra.run.smithi018.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-17T19:38:16.319 INFO:teuthology.orchestra.run.smithi018.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-17T19:38:16.409 INFO:teuthology.orchestra.run.smithi018.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-17T19:38:16.434 INFO:teuthology.orchestra.run.smithi173.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-17T19:38:16.434 INFO:teuthology.orchestra.run.smithi173.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-17T19:38:16.495 INFO:teuthology.orchestra.run.smithi173.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-17T19:38:16.584 INFO:teuthology.orchestra.run.smithi018.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,346 kB] 2024-04-17T19:38:16.663 INFO:teuthology.orchestra.run.smithi018.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [611 kB] 2024-04-17T19:38:16.704 INFO:teuthology.orchestra.run.smithi018.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [445 kB] 2024-04-17T19:38:16.714 INFO:teuthology.orchestra.run.smithi018.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [237 kB] 2024-04-17T19:38:16.719 INFO:teuthology.orchestra.run.smithi018.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-17T19:38:16.720 INFO:teuthology.orchestra.run.smithi018.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,670 kB] 2024-04-17T19:38:16.757 INFO:teuthology.orchestra.run.smithi018.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [34.1 kB] 2024-04-17T19:38:16.758 INFO:teuthology.orchestra.run.smithi018.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [280 kB] 2024-04-17T19:38:16.762 INFO:teuthology.orchestra.run.smithi018.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,562 kB] 2024-04-17T19:38:16.766 INFO:teuthology.orchestra.run.smithi018.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-17T19:38:16.766 INFO:teuthology.orchestra.run.smithi018.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [600 kB] 2024-04-17T19:38:16.781 INFO:teuthology.orchestra.run.smithi018.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [852 kB] 2024-04-17T19:38:16.797 INFO:teuthology.orchestra.run.smithi018.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-17T19:38:16.800 INFO:teuthology.orchestra.run.smithi018.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-17T19:38:16.803 INFO:teuthology.orchestra.run.smithi018.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-17T19:38:16.803 INFO:teuthology.orchestra.run.smithi018.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-17T19:38:16.855 INFO:teuthology.orchestra.run.smithi173.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [445 kB] 2024-04-17T19:38:16.861 INFO:teuthology.orchestra.run.smithi173.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-17T19:38:16.882 INFO:teuthology.orchestra.run.smithi018.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [298 kB] 2024-04-17T19:38:16.882 INFO:teuthology.orchestra.run.smithi018.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-17T19:38:16.882 INFO:teuthology.orchestra.run.smithi018.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-17T19:38:16.887 INFO:teuthology.orchestra.run.smithi018.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-17T19:38:16.888 INFO:teuthology.orchestra.run.smithi018.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [35.7 kB] 2024-04-17T19:38:16.889 INFO:teuthology.orchestra.run.smithi018.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,702 kB] 2024-04-17T19:38:16.924 INFO:teuthology.orchestra.run.smithi018.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [286 kB] 2024-04-17T19:38:16.929 INFO:teuthology.orchestra.run.smithi018.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-17T19:38:16.930 INFO:teuthology.orchestra.run.smithi018.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [699 kB] 2024-04-17T19:38:16.939 INFO:teuthology.orchestra.run.smithi018.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,075 kB] 2024-04-17T19:38:16.952 INFO:teuthology.orchestra.run.smithi018.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [245 kB] 2024-04-17T19:38:16.954 INFO:teuthology.orchestra.run.smithi018.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-17T19:38:16.955 INFO:teuthology.orchestra.run.smithi018.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [6,028 B] 2024-04-17T19:38:16.955 INFO:teuthology.orchestra.run.smithi018.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [49.7 kB] 2024-04-17T19:38:16.956 INFO:teuthology.orchestra.run.smithi018.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [12.1 kB] 2024-04-17T19:38:16.956 INFO:teuthology.orchestra.run.smithi018.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-17T19:38:16.971 INFO:teuthology.orchestra.run.smithi018.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-17T19:38:16.972 INFO:teuthology.orchestra.run.smithi018.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.2 kB] 2024-04-17T19:38:16.973 INFO:teuthology.orchestra.run.smithi018.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-17T19:38:16.992 INFO:teuthology.orchestra.run.smithi018.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-17T19:38:16.992 INFO:teuthology.orchestra.run.smithi018.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-04-17T19:38:16.992 INFO:teuthology.orchestra.run.smithi018.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.4 kB] 2024-04-17T19:38:16.993 INFO:teuthology.orchestra.run.smithi018.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-17T19:38:16.993 INFO:teuthology.orchestra.run.smithi018.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-17T19:38:17.002 INFO:teuthology.orchestra.run.smithi173.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [611 kB] 2024-04-17T19:38:17.146 INFO:teuthology.orchestra.run.smithi173.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,346 kB] 2024-04-17T19:38:17.252 INFO:teuthology.orchestra.run.smithi173.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,562 kB] 2024-04-17T19:38:17.312 INFO:teuthology.orchestra.run.smithi173.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [237 kB] 2024-04-17T19:38:17.327 INFO:teuthology.orchestra.run.smithi173.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-17T19:38:17.327 INFO:teuthology.orchestra.run.smithi173.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [34.1 kB] 2024-04-17T19:38:17.329 INFO:teuthology.orchestra.run.smithi173.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,670 kB] 2024-04-17T19:38:17.407 INFO:teuthology.orchestra.run.smithi173.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [280 kB] 2024-04-17T19:38:17.415 INFO:teuthology.orchestra.run.smithi173.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-17T19:38:17.415 INFO:teuthology.orchestra.run.smithi173.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [852 kB] 2024-04-17T19:38:17.438 INFO:teuthology.orchestra.run.smithi173.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [600 kB] 2024-04-17T19:38:17.509 INFO:teuthology.orchestra.run.smithi173.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [298 kB] 2024-04-17T19:38:17.513 INFO:teuthology.orchestra.run.smithi173.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-17T19:38:17.514 INFO:teuthology.orchestra.run.smithi173.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,702 kB] 2024-04-17T19:38:17.616 INFO:teuthology.orchestra.run.smithi173.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-17T19:38:17.652 INFO:teuthology.orchestra.run.smithi173.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [35.7 kB] 2024-04-17T19:38:17.652 INFO:teuthology.orchestra.run.smithi173.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [286 kB] 2024-04-17T19:38:17.718 INFO:teuthology.orchestra.run.smithi173.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-17T19:38:17.882 INFO:teuthology.orchestra.run.smithi173.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [699 kB] 2024-04-17T19:38:18.034 INFO:teuthology.orchestra.run.smithi173.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-17T19:38:18.040 INFO:teuthology.orchestra.run.smithi173.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-17T19:38:18.041 INFO:teuthology.orchestra.run.smithi173.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-17T19:38:18.055 INFO:teuthology.orchestra.run.smithi173.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-17T19:38:18.058 INFO:teuthology.orchestra.run.smithi173.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-17T19:38:19.361 INFO:teuthology.orchestra.run.smithi173.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,075 kB] 2024-04-17T19:38:20.655 INFO:teuthology.orchestra.run.smithi173.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [245 kB] 2024-04-17T19:38:21.002 INFO:teuthology.orchestra.run.smithi173.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-17T19:38:21.043 INFO:teuthology.orchestra.run.smithi173.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [49.7 kB] 2024-04-17T19:38:21.131 INFO:teuthology.orchestra.run.smithi173.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [6,028 B] 2024-04-17T19:38:21.146 INFO:teuthology.orchestra.run.smithi173.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [12.1 kB] 2024-04-17T19:38:21.155 INFO:teuthology.orchestra.run.smithi173.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-17T19:38:21.155 INFO:teuthology.orchestra.run.smithi173.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-17T19:38:21.261 INFO:teuthology.orchestra.run.smithi173.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.2 kB] 2024-04-17T19:38:21.336 INFO:teuthology.orchestra.run.smithi173.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-17T19:38:21.534 INFO:teuthology.orchestra.run.smithi173.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-17T19:38:21.617 INFO:teuthology.orchestra.run.smithi173.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.4 kB] 2024-04-17T19:38:21.725 INFO:teuthology.orchestra.run.smithi173.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-04-17T19:38:21.783 INFO:teuthology.orchestra.run.smithi173.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-17T19:38:21.818 INFO:teuthology.orchestra.run.smithi173.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-17T19:38:22.745 INFO:teuthology.orchestra.run.smithi018.stdout:Fetched 12.9 MB in 2s (6,542 kB/s) 2024-04-17T19:38:24.108 INFO:teuthology.orchestra.run.smithi018.stdout:Reading package lists... 2024-04-17T19:38:24.127 DEBUG:teuthology.orchestra.run.smithi018:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-17T19:38:24.181 INFO:teuthology.orchestra.run.smithi018.stdout:Reading package lists... 2024-04-17T19:38:24.361 INFO:teuthology.orchestra.run.smithi018.stdout:Building dependency tree... 2024-04-17T19:38:24.361 INFO:teuthology.orchestra.run.smithi018.stdout:Reading state information... 2024-04-17T19:38:24.519 INFO:teuthology.orchestra.run.smithi018.stdout:The following packages were automatically installed and are no longer required: 2024-04-17T19:38:24.519 INFO:teuthology.orchestra.run.smithi018.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-17T19:38:24.519 INFO:teuthology.orchestra.run.smithi018.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-17T19:38:24.520 INFO:teuthology.orchestra.run.smithi018.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-17T19:38:24.520 INFO:teuthology.orchestra.run.smithi018.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-17T19:38:24.520 INFO:teuthology.orchestra.run.smithi018.stdout: python2.7-minimal 2024-04-17T19:38:24.520 INFO:teuthology.orchestra.run.smithi018.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-17T19:38:24.521 INFO:teuthology.orchestra.run.smithi018.stdout:The following additional packages will be installed: 2024-04-17T19:38:24.521 INFO:teuthology.orchestra.run.smithi018.stdout: linux-generic linux-headers-5.15.0-102 linux-headers-5.15.0-102-generic 2024-04-17T19:38:24.521 INFO:teuthology.orchestra.run.smithi018.stdout: linux-headers-generic linux-image-5.15.0-102-generic 2024-04-17T19:38:24.521 INFO:teuthology.orchestra.run.smithi018.stdout: linux-modules-5.15.0-102-generic linux-modules-extra-5.15.0-102-generic 2024-04-17T19:38:24.522 INFO:teuthology.orchestra.run.smithi018.stdout:Suggested packages: 2024-04-17T19:38:24.522 INFO:teuthology.orchestra.run.smithi018.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-17T19:38:24.523 INFO:teuthology.orchestra.run.smithi018.stdout:Recommended packages: 2024-04-17T19:38:24.523 INFO:teuthology.orchestra.run.smithi018.stdout: thermald 2024-04-17T19:38:24.568 INFO:teuthology.orchestra.run.smithi018.stdout:The following NEW packages will be installed: 2024-04-17T19:38:24.568 INFO:teuthology.orchestra.run.smithi018.stdout: linux-headers-5.15.0-102 linux-headers-5.15.0-102-generic 2024-04-17T19:38:24.568 INFO:teuthology.orchestra.run.smithi018.stdout: linux-image-5.15.0-102-generic linux-modules-5.15.0-102-generic 2024-04-17T19:38:24.568 INFO:teuthology.orchestra.run.smithi018.stdout: linux-modules-extra-5.15.0-102-generic 2024-04-17T19:38:24.569 INFO:teuthology.orchestra.run.smithi018.stdout:The following packages will be upgraded: 2024-04-17T19:38:24.570 INFO:teuthology.orchestra.run.smithi018.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-17T19:38:24.628 INFO:teuthology.orchestra.run.smithi018.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-17T19:38:24.628 INFO:teuthology.orchestra.run.smithi018.stdout:Need to get 113 MB of archives. 2024-04-17T19:38:24.628 INFO:teuthology.orchestra.run.smithi018.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-17T19:38:24.628 INFO:teuthology.orchestra.run.smithi018.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-102-generic amd64 5.15.0-102.112 [22.7 MB] 2024-04-17T19:38:25.118 INFO:teuthology.orchestra.run.smithi018.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-102-generic amd64 5.15.0-102.112 [11.5 MB] 2024-04-17T19:38:25.233 INFO:teuthology.orchestra.run.smithi018.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-102-generic amd64 5.15.0-102.112 [63.9 MB] 2024-04-17T19:38:26.046 INFO:teuthology.orchestra.run.smithi173.stdout:Fetched 12.9 MB in 6s (2,300 kB/s) 2024-04-17T19:38:26.634 INFO:teuthology.orchestra.run.smithi018.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.102.99 [1,700 B] 2024-04-17T19:38:26.634 INFO:teuthology.orchestra.run.smithi018.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.102.99 [2,512 B] 2024-04-17T19:38:26.634 INFO:teuthology.orchestra.run.smithi018.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-102 all 5.15.0-102.112 [12.4 MB] 2024-04-17T19:38:26.806 INFO:teuthology.orchestra.run.smithi018.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-102-generic amd64 5.15.0-102.112 [2,877 kB] 2024-04-17T19:38:26.838 INFO:teuthology.orchestra.run.smithi018.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.102.99 [2,360 B] 2024-04-17T19:38:27.270 INFO:teuthology.orchestra.run.smithi018.stdout:Fetched 113 MB in 2s (50.1 MB/s) 2024-04-17T19:38:27.428 INFO:teuthology.orchestra.run.smithi173.stdout:Reading package lists... 2024-04-17T19:38:27.439 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package linux-modules-5.15.0-102-generic. 2024-04-17T19:38:27.446 DEBUG:teuthology.orchestra.run.smithi173:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-17T19:38:27.505 INFO:teuthology.orchestra.run.smithi173.stdout:Reading package lists... 2024-04-17T19:38:27.703 INFO:teuthology.orchestra.run.smithi173.stdout:Building dependency tree... 2024-04-17T19:38:27.704 INFO:teuthology.orchestra.run.smithi173.stdout:Reading state information... 2024-04-17T19:38:27.879 INFO:teuthology.orchestra.run.smithi173.stdout:The following packages were automatically installed and are no longer required: 2024-04-17T19:38:27.879 INFO:teuthology.orchestra.run.smithi173.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-17T19:38:27.879 INFO:teuthology.orchestra.run.smithi173.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-17T19:38:27.880 INFO:teuthology.orchestra.run.smithi173.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-17T19:38:27.880 INFO:teuthology.orchestra.run.smithi173.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-17T19:38:27.880 INFO:teuthology.orchestra.run.smithi173.stdout: python2.7-minimal 2024-04-17T19:38:27.880 INFO:teuthology.orchestra.run.smithi173.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-17T19:38:27.881 INFO:teuthology.orchestra.run.smithi173.stdout:The following additional packages will be installed: 2024-04-17T19:38:27.881 INFO:teuthology.orchestra.run.smithi173.stdout: linux-generic linux-headers-5.15.0-102 linux-headers-5.15.0-102-generic 2024-04-17T19:38:27.881 INFO:teuthology.orchestra.run.smithi173.stdout: linux-headers-generic linux-image-5.15.0-102-generic 2024-04-17T19:38:27.881 INFO:teuthology.orchestra.run.smithi173.stdout: linux-modules-5.15.0-102-generic linux-modules-extra-5.15.0-102-generic 2024-04-17T19:38:27.882 INFO:teuthology.orchestra.run.smithi173.stdout:Suggested packages: 2024-04-17T19:38:27.883 INFO:teuthology.orchestra.run.smithi173.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-17T19:38:27.883 INFO:teuthology.orchestra.run.smithi173.stdout:Recommended packages: 2024-04-17T19:38:27.883 INFO:teuthology.orchestra.run.smithi173.stdout: thermald 2024-04-17T19:38:27.932 INFO:teuthology.orchestra.run.smithi173.stdout:The following NEW packages will be installed: 2024-04-17T19:38:27.932 INFO:teuthology.orchestra.run.smithi173.stdout: linux-headers-5.15.0-102 linux-headers-5.15.0-102-generic 2024-04-17T19:38:27.932 INFO:teuthology.orchestra.run.smithi173.stdout: linux-image-5.15.0-102-generic linux-modules-5.15.0-102-generic 2024-04-17T19:38:27.932 INFO:teuthology.orchestra.run.smithi173.stdout: linux-modules-extra-5.15.0-102-generic 2024-04-17T19:38:27.933 INFO:teuthology.orchestra.run.smithi173.stdout:The following packages will be upgraded: 2024-04-17T19:38:27.934 INFO:teuthology.orchestra.run.smithi173.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-17T19:38:27.991 INFO:teuthology.orchestra.run.smithi173.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-17T19:38:27.991 INFO:teuthology.orchestra.run.smithi173.stdout:Need to get 113 MB of archives. 2024-04-17T19:38:27.991 INFO:teuthology.orchestra.run.smithi173.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-17T19:38:27.991 INFO:teuthology.orchestra.run.smithi173.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-102-generic amd64 5.15.0-102.112 [22.7 MB] 2024-04-17T19:38:28.473 INFO:teuthology.orchestra.run.smithi173.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-102-generic amd64 5.15.0-102.112 [11.5 MB] 2024-04-17T19:38:28.634 INFO:teuthology.orchestra.run.smithi173.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-102-generic amd64 5.15.0-102.112 [63.9 MB] 2024-04-17T19:38:29.612 INFO:teuthology.orchestra.run.smithi018.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-17T19:38:29.616 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../0-linux-modules-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-17T19:38:29.842 INFO:teuthology.orchestra.run.smithi173.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.102.99 [1,700 B] 2024-04-17T19:38:29.842 INFO:teuthology.orchestra.run.smithi173.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.102.99 [2,512 B] 2024-04-17T19:38:29.842 INFO:teuthology.orchestra.run.smithi173.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-102 all 5.15.0-102.112 [12.4 MB] 2024-04-17T19:38:29.952 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking linux-modules-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-17T19:38:30.051 INFO:teuthology.orchestra.run.smithi173.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-102-generic amd64 5.15.0-102.112 [2,877 kB] 2024-04-17T19:38:30.144 INFO:teuthology.orchestra.run.smithi173.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.102.99 [2,360 B] 2024-04-17T19:38:30.550 INFO:teuthology.orchestra.run.smithi173.stdout:Fetched 113 MB in 2s (51.5 MB/s) 2024-04-17T19:38:30.711 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package linux-modules-5.15.0-102-generic. 2024-04-17T19:38:31.978 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package linux-image-5.15.0-102-generic. 2024-04-17T19:38:32.000 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../1-linux-image-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-17T19:38:32.086 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-17T19:38:32.514 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-102-generic. 2024-04-17T19:38:32.535 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-17T19:38:32.572 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking linux-modules-extra-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-17T19:38:32.722 INFO:teuthology.orchestra.run.smithi173.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-17T19:38:32.726 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../0-linux-modules-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-17T19:38:32.791 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking linux-modules-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-17T19:38:35.117 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package linux-image-5.15.0-102-generic. 2024-04-17T19:38:35.138 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../1-linux-image-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-17T19:38:35.223 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-17T19:38:35.696 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-102-generic. 2024-04-17T19:38:35.716 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-17T19:38:35.754 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking linux-modules-extra-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-17T19:38:39.145 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../3-linux-generic_5.15.0.102.99_amd64.deb ... 2024-04-17T19:38:39.272 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking linux-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-17T19:38:39.614 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.102.99_amd64.deb ... 2024-04-17T19:38:39.742 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking linux-image-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-17T19:38:40.011 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package linux-headers-5.15.0-102. 2024-04-17T19:38:40.034 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../5-linux-headers-5.15.0-102_5.15.0-102.112_all.deb ... 2024-04-17T19:38:40.069 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking linux-headers-5.15.0-102 (5.15.0-102.112) ... 2024-04-17T19:38:42.196 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../3-linux-generic_5.15.0.102.99_amd64.deb ... 2024-04-17T19:38:42.321 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking linux-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-17T19:38:42.637 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.102.99_amd64.deb ... 2024-04-17T19:38:42.741 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking linux-image-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-17T19:38:43.077 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package linux-headers-5.15.0-102. 2024-04-17T19:38:43.099 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../5-linux-headers-5.15.0-102_5.15.0-102.112_all.deb ... 2024-04-17T19:38:43.147 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking linux-headers-5.15.0-102 (5.15.0-102.112) ... 2024-04-17T19:38:45.477 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package linux-headers-5.15.0-102-generic. 2024-04-17T19:38:45.515 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../6-linux-headers-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-17T19:38:45.552 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking linux-headers-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-17T19:38:48.299 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.102.99_amd64.deb ... 2024-04-17T19:38:48.421 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking linux-headers-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-17T19:38:48.764 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up linux-headers-5.15.0-102 (5.15.0-102.112) ... 2024-04-17T19:38:48.893 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up linux-headers-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-17T19:38:49.008 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package linux-headers-5.15.0-102-generic. 2024-04-17T19:38:49.019 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up linux-headers-generic (5.15.0.102.99) ... 2024-04-17T19:38:49.027 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../6-linux-headers-5.15.0-102-generic_5.15.0-102.112_amd64.deb ... 2024-04-17T19:38:49.066 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking linux-headers-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-17T19:38:49.148 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-17T19:38:50.482 INFO:teuthology.orchestra.run.smithi018.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-17T19:38:50.482 INFO:teuthology.orchestra.run.smithi018.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-17T19:38:50.483 INFO:teuthology.orchestra.run.smithi018.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-102-generic 2024-04-17T19:38:50.483 INFO:teuthology.orchestra.run.smithi018.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-102-generic 2024-04-17T19:38:50.641 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up linux-modules-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-17T19:38:51.668 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.102.99_amd64.deb ... 2024-04-17T19:38:52.544 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking linux-headers-generic (5.15.0.102.99) over (5.15.0.56.54) ... 2024-04-17T19:38:52.551 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up linux-modules-extra-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-17T19:38:52.885 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up linux-headers-5.15.0-102 (5.15.0-102.112) ... 2024-04-17T19:38:53.007 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up linux-headers-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-17T19:38:53.133 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up linux-headers-generic (5.15.0.102.99) ... 2024-04-17T19:38:53.262 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-17T19:38:53.969 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up linux-image-generic (5.15.0.102.99) ... 2024-04-17T19:38:54.095 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up linux-generic (5.15.0.102.99) ... 2024-04-17T19:38:54.221 INFO:teuthology.orchestra.run.smithi018.stdout:Processing triggers for linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-17T19:38:54.289 INFO:teuthology.orchestra.run.smithi018.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-17T19:38:54.289 INFO:teuthology.orchestra.run.smithi018.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-102-generic 2024-04-17T19:38:54.585 INFO:teuthology.orchestra.run.smithi173.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-17T19:38:54.585 INFO:teuthology.orchestra.run.smithi173.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-17T19:38:54.585 INFO:teuthology.orchestra.run.smithi173.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-102-generic 2024-04-17T19:38:54.585 INFO:teuthology.orchestra.run.smithi173.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-102-generic 2024-04-17T19:38:54.755 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up linux-modules-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-17T19:38:56.157 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up linux-modules-extra-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-17T19:38:57.533 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up linux-image-generic (5.15.0.102.99) ... 2024-04-17T19:38:58.435 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up linux-generic (5.15.0.102.99) ... 2024-04-17T19:38:58.561 INFO:teuthology.orchestra.run.smithi173.stdout:Processing triggers for linux-image-5.15.0-102-generic (5.15.0-102.112) ... 2024-04-17T19:38:58.638 INFO:teuthology.orchestra.run.smithi173.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-17T19:38:58.638 INFO:teuthology.orchestra.run.smithi173.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-102-generic 2024-04-17T19:39:09.084 INFO:teuthology.orchestra.run.smithi018.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-17T19:39:09.084 INFO:teuthology.orchestra.run.smithi018.stdout:Sourcing file `/etc/default/grub' 2024-04-17T19:39:09.096 INFO:teuthology.orchestra.run.smithi018.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-17T19:39:09.134 INFO:teuthology.orchestra.run.smithi018.stdout:Generating grub configuration file ... 2024-04-17T19:39:09.422 INFO:teuthology.orchestra.run.smithi018.stdout:Found linux image: /boot/vmlinuz-5.15.0-102-generic 2024-04-17T19:39:09.439 INFO:teuthology.orchestra.run.smithi018.stdout:Found initrd image: /boot/initrd.img-5.15.0-102-generic 2024-04-17T19:39:09.737 INFO:teuthology.orchestra.run.smithi018.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-17T19:39:09.743 INFO:teuthology.orchestra.run.smithi018.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-17T19:39:09.817 INFO:teuthology.orchestra.run.smithi018.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-17T19:39:09.823 INFO:teuthology.orchestra.run.smithi018.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-17T19:39:10.015 INFO:teuthology.orchestra.run.smithi018.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-17T19:39:10.015 INFO:teuthology.orchestra.run.smithi018.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-17T19:39:10.015 INFO:teuthology.orchestra.run.smithi018.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-17T19:39:10.062 INFO:teuthology.orchestra.run.smithi018.stdout:done 2024-04-17T19:39:10.524 DEBUG:teuthology.orchestra.run.smithi018:> dpkg -s linux-image-generic 2024-04-17T19:39:10.545 INFO:teuthology.orchestra.run.smithi018.stdout:Package: linux-image-generic 2024-04-17T19:39:10.545 INFO:teuthology.orchestra.run.smithi018.stdout:Status: install ok installed 2024-04-17T19:39:10.546 INFO:teuthology.orchestra.run.smithi018.stdout:Priority: optional 2024-04-17T19:39:10.546 INFO:teuthology.orchestra.run.smithi018.stdout:Section: kernel 2024-04-17T19:39:10.546 INFO:teuthology.orchestra.run.smithi018.stdout:Installed-Size: 21 2024-04-17T19:39:10.546 INFO:teuthology.orchestra.run.smithi018.stdout:Maintainer: Ubuntu Kernel Team 2024-04-17T19:39:10.546 INFO:teuthology.orchestra.run.smithi018.stdout:Architecture: amd64 2024-04-17T19:39:10.546 INFO:teuthology.orchestra.run.smithi018.stdout:Source: linux-meta 2024-04-17T19:39:10.546 INFO:teuthology.orchestra.run.smithi018.stdout:Version: 5.15.0.102.99 2024-04-17T19:39:10.546 INFO:teuthology.orchestra.run.smithi018.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-102), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-17T19:39:10.546 INFO:teuthology.orchestra.run.smithi018.stdout:Depends: linux-image-5.15.0-102-generic, linux-modules-extra-5.15.0-102-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-17T19:39:10.546 INFO:teuthology.orchestra.run.smithi018.stdout:Recommends: thermald 2024-04-17T19:39:10.546 INFO:teuthology.orchestra.run.smithi018.stdout:Description: Generic Linux kernel image 2024-04-17T19:39:10.546 INFO:teuthology.orchestra.run.smithi018.stdout: This package will always depend on the latest generic kernel image 2024-04-17T19:39:10.546 INFO:teuthology.orchestra.run.smithi018.stdout: available. 2024-04-17T19:39:10.547 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-102-generic 2024-04-17T19:39:10.547 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-17T19:39:10.547 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-17T19:39:10.547 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-17T19:39:10.547 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi018.front.sepia.ceph.com, path=None, version=distro) 2024-04-17T19:39:10.547 DEBUG:teuthology.orchestra.run.smithi018:> sudo apt-get clean 2024-04-17T19:39:10.767 DEBUG:teuthology.orchestra.run.smithi018:> sudo apt-get update 2024-04-17T19:39:10.901 INFO:teuthology.orchestra.run.smithi018.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-17T19:39:10.908 INFO:teuthology.orchestra.run.smithi018.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-17T19:39:10.928 INFO:teuthology.orchestra.run.smithi018.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-17T19:39:10.975 INFO:teuthology.orchestra.run.smithi018.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-17T19:39:12.307 INFO:teuthology.orchestra.run.smithi018.stdout:Reading package lists... 2024-04-17T19:39:12.326 DEBUG:teuthology.orchestra.run.smithi018:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-17T19:39:12.392 INFO:teuthology.orchestra.run.smithi018.stdout:Reading package lists... 2024-04-17T19:39:12.505 INFO:teuthology.orchestra.run.smithi173.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-17T19:39:12.505 INFO:teuthology.orchestra.run.smithi173.stdout:Sourcing file `/etc/default/grub' 2024-04-17T19:39:12.527 INFO:teuthology.orchestra.run.smithi173.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-17T19:39:12.551 INFO:teuthology.orchestra.run.smithi173.stdout:Generating grub configuration file ... 2024-04-17T19:39:12.593 INFO:teuthology.orchestra.run.smithi018.stdout:Building dependency tree... 2024-04-17T19:39:12.594 INFO:teuthology.orchestra.run.smithi018.stdout:Reading state information... 2024-04-17T19:39:12.773 INFO:teuthology.orchestra.run.smithi018.stdout:linux-image-generic is already the newest version (5.15.0.102.99). 2024-04-17T19:39:12.773 INFO:teuthology.orchestra.run.smithi018.stdout:The following packages were automatically installed and are no longer required: 2024-04-17T19:39:12.773 INFO:teuthology.orchestra.run.smithi018.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-17T19:39:12.773 INFO:teuthology.orchestra.run.smithi018.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-17T19:39:12.773 INFO:teuthology.orchestra.run.smithi018.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-17T19:39:12.774 INFO:teuthology.orchestra.run.smithi018.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-17T19:39:12.774 INFO:teuthology.orchestra.run.smithi018.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-17T19:39:12.774 INFO:teuthology.orchestra.run.smithi018.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-17T19:39:12.808 INFO:teuthology.orchestra.run.smithi173.stdout:Found linux image: /boot/vmlinuz-5.15.0-102-generic 2024-04-17T19:39:12.816 INFO:teuthology.orchestra.run.smithi018.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-17T19:39:12.819 DEBUG:teuthology.orchestra.run.smithi018:> dpkg -s linux-image-generic 2024-04-17T19:39:12.830 INFO:teuthology.orchestra.run.smithi173.stdout:Found initrd image: /boot/initrd.img-5.15.0-102-generic 2024-04-17T19:39:12.832 INFO:teuthology.orchestra.run.smithi018.stdout:Package: linux-image-generic 2024-04-17T19:39:12.832 INFO:teuthology.orchestra.run.smithi018.stdout:Status: install ok installed 2024-04-17T19:39:12.832 INFO:teuthology.orchestra.run.smithi018.stdout:Priority: optional 2024-04-17T19:39:12.832 INFO:teuthology.orchestra.run.smithi018.stdout:Section: kernel 2024-04-17T19:39:12.832 INFO:teuthology.orchestra.run.smithi018.stdout:Installed-Size: 21 2024-04-17T19:39:12.832 INFO:teuthology.orchestra.run.smithi018.stdout:Maintainer: Ubuntu Kernel Team 2024-04-17T19:39:12.832 INFO:teuthology.orchestra.run.smithi018.stdout:Architecture: amd64 2024-04-17T19:39:12.833 INFO:teuthology.orchestra.run.smithi018.stdout:Source: linux-meta 2024-04-17T19:39:12.833 INFO:teuthology.orchestra.run.smithi018.stdout:Version: 5.15.0.102.99 2024-04-17T19:39:12.833 INFO:teuthology.orchestra.run.smithi018.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-102), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-17T19:39:12.833 INFO:teuthology.orchestra.run.smithi018.stdout:Depends: linux-image-5.15.0-102-generic, linux-modules-extra-5.15.0-102-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-17T19:39:12.833 INFO:teuthology.orchestra.run.smithi018.stdout:Recommends: thermald 2024-04-17T19:39:12.833 INFO:teuthology.orchestra.run.smithi018.stdout:Description: Generic Linux kernel image 2024-04-17T19:39:12.833 INFO:teuthology.orchestra.run.smithi018.stdout: This package will always depend on the latest generic kernel image 2024-04-17T19:39:12.833 INFO:teuthology.orchestra.run.smithi018.stdout: available. 2024-04-17T19:39:12.833 DEBUG:teuthology.orchestra.run.smithi018:> mktemp 2024-04-17T19:39:12.885 INFO:teuthology.orchestra.run.smithi018.stdout:/tmp/tmp.Hq8v5IxsxT 2024-04-17T19:39:12.885 DEBUG:teuthology.orchestra.run.smithi018:> sudo cp /boot/grub/grub.cfg /tmp/tmp.Hq8v5IxsxT 2024-04-17T19:39:12.938 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 0666 /tmp/tmp.Hq8v5IxsxT 2024-04-17T19:39:13.062 DEBUG:teuthology.orchestra.remote:smithi018:/tmp/tmp.Hq8v5IxsxT is 10KB 2024-04-17T19:39:13.076 DEBUG:teuthology.orchestra.run.smithi018:> rm -fr /tmp/tmp.Hq8v5IxsxT 2024-04-17T19:39:13.081 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-17T19:39:13.127 INFO:teuthology.orchestra.run.smithi173.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-17T19:39:13.133 INFO:teuthology.orchestra.run.smithi173.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-17T19:39:13.134 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-17T19:39:13.134 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-17T19:39:13.134 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-17T19:39:13.203 INFO:teuthology.orchestra.run.smithi173.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-17T19:39:13.208 INFO:teuthology.orchestra.run.smithi173.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-17T19:39:13.213 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-102-generic 2024-04-17T19:39:13.213 DEBUG:teuthology.orchestra.run.smithi018:> sudo update-grub 2024-04-17T19:39:13.377 INFO:teuthology.orchestra.run.smithi173.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-17T19:39:13.378 INFO:teuthology.orchestra.run.smithi173.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-17T19:39:13.378 INFO:teuthology.orchestra.run.smithi173.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-17T19:39:13.420 INFO:teuthology.orchestra.run.smithi173.stdout:done 2024-04-17T19:39:13.867 DEBUG:teuthology.orchestra.run.smithi173:> dpkg -s linux-image-generic 2024-04-17T19:39:13.889 INFO:teuthology.orchestra.run.smithi173.stdout:Package: linux-image-generic 2024-04-17T19:39:13.890 INFO:teuthology.orchestra.run.smithi173.stdout:Status: install ok installed 2024-04-17T19:39:13.890 INFO:teuthology.orchestra.run.smithi173.stdout:Priority: optional 2024-04-17T19:39:13.890 INFO:teuthology.orchestra.run.smithi173.stdout:Section: kernel 2024-04-17T19:39:13.890 INFO:teuthology.orchestra.run.smithi173.stdout:Installed-Size: 21 2024-04-17T19:39:13.890 INFO:teuthology.orchestra.run.smithi173.stdout:Maintainer: Ubuntu Kernel Team 2024-04-17T19:39:13.890 INFO:teuthology.orchestra.run.smithi173.stdout:Architecture: amd64 2024-04-17T19:39:13.890 INFO:teuthology.orchestra.run.smithi173.stdout:Source: linux-meta 2024-04-17T19:39:13.890 INFO:teuthology.orchestra.run.smithi173.stdout:Version: 5.15.0.102.99 2024-04-17T19:39:13.890 INFO:teuthology.orchestra.run.smithi173.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-102), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-17T19:39:13.890 INFO:teuthology.orchestra.run.smithi173.stdout:Depends: linux-image-5.15.0-102-generic, linux-modules-extra-5.15.0-102-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-17T19:39:13.890 INFO:teuthology.orchestra.run.smithi173.stdout:Recommends: thermald 2024-04-17T19:39:13.890 INFO:teuthology.orchestra.run.smithi173.stdout:Description: Generic Linux kernel image 2024-04-17T19:39:13.890 INFO:teuthology.orchestra.run.smithi173.stdout: This package will always depend on the latest generic kernel image 2024-04-17T19:39:13.891 INFO:teuthology.orchestra.run.smithi173.stdout: available. 2024-04-17T19:39:13.891 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-102-generic 2024-04-17T19:39:13.891 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-17T19:39:13.891 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-17T19:39:13.891 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-04-17T19:39:13.891 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi173.front.sepia.ceph.com, path=None, version=distro) 2024-04-17T19:39:13.891 DEBUG:teuthology.orchestra.run.smithi173:> sudo apt-get clean 2024-04-17T19:39:14.063 DEBUG:teuthology.orchestra.run.smithi173:> sudo apt-get update 2024-04-17T19:39:14.181 INFO:teuthology.orchestra.run.smithi173.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-17T19:39:14.298 INFO:teuthology.orchestra.run.smithi173.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-17T19:39:14.388 INFO:teuthology.orchestra.run.smithi018.stderr:Sourcing file `/etc/default/grub' 2024-04-17T19:39:14.389 INFO:teuthology.orchestra.run.smithi018.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-17T19:39:14.391 INFO:teuthology.orchestra.run.smithi018.stderr:Generating grub configuration file ... 2024-04-17T19:39:14.398 INFO:teuthology.orchestra.run.smithi173.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-17T19:39:14.465 INFO:teuthology.orchestra.run.smithi173.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-17T19:39:14.575 INFO:teuthology.orchestra.run.smithi018.stderr:Found linux image: /boot/vmlinuz-5.15.0-102-generic 2024-04-17T19:39:14.581 INFO:teuthology.orchestra.run.smithi018.stderr:Found initrd image: /boot/initrd.img-5.15.0-102-generic 2024-04-17T19:39:14.808 INFO:teuthology.orchestra.run.smithi018.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-17T19:39:14.814 INFO:teuthology.orchestra.run.smithi018.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-17T19:39:14.858 INFO:teuthology.orchestra.run.smithi018.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-17T19:39:14.864 INFO:teuthology.orchestra.run.smithi018.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-17T19:39:14.991 INFO:teuthology.orchestra.run.smithi018.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-17T19:39:14.991 INFO:teuthology.orchestra.run.smithi018.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-17T19:39:14.991 INFO:teuthology.orchestra.run.smithi018.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-17T19:39:15.002 INFO:teuthology.orchestra.run.smithi018.stderr:done 2024-04-17T19:39:15.015 DEBUG:teuthology.orchestra.run.smithi018:> sudo shutdown -r now 2024-04-17T19:39:15.633 INFO:teuthology.orchestra.run.smithi173.stdout:Reading package lists... 2024-04-17T19:39:15.651 DEBUG:teuthology.orchestra.run.smithi173:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-17T19:39:15.714 INFO:teuthology.orchestra.run.smithi173.stdout:Reading package lists... 2024-04-17T19:39:15.907 INFO:teuthology.orchestra.run.smithi173.stdout:Building dependency tree... 2024-04-17T19:39:15.908 INFO:teuthology.orchestra.run.smithi173.stdout:Reading state information... 2024-04-17T19:39:16.086 INFO:teuthology.orchestra.run.smithi173.stdout:linux-image-generic is already the newest version (5.15.0.102.99). 2024-04-17T19:39:16.086 INFO:teuthology.orchestra.run.smithi173.stdout:The following packages were automatically installed and are no longer required: 2024-04-17T19:39:16.086 INFO:teuthology.orchestra.run.smithi173.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-17T19:39:16.087 INFO:teuthology.orchestra.run.smithi173.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-17T19:39:16.087 INFO:teuthology.orchestra.run.smithi173.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-17T19:39:16.087 INFO:teuthology.orchestra.run.smithi173.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-17T19:39:16.087 INFO:teuthology.orchestra.run.smithi173.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-17T19:39:16.087 INFO:teuthology.orchestra.run.smithi173.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-17T19:39:16.125 INFO:teuthology.orchestra.run.smithi173.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-17T19:39:16.127 DEBUG:teuthology.orchestra.run.smithi173:> dpkg -s linux-image-generic 2024-04-17T19:39:16.143 INFO:teuthology.orchestra.run.smithi173.stdout:Package: linux-image-generic 2024-04-17T19:39:16.143 INFO:teuthology.orchestra.run.smithi173.stdout:Status: install ok installed 2024-04-17T19:39:16.143 INFO:teuthology.orchestra.run.smithi173.stdout:Priority: optional 2024-04-17T19:39:16.143 INFO:teuthology.orchestra.run.smithi173.stdout:Section: kernel 2024-04-17T19:39:16.143 INFO:teuthology.orchestra.run.smithi173.stdout:Installed-Size: 21 2024-04-17T19:39:16.143 INFO:teuthology.orchestra.run.smithi173.stdout:Maintainer: Ubuntu Kernel Team 2024-04-17T19:39:16.143 INFO:teuthology.orchestra.run.smithi173.stdout:Architecture: amd64 2024-04-17T19:39:16.143 INFO:teuthology.orchestra.run.smithi173.stdout:Source: linux-meta 2024-04-17T19:39:16.143 INFO:teuthology.orchestra.run.smithi173.stdout:Version: 5.15.0.102.99 2024-04-17T19:39:16.143 INFO:teuthology.orchestra.run.smithi173.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-102), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-17T19:39:16.143 INFO:teuthology.orchestra.run.smithi173.stdout:Depends: linux-image-5.15.0-102-generic, linux-modules-extra-5.15.0-102-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-17T19:39:16.143 INFO:teuthology.orchestra.run.smithi173.stdout:Recommends: thermald 2024-04-17T19:39:16.143 INFO:teuthology.orchestra.run.smithi173.stdout:Description: Generic Linux kernel image 2024-04-17T19:39:16.144 INFO:teuthology.orchestra.run.smithi173.stdout: This package will always depend on the latest generic kernel image 2024-04-17T19:39:16.144 INFO:teuthology.orchestra.run.smithi173.stdout: available. 2024-04-17T19:39:16.144 DEBUG:teuthology.orchestra.run.smithi173:> mktemp 2024-04-17T19:39:16.188 INFO:teuthology.orchestra.run.smithi173.stdout:/tmp/tmp.EXpL1NT08x 2024-04-17T19:39:16.188 DEBUG:teuthology.orchestra.run.smithi173:> sudo cp /boot/grub/grub.cfg /tmp/tmp.EXpL1NT08x 2024-04-17T19:39:16.257 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 0666 /tmp/tmp.EXpL1NT08x 2024-04-17T19:39:16.377 DEBUG:teuthology.orchestra.remote:smithi173:/tmp/tmp.EXpL1NT08x is 10KB 2024-04-17T19:39:16.390 DEBUG:teuthology.orchestra.run.smithi173:> rm -fr /tmp/tmp.EXpL1NT08x 2024-04-17T19:39:16.395 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-17T19:39:16.448 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-17T19:39:16.449 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-17T19:39:16.449 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-17T19:39:16.517 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-102-generic 2024-04-17T19:39:16.517 DEBUG:teuthology.orchestra.run.smithi173:> sudo update-grub 2024-04-17T19:39:17.751 INFO:teuthology.orchestra.run.smithi173.stderr:Sourcing file `/etc/default/grub' 2024-04-17T19:39:17.752 INFO:teuthology.orchestra.run.smithi173.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-17T19:39:17.754 INFO:teuthology.orchestra.run.smithi173.stderr:Generating grub configuration file ... 2024-04-17T19:39:17.922 INFO:teuthology.orchestra.run.smithi173.stderr:Found linux image: /boot/vmlinuz-5.15.0-102-generic 2024-04-17T19:39:17.927 INFO:teuthology.orchestra.run.smithi173.stderr:Found initrd image: /boot/initrd.img-5.15.0-102-generic 2024-04-17T19:39:18.145 INFO:teuthology.orchestra.run.smithi173.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-17T19:39:18.151 INFO:teuthology.orchestra.run.smithi173.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-17T19:39:18.191 INFO:teuthology.orchestra.run.smithi173.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-17T19:39:18.195 INFO:teuthology.orchestra.run.smithi173.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-17T19:39:18.310 INFO:teuthology.orchestra.run.smithi173.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-17T19:39:18.310 INFO:teuthology.orchestra.run.smithi173.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-17T19:39:18.310 INFO:teuthology.orchestra.run.smithi173.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-17T19:39:18.328 INFO:teuthology.orchestra.run.smithi173.stderr:done 2024-04-17T19:39:18.329 DEBUG:teuthology.orchestra.run.smithi173:> sudo shutdown -r now 2024-04-17T19:39:45.031 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-17T19:39:45.031 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-04-17T19:39:45.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T19:39:48.335 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-04-17T19:39:48.335 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-04-17T19:39:48.336 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T19:40:03.486 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.18 2024-04-17T19:40:06.814 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-04-17T19:40:12.489 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-04-17T19:40:12.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T19:40:15.819 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-04-17T19:40:15.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T19:40:18.878 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-04-17T19:40:30.891 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-04-17T19:40:30.891 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T19:41:02.636 DEBUG:teuthology.orchestra.run.smithi173:> true 2024-04-17T19:41:03.235 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-04-17T19:41:03.235 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-102-generic"... 2024-04-17T19:41:03.235 DEBUG:teuthology.orchestra.run.smithi173:> uname -r 2024-04-17T19:41:03.240 INFO:teuthology.orchestra.run.smithi173.stdout:5.15.0-102-generic 2024-04-17T19:41:03.241 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-102-generic vs 5.15.0-102-generic 2024-04-17T19:41:03.241 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-17T19:41:03.241 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-17T19:41:04.241 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-17T19:41:04.242 DEBUG:teuthology.orchestra.run.smithi173:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-17T19:41:04.350 INFO:teuthology.orchestra.run.smithi173.stdout:ttyS1 2024-04-17T19:41:04.375 DEBUG:teuthology.parallel:result is None 2024-04-17T19:41:12.492 DEBUG:teuthology.orchestra.remote:timed out 2024-04-17T19:41:24.493 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-04-17T19:41:24.495 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T19:41:24.707 DEBUG:teuthology.orchestra.run.smithi018:> true 2024-04-17T19:41:25.336 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-04-17T19:41:25.336 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-102-generic"... 2024-04-17T19:41:25.337 DEBUG:teuthology.orchestra.run.smithi018:> uname -r 2024-04-17T19:41:25.385 INFO:teuthology.orchestra.run.smithi018.stdout:5.15.0-102-generic 2024-04-17T19:41:25.385 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-102-generic vs 5.15.0-102-generic 2024-04-17T19:41:25.385 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-17T19:41:25.385 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-17T19:41:26.386 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-17T19:41:26.386 DEBUG:teuthology.orchestra.run.smithi018:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-17T19:41:26.475 INFO:teuthology.orchestra.run.smithi018.stdout:ttyS1 2024-04-17T19:41:26.506 DEBUG:teuthology.parallel:result is None 2024-04-17T19:41:26.506 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-17T19:41:26.514 INFO:teuthology.task.internal:Creating test directory... 2024-04-17T19:41:26.514 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-17T19:41:26.516 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-17T19:41:26.522 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-17T19:41:26.544 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-17T19:41:26.595 INFO:teuthology.task.internal:Creating archive directory... 2024-04-17T19:41:26.595 DEBUG:teuthology.orchestra.run.smithi018:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-17T19:41:26.597 DEBUG:teuthology.orchestra.run.smithi173:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-17T19:41:26.628 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-17T19:41:26.678 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-17T19:41:26.678 DEBUG:teuthology.orchestra.run.smithi018:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-17T19:41:26.681 DEBUG:teuthology.orchestra.run.smithi173:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-17T19:41:26.695 INFO:teuthology.orchestra.run.smithi018.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-17T19:41:26.703 INFO:teuthology.orchestra.run.smithi018.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-17T19:41:26.725 INFO:teuthology.orchestra.run.smithi173.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-17T19:41:26.733 INFO:teuthology.orchestra.run.smithi173.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-17T19:41:26.735 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-17T19:41:26.753 INFO:teuthology.task.internal:Configuring sudo... 2024-04-17T19:41:26.753 DEBUG:teuthology.orchestra.run.smithi018:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-17T19:41:26.756 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-17T19:41:26.768 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-17T19:41:26.848 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-17T19:41:26.848 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-17T19:41:26.851 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-17T19:41:26.856 DEBUG:teuthology.orchestra.run.smithi018:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-17T19:41:26.901 DEBUG:teuthology.orchestra.run.smithi018:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-17T19:41:26.949 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-17T19:41:26.949 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-17T19:41:27.011 DEBUG:teuthology.orchestra.run.smithi173:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-17T19:41:27.017 DEBUG:teuthology.orchestra.run.smithi173:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-17T19:41:27.065 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-17T19:41:27.065 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-17T19:41:27.126 DEBUG:teuthology.orchestra.run.smithi018:> sudo service rsyslog restart 2024-04-17T19:41:27.129 DEBUG:teuthology.orchestra.run.smithi173:> sudo service rsyslog restart 2024-04-17T19:41:27.200 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-17T19:41:27.208 INFO:teuthology.task.internal:Starting timer... 2024-04-17T19:41:27.209 INFO:teuthology.run_tasks:Running task pcp... 2024-04-17T19:41:27.256 INFO:teuthology.run_tasks:Running task selinux... 2024-04-17T19:41:27.340 DEBUG:teuthology.task.selinux:Excluding smithi018: OS 'ubuntu' does not support SELinux 2024-04-17T19:41:27.340 DEBUG:teuthology.task.selinux:Excluding smithi173: OS 'ubuntu' does not support SELinux 2024-04-17T19:41:27.341 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-17T19:41:27.341 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-17T19:41:27.341 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-17T19:41:27.341 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-17T19:41:27.414 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-17T19:41:27.431 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-17T19:41:27.432 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi018.front.sepia.ceph.com,smithi173.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-17T19:48:25.964 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi018.front.sepia.ceph.com'), Remote(name='ubuntu@smithi173.front.sepia.ceph.com')] 2024-04-17T19:48:25.965 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-04-17T19:48:25.966 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T19:48:26.054 DEBUG:teuthology.orchestra.run.smithi018:> true 2024-04-17T19:48:26.138 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-04-17T19:48:26.139 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-04-17T19:48:26.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T19:48:26.219 DEBUG:teuthology.orchestra.run.smithi173:> true 2024-04-17T19:48:26.298 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-04-17T19:48:26.298 INFO:teuthology.run_tasks:Running task clock... 2024-04-17T19:48:26.312 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-17T19:48:26.313 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-17T19:48:26.313 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-17T19:48:26.316 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-17T19:48:26.316 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-17T19:48:26.342 INFO:teuthology.orchestra.run.smithi018.stdout:17 Apr 19:48:26 ntpd[17143]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-17T19:48:26.342 INFO:teuthology.orchestra.run.smithi018.stdout:17 Apr 19:48:26 ntpd[17143]: Command line: ntpd -gq 2024-04-17T19:48:26.342 INFO:teuthology.orchestra.run.smithi018.stdout:17 Apr 19:48:26 ntpd[17143]: ---------------------------------------------------- 2024-04-17T19:48:26.342 INFO:teuthology.orchestra.run.smithi018.stdout:17 Apr 19:48:26 ntpd[17143]: ntp-4 is maintained by Network Time Foundation, 2024-04-17T19:48:26.342 INFO:teuthology.orchestra.run.smithi018.stdout:17 Apr 19:48:26 ntpd[17143]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-17T19:48:26.342 INFO:teuthology.orchestra.run.smithi018.stdout:17 Apr 19:48:26 ntpd[17143]: corporation. Support and training for ntp-4 are 2024-04-17T19:48:26.342 INFO:teuthology.orchestra.run.smithi018.stdout:17 Apr 19:48:26 ntpd[17143]: available at https://www.nwtime.org/support 2024-04-17T19:48:26.342 INFO:teuthology.orchestra.run.smithi018.stdout:17 Apr 19:48:26 ntpd[17143]: ---------------------------------------------------- 2024-04-17T19:48:26.343 INFO:teuthology.orchestra.run.smithi018.stdout:17 Apr 19:48:26 ntpd[17143]: proto: precision = 0.062 usec (-24) 2024-04-17T19:48:26.343 INFO:teuthology.orchestra.run.smithi018.stdout:17 Apr 19:48:26 ntpd[17143]: basedate set to 2022-02-04 2024-04-17T19:48:26.343 INFO:teuthology.orchestra.run.smithi018.stdout:17 Apr 19:48:26 ntpd[17143]: gps base set to 2022-02-06 (week 2196) 2024-04-17T19:48:26.343 INFO:teuthology.orchestra.run.smithi018.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-17T19:48:26.344 INFO:teuthology.orchestra.run.smithi018.stdout:17 Apr 19:48:26 ntpd[17143]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-17T19:48:26.344 INFO:teuthology.orchestra.run.smithi018.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-17T19:48:26.345 INFO:teuthology.orchestra.run.smithi018.stdout:17 Apr 19:48:26 ntpd[17143]: restrict ::: KOD does nothing without LIMITED. 2024-04-17T19:48:26.345 INFO:teuthology.orchestra.run.smithi018.stdout:17 Apr 19:48:26 ntpd[17143]: Listen and drop on 0 v6wildcard [::]:123 2024-04-17T19:48:26.345 INFO:teuthology.orchestra.run.smithi018.stdout:17 Apr 19:48:26 ntpd[17143]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-17T19:48:26.345 INFO:teuthology.orchestra.run.smithi018.stdout:17 Apr 19:48:26 ntpd[17143]: Listen normally on 2 lo 127.0.0.1:123 2024-04-17T19:48:26.345 INFO:teuthology.orchestra.run.smithi018.stdout:17 Apr 19:48:26 ntpd[17143]: Listen normally on 3 ens1f0 172.21.15.18:123 2024-04-17T19:48:26.345 INFO:teuthology.orchestra.run.smithi018.stdout:17 Apr 19:48:26 ntpd[17143]: Listen normally on 4 lo [::1]:123 2024-04-17T19:48:26.346 INFO:teuthology.orchestra.run.smithi018.stdout:17 Apr 19:48:26 ntpd[17143]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1362%4]:123 2024-04-17T19:48:26.346 INFO:teuthology.orchestra.run.smithi018.stdout:17 Apr 19:48:26 ntpd[17143]: Listening on routing socket on fd #22 for interface updates 2024-04-17T19:48:26.371 INFO:teuthology.orchestra.run.smithi173.stdout:17 Apr 19:48:26 ntpd[17180]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-17T19:48:26.372 INFO:teuthology.orchestra.run.smithi173.stdout:17 Apr 19:48:26 ntpd[17180]: Command line: ntpd -gq 2024-04-17T19:48:26.372 INFO:teuthology.orchestra.run.smithi173.stdout:17 Apr 19:48:26 ntpd[17180]: ---------------------------------------------------- 2024-04-17T19:48:26.372 INFO:teuthology.orchestra.run.smithi173.stdout:17 Apr 19:48:26 ntpd[17180]: ntp-4 is maintained by Network Time Foundation, 2024-04-17T19:48:26.372 INFO:teuthology.orchestra.run.smithi173.stdout:17 Apr 19:48:26 ntpd[17180]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-17T19:48:26.372 INFO:teuthology.orchestra.run.smithi173.stdout:17 Apr 19:48:26 ntpd[17180]: corporation. Support and training for ntp-4 are 2024-04-17T19:48:26.372 INFO:teuthology.orchestra.run.smithi173.stdout:17 Apr 19:48:26 ntpd[17180]: available at https://www.nwtime.org/support 2024-04-17T19:48:26.372 INFO:teuthology.orchestra.run.smithi173.stdout:17 Apr 19:48:26 ntpd[17180]: ---------------------------------------------------- 2024-04-17T19:48:26.373 INFO:teuthology.orchestra.run.smithi173.stdout:17 Apr 19:48:26 ntpd[17180]: proto: precision = 0.047 usec (-24) 2024-04-17T19:48:26.373 INFO:teuthology.orchestra.run.smithi173.stdout:17 Apr 19:48:26 ntpd[17180]: basedate set to 2022-02-04 2024-04-17T19:48:26.373 INFO:teuthology.orchestra.run.smithi173.stdout:17 Apr 19:48:26 ntpd[17180]: gps base set to 2022-02-06 (week 2196) 2024-04-17T19:48:26.373 INFO:teuthology.orchestra.run.smithi173.stdout:17 Apr 19:48:26 ntpd[17180]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-17T19:48:26.373 INFO:teuthology.orchestra.run.smithi173.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-17T19:48:26.373 INFO:teuthology.orchestra.run.smithi173.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-17T19:48:26.374 INFO:teuthology.orchestra.run.smithi173.stdout:17 Apr 19:48:26 ntpd[17180]: restrict ::: KOD does nothing without LIMITED. 2024-04-17T19:48:26.375 INFO:teuthology.orchestra.run.smithi173.stdout:17 Apr 19:48:26 ntpd[17180]: Listen and drop on 0 v6wildcard [::]:123 2024-04-17T19:48:26.375 INFO:teuthology.orchestra.run.smithi173.stdout:17 Apr 19:48:26 ntpd[17180]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-17T19:48:26.375 INFO:teuthology.orchestra.run.smithi173.stdout:17 Apr 19:48:26 ntpd[17180]: Listen normally on 2 lo 127.0.0.1:123 2024-04-17T19:48:26.375 INFO:teuthology.orchestra.run.smithi173.stdout:17 Apr 19:48:26 ntpd[17180]: Listen normally on 3 enp3s0f1 172.21.15.173:123 2024-04-17T19:48:26.375 INFO:teuthology.orchestra.run.smithi173.stdout:17 Apr 19:48:26 ntpd[17180]: Listen normally on 4 lo [::1]:123 2024-04-17T19:48:26.375 INFO:teuthology.orchestra.run.smithi173.stdout:17 Apr 19:48:26 ntpd[17180]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7259%5]:123 2024-04-17T19:48:26.375 INFO:teuthology.orchestra.run.smithi173.stdout:17 Apr 19:48:26 ntpd[17180]: Listening on routing socket on fd #22 for interface updates 2024-04-17T19:48:27.343 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:27 ntpd[17143]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:48:27.343 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:27 ntpd[17143]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:48:27.343 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:27 ntpd[17143]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:48:27.343 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:27 ntpd[17143]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:48:27.343 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:27 ntpd[17143]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T19:48:27.343 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:27 ntpd[17143]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T19:48:27.372 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:27 ntpd[17180]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:48:27.372 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:27 ntpd[17180]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:48:27.373 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:27 ntpd[17180]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:48:27.373 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:27 ntpd[17180]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:48:27.373 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:27 ntpd[17180]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:48:27.373 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:27 ntpd[17180]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:48:27.373 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:27 ntpd[17180]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T19:48:27.373 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:27 ntpd[17180]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T19:48:27.373 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:27 ntpd[17180]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:48:27.373 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:27 ntpd[17180]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:48:27.373 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:27 ntpd[17180]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T19:48:27.373 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:27 ntpd[17180]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T19:48:28.343 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:28 ntpd[17143]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:48:28.343 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:28 ntpd[17143]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:48:28.343 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:28 ntpd[17143]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:48:28.343 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:28 ntpd[17143]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:48:28.343 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:28 ntpd[17143]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T19:48:28.343 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:28 ntpd[17143]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T19:48:29.343 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:29 ntpd[17143]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:48:29.344 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:29 ntpd[17143]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:48:29.344 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:29 ntpd[17143]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:48:29.344 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:29 ntpd[17143]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:48:29.344 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:29 ntpd[17143]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:48:29.344 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:29 ntpd[17143]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:48:29.344 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:29 ntpd[17143]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:48:29.344 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:29 ntpd[17143]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:48:29.345 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:29 ntpd[17143]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T19:48:29.345 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:29 ntpd[17143]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T19:48:29.345 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:29 ntpd[17143]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:48:29.345 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:29 ntpd[17143]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:48:29.345 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:29 ntpd[17143]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T19:48:29.345 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:29 ntpd[17143]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T19:48:29.373 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:29 ntpd[17180]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:48:29.373 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:29 ntpd[17180]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:48:29.373 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:29 ntpd[17180]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:48:29.373 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:29 ntpd[17180]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:48:29.373 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:29 ntpd[17180]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:48:29.373 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:29 ntpd[17180]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:48:29.373 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:29 ntpd[17180]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:48:29.373 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:29 ntpd[17180]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:48:29.373 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:29 ntpd[17180]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T19:48:29.373 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:29 ntpd[17180]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T19:48:29.373 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:29 ntpd[17180]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:48:29.373 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:29 ntpd[17180]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:48:29.374 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:29 ntpd[17180]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T19:48:29.374 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:29 ntpd[17180]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T19:48:30.343 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:30 ntpd[17143]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:48:30.343 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:30 ntpd[17143]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:48:30.343 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:30 ntpd[17143]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:48:30.343 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:30 ntpd[17143]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:48:30.343 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:30 ntpd[17143]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T19:48:30.343 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:30 ntpd[17143]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T19:48:30.372 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:30 ntpd[17180]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:48:30.373 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:30 ntpd[17180]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:48:30.373 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:30 ntpd[17180]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:48:30.373 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:30 ntpd[17180]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:48:30.373 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:30 ntpd[17180]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T19:48:30.373 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:30 ntpd[17180]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T19:48:31.343 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:31 ntpd[17143]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:48:31.343 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:31 ntpd[17143]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:48:31.343 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:31 ntpd[17143]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:48:31.343 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:31 ntpd[17143]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:48:31.343 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:31 ntpd[17143]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:48:31.343 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:31 ntpd[17143]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:48:31.343 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:31 ntpd[17143]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T19:48:31.343 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:31 ntpd[17143]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T19:48:31.344 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:31 ntpd[17143]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:48:31.344 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:31 ntpd[17143]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:48:31.344 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:31 ntpd[17143]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T19:48:31.344 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:31 ntpd[17143]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T19:48:31.372 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:31 ntpd[17180]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:48:31.372 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:31 ntpd[17180]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:48:31.373 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:31 ntpd[17180]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:48:31.373 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:31 ntpd[17180]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:48:31.373 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:31 ntpd[17180]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:48:31.373 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:31 ntpd[17180]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:48:31.373 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:31 ntpd[17180]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T19:48:31.373 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:31 ntpd[17180]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T19:48:31.373 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:31 ntpd[17180]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:48:31.373 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:31 ntpd[17180]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:48:31.373 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:31 ntpd[17180]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T19:48:31.373 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:31 ntpd[17180]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T19:48:32.342 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:32 ntpd[17143]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:48:32.343 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:32 ntpd[17143]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:48:32.343 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:32 ntpd[17143]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:48:32.343 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:32 ntpd[17143]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:48:32.343 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:32 ntpd[17143]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T19:48:32.343 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:32 ntpd[17143]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T19:48:32.372 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:32 ntpd[17180]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:48:32.372 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:32 ntpd[17180]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:48:32.372 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:32 ntpd[17180]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:48:32.372 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:32 ntpd[17180]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:48:32.372 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:32 ntpd[17180]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T19:48:32.372 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:32 ntpd[17180]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T19:48:33.343 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:33 ntpd[17143]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:48:33.343 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:33 ntpd[17143]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:48:33.343 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:33 ntpd[17143]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:48:33.344 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:33 ntpd[17143]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:48:33.344 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:33 ntpd[17143]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:48:33.344 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:33 ntpd[17143]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:48:33.344 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:33 ntpd[17143]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T19:48:33.344 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:33 ntpd[17143]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T19:48:33.344 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:33 ntpd[17143]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:48:33.344 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:33 ntpd[17143]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:48:33.344 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:33 ntpd[17143]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T19:48:33.344 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:33 ntpd[17143]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T19:48:33.344 INFO:teuthology.orchestra.run.smithi018.stdout:17 Apr 19:48:33 ntpd[17143]: ntpd: time slew +0.001249 s 2024-04-17T19:48:33.344 INFO:teuthology.orchestra.run.smithi018.stdout:ntpd: time slew +0.001249s 2024-04-17T19:48:33.345 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:33 ntpd[17143]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-17T19:48:33.345 INFO:teuthology.orchestra.run.smithi018.stderr:17 Apr 19:48:33 ntpd[17143]: can't open /var/log/ntpstats/loopstats.20240417: Permission denied 2024-04-17T19:48:33.372 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:33 ntpd[17180]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:48:33.372 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:33 ntpd[17180]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:48:33.372 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:33 ntpd[17180]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:48:33.372 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:33 ntpd[17180]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:48:33.372 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:33 ntpd[17180]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-17T19:48:33.372 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:33 ntpd[17180]: can't open /var/log/ntpstats/rawstats.20240417: Permission denied 2024-04-17T19:48:33.373 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:33 ntpd[17180]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-17T19:48:33.373 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:33 ntpd[17180]: can't open /var/log/ntpstats/peerstats.20240417: Permission denied 2024-04-17T19:48:33.373 INFO:teuthology.orchestra.run.smithi173.stdout:17 Apr 19:48:33 ntpd[17180]: ntpd: time slew +0.000228 s 2024-04-17T19:48:33.373 INFO:teuthology.orchestra.run.smithi173.stdout:ntpd: time slew +0.000228s 2024-04-17T19:48:33.373 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:33 ntpd[17180]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-17T19:48:33.373 INFO:teuthology.orchestra.run.smithi173.stderr:17 Apr 19:48:33 ntpd[17180]: can't open /var/log/ntpstats/loopstats.20240417: Permission denied 2024-04-17T19:48:33.398 INFO:teuthology.orchestra.run.smithi018.stdout: remote refid st t when poll reach delay offset jitter 2024-04-17T19:48:33.398 INFO:teuthology.orchestra.run.smithi018.stdout:============================================================================== 2024-04-17T19:48:33.398 INFO:teuthology.orchestra.run.smithi018.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-17T19:48:33.398 INFO:teuthology.orchestra.run.smithi018.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-17T19:48:33.399 INFO:teuthology.orchestra.run.smithi018.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-17T19:48:33.399 INFO:teuthology.orchestra.run.smithi018.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-17T19:48:33.427 INFO:teuthology.orchestra.run.smithi173.stdout: remote refid st t when poll reach delay offset jitter 2024-04-17T19:48:33.428 INFO:teuthology.orchestra.run.smithi173.stdout:============================================================================== 2024-04-17T19:48:33.428 INFO:teuthology.orchestra.run.smithi173.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-17T19:48:33.428 INFO:teuthology.orchestra.run.smithi173.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-17T19:48:33.428 INFO:teuthology.orchestra.run.smithi173.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-17T19:48:33.428 INFO:teuthology.orchestra.run.smithi173.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-17T19:48:33.429 INFO:teuthology.run_tasks:Running task install... 2024-04-17T19:48:33.438 DEBUG:teuthology.task.install:project ceph 2024-04-17T19:48:33.438 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'f3a98d3f110319c567ec86bf70955c141495ccf6'}} 2024-04-17T19:48:33.438 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'f3a98d3f110319c567ec86bf70955c141495ccf6'} 2024-04-17T19:48:33.438 INFO:teuthology.task.install:Using flavor: default 2024-04-17T19:48:33.443 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-17T19:48:33.443 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-17T19:48:33.444 DEBUG:teuthology.orchestra.run.smithi018:> sudo apt-key list | grep Ceph 2024-04-17T19:48:33.444 DEBUG:teuthology.orchestra.run.smithi173:> sudo apt-key list | grep Ceph 2024-04-17T19:48:33.503 INFO:teuthology.orchestra.run.smithi018.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-17T19:48:33.528 INFO:teuthology.orchestra.run.smithi173.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-17T19:48:33.533 INFO:teuthology.orchestra.run.smithi018.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-17T19:48:33.533 INFO:teuthology.orchestra.run.smithi018.stdout:uid [ unknown] Ceph.com (release key) 2024-04-17T19:48:33.533 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-17T19:48:33.534 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-17T19:48:33.534 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=f3a98d3f110319c567ec86bf70955c141495ccf6 2024-04-17T19:48:33.557 INFO:teuthology.orchestra.run.smithi173.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-17T19:48:33.557 INFO:teuthology.orchestra.run.smithi173.stdout:uid [ unknown] Ceph.com (release key) 2024-04-17T19:48:33.558 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-17T19:48:33.558 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-17T19:48:33.558 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=f3a98d3f110319c567ec86bf70955c141495ccf6 2024-04-17T19:48:33.678 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default/ 2024-04-17T19:48:33.678 INFO:teuthology.task.install.deb:Package version is 19.0.0-3146-gf3a98d3f-1jammy 2024-04-17T19:48:33.699 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default/ 2024-04-17T19:48:33.699 INFO:teuthology.task.install.deb:Package version is 19.0.0-3146-gf3a98d3f-1jammy 2024-04-17T19:48:33.810 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-17T19:48:33.810 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-17T19:48:33.822 DEBUG:teuthology.orchestra.run.smithi173:> sudo apt-get update 2024-04-17T19:48:33.845 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-17T19:48:33.846 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-17T19:48:33.860 DEBUG:teuthology.orchestra.run.smithi018:> sudo apt-get update 2024-04-17T19:48:33.996 INFO:teuthology.orchestra.run.smithi173.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-17T19:48:34.010 INFO:teuthology.orchestra.run.smithi173.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-17T19:48:34.031 INFO:teuthology.orchestra.run.smithi173.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-17T19:48:34.038 INFO:teuthology.orchestra.run.smithi018.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-17T19:48:34.038 INFO:teuthology.orchestra.run.smithi018.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-17T19:48:34.045 INFO:teuthology.orchestra.run.smithi173.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy InRelease 2024-04-17T19:48:34.051 INFO:teuthology.orchestra.run.smithi018.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-17T19:48:34.066 INFO:teuthology.orchestra.run.smithi173.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-17T19:48:34.071 INFO:teuthology.orchestra.run.smithi018.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-17T19:48:34.085 INFO:teuthology.orchestra.run.smithi018.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy InRelease 2024-04-17T19:48:34.088 INFO:teuthology.orchestra.run.smithi173.stdout:Ign:6 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-17T19:48:34.106 INFO:teuthology.orchestra.run.smithi018.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-17T19:48:34.109 INFO:teuthology.orchestra.run.smithi173.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,418 B] 2024-04-17T19:48:34.128 INFO:teuthology.orchestra.run.smithi018.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-17T19:48:34.135 INFO:teuthology.orchestra.run.smithi173.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-17T19:48:34.136 INFO:teuthology.orchestra.run.smithi173.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-17T19:48:34.149 INFO:teuthology.orchestra.run.smithi018.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,418 B] 2024-04-17T19:48:34.177 INFO:teuthology.orchestra.run.smithi018.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-17T19:48:34.335 INFO:teuthology.orchestra.run.smithi173.stdout:Fetched 29.2 kB in 0s (87.3 kB/s) 2024-04-17T19:48:34.425 INFO:teuthology.orchestra.run.smithi018.stdout:Fetched 29.2 kB in 0s (77.9 kB/s) 2024-04-17T19:48:35.240 INFO:teuthology.orchestra.run.smithi173.stdout:Reading package lists... 2024-04-17T19:48:35.255 DEBUG:teuthology.orchestra.run.smithi173:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3146-gf3a98d3f-1jammy cephadm=19.0.0-3146-gf3a98d3f-1jammy ceph-mds=19.0.0-3146-gf3a98d3f-1jammy ceph-mgr=19.0.0-3146-gf3a98d3f-1jammy ceph-common=19.0.0-3146-gf3a98d3f-1jammy ceph-fuse=19.0.0-3146-gf3a98d3f-1jammy ceph-test=19.0.0-3146-gf3a98d3f-1jammy ceph-volume=19.0.0-3146-gf3a98d3f-1jammy radosgw=19.0.0-3146-gf3a98d3f-1jammy python3-rados=19.0.0-3146-gf3a98d3f-1jammy python3-rgw=19.0.0-3146-gf3a98d3f-1jammy python3-cephfs=19.0.0-3146-gf3a98d3f-1jammy python3-rbd=19.0.0-3146-gf3a98d3f-1jammy libcephfs2=19.0.0-3146-gf3a98d3f-1jammy libcephfs-dev=19.0.0-3146-gf3a98d3f-1jammy librados2=19.0.0-3146-gf3a98d3f-1jammy librbd1=19.0.0-3146-gf3a98d3f-1jammy rbd-fuse=19.0.0-3146-gf3a98d3f-1jammy python3-cephfs=19.0.0-3146-gf3a98d3f-1jammy cephfs-shell=19.0.0-3146-gf3a98d3f-1jammy cephfs-top=19.0.0-3146-gf3a98d3f-1jammy cephfs-mirror=19.0.0-3146-gf3a98d3f-1jammy 2024-04-17T19:48:35.306 INFO:teuthology.orchestra.run.smithi173.stdout:Reading package lists... 2024-04-17T19:48:35.411 INFO:teuthology.orchestra.run.smithi018.stdout:Reading package lists... 2024-04-17T19:48:35.428 DEBUG:teuthology.orchestra.run.smithi018:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3146-gf3a98d3f-1jammy cephadm=19.0.0-3146-gf3a98d3f-1jammy ceph-mds=19.0.0-3146-gf3a98d3f-1jammy ceph-mgr=19.0.0-3146-gf3a98d3f-1jammy ceph-common=19.0.0-3146-gf3a98d3f-1jammy ceph-fuse=19.0.0-3146-gf3a98d3f-1jammy ceph-test=19.0.0-3146-gf3a98d3f-1jammy ceph-volume=19.0.0-3146-gf3a98d3f-1jammy radosgw=19.0.0-3146-gf3a98d3f-1jammy python3-rados=19.0.0-3146-gf3a98d3f-1jammy python3-rgw=19.0.0-3146-gf3a98d3f-1jammy python3-cephfs=19.0.0-3146-gf3a98d3f-1jammy python3-rbd=19.0.0-3146-gf3a98d3f-1jammy libcephfs2=19.0.0-3146-gf3a98d3f-1jammy libcephfs-dev=19.0.0-3146-gf3a98d3f-1jammy librados2=19.0.0-3146-gf3a98d3f-1jammy librbd1=19.0.0-3146-gf3a98d3f-1jammy rbd-fuse=19.0.0-3146-gf3a98d3f-1jammy python3-cephfs=19.0.0-3146-gf3a98d3f-1jammy cephfs-shell=19.0.0-3146-gf3a98d3f-1jammy cephfs-top=19.0.0-3146-gf3a98d3f-1jammy cephfs-mirror=19.0.0-3146-gf3a98d3f-1jammy 2024-04-17T19:48:35.481 INFO:teuthology.orchestra.run.smithi173.stdout:Building dependency tree... 2024-04-17T19:48:35.482 INFO:teuthology.orchestra.run.smithi173.stdout:Reading state information... 2024-04-17T19:48:35.492 INFO:teuthology.orchestra.run.smithi018.stdout:Reading package lists... 2024-04-17T19:48:35.652 INFO:teuthology.orchestra.run.smithi173.stdout:The following packages were automatically installed and are no longer required: 2024-04-17T19:48:35.652 INFO:teuthology.orchestra.run.smithi173.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-17T19:48:35.653 INFO:teuthology.orchestra.run.smithi173.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-17T19:48:35.653 INFO:teuthology.orchestra.run.smithi173.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-17T19:48:35.653 INFO:teuthology.orchestra.run.smithi173.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-17T19:48:35.653 INFO:teuthology.orchestra.run.smithi173.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-17T19:48:35.653 INFO:teuthology.orchestra.run.smithi173.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-17T19:48:35.654 INFO:teuthology.orchestra.run.smithi173.stdout:The following additional packages will be installed: 2024-04-17T19:48:35.654 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-17T19:48:35.654 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-17T19:48:35.654 INFO:teuthology.orchestra.run.smithi173.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-17T19:48:35.654 INFO:teuthology.orchestra.run.smithi173.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-17T19:48:35.655 INFO:teuthology.orchestra.run.smithi173.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-17T19:48:35.655 INFO:teuthology.orchestra.run.smithi173.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-17T19:48:35.656 INFO:teuthology.orchestra.run.smithi173.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-17T19:48:35.656 INFO:teuthology.orchestra.run.smithi173.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-17T19:48:35.656 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-17T19:48:35.656 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-17T19:48:35.656 INFO:teuthology.orchestra.run.smithi173.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-17T19:48:35.656 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-17T19:48:35.656 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-17T19:48:35.656 INFO:teuthology.orchestra.run.smithi173.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-17T19:48:35.656 INFO:teuthology.orchestra.run.smithi173.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-17T19:48:35.656 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-17T19:48:35.656 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-17T19:48:35.656 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-17T19:48:35.656 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-17T19:48:35.656 INFO:teuthology.orchestra.run.smithi173.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-17T19:48:35.656 INFO:teuthology.orchestra.run.smithi173.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-17T19:48:35.657 INFO:teuthology.orchestra.run.smithi173.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-17T19:48:35.657 INFO:teuthology.orchestra.run.smithi173.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-17T19:48:35.657 INFO:teuthology.orchestra.run.smithi173.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-17T19:48:35.657 INFO:teuthology.orchestra.run.smithi173.stdout:Suggested packages: 2024-04-17T19:48:35.657 INFO:teuthology.orchestra.run.smithi173.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-17T19:48:35.657 INFO:teuthology.orchestra.run.smithi173.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-17T19:48:35.657 INFO:teuthology.orchestra.run.smithi173.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-17T19:48:35.657 INFO:teuthology.orchestra.run.smithi173.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-17T19:48:35.657 INFO:teuthology.orchestra.run.smithi173.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-17T19:48:35.657 INFO:teuthology.orchestra.run.smithi173.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-17T19:48:35.658 INFO:teuthology.orchestra.run.smithi173.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-17T19:48:35.658 INFO:teuthology.orchestra.run.smithi173.stdout:Recommended packages: 2024-04-17T19:48:35.658 INFO:teuthology.orchestra.run.smithi173.stdout: btrfs-tools 2024-04-17T19:48:35.691 INFO:teuthology.orchestra.run.smithi018.stdout:Building dependency tree... 2024-04-17T19:48:35.692 INFO:teuthology.orchestra.run.smithi018.stdout:Reading state information... 2024-04-17T19:48:35.762 INFO:teuthology.orchestra.run.smithi173.stdout:The following NEW packages will be installed: 2024-04-17T19:48:35.762 INFO:teuthology.orchestra.run.smithi173.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-17T19:48:35.762 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-17T19:48:35.762 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-17T19:48:35.762 INFO:teuthology.orchestra.run.smithi173.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-17T19:48:35.764 INFO:teuthology.orchestra.run.smithi173.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-17T19:48:35.764 INFO:teuthology.orchestra.run.smithi173.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-17T19:48:35.764 INFO:teuthology.orchestra.run.smithi173.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-17T19:48:35.764 INFO:teuthology.orchestra.run.smithi173.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-17T19:48:35.764 INFO:teuthology.orchestra.run.smithi173.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-17T19:48:35.764 INFO:teuthology.orchestra.run.smithi173.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-17T19:48:35.764 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-17T19:48:35.764 INFO:teuthology.orchestra.run.smithi173.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-17T19:48:35.764 INFO:teuthology.orchestra.run.smithi173.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-17T19:48:35.765 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-17T19:48:35.765 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-17T19:48:35.765 INFO:teuthology.orchestra.run.smithi173.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-17T19:48:35.765 INFO:teuthology.orchestra.run.smithi173.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-17T19:48:35.765 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-17T19:48:35.765 INFO:teuthology.orchestra.run.smithi173.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-17T19:48:35.765 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-17T19:48:35.765 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-17T19:48:35.765 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-17T19:48:35.765 INFO:teuthology.orchestra.run.smithi173.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-17T19:48:35.765 INFO:teuthology.orchestra.run.smithi173.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-17T19:48:35.765 INFO:teuthology.orchestra.run.smithi173.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-17T19:48:35.765 INFO:teuthology.orchestra.run.smithi173.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-17T19:48:35.765 INFO:teuthology.orchestra.run.smithi173.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-17T19:48:35.765 INFO:teuthology.orchestra.run.smithi173.stdout: socat unzip xmlstarlet zip 2024-04-17T19:48:35.892 INFO:teuthology.orchestra.run.smithi018.stdout:The following packages were automatically installed and are no longer required: 2024-04-17T19:48:35.892 INFO:teuthology.orchestra.run.smithi018.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-17T19:48:35.892 INFO:teuthology.orchestra.run.smithi018.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-17T19:48:35.892 INFO:teuthology.orchestra.run.smithi018.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-17T19:48:35.892 INFO:teuthology.orchestra.run.smithi018.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-17T19:48:35.893 INFO:teuthology.orchestra.run.smithi018.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-17T19:48:35.893 INFO:teuthology.orchestra.run.smithi018.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-17T19:48:35.893 INFO:teuthology.orchestra.run.smithi018.stdout:The following additional packages will be installed: 2024-04-17T19:48:35.894 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-17T19:48:35.894 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-17T19:48:35.894 INFO:teuthology.orchestra.run.smithi018.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-17T19:48:35.894 INFO:teuthology.orchestra.run.smithi018.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-17T19:48:35.895 INFO:teuthology.orchestra.run.smithi018.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-17T19:48:35.895 INFO:teuthology.orchestra.run.smithi018.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-17T19:48:35.895 INFO:teuthology.orchestra.run.smithi018.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-17T19:48:35.895 INFO:teuthology.orchestra.run.smithi018.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-17T19:48:35.895 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-17T19:48:35.895 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-17T19:48:35.895 INFO:teuthology.orchestra.run.smithi018.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-17T19:48:35.895 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-17T19:48:35.895 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-17T19:48:35.896 INFO:teuthology.orchestra.run.smithi018.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-17T19:48:35.896 INFO:teuthology.orchestra.run.smithi018.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-17T19:48:35.896 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-17T19:48:35.896 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-17T19:48:35.896 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-17T19:48:35.896 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-17T19:48:35.896 INFO:teuthology.orchestra.run.smithi018.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-17T19:48:35.896 INFO:teuthology.orchestra.run.smithi018.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-17T19:48:35.896 INFO:teuthology.orchestra.run.smithi018.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-17T19:48:35.896 INFO:teuthology.orchestra.run.smithi018.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-17T19:48:35.896 INFO:teuthology.orchestra.run.smithi018.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-17T19:48:35.897 INFO:teuthology.orchestra.run.smithi018.stdout:Suggested packages: 2024-04-17T19:48:35.897 INFO:teuthology.orchestra.run.smithi018.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-17T19:48:35.897 INFO:teuthology.orchestra.run.smithi018.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-17T19:48:35.897 INFO:teuthology.orchestra.run.smithi018.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-17T19:48:35.897 INFO:teuthology.orchestra.run.smithi018.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-17T19:48:35.897 INFO:teuthology.orchestra.run.smithi018.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-17T19:48:35.897 INFO:teuthology.orchestra.run.smithi018.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-17T19:48:35.897 INFO:teuthology.orchestra.run.smithi018.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-17T19:48:35.897 INFO:teuthology.orchestra.run.smithi018.stdout:Recommended packages: 2024-04-17T19:48:35.897 INFO:teuthology.orchestra.run.smithi018.stdout: btrfs-tools 2024-04-17T19:48:35.952 INFO:teuthology.orchestra.run.smithi173.stdout:0 upgraded, 124 newly installed, 0 to remove and 302 not upgraded. 2024-04-17T19:48:35.952 INFO:teuthology.orchestra.run.smithi173.stdout:Need to get 175 MB of archives. 2024-04-17T19:48:35.953 INFO:teuthology.orchestra.run.smithi173.stdout:After this operation, 887 MB of additional disk space will be used. 2024-04-17T19:48:35.953 INFO:teuthology.orchestra.run.smithi173.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-17T19:48:35.979 INFO:teuthology.orchestra.run.smithi173.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3146-gf3a98d3f-1jammy [3,523 kB] 2024-04-17T19:48:36.009 INFO:teuthology.orchestra.run.smithi018.stdout:The following NEW packages will be installed: 2024-04-17T19:48:36.009 INFO:teuthology.orchestra.run.smithi018.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-17T19:48:36.009 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-17T19:48:36.009 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-17T19:48:36.009 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-17T19:48:36.009 INFO:teuthology.orchestra.run.smithi018.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-17T19:48:36.009 INFO:teuthology.orchestra.run.smithi018.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-17T19:48:36.009 INFO:teuthology.orchestra.run.smithi018.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-17T19:48:36.009 INFO:teuthology.orchestra.run.smithi018.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-17T19:48:36.009 INFO:teuthology.orchestra.run.smithi018.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-17T19:48:36.009 INFO:teuthology.orchestra.run.smithi018.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-17T19:48:36.010 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-17T19:48:36.010 INFO:teuthology.orchestra.run.smithi018.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-17T19:48:36.010 INFO:teuthology.orchestra.run.smithi018.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-17T19:48:36.010 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-17T19:48:36.010 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-17T19:48:36.010 INFO:teuthology.orchestra.run.smithi018.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-17T19:48:36.010 INFO:teuthology.orchestra.run.smithi018.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-17T19:48:36.010 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-17T19:48:36.010 INFO:teuthology.orchestra.run.smithi018.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-17T19:48:36.013 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-17T19:48:36.013 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-17T19:48:36.013 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-17T19:48:36.013 INFO:teuthology.orchestra.run.smithi018.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-17T19:48:36.014 INFO:teuthology.orchestra.run.smithi018.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-17T19:48:36.014 INFO:teuthology.orchestra.run.smithi018.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-17T19:48:36.014 INFO:teuthology.orchestra.run.smithi018.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-17T19:48:36.014 INFO:teuthology.orchestra.run.smithi018.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-17T19:48:36.014 INFO:teuthology.orchestra.run.smithi018.stdout: socat unzip xmlstarlet zip 2024-04-17T19:48:36.035 INFO:teuthology.orchestra.run.smithi173.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-17T19:48:36.078 INFO:teuthology.orchestra.run.smithi018.stdout:0 upgraded, 124 newly installed, 0 to remove and 302 not upgraded. 2024-04-17T19:48:36.078 INFO:teuthology.orchestra.run.smithi018.stdout:Need to get 175 MB of archives. 2024-04-17T19:48:36.078 INFO:teuthology.orchestra.run.smithi018.stdout:After this operation, 887 MB of additional disk space will be used. 2024-04-17T19:48:36.078 INFO:teuthology.orchestra.run.smithi018.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-17T19:48:36.080 INFO:teuthology.orchestra.run.smithi173.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-17T19:48:36.098 INFO:teuthology.orchestra.run.smithi018.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-17T19:48:36.115 INFO:teuthology.orchestra.run.smithi018.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-17T19:48:36.164 INFO:teuthology.orchestra.run.smithi018.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-17T19:48:36.190 INFO:teuthology.orchestra.run.smithi018.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-17T19:48:36.194 INFO:teuthology.orchestra.run.smithi018.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-17T19:48:36.208 INFO:teuthology.orchestra.run.smithi018.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-17T19:48:36.232 INFO:teuthology.orchestra.run.smithi018.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3146-gf3a98d3f-1jammy [3,523 kB] 2024-04-17T19:48:36.264 INFO:teuthology.orchestra.run.smithi018.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-17T19:48:36.268 INFO:teuthology.orchestra.run.smithi018.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-17T19:48:36.276 INFO:teuthology.orchestra.run.smithi173.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-17T19:48:36.280 INFO:teuthology.orchestra.run.smithi018.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-17T19:48:36.285 INFO:teuthology.orchestra.run.smithi018.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-17T19:48:36.285 INFO:teuthology.orchestra.run.smithi018.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-17T19:48:36.294 INFO:teuthology.orchestra.run.smithi018.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-17T19:48:36.296 INFO:teuthology.orchestra.run.smithi018.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-17T19:48:36.299 INFO:teuthology.orchestra.run.smithi018.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-17T19:48:36.300 INFO:teuthology.orchestra.run.smithi018.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-17T19:48:36.300 INFO:teuthology.orchestra.run.smithi018.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-17T19:48:36.308 INFO:teuthology.orchestra.run.smithi018.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-17T19:48:36.310 INFO:teuthology.orchestra.run.smithi018.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-17T19:48:36.312 INFO:teuthology.orchestra.run.smithi018.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-17T19:48:36.313 INFO:teuthology.orchestra.run.smithi173.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3146-gf3a98d3f-1jammy [3,286 kB] 2024-04-17T19:48:36.327 INFO:teuthology.orchestra.run.smithi018.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-17T19:48:36.328 INFO:teuthology.orchestra.run.smithi018.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-17T19:48:36.329 INFO:teuthology.orchestra.run.smithi018.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-17T19:48:36.329 INFO:teuthology.orchestra.run.smithi018.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-17T19:48:36.329 INFO:teuthology.orchestra.run.smithi018.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-17T19:48:36.330 INFO:teuthology.orchestra.run.smithi018.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-17T19:48:36.330 INFO:teuthology.orchestra.run.smithi018.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-17T19:48:36.347 INFO:teuthology.orchestra.run.smithi018.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-17T19:48:36.347 INFO:teuthology.orchestra.run.smithi018.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-17T19:48:36.350 INFO:teuthology.orchestra.run.smithi018.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-17T19:48:36.375 INFO:teuthology.orchestra.run.smithi173.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-17T19:48:36.377 INFO:teuthology.orchestra.run.smithi018.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-17T19:48:36.378 INFO:teuthology.orchestra.run.smithi018.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-17T19:48:36.378 INFO:teuthology.orchestra.run.smithi018.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-17T19:48:36.380 INFO:teuthology.orchestra.run.smithi018.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-17T19:48:36.381 INFO:teuthology.orchestra.run.smithi018.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-17T19:48:36.382 INFO:teuthology.orchestra.run.smithi018.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-17T19:48:36.384 INFO:teuthology.orchestra.run.smithi018.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-17T19:48:36.388 INFO:teuthology.orchestra.run.smithi173.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-17T19:48:36.397 INFO:teuthology.orchestra.run.smithi018.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-17T19:48:36.398 INFO:teuthology.orchestra.run.smithi018.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-17T19:48:36.407 INFO:teuthology.orchestra.run.smithi018.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-17T19:48:36.417 INFO:teuthology.orchestra.run.smithi018.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-17T19:48:36.418 INFO:teuthology.orchestra.run.smithi018.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-17T19:48:36.419 INFO:teuthology.orchestra.run.smithi018.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-17T19:48:36.421 INFO:teuthology.orchestra.run.smithi018.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-17T19:48:36.425 INFO:teuthology.orchestra.run.smithi018.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-17T19:48:36.426 INFO:teuthology.orchestra.run.smithi018.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-17T19:48:36.429 INFO:teuthology.orchestra.run.smithi018.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-17T19:48:36.436 INFO:teuthology.orchestra.run.smithi018.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-17T19:48:36.440 INFO:teuthology.orchestra.run.smithi173.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-17T19:48:36.441 INFO:teuthology.orchestra.run.smithi018.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-17T19:48:36.442 INFO:teuthology.orchestra.run.smithi018.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-17T19:48:36.456 INFO:teuthology.orchestra.run.smithi018.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-17T19:48:36.460 INFO:teuthology.orchestra.run.smithi018.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-17T19:48:36.469 INFO:teuthology.orchestra.run.smithi173.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3146-gf3a98d3f-1jammy [726 kB] 2024-04-17T19:48:36.496 INFO:teuthology.orchestra.run.smithi173.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3146-gf3a98d3f-1jammy [357 kB] 2024-04-17T19:48:36.529 INFO:teuthology.orchestra.run.smithi173.stdout:Get:12 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3146-gf3a98d3f-1jammy [32.8 kB] 2024-04-17T19:48:36.530 INFO:teuthology.orchestra.run.smithi173.stdout:Get:13 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3146-gf3a98d3f-1jammy [180 kB] 2024-04-17T19:48:36.536 INFO:teuthology.orchestra.run.smithi173.stdout:Get:14 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3146-gf3a98d3f-1jammy [66.9 kB] 2024-04-17T19:48:36.536 INFO:teuthology.orchestra.run.smithi018.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-17T19:48:36.537 INFO:teuthology.orchestra.run.smithi018.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-17T19:48:36.538 INFO:teuthology.orchestra.run.smithi173.stdout:Get:15 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3146-gf3a98d3f-1jammy [330 kB] 2024-04-17T19:48:36.538 INFO:teuthology.orchestra.run.smithi018.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-17T19:48:36.539 INFO:teuthology.orchestra.run.smithi018.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-17T19:48:36.540 INFO:teuthology.orchestra.run.smithi018.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-17T19:48:36.548 INFO:teuthology.orchestra.run.smithi173.stdout:Get:16 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3146-gf3a98d3f-1jammy [7,186 kB] 2024-04-17T19:48:36.558 INFO:teuthology.orchestra.run.smithi018.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-17T19:48:36.560 INFO:teuthology.orchestra.run.smithi018.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-17T19:48:36.560 INFO:teuthology.orchestra.run.smithi018.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-17T19:48:36.576 INFO:teuthology.orchestra.run.smithi018.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-17T19:48:36.576 INFO:teuthology.orchestra.run.smithi018.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-17T19:48:36.580 INFO:teuthology.orchestra.run.smithi018.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-17T19:48:36.580 INFO:teuthology.orchestra.run.smithi018.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-17T19:48:36.581 INFO:teuthology.orchestra.run.smithi018.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-17T19:48:36.582 INFO:teuthology.orchestra.run.smithi018.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-17T19:48:36.582 INFO:teuthology.orchestra.run.smithi018.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-17T19:48:36.600 INFO:teuthology.orchestra.run.smithi018.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-17T19:48:36.604 INFO:teuthology.orchestra.run.smithi018.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-17T19:48:36.606 INFO:teuthology.orchestra.run.smithi018.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-17T19:48:36.608 INFO:teuthology.orchestra.run.smithi018.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-17T19:48:36.609 INFO:teuthology.orchestra.run.smithi018.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-17T19:48:36.614 INFO:teuthology.orchestra.run.smithi173.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-17T19:48:36.619 INFO:teuthology.orchestra.run.smithi018.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-17T19:48:36.623 INFO:teuthology.orchestra.run.smithi018.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-17T19:48:36.623 INFO:teuthology.orchestra.run.smithi018.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-17T19:48:36.623 INFO:teuthology.orchestra.run.smithi173.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-17T19:48:36.624 INFO:teuthology.orchestra.run.smithi018.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-17T19:48:36.624 INFO:teuthology.orchestra.run.smithi018.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-17T19:48:36.625 INFO:teuthology.orchestra.run.smithi018.stdout:Get:79 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3146-gf3a98d3f-1jammy [3,286 kB] 2024-04-17T19:48:36.639 INFO:teuthology.orchestra.run.smithi018.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-17T19:48:36.640 INFO:teuthology.orchestra.run.smithi018.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-17T19:48:36.643 INFO:teuthology.orchestra.run.smithi018.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-17T19:48:36.643 INFO:teuthology.orchestra.run.smithi018.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-17T19:48:36.644 INFO:teuthology.orchestra.run.smithi018.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-17T19:48:36.651 INFO:teuthology.orchestra.run.smithi173.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-17T19:48:36.659 INFO:teuthology.orchestra.run.smithi018.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-17T19:48:36.659 INFO:teuthology.orchestra.run.smithi173.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-17T19:48:36.661 INFO:teuthology.orchestra.run.smithi018.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-17T19:48:36.661 INFO:teuthology.orchestra.run.smithi018.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-17T19:48:36.671 INFO:teuthology.orchestra.run.smithi018.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-17T19:48:36.671 INFO:teuthology.orchestra.run.smithi018.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-17T19:48:36.678 INFO:teuthology.orchestra.run.smithi018.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-17T19:48:36.681 INFO:teuthology.orchestra.run.smithi018.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-17T19:48:36.681 INFO:teuthology.orchestra.run.smithi018.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-17T19:48:36.824 INFO:teuthology.orchestra.run.smithi173.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-17T19:48:36.865 INFO:teuthology.orchestra.run.smithi018.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3146-gf3a98d3f-1jammy [726 kB] 2024-04-17T19:48:36.890 INFO:teuthology.orchestra.run.smithi018.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3146-gf3a98d3f-1jammy [357 kB] 2024-04-17T19:48:36.947 INFO:teuthology.orchestra.run.smithi018.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3146-gf3a98d3f-1jammy [32.8 kB] 2024-04-17T19:48:36.949 INFO:teuthology.orchestra.run.smithi018.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3146-gf3a98d3f-1jammy [180 kB] 2024-04-17T19:48:36.954 INFO:teuthology.orchestra.run.smithi018.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3146-gf3a98d3f-1jammy [66.9 kB] 2024-04-17T19:48:36.957 INFO:teuthology.orchestra.run.smithi018.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3146-gf3a98d3f-1jammy [330 kB] 2024-04-17T19:48:36.970 INFO:teuthology.orchestra.run.smithi018.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3146-gf3a98d3f-1jammy [7,186 kB] 2024-04-17T19:48:37.023 INFO:teuthology.orchestra.run.smithi173.stdout:Get:22 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3146-gf3a98d3f-1jammy [112 kB] 2024-04-17T19:48:37.026 INFO:teuthology.orchestra.run.smithi173.stdout:Get:23 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3146-gf3a98d3f-1jammy [471 kB] 2024-04-17T19:48:37.036 INFO:teuthology.orchestra.run.smithi173.stdout:Get:24 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3146-gf3a98d3f-1jammy [25.6 MB] 2024-04-17T19:48:37.391 INFO:teuthology.orchestra.run.smithi173.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-17T19:48:37.406 INFO:teuthology.orchestra.run.smithi173.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-17T19:48:37.422 INFO:teuthology.orchestra.run.smithi173.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-17T19:48:37.430 INFO:teuthology.orchestra.run.smithi173.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-17T19:48:37.431 INFO:teuthology.orchestra.run.smithi173.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-17T19:48:37.447 INFO:teuthology.orchestra.run.smithi173.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-17T19:48:37.481 INFO:teuthology.orchestra.run.smithi018.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3146-gf3a98d3f-1jammy [112 kB] 2024-04-17T19:48:37.483 INFO:teuthology.orchestra.run.smithi018.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3146-gf3a98d3f-1jammy [471 kB] 2024-04-17T19:48:37.485 INFO:teuthology.orchestra.run.smithi173.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-17T19:48:37.498 INFO:teuthology.orchestra.run.smithi173.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-17T19:48:37.500 INFO:teuthology.orchestra.run.smithi018.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3146-gf3a98d3f-1jammy [25.6 MB] 2024-04-17T19:48:37.502 INFO:teuthology.orchestra.run.smithi173.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-17T19:48:37.503 INFO:teuthology.orchestra.run.smithi173.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-17T19:48:37.673 INFO:teuthology.orchestra.run.smithi173.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-17T19:48:37.757 INFO:teuthology.orchestra.run.smithi173.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-17T19:48:37.764 INFO:teuthology.orchestra.run.smithi173.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-17T19:48:37.838 INFO:teuthology.orchestra.run.smithi173.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-17T19:48:37.864 INFO:teuthology.orchestra.run.smithi173.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-17T19:48:37.880 INFO:teuthology.orchestra.run.smithi173.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-17T19:48:37.897 INFO:teuthology.orchestra.run.smithi173.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-17T19:48:38.079 INFO:teuthology.orchestra.run.smithi173.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-17T19:48:38.096 INFO:teuthology.orchestra.run.smithi173.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-17T19:48:38.103 INFO:teuthology.orchestra.run.smithi173.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-17T19:48:38.108 INFO:teuthology.orchestra.run.smithi173.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-17T19:48:38.293 INFO:teuthology.orchestra.run.smithi173.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-17T19:48:38.376 INFO:teuthology.orchestra.run.smithi173.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-17T19:48:38.390 INFO:teuthology.orchestra.run.smithi173.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-17T19:48:38.570 INFO:teuthology.orchestra.run.smithi173.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-17T19:48:38.616 INFO:teuthology.orchestra.run.smithi173.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-17T19:48:38.628 INFO:teuthology.orchestra.run.smithi173.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-17T19:48:38.808 INFO:teuthology.orchestra.run.smithi173.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-17T19:48:38.808 INFO:teuthology.orchestra.run.smithi173.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-17T19:48:38.810 INFO:teuthology.orchestra.run.smithi173.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-17T19:48:38.810 INFO:teuthology.orchestra.run.smithi173.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-17T19:48:38.860 INFO:teuthology.orchestra.run.smithi173.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-17T19:48:38.861 INFO:teuthology.orchestra.run.smithi173.stdout:Get:57 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3146-gf3a98d3f-1jammy [4,916 kB] 2024-04-17T19:48:39.028 INFO:teuthology.orchestra.run.smithi173.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-17T19:48:39.074 INFO:teuthology.orchestra.run.smithi173.stdout:Get:59 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3146-gf3a98d3f-1jammy [244 kB] 2024-04-17T19:48:39.084 INFO:teuthology.orchestra.run.smithi173.stdout:Get:60 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3146-gf3a98d3f-1jammy [125 kB] 2024-04-17T19:48:39.098 INFO:teuthology.orchestra.run.smithi173.stdout:Get:61 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3146-gf3a98d3f-1jammy [1,519 kB] 2024-04-17T19:48:39.189 INFO:teuthology.orchestra.run.smithi173.stdout:Get:62 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3146-gf3a98d3f-1jammy [6,148 kB] 2024-04-17T19:48:39.206 INFO:teuthology.orchestra.run.smithi018.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3146-gf3a98d3f-1jammy [4,916 kB] 2024-04-17T19:48:39.292 INFO:teuthology.orchestra.run.smithi173.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-17T19:48:39.407 INFO:teuthology.orchestra.run.smithi173.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-17T19:48:39.439 INFO:teuthology.orchestra.run.smithi018.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3146-gf3a98d3f-1jammy [244 kB] 2024-04-17T19:48:39.449 INFO:teuthology.orchestra.run.smithi173.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-17T19:48:39.455 INFO:teuthology.orchestra.run.smithi018.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3146-gf3a98d3f-1jammy [125 kB] 2024-04-17T19:48:39.459 INFO:teuthology.orchestra.run.smithi018.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3146-gf3a98d3f-1jammy [1,519 kB] 2024-04-17T19:48:39.532 INFO:teuthology.orchestra.run.smithi173.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-17T19:48:39.544 INFO:teuthology.orchestra.run.smithi173.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-17T19:48:39.548 INFO:teuthology.orchestra.run.smithi018.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3146-gf3a98d3f-1jammy [6,148 kB] 2024-04-17T19:48:39.557 INFO:teuthology.orchestra.run.smithi173.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-17T19:48:39.579 INFO:teuthology.orchestra.run.smithi173.stdout:Get:69 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3146-gf3a98d3f-1jammy [22.5 MB] 2024-04-17T19:48:39.597 INFO:teuthology.orchestra.run.smithi173.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-17T19:48:39.862 INFO:teuthology.orchestra.run.smithi173.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-17T19:48:39.864 INFO:teuthology.orchestra.run.smithi173.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-17T19:48:39.867 INFO:teuthology.orchestra.run.smithi173.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-17T19:48:39.985 INFO:teuthology.orchestra.run.smithi018.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3146-gf3a98d3f-1jammy [22.5 MB] 2024-04-17T19:48:40.031 INFO:teuthology.orchestra.run.smithi173.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-17T19:48:40.370 INFO:teuthology.orchestra.run.smithi173.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-17T19:48:40.765 INFO:teuthology.orchestra.run.smithi173.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-17T19:48:40.775 INFO:teuthology.orchestra.run.smithi173.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-17T19:48:40.776 INFO:teuthology.orchestra.run.smithi173.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-17T19:48:40.845 INFO:teuthology.orchestra.run.smithi173.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-17T19:48:40.845 INFO:teuthology.orchestra.run.smithi173.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-17T19:48:40.847 INFO:teuthology.orchestra.run.smithi173.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-17T19:48:40.848 INFO:teuthology.orchestra.run.smithi173.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-17T19:48:40.849 INFO:teuthology.orchestra.run.smithi173.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-17T19:48:41.015 INFO:teuthology.orchestra.run.smithi173.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-17T19:48:41.109 INFO:teuthology.orchestra.run.smithi173.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-17T19:48:41.110 INFO:teuthology.orchestra.run.smithi173.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3146-gf3a98d3f-1jammy [14.0 kB] 2024-04-17T19:48:41.111 INFO:teuthology.orchestra.run.smithi173.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3146-gf3a98d3f-1jammy [856 kB] 2024-04-17T19:48:41.127 INFO:teuthology.orchestra.run.smithi173.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3146-gf3a98d3f-1jammy [2,369 kB] 2024-04-17T19:48:41.199 INFO:teuthology.orchestra.run.smithi173.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-17T19:48:41.237 INFO:teuthology.orchestra.run.smithi173.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3146-gf3a98d3f-1jammy [791 kB] 2024-04-17T19:48:41.280 INFO:teuthology.orchestra.run.smithi173.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3146-gf3a98d3f-1jammy [148 kB] 2024-04-17T19:48:41.284 INFO:teuthology.orchestra.run.smithi173.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3146-gf3a98d3f-1jammy [2,297 kB] 2024-04-17T19:48:41.426 INFO:teuthology.orchestra.run.smithi173.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3146-gf3a98d3f-1jammy [8,625 kB] 2024-04-17T19:48:41.445 INFO:teuthology.orchestra.run.smithi173.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-17T19:48:41.488 INFO:teuthology.orchestra.run.smithi173.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-17T19:48:41.512 INFO:teuthology.orchestra.run.smithi173.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-17T19:48:41.521 INFO:teuthology.orchestra.run.smithi173.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-17T19:48:41.565 INFO:teuthology.orchestra.run.smithi173.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-17T19:48:41.581 INFO:teuthology.orchestra.run.smithi018.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3146-gf3a98d3f-1jammy [14.0 kB] 2024-04-17T19:48:41.582 INFO:teuthology.orchestra.run.smithi018.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3146-gf3a98d3f-1jammy [856 kB] 2024-04-17T19:48:41.590 INFO:teuthology.orchestra.run.smithi173.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-17T19:48:41.592 INFO:teuthology.orchestra.run.smithi173.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-17T19:48:41.598 INFO:teuthology.orchestra.run.smithi173.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-17T19:48:41.599 INFO:teuthology.orchestra.run.smithi018.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3146-gf3a98d3f-1jammy [2,369 kB] 2024-04-17T19:48:41.740 INFO:teuthology.orchestra.run.smithi018.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3146-gf3a98d3f-1jammy [791 kB] 2024-04-17T19:48:41.765 INFO:teuthology.orchestra.run.smithi173.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-17T19:48:41.824 INFO:teuthology.orchestra.run.smithi018.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3146-gf3a98d3f-1jammy [148 kB] 2024-04-17T19:48:41.834 INFO:teuthology.orchestra.run.smithi018.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3146-gf3a98d3f-1jammy [2,297 kB] 2024-04-17T19:48:41.951 INFO:teuthology.orchestra.run.smithi018.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3146-gf3a98d3f-1jammy [8,625 kB] 2024-04-17T19:48:41.965 INFO:teuthology.orchestra.run.smithi173.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3146-gf3a98d3f-1jammy [14.2 kB] 2024-04-17T19:48:41.966 INFO:teuthology.orchestra.run.smithi173.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3146-gf3a98d3f-1jammy [44.9 MB] 2024-04-17T19:48:42.302 INFO:teuthology.orchestra.run.smithi173.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-17T19:48:42.307 INFO:teuthology.orchestra.run.smithi173.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-17T19:48:42.347 INFO:teuthology.orchestra.run.smithi173.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-17T19:48:42.348 INFO:teuthology.orchestra.run.smithi173.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-17T19:48:42.353 INFO:teuthology.orchestra.run.smithi173.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-17T19:48:42.356 INFO:teuthology.orchestra.run.smithi173.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-17T19:48:42.397 INFO:teuthology.orchestra.run.smithi173.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-17T19:48:42.406 INFO:teuthology.orchestra.run.smithi173.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-17T19:48:42.478 INFO:teuthology.orchestra.run.smithi173.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-17T19:48:42.479 INFO:teuthology.orchestra.run.smithi173.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-17T19:48:42.578 INFO:teuthology.orchestra.run.smithi018.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3146-gf3a98d3f-1jammy [14.2 kB] 2024-04-17T19:48:42.579 INFO:teuthology.orchestra.run.smithi018.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3146-gf3a98d3f-1jammy [44.9 MB] 2024-04-17T19:48:42.645 INFO:teuthology.orchestra.run.smithi173.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-17T19:48:43.079 INFO:teuthology.orchestra.run.smithi173.stdout:Get:116 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-17T19:48:43.094 INFO:teuthology.orchestra.run.smithi173.stdout:Get:117 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-17T19:48:45.224 INFO:teuthology.orchestra.run.smithi173.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3146-gf3a98d3f-1jammy [124 kB] 2024-04-17T19:48:45.226 INFO:teuthology.orchestra.run.smithi173.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3146-gf3a98d3f-1jammy [236 kB] 2024-04-17T19:48:45.231 INFO:teuthology.orchestra.run.smithi173.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3146-gf3a98d3f-1jammy [33.9 kB] 2024-04-17T19:48:45.232 INFO:teuthology.orchestra.run.smithi173.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3146-gf3a98d3f-1jammy [23.4 kB] 2024-04-17T19:48:45.233 INFO:teuthology.orchestra.run.smithi173.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3146-gf3a98d3f-1jammy [38.9 kB] 2024-04-17T19:48:45.234 INFO:teuthology.orchestra.run.smithi173.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3146-gf3a98d3f-1jammy [14.1 MB] 2024-04-17T19:48:45.514 INFO:teuthology.orchestra.run.smithi018.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3146-gf3a98d3f-1jammy [124 kB] 2024-04-17T19:48:45.517 INFO:teuthology.orchestra.run.smithi018.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3146-gf3a98d3f-1jammy [236 kB] 2024-04-17T19:48:45.522 INFO:teuthology.orchestra.run.smithi018.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3146-gf3a98d3f-1jammy [33.9 kB] 2024-04-17T19:48:45.523 INFO:teuthology.orchestra.run.smithi018.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3146-gf3a98d3f-1jammy [23.4 kB] 2024-04-17T19:48:45.574 INFO:teuthology.orchestra.run.smithi018.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3146-gf3a98d3f-1jammy [38.9 kB] 2024-04-17T19:48:45.575 INFO:teuthology.orchestra.run.smithi018.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3146-gf3a98d3f-1jammy [14.1 MB] 2024-04-17T19:48:46.053 INFO:teuthology.orchestra.run.smithi173.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3146-gf3a98d3f-1jammy [92.6 kB] 2024-04-17T19:48:46.156 INFO:teuthology.orchestra.run.smithi018.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240417.021458-debug/f3a98d3f110319c567ec86bf70955c141495ccf6/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3146-gf3a98d3f-1jammy [92.6 kB] 2024-04-17T19:48:46.674 INFO:teuthology.orchestra.run.smithi173.stdout:Fetched 175 MB in 10s (17.0 MB/s) 2024-04-17T19:48:46.788 INFO:teuthology.orchestra.run.smithi018.stdout:Fetched 175 MB in 10s (17.2 MB/s) 2024-04-17T19:48:46.811 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-17T19:48:46.870 INFO:teuthology.orchestra.run.smithi173.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-17T19:48:46.876 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-17T19:48:46.884 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-17T19:48:46.918 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-17T19:48:46.972 INFO:teuthology.orchestra.run.smithi018.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-17T19:48:46.978 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-17T19:48:47.016 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-17T19:48:47.212 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-17T19:48:47.239 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-17T19:48:47.279 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-17T19:48:47.302 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-17T19:48:47.329 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-17T19:48:47.368 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-17T19:48:47.599 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-cmd2. 2024-04-17T19:48:47.625 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-17T19:48:47.665 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-17T19:48:47.713 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-cmd2. 2024-04-17T19:48:47.740 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-17T19:48:47.779 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-17T19:48:48.001 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-17T19:48:48.028 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-17T19:48:48.082 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-17T19:48:48.093 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-17T19:48:48.109 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-17T19:48:48.191 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-17T19:48:48.463 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-17T19:48:48.490 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-17T19:48:48.519 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-17T19:48:48.530 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-17T19:48:48.546 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-17T19:48:48.585 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-17T19:48:48.925 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-17T19:48:48.947 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-17T19:48:48.951 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-17T19:48:48.974 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-17T19:48:48.991 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-17T19:48:49.013 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-17T19:48:49.403 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-17T19:48:49.408 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-17T19:48:49.430 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-17T19:48:49.435 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-17T19:48:49.475 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T19:48:49.478 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T19:48:49.889 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-17T19:48:49.915 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-17T19:48:49.964 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T19:48:50.078 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-17T19:48:50.104 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-17T19:48:50.144 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T19:48:50.251 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-17T19:48:50.277 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-17T19:48:50.309 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T19:48:50.498 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-17T19:48:50.524 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-17T19:48:50.606 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T19:48:50.670 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-17T19:48:50.697 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-17T19:48:50.737 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-17T19:48:51.042 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-17T19:48:51.069 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-17T19:48:51.073 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package librados2. 2024-04-17T19:48:51.099 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../010-librados2_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:48:51.108 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-17T19:48:51.140 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking librados2 (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:48:51.378 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package librados2. 2024-04-17T19:48:51.394 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../010-librados2_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:48:51.436 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking librados2 (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:48:51.592 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package librbd1. 2024-04-17T19:48:51.619 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../011-librbd1_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:48:51.659 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking librbd1 (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:48:51.914 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package librbd1. 2024-04-17T19:48:51.942 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../011-librbd1_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:48:51.981 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking librbd1 (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:48:52.078 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libcephfs2. 2024-04-17T19:48:52.093 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:48:52.136 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libcephfs2 (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:48:52.433 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libcephfs2. 2024-04-17T19:48:52.456 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-rados. 2024-04-17T19:48:52.460 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:48:52.482 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:48:52.500 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libcephfs2 (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:48:52.522 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-rados (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:48:52.786 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-rados. 2024-04-17T19:48:52.801 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:48:52.835 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-rados (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:48:52.842 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-17T19:48:52.868 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3146-gf3a98d3f-1jammy_all.deb ... 2024-04-17T19:48:52.908 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-ceph-argparse (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:48:53.113 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-17T19:48:53.140 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3146-gf3a98d3f-1jammy_all.deb ... 2024-04-17T19:48:53.144 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-cephfs. 2024-04-17T19:48:53.159 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:48:53.180 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-ceph-argparse (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:48:53.194 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-cephfs (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:48:53.432 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-cephfs. 2024-04-17T19:48:53.459 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:48:53.499 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-cephfs (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:48:53.513 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-17T19:48:53.539 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3146-gf3a98d3f-1jammy_all.deb ... 2024-04-17T19:48:53.580 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-ceph-common (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:48:53.835 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-17T19:48:53.861 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3146-gf3a98d3f-1jammy_all.deb ... 2024-04-17T19:48:53.901 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-ceph-common (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:48:53.908 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-prettytable. 2024-04-17T19:48:53.935 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-17T19:48:54.000 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-17T19:48:54.230 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-prettytable. 2024-04-17T19:48:54.244 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-rbd. 2024-04-17T19:48:54.256 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-17T19:48:54.270 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:48:54.296 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-17T19:48:54.302 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-rbd (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:48:54.557 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-rbd. 2024-04-17T19:48:54.573 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:48:54.615 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-rbd (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:48:54.647 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-17T19:48:54.673 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-17T19:48:54.713 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-17T19:48:54.968 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-17T19:48:54.995 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-17T19:48:54.999 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-17T19:48:55.014 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-17T19:48:55.026 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-17T19:48:55.057 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-17T19:48:55.296 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-17T19:48:55.322 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-17T19:48:55.360 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-17T19:48:55.362 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-17T19:48:55.387 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-17T19:48:55.427 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-17T19:48:55.665 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-17T19:48:55.681 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-17T19:48:55.715 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-17T19:48:55.738 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package lua5.1. 2024-04-17T19:48:55.754 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-17T19:48:55.788 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-17T19:48:56.035 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package lua5.1. 2024-04-17T19:48:56.061 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-17T19:48:56.100 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package lua-any. 2024-04-17T19:48:56.101 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-17T19:48:56.115 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-17T19:48:56.158 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-17T19:48:56.411 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package zip. 2024-04-17T19:48:56.426 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-17T19:48:56.429 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package lua-any. 2024-04-17T19:48:56.445 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-17T19:48:56.469 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking zip (3.0-12build2) ... 2024-04-17T19:48:56.488 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-17T19:48:56.749 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package zip. 2024-04-17T19:48:56.775 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-17T19:48:56.789 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package unzip. 2024-04-17T19:48:56.815 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-17T19:48:56.815 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking zip (3.0-12build2) ... 2024-04-17T19:48:56.855 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-17T19:48:57.093 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package unzip. 2024-04-17T19:48:57.120 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-17T19:48:57.151 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-17T19:48:57.226 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package luarocks. 2024-04-17T19:48:57.252 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-17T19:48:57.309 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-17T19:48:57.563 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package luarocks. 2024-04-17T19:48:57.590 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-17T19:48:57.630 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-17T19:48:57.700 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package librgw2. 2024-04-17T19:48:57.726 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../027-librgw2_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:48:57.766 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking librgw2 (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:48:58.038 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package librgw2. 2024-04-17T19:48:58.064 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../027-librgw2_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:48:58.104 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking librgw2 (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:48:58.410 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-rgw. 2024-04-17T19:48:58.437 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:48:58.477 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-rgw (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:48:58.748 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-rgw. 2024-04-17T19:48:58.775 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:48:58.788 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-17T19:48:58.804 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-17T19:48:58.814 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-rgw (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:48:58.838 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-17T19:48:59.125 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libradosstriper1. 2024-04-17T19:48:59.140 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:48:59.142 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-17T19:48:59.169 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-17T19:48:59.183 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libradosstriper1 (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:48:59.209 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-17T19:48:59.470 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libradosstriper1. 2024-04-17T19:48:59.496 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:48:59.536 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libradosstriper1 (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:48:59.619 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-common. 2024-04-17T19:48:59.646 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:48:59.686 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-common (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:48:59.990 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-common. 2024-04-17T19:49:00.017 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:49:00.180 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-common (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:49:01.275 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-base. 2024-04-17T19:49:01.301 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:49:01.350 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-base (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:49:01.695 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-base. 2024-04-17T19:49:01.721 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:49:01.771 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-base (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:49:01.928 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-17T19:49:01.944 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-17T19:49:01.978 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-17T19:49:02.264 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-cheroot. 2024-04-17T19:49:02.291 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-17T19:49:02.315 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-17T19:49:02.331 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-17T19:49:02.332 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-17T19:49:02.365 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-17T19:49:02.643 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-cheroot. 2024-04-17T19:49:02.651 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-17T19:49:02.670 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-17T19:49:02.677 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-17T19:49:02.709 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-17T19:49:02.717 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-17T19:49:03.020 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-17T19:49:03.036 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-17T19:49:03.054 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-17T19:49:03.078 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-17T19:49:03.081 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-17T19:49:03.121 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-17T19:49:03.364 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-17T19:49:03.380 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-17T19:49:03.414 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-17T19:49:03.432 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-17T19:49:03.448 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-17T19:49:03.490 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-17T19:49:03.701 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-tempora. 2024-04-17T19:49:03.716 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-17T19:49:03.759 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-17T19:49:03.768 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-17T19:49:03.795 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-17T19:49:03.834 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-17T19:49:04.062 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-portend. 2024-04-17T19:49:04.088 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-17T19:49:04.112 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-tempora. 2024-04-17T19:49:04.128 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-17T19:49:04.139 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-17T19:49:04.179 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-17T19:49:04.440 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-17T19:49:04.466 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-17T19:49:04.482 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-portend. 2024-04-17T19:49:04.506 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-17T19:49:04.509 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-17T19:49:04.548 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-17T19:49:04.809 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-17T19:49:04.826 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-17T19:49:04.836 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-17T19:49:04.853 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-17T19:49:04.867 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-17T19:49:04.892 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-17T19:49:05.145 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-17T19:49:05.172 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-17T19:49:05.187 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-natsort. 2024-04-17T19:49:05.203 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-17T19:49:05.212 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-17T19:49:05.262 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-17T19:49:05.565 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-natsort. 2024-04-17T19:49:05.574 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-logutils. 2024-04-17T19:49:05.593 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-17T19:49:05.600 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-17T19:49:05.632 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-17T19:49:05.649 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-17T19:49:05.910 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-17T19:49:05.936 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-17T19:49:05.968 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-17T19:49:05.968 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-logutils. 2024-04-17T19:49:05.995 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-17T19:49:06.035 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-17T19:49:06.271 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-mako. 2024-04-17T19:49:06.298 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-17T19:49:06.337 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-17T19:49:06.346 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-17T19:49:06.373 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-17T19:49:06.413 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-17T19:49:06.632 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-17T19:49:06.659 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-17T19:49:06.699 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-17T19:49:06.715 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-mako. 2024-04-17T19:49:06.742 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-17T19:49:06.782 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-17T19:49:06.985 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-17T19:49:07.011 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-17T19:49:07.051 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-17T19:49:07.084 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-17T19:49:07.108 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-17T19:49:07.143 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-17T19:49:07.354 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-webob. 2024-04-17T19:49:07.380 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-17T19:49:07.412 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-17T19:49:07.421 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-17T19:49:07.439 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-17T19:49:07.504 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-17T19:49:07.790 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-webob. 2024-04-17T19:49:07.790 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-waitress. 2024-04-17T19:49:07.817 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-17T19:49:07.817 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-17T19:49:07.856 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-17T19:49:07.860 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-17T19:49:08.169 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-tempita. 2024-04-17T19:49:08.195 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-17T19:49:08.226 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-waitress. 2024-04-17T19:49:08.235 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-17T19:49:08.253 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-17T19:49:08.296 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-17T19:49:08.521 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-paste. 2024-04-17T19:49:08.547 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-17T19:49:08.579 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-17T19:49:08.604 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-tempita. 2024-04-17T19:49:08.631 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-17T19:49:08.670 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-17T19:49:08.907 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-17T19:49:08.922 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-17T19:49:08.923 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-paste. 2024-04-17T19:49:08.950 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-17T19:49:08.966 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-17T19:49:08.981 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-17T19:49:09.235 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-17T19:49:09.262 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-17T19:49:09.328 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-17T19:49:09.760 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-17T19:49:09.788 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-17T19:49:10.152 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-17T19:49:10.479 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-17T19:49:10.506 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-17T19:49:10.647 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-webtest. 2024-04-17T19:49:10.671 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-17T19:49:10.673 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-17T19:49:10.713 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-17T19:49:11.007 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-pecan. 2024-04-17T19:49:11.034 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-17T19:49:11.082 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-17T19:49:11.132 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-webtest. 2024-04-17T19:49:11.159 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-17T19:49:11.207 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-17T19:49:11.445 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-certifi. 2024-04-17T19:49:11.472 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-17T19:49:11.510 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-pecan. 2024-04-17T19:49:11.512 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-17T19:49:11.537 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-17T19:49:11.576 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-17T19:49:11.840 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-idna. 2024-04-17T19:49:11.866 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-17T19:49:11.906 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-17T19:49:11.914 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-certifi. 2024-04-17T19:49:11.942 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-17T19:49:11.981 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-17T19:49:12.176 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-urllib3. 2024-04-17T19:49:12.202 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-17T19:49:12.242 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-17T19:49:12.284 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-idna. 2024-04-17T19:49:12.311 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-17T19:49:12.350 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-17T19:49:12.529 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-requests. 2024-04-17T19:49:12.544 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-17T19:49:12.579 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-17T19:49:12.661 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-urllib3. 2024-04-17T19:49:12.689 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-17T19:49:12.728 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-17T19:49:12.865 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-17T19:49:12.891 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-17T19:49:12.931 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-17T19:49:13.048 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-requests. 2024-04-17T19:49:13.075 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-17T19:49:13.114 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-17T19:49:13.218 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-17T19:49:13.233 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3146-gf3a98d3f-1jammy_all.deb ... 2024-04-17T19:49:13.268 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:49:13.426 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-17T19:49:13.453 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-17T19:49:13.492 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-17T19:49:13.631 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-17T19:49:13.658 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:49:13.697 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:49:13.795 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-17T19:49:13.822 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3146-gf3a98d3f-1jammy_all.deb ... 2024-04-17T19:49:13.861 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:49:14.017 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-17T19:49:14.044 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-17T19:49:14.083 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-17T19:49:14.258 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-17T19:49:14.285 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:49:14.324 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:49:14.345 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-openssl. 2024-04-17T19:49:14.371 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-17T19:49:14.403 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-17T19:49:14.644 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-17T19:49:14.671 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-17T19:49:14.710 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-17T19:49:14.739 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-mgr. 2024-04-17T19:49:14.766 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:49:14.806 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-mgr (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:49:14.988 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-openssl. 2024-04-17T19:49:15.015 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-17T19:49:15.046 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-17T19:49:15.192 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-mon. 2024-04-17T19:49:15.219 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:49:15.259 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-mon (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:49:15.399 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-mgr. 2024-04-17T19:49:15.426 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:49:15.465 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-mgr (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:49:15.862 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-osd. 2024-04-17T19:49:15.877 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-mon. 2024-04-17T19:49:15.889 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:49:15.904 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:49:15.928 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-osd (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:49:15.943 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-mon (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:49:16.547 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-osd. 2024-04-17T19:49:16.574 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:49:16.613 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-osd (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:49:17.057 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph. 2024-04-17T19:49:17.084 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../068-ceph_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:49:17.123 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:49:17.470 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-fuse. 2024-04-17T19:49:17.496 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:49:17.536 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-fuse (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:49:17.658 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph. 2024-04-17T19:49:17.671 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../068-ceph_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:49:17.708 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:49:17.906 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-mds. 2024-04-17T19:49:17.933 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:49:17.972 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-mds (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:49:18.027 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-fuse. 2024-04-17T19:49:18.054 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:49:18.093 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-fuse (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:49:18.333 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package cephadm. 2024-04-17T19:49:18.349 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../071-cephadm_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:49:18.383 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking cephadm (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:49:18.530 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-mds. 2024-04-17T19:49:18.557 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:49:18.596 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-mds (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:49:18.694 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-17T19:49:18.721 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-17T19:49:18.761 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-17T19:49:19.017 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package cephadm. 2024-04-17T19:49:19.044 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../071-cephadm_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:49:19.082 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking cephadm (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:49:19.097 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-17T19:49:19.123 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-17T19:49:19.163 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-17T19:49:19.352 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-17T19:49:19.368 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-17T19:49:19.402 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-17T19:49:19.705 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-17T19:49:19.731 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-17T19:49:19.771 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-17T19:49:20.226 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-babel. 2024-04-17T19:49:20.254 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-17T19:49:20.293 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-17T19:49:20.638 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-jinja2. 2024-04-17T19:49:20.665 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-17T19:49:20.704 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-17T19:49:20.836 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-babel. 2024-04-17T19:49:20.864 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-17T19:49:20.903 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-17T19:49:21.065 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-17T19:49:21.093 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3146-gf3a98d3f-1jammy_all.deb ... 2024-04-17T19:49:21.140 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:49:21.423 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-jinja2. 2024-04-17T19:49:21.450 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-17T19:49:21.485 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-17T19:49:21.489 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-17T19:49:21.513 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-17T19:49:21.552 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-17T19:49:21.821 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-routes. 2024-04-17T19:49:21.834 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-17T19:49:21.837 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-17T19:49:21.861 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3146-gf3a98d3f-1jammy_all.deb ... 2024-04-17T19:49:21.871 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-17T19:49:21.900 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:49:22.174 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-17T19:49:22.201 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3146-gf3a98d3f-1jammy_all.deb ... 2024-04-17T19:49:22.241 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:49:22.254 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-17T19:49:22.281 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-17T19:49:22.320 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-17T19:49:22.581 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-routes. 2024-04-17T19:49:22.609 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-17T19:49:22.648 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-17T19:49:22.985 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-17T19:49:23.012 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3146-gf3a98d3f-1jammy_all.deb ... 2024-04-17T19:49:23.051 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:49:23.471 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-17T19:49:23.487 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-17T19:49:23.520 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-17T19:49:23.999 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-joblib. 2024-04-17T19:49:24.026 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-17T19:49:24.065 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-17T19:49:24.281 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-17T19:49:24.297 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-17T19:49:24.339 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-17T19:49:24.402 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-17T19:49:24.429 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-17T19:49:24.546 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-17T19:49:24.835 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-joblib. 2024-04-17T19:49:24.849 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-sklearn. 2024-04-17T19:49:24.862 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-17T19:49:24.875 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-17T19:49:24.893 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-17T19:49:24.960 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-17T19:49:25.239 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-17T19:49:25.265 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-17T19:49:25.398 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-17T19:49:25.710 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-sklearn. 2024-04-17T19:49:25.738 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-17T19:49:25.776 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-17T19:49:25.874 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-17T19:49:25.890 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3146-gf3a98d3f-1jammy_all.deb ... 2024-04-17T19:49:25.924 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:49:26.511 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-17T19:49:26.539 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3146-gf3a98d3f-1jammy_all.deb ... 2024-04-17T19:49:26.577 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:49:26.928 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-cachetools. 2024-04-17T19:49:26.955 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-17T19:49:26.994 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-17T19:49:27.313 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-17T19:49:27.341 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-17T19:49:27.380 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-17T19:49:27.514 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-cachetools. 2024-04-17T19:49:27.542 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-17T19:49:27.580 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-17T19:49:27.717 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-17T19:49:27.745 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-17T19:49:27.783 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-17T19:49:27.850 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-17T19:49:27.878 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-17T19:49:27.917 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-17T19:49:28.103 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-rsa. 2024-04-17T19:49:28.130 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-17T19:49:28.169 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-17T19:49:28.262 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-17T19:49:28.290 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-17T19:49:28.328 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-17T19:49:28.448 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-google-auth. 2024-04-17T19:49:28.475 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-17T19:49:28.506 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-17T19:49:28.615 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-rsa. 2024-04-17T19:49:28.643 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-17T19:49:28.681 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-17T19:49:28.768 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-17T19:49:28.795 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-17T19:49:28.834 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-17T19:49:28.977 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-google-auth. 2024-04-17T19:49:29.005 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-17T19:49:29.043 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-17T19:49:29.146 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-websocket. 2024-04-17T19:49:29.173 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-17T19:49:29.212 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-17T19:49:29.371 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-17T19:49:29.399 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-17T19:49:29.438 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-17T19:49:29.565 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-17T19:49:29.593 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-17T19:49:29.632 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-17T19:49:29.758 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-websocket. 2024-04-17T19:49:29.786 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-17T19:49:29.824 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-17T19:49:30.145 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-17T19:49:30.172 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-17T19:49:30.211 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-17T19:49:30.229 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-17T19:49:30.245 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3146-gf3a98d3f-1jammy_all.deb ... 2024-04-17T19:49:30.278 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:49:30.581 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-17T19:49:30.609 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-17T19:49:30.648 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-17T19:49:31.034 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-17T19:49:31.062 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3146-gf3a98d3f-1jammy_all.deb ... 2024-04-17T19:49:31.091 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:49:31.143 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-17T19:49:31.170 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-17T19:49:31.209 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-17T19:49:31.403 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-17T19:49:31.431 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-17T19:49:31.453 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package jq. 2024-04-17T19:49:31.469 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-17T19:49:31.469 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-17T19:49:31.503 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-17T19:49:31.698 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package socat. 2024-04-17T19:49:31.725 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-17T19:49:31.756 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-17T19:49:32.014 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-17T19:49:32.042 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package xmlstarlet. 2024-04-17T19:49:32.042 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-17T19:49:32.058 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-17T19:49:32.080 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-17T19:49:32.100 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-17T19:49:32.350 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package jq. 2024-04-17T19:49:32.378 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-17T19:49:32.408 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-17T19:49:32.447 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-test. 2024-04-17T19:49:32.474 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:49:32.513 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-test (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:49:32.627 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package socat. 2024-04-17T19:49:32.644 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-17T19:49:32.685 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-17T19:49:33.006 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package xmlstarlet. 2024-04-17T19:49:33.022 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-17T19:49:33.064 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-17T19:49:33.377 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-test. 2024-04-17T19:49:33.393 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:49:33.434 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-test (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:49:34.767 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ceph-volume. 2024-04-17T19:49:34.795 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3146-gf3a98d3f-1jammy_all.deb ... 2024-04-17T19:49:34.825 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ceph-volume (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:49:35.163 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-17T19:49:35.191 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:49:35.221 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking cephfs-mirror (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:49:35.540 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-colorama. 2024-04-17T19:49:35.568 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-17T19:49:35.607 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-17T19:49:35.647 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-volume. 2024-04-17T19:49:35.675 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3146-gf3a98d3f-1jammy_all.deb ... 2024-04-17T19:49:35.722 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-volume (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:49:35.868 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package cephfs-shell. 2024-04-17T19:49:35.884 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3146-gf3a98d3f-1jammy_all.deb ... 2024-04-17T19:49:35.926 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking cephfs-shell (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:49:36.126 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-17T19:49:36.154 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:49:36.186 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package cephfs-top. 2024-04-17T19:49:36.201 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking cephfs-mirror (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:49:36.203 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3146-gf3a98d3f-1jammy_all.deb ... 2024-04-17T19:49:36.245 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking cephfs-top (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:49:36.481 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-17T19:49:36.509 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:49:36.547 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libcephfs-dev (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:49:36.587 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-colorama. 2024-04-17T19:49:36.615 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-17T19:49:36.687 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-17T19:49:36.875 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-17T19:49:36.903 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-17T19:49:36.941 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-17T19:49:37.006 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package cephfs-shell. 2024-04-17T19:49:37.035 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3146-gf3a98d3f-1jammy_all.deb ... 2024-04-17T19:49:37.073 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking cephfs-shell (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:49:37.280 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-17T19:49:37.307 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-17T19:49:37.334 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package cephfs-top. 2024-04-17T19:49:37.346 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-17T19:49:37.351 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3146-gf3a98d3f-1jammy_all.deb ... 2024-04-17T19:49:37.392 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking cephfs-top (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:49:37.628 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-17T19:49:37.645 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:49:37.666 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package nvme-cli. 2024-04-17T19:49:37.686 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libcephfs-dev (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:49:37.694 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-17T19:49:37.733 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-17T19:49:38.056 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-17T19:49:38.084 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-17T19:49:38.130 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-17T19:49:38.138 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package pkg-config. 2024-04-17T19:49:38.165 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-17T19:49:38.204 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-17T19:49:38.452 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-17T19:49:38.465 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-17T19:49:38.480 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-17T19:49:38.481 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-17T19:49:38.518 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-17T19:49:38.523 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-17T19:49:38.881 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package nvme-cli. 2024-04-17T19:49:38.909 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-17T19:49:38.947 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-17T19:49:38.960 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-17T19:49:38.988 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-17T19:49:39.026 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-17T19:49:39.338 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-pastescript. 2024-04-17T19:49:39.365 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-17T19:49:39.378 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package pkg-config. 2024-04-17T19:49:39.404 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-17T19:49:39.406 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-17T19:49:39.444 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-17T19:49:39.680 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-17T19:49:39.701 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-17T19:49:39.733 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-pluggy. 2024-04-17T19:49:39.755 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-17T19:49:39.760 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-17T19:49:39.799 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-17T19:49:40.052 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-psutil. 2024-04-17T19:49:40.068 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-17T19:49:40.101 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-17T19:49:40.159 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-17T19:49:40.187 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-17T19:49:40.225 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-17T19:49:40.528 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-pastescript. 2024-04-17T19:49:40.556 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-17T19:49:40.594 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-17T19:49:40.696 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-py. 2024-04-17T19:49:40.713 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-17T19:49:40.746 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-17T19:49:40.923 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-pluggy. 2024-04-17T19:49:40.951 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-17T19:49:40.989 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-17T19:49:41.024 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-pygments. 2024-04-17T19:49:41.052 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-17T19:49:41.082 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-17T19:49:41.301 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-psutil. 2024-04-17T19:49:41.329 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-17T19:49:41.367 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-17T19:49:41.587 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-17T19:49:41.614 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-17T19:49:41.653 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-17T19:49:41.712 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-py. 2024-04-17T19:49:41.740 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-17T19:49:41.778 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-17T19:49:41.956 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-toml. 2024-04-17T19:49:41.983 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-17T19:49:42.022 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-17T19:49:42.283 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-pytest. 2024-04-17T19:49:42.311 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-17T19:49:42.332 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-pygments. 2024-04-17T19:49:42.341 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-17T19:49:42.360 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-17T19:49:42.398 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-17T19:49:42.678 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package python3-simplejson. 2024-04-17T19:49:42.706 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-17T19:49:42.744 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-17T19:49:42.919 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-17T19:49:42.948 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-17T19:49:42.985 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-17T19:49:43.022 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-17T19:49:43.038 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-17T19:49:43.080 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-17T19:49:43.255 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-toml. 2024-04-17T19:49:43.271 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-17T19:49:43.313 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-17T19:49:43.557 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-pytest. 2024-04-17T19:49:43.571 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-17T19:49:43.615 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-17T19:49:43.810 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package radosgw. 2024-04-17T19:49:43.837 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../122-radosgw_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:49:43.867 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking radosgw (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:49:43.944 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-simplejson. 2024-04-17T19:49:43.961 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-17T19:49:44.002 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-17T19:49:44.246 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-17T19:49:44.263 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-17T19:49:44.296 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-17T19:49:44.796 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package rbd-fuse. 2024-04-17T19:49:44.823 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:49:44.862 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking rbd-fuse (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:49:45.076 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package radosgw. 2024-04-17T19:49:45.104 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../122-radosgw_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:49:45.142 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking radosgw (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:49:45.175 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-17T19:49:45.425 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-17T19:49:45.551 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-17T19:49:45.829 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-17T19:49:46.134 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-17T19:49:46.170 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package rbd-fuse. 2024-04-17T19:49:46.187 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3146-gf3a98d3f-1jammy_amd64.deb ... 2024-04-17T19:49:46.228 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking rbd-fuse (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:49:46.534 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-17T19:49:46.556 INFO:teuthology.orchestra.run.smithi173.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-17T19:49:46.767 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-17T19:49:46.846 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up cephadm (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:49:46.893 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-17T19:49:47.167 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-17T19:49:47.437 INFO:teuthology.orchestra.run.smithi173.stdout:Adding system user cephadm....done 2024-04-17T19:49:47.479 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-17T19:49:47.593 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-17T19:49:47.869 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-17T19:49:47.897 INFO:teuthology.orchestra.run.smithi018.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-17T19:49:47.961 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up cephadm (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:49:48.121 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-17T19:49:48.247 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-17T19:49:48.470 INFO:teuthology.orchestra.run.smithi018.stdout:Adding system user cephadm....done 2024-04-17T19:49:48.489 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-17T19:49:48.593 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-17T19:49:48.732 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-17T19:49:48.858 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-17T19:49:48.869 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-17T19:49:49.121 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-17T19:49:49.160 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-17T19:49:49.271 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-17T19:49:49.520 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-17T19:49:49.531 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-17T19:49:49.782 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-17T19:49:49.788 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-17T19:49:49.892 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-17T19:49:50.048 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-17T19:49:50.193 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-17T19:49:50.290 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-17T19:49:50.525 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-17T19:49:50.595 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-17T19:49:50.776 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-17T19:49:50.863 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-17T19:49:51.094 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-17T19:49:51.131 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-17T19:49:51.399 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-17T19:49:51.454 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-ceph-argparse (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:49:51.643 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-17T19:49:51.713 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-17T19:49:51.847 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-17T19:49:51.919 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-17T19:49:51.957 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-17T19:49:52.186 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-17T19:49:52.191 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-17T19:49:52.292 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-17T19:49:52.504 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-ceph-argparse (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:49:52.543 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-17T19:49:52.797 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-17T19:49:52.912 INFO:teuthology.orchestra.run.smithi173.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-17T19:49:52.915 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-17T19:49:52.940 INFO:teuthology.orchestra.run.smithi173.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-17T19:49:53.005 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-17T19:49:53.015 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-17T19:49:53.122 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-17T19:49:53.258 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-17T19:49:53.359 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-17T19:49:53.456 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-17T19:49:53.557 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-17T19:49:53.619 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-17T19:49:53.817 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-17T19:49:53.984 INFO:teuthology.orchestra.run.smithi018.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-17T19:49:54.017 INFO:teuthology.orchestra.run.smithi018.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-17T19:49:54.080 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-17T19:49:54.118 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-17T19:49:54.190 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-17T19:49:54.436 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up zip (3.0-12build2) ... 2024-04-17T19:49:54.557 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-17T19:49:54.570 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-17T19:49:54.675 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-17T19:49:54.951 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-17T19:49:55.206 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-17T19:49:55.219 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-17T19:49:55.465 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-17T19:49:55.537 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up zip (3.0-12build2) ... 2024-04-17T19:49:55.566 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-17T19:49:55.663 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-17T19:49:55.692 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-17T19:49:55.984 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-17T19:49:56.348 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-17T19:49:56.377 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-17T19:49:56.591 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-17T19:49:56.645 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-17T19:49:56.701 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-17T19:49:56.818 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-17T19:49:57.022 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-17T19:49:57.119 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-17T19:49:57.298 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-17T19:49:57.504 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-17T19:49:57.608 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-17T19:49:57.780 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-17T19:49:57.976 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-17T19:49:58.165 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-17T19:49:58.235 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-17T19:49:58.361 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-ceph-common (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:49:58.466 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-17T19:49:58.654 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-idna (3.3-1) ... 2024-04-17T19:49:58.776 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-17T19:49:58.963 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-17T19:49:59.161 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-17T19:49:59.420 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-17T19:49:59.546 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-ceph-common (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:49:59.856 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-idna (3.3-1) ... 2024-04-17T19:50:00.138 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-17T19:50:00.181 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-17T19:50:00.398 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T19:50:00.507 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-17T19:50:00.767 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-17T19:50:00.893 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-17T19:50:01.019 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-17T19:50:01.320 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-17T19:50:01.337 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-17T19:50:01.580 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-17T19:50:01.606 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T19:50:01.723 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-17T19:50:01.815 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T19:50:01.915 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-17T19:50:01.966 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-17T19:50:02.092 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-17T19:50:02.192 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-17T19:50:02.218 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-17T19:50:02.451 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-17T19:50:02.536 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-17T19:50:02.711 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-17T19:50:02.813 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-17T19:50:02.971 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-17T19:50:03.064 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T19:50:03.181 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-17T19:50:03.230 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-17T19:50:03.466 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-17T19:50:03.473 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-17T19:50:03.574 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-17T19:50:03.719 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-17T19:50:03.851 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-17T19:50:03.977 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-17T19:50:04.012 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-17T19:50:04.269 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-17T19:50:04.271 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-17T19:50:04.539 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-17T19:50:04.571 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-17T19:50:04.832 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-17T19:50:04.838 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-17T19:50:04.933 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-17T19:50:04.956 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-17T19:50:05.057 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-17T19:50:05.156 INFO:teuthology.orchestra.run.smithi173.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-17T19:50:05.192 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-17T19:50:05.318 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-17T19:50:05.401 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-17T19:50:05.527 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-17T19:50:05.620 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-17T19:50:05.921 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-17T19:50:05.946 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-17T19:50:06.197 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-17T19:50:06.205 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-17T19:50:06.315 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-17T19:50:06.331 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-17T19:50:06.440 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-17T19:50:06.514 INFO:teuthology.orchestra.run.smithi018.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-17T19:50:06.549 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T19:50:06.667 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-17T19:50:06.767 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-17T19:50:06.893 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-17T19:50:06.985 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-17T19:50:07.286 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-17T19:50:07.286 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-17T19:50:07.554 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-17T19:50:07.554 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-17T19:50:07.705 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-17T19:50:07.766 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-17T19:50:07.973 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-17T19:50:08.017 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-17T19:50:08.090 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-17T19:50:08.285 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-17T19:50:08.392 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-17T19:50:08.570 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-17T19:50:08.701 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-17T19:50:08.955 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-17T19:50:08.986 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-17T19:50:09.197 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-17T19:50:09.249 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-17T19:50:09.457 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-17T19:50:09.576 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-17T19:50:09.700 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-17T19:50:09.702 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up librados2 (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:09.829 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:09.951 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-17T19:50:09.955 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-17T19:50:10.283 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libcephfs2 (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:10.353 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-17T19:50:10.409 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libradosstriper1 (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:10.535 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-17T19:50:10.663 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-17T19:50:10.837 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up librbd1 (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:10.963 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-mgr-modules-core (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:11.032 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-17T19:50:11.081 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-fuse (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:11.133 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up librados2 (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:11.242 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:11.287 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-17T19:50:11.287 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-17T19:50:11.368 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-17T19:50:11.705 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libcephfs2 (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:11.766 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libcephfs-dev (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:11.831 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libradosstriper1 (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:11.875 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-rados (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:11.948 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-17T19:50:12.001 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up librgw2 (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:12.127 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up cephfs-top (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:12.209 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up librbd1 (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:12.253 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-17T19:50:12.334 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-mgr-modules-core (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:12.461 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-fuse (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:12.683 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-17T19:50:12.683 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-17T19:50:13.363 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libcephfs-dev (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:13.457 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-rbd (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:13.514 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-rados (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:13.567 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up rbd-fuse (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:13.623 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up librgw2 (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:13.693 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-rgw (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:13.724 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up cephfs-top (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:13.819 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up python3-cephfs (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:13.858 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-17T19:50:13.945 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up cephfs-shell (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:14.071 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-common (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:14.572 INFO:teuthology.orchestra.run.smithi173.stdout:Adding group ceph....done 2024-04-17T19:50:14.925 INFO:teuthology.orchestra.run.smithi173.stdout:Adding system user ceph....done 2024-04-17T19:50:15.085 INFO:teuthology.orchestra.run.smithi173.stdout:Setting system user ceph properties....done 2024-04-17T19:50:15.102 INFO:teuthology.orchestra.run.smithi173.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-17T19:50:15.173 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-rbd (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:15.236 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-17T19:50:15.274 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up rbd-fuse (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:15.375 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-rgw (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:15.501 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-cephfs (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:15.548 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-17T19:50:15.627 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up cephfs-shell (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:15.754 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-common (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:15.998 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up cephfs-mirror (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:16.188 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-17T19:50:16.188 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-17T19:50:16.288 INFO:teuthology.orchestra.run.smithi018.stdout:Adding group ceph....done 2024-04-17T19:50:16.642 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-test (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:16.656 INFO:teuthology.orchestra.run.smithi018.stdout:Adding system user ceph....done 2024-04-17T19:50:16.768 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up radosgw (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:16.825 INFO:teuthology.orchestra.run.smithi018.stdout:Setting system user ceph properties....done 2024-04-17T19:50:16.839 INFO:teuthology.orchestra.run.smithi018.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-17T19:50:16.983 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-17T19:50:17.239 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-17T19:50:17.239 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-17T19:50:17.314 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-17T19:50:17.711 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-base (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:17.772 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up cephfs-mirror (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:17.972 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-17T19:50:17.972 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-17T19:50:18.069 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-17T19:50:18.474 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-test (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:18.521 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-mds (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:18.575 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up radosgw (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:18.750 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-17T19:50:18.750 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-17T19:50:19.035 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-17T19:50:19.035 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-17T19:50:19.199 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-mgr (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:19.422 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-17T19:50:19.422 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-17T19:50:19.502 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-base (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:19.873 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-17T19:50:19.908 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-osd (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:20.171 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-17T19:50:20.171 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-17T19:50:20.362 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-mds (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:20.597 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-17T19:50:20.597 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-17T19:50:20.627 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:20.753 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:20.888 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-mon (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:21.080 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-mgr (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:21.082 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-17T19:50:21.082 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-17T19:50:21.295 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-17T19:50:21.295 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-17T19:50:21.522 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-mgr-cephadm (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:21.674 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:21.798 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-osd (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:21.979 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-mgr-dashboard (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:22.068 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-17T19:50:22.069 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-17T19:50:22.105 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ceph-volume (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:22.434 INFO:teuthology.orchestra.run.smithi173.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-17T19:50:22.560 INFO:teuthology.orchestra.run.smithi173.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-17T19:50:22.625 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:22.712 INFO:teuthology.orchestra.run.smithi173.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-17T19:50:22.751 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:22.911 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-mon (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:23.224 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-17T19:50:23.224 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-17T19:50:23.746 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-mgr-cephadm (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:23.755 INFO:teuthology.orchestra.run.smithi173.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-17T19:50:23.889 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:24.006 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-mgr-dashboard (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:24.132 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-volume (19.0.0-3146-gf3a98d3f-1jammy) ... 2024-04-17T19:50:24.414 INFO:teuthology.orchestra.run.smithi173.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-17T19:50:24.417 DEBUG:teuthology.orchestra.run.smithi173:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-17T19:50:24.477 INFO:teuthology.orchestra.run.smithi018.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-17T19:50:24.510 INFO:teuthology.orchestra.run.smithi173.stdout:Reading package lists... 2024-04-17T19:50:24.595 INFO:teuthology.orchestra.run.smithi018.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-17T19:50:24.708 INFO:teuthology.orchestra.run.smithi173.stdout:Building dependency tree... 2024-04-17T19:50:24.709 INFO:teuthology.orchestra.run.smithi173.stdout:Reading state information... 2024-04-17T19:50:24.747 INFO:teuthology.orchestra.run.smithi018.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-17T19:50:24.887 INFO:teuthology.orchestra.run.smithi173.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-17T19:50:24.887 INFO:teuthology.orchestra.run.smithi173.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-17T19:50:24.887 INFO:teuthology.orchestra.run.smithi173.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-17T19:50:24.887 INFO:teuthology.orchestra.run.smithi173.stdout:The following packages were automatically installed and are no longer required: 2024-04-17T19:50:24.887 INFO:teuthology.orchestra.run.smithi173.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-17T19:50:24.887 INFO:teuthology.orchestra.run.smithi173.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-17T19:50:24.887 INFO:teuthology.orchestra.run.smithi173.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-17T19:50:24.887 INFO:teuthology.orchestra.run.smithi173.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-17T19:50:24.887 INFO:teuthology.orchestra.run.smithi173.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-17T19:50:24.887 INFO:teuthology.orchestra.run.smithi173.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-17T19:50:24.888 INFO:teuthology.orchestra.run.smithi173.stdout:The following additional packages will be installed: 2024-04-17T19:50:24.888 INFO:teuthology.orchestra.run.smithi173.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-17T19:50:24.888 INFO:teuthology.orchestra.run.smithi173.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-17T19:50:24.888 INFO:teuthology.orchestra.run.smithi173.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-17T19:50:24.889 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-17T19:50:24.889 INFO:teuthology.orchestra.run.smithi173.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-17T19:50:24.890 INFO:teuthology.orchestra.run.smithi173.stdout:Suggested packages: 2024-04-17T19:50:24.890 INFO:teuthology.orchestra.run.smithi173.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-17T19:50:24.890 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-17T19:50:24.890 INFO:teuthology.orchestra.run.smithi173.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-17T19:50:24.929 INFO:teuthology.orchestra.run.smithi173.stdout:The following NEW packages will be installed: 2024-04-17T19:50:24.929 INFO:teuthology.orchestra.run.smithi173.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-17T19:50:24.929 INFO:teuthology.orchestra.run.smithi173.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-17T19:50:24.930 INFO:teuthology.orchestra.run.smithi173.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-17T19:50:24.930 INFO:teuthology.orchestra.run.smithi173.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-17T19:50:24.930 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-17T19:50:24.930 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-17T19:50:24.931 INFO:teuthology.orchestra.run.smithi173.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-17T19:50:24.931 INFO:teuthology.orchestra.run.smithi173.stdout:The following packages will be upgraded: 2024-04-17T19:50:24.932 INFO:teuthology.orchestra.run.smithi173.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-17T19:50:25.113 INFO:teuthology.orchestra.run.smithi173.stdout:4 upgraded, 39 newly installed, 0 to remove and 298 not upgraded. 2024-04-17T19:50:25.113 INFO:teuthology.orchestra.run.smithi173.stdout:Need to get 55.7 MB of archives. 2024-04-17T19:50:25.113 INFO:teuthology.orchestra.run.smithi173.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-17T19:50:25.113 INFO:teuthology.orchestra.run.smithi173.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-17T19:50:25.439 INFO:teuthology.orchestra.run.smithi018.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-17T19:50:25.743 INFO:teuthology.orchestra.run.smithi173.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-17T19:50:25.760 INFO:teuthology.orchestra.run.smithi173.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-17T19:50:25.885 INFO:teuthology.orchestra.run.smithi173.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-17T19:50:25.886 INFO:teuthology.orchestra.run.smithi173.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-17T19:50:25.887 INFO:teuthology.orchestra.run.smithi173.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-17T19:50:25.916 INFO:teuthology.orchestra.run.smithi173.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-17T19:50:25.917 INFO:teuthology.orchestra.run.smithi173.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-17T19:50:25.921 INFO:teuthology.orchestra.run.smithi173.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-17T19:50:25.923 INFO:teuthology.orchestra.run.smithi173.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-17T19:50:25.924 INFO:teuthology.orchestra.run.smithi173.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-17T19:50:26.091 INFO:teuthology.orchestra.run.smithi173.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-17T19:50:26.126 INFO:teuthology.orchestra.run.smithi018.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-17T19:50:26.129 DEBUG:teuthology.orchestra.run.smithi018:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-17T19:50:26.184 INFO:teuthology.orchestra.run.smithi018.stdout:Reading package lists... 2024-04-17T19:50:26.375 INFO:teuthology.orchestra.run.smithi173.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-17T19:50:26.385 INFO:teuthology.orchestra.run.smithi018.stdout:Building dependency tree... 2024-04-17T19:50:26.385 INFO:teuthology.orchestra.run.smithi173.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-17T19:50:26.386 INFO:teuthology.orchestra.run.smithi018.stdout:Reading state information... 2024-04-17T19:50:26.390 INFO:teuthology.orchestra.run.smithi173.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-17T19:50:26.473 INFO:teuthology.orchestra.run.smithi173.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-17T19:50:26.587 INFO:teuthology.orchestra.run.smithi018.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-17T19:50:26.587 INFO:teuthology.orchestra.run.smithi018.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-17T19:50:26.587 INFO:teuthology.orchestra.run.smithi018.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-17T19:50:26.587 INFO:teuthology.orchestra.run.smithi018.stdout:The following packages were automatically installed and are no longer required: 2024-04-17T19:50:26.587 INFO:teuthology.orchestra.run.smithi018.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-17T19:50:26.587 INFO:teuthology.orchestra.run.smithi018.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-17T19:50:26.587 INFO:teuthology.orchestra.run.smithi018.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-17T19:50:26.588 INFO:teuthology.orchestra.run.smithi018.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-17T19:50:26.588 INFO:teuthology.orchestra.run.smithi018.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-17T19:50:26.588 INFO:teuthology.orchestra.run.smithi018.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-17T19:50:26.589 INFO:teuthology.orchestra.run.smithi018.stdout:The following additional packages will be installed: 2024-04-17T19:50:26.589 INFO:teuthology.orchestra.run.smithi018.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-17T19:50:26.589 INFO:teuthology.orchestra.run.smithi018.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-17T19:50:26.590 INFO:teuthology.orchestra.run.smithi018.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-17T19:50:26.590 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-17T19:50:26.590 INFO:teuthology.orchestra.run.smithi018.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-17T19:50:26.591 INFO:teuthology.orchestra.run.smithi018.stdout:Suggested packages: 2024-04-17T19:50:26.591 INFO:teuthology.orchestra.run.smithi018.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-17T19:50:26.591 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-17T19:50:26.591 INFO:teuthology.orchestra.run.smithi018.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-17T19:50:26.634 INFO:teuthology.orchestra.run.smithi018.stdout:The following NEW packages will be installed: 2024-04-17T19:50:26.635 INFO:teuthology.orchestra.run.smithi018.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-17T19:50:26.635 INFO:teuthology.orchestra.run.smithi018.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-17T19:50:26.635 INFO:teuthology.orchestra.run.smithi018.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-17T19:50:26.635 INFO:teuthology.orchestra.run.smithi018.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-17T19:50:26.635 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-17T19:50:26.636 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-17T19:50:26.636 INFO:teuthology.orchestra.run.smithi018.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-17T19:50:26.637 INFO:teuthology.orchestra.run.smithi018.stdout:The following packages will be upgraded: 2024-04-17T19:50:26.637 INFO:teuthology.orchestra.run.smithi018.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-17T19:50:26.823 INFO:teuthology.orchestra.run.smithi018.stdout:4 upgraded, 39 newly installed, 0 to remove and 298 not upgraded. 2024-04-17T19:50:26.823 INFO:teuthology.orchestra.run.smithi018.stdout:Need to get 55.7 MB of archives. 2024-04-17T19:50:26.823 INFO:teuthology.orchestra.run.smithi018.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-17T19:50:26.823 INFO:teuthology.orchestra.run.smithi018.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-17T19:50:27.539 INFO:teuthology.orchestra.run.smithi173.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-17T19:50:27.543 INFO:teuthology.orchestra.run.smithi173.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-17T19:50:27.543 INFO:teuthology.orchestra.run.smithi173.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-17T19:50:27.549 INFO:teuthology.orchestra.run.smithi173.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-17T19:50:27.549 INFO:teuthology.orchestra.run.smithi173.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-17T19:50:27.559 INFO:teuthology.orchestra.run.smithi173.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-17T19:50:27.731 INFO:teuthology.orchestra.run.smithi173.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-17T19:50:29.465 INFO:teuthology.orchestra.run.smithi018.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-17T19:50:29.777 INFO:teuthology.orchestra.run.smithi173.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-17T19:50:29.785 INFO:teuthology.orchestra.run.smithi173.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-17T19:50:30.255 INFO:teuthology.orchestra.run.smithi018.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-17T19:50:34.852 INFO:teuthology.orchestra.run.smithi173.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-17T19:50:34.878 INFO:teuthology.orchestra.run.smithi173.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-17T19:50:35.301 INFO:teuthology.orchestra.run.smithi018.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-17T19:50:35.378 INFO:teuthology.orchestra.run.smithi018.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-17T19:50:35.480 INFO:teuthology.orchestra.run.smithi018.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-17T19:50:37.514 INFO:teuthology.orchestra.run.smithi018.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-17T19:50:37.664 INFO:teuthology.orchestra.run.smithi018.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-17T19:50:37.849 INFO:teuthology.orchestra.run.smithi173.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-17T19:50:37.876 INFO:teuthology.orchestra.run.smithi018.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-17T19:50:38.082 INFO:teuthology.orchestra.run.smithi018.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-17T19:50:38.169 INFO:teuthology.orchestra.run.smithi018.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-17T19:50:38.526 INFO:teuthology.orchestra.run.smithi018.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-17T19:50:38.821 INFO:teuthology.orchestra.run.smithi018.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-17T19:50:38.829 INFO:teuthology.orchestra.run.smithi018.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-17T19:50:38.834 INFO:teuthology.orchestra.run.smithi018.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-17T19:50:38.919 INFO:teuthology.orchestra.run.smithi018.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-17T19:50:40.139 INFO:teuthology.orchestra.run.smithi018.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-17T19:50:40.144 INFO:teuthology.orchestra.run.smithi018.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-17T19:50:40.144 INFO:teuthology.orchestra.run.smithi018.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-17T19:50:40.151 INFO:teuthology.orchestra.run.smithi018.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-17T19:50:40.151 INFO:teuthology.orchestra.run.smithi018.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-17T19:50:40.362 INFO:teuthology.orchestra.run.smithi018.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-17T19:50:40.999 INFO:teuthology.orchestra.run.smithi018.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-17T19:50:41.600 INFO:teuthology.orchestra.run.smithi018.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-17T19:50:41.600 INFO:teuthology.orchestra.run.smithi018.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-17T19:50:41.780 INFO:teuthology.orchestra.run.smithi018.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-17T19:50:41.781 INFO:teuthology.orchestra.run.smithi018.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-17T19:50:41.819 INFO:teuthology.orchestra.run.smithi018.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-17T19:50:41.881 INFO:teuthology.orchestra.run.smithi018.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-17T19:50:41.889 INFO:teuthology.orchestra.run.smithi018.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-17T19:50:41.890 INFO:teuthology.orchestra.run.smithi018.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-17T19:50:41.891 INFO:teuthology.orchestra.run.smithi018.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-17T19:50:41.893 INFO:teuthology.orchestra.run.smithi018.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-17T19:50:42.103 INFO:teuthology.orchestra.run.smithi018.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-17T19:50:42.516 INFO:teuthology.orchestra.run.smithi018.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-17T19:50:43.345 INFO:teuthology.orchestra.run.smithi173.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-17T19:50:44.003 INFO:teuthology.orchestra.run.smithi173.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-17T19:50:44.051 INFO:teuthology.orchestra.run.smithi173.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-17T19:50:44.080 INFO:teuthology.orchestra.run.smithi173.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-17T19:50:44.179 INFO:teuthology.orchestra.run.smithi173.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-17T19:50:47.280 INFO:teuthology.orchestra.run.smithi173.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-17T19:50:47.328 INFO:teuthology.orchestra.run.smithi018.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-17T19:50:47.329 INFO:teuthology.orchestra.run.smithi018.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-17T19:50:47.329 INFO:teuthology.orchestra.run.smithi018.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-17T19:50:47.330 INFO:teuthology.orchestra.run.smithi018.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-17T19:50:47.331 INFO:teuthology.orchestra.run.smithi018.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-17T19:50:47.331 INFO:teuthology.orchestra.run.smithi018.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-17T19:50:47.483 INFO:teuthology.orchestra.run.smithi018.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-17T19:50:47.487 INFO:teuthology.orchestra.run.smithi018.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-17T19:50:47.825 INFO:teuthology.orchestra.run.smithi173.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-17T19:50:47.914 INFO:teuthology.orchestra.run.smithi018.stdout:Preconfiguring packages ... 2024-04-17T19:50:48.059 INFO:teuthology.orchestra.run.smithi018.stdout:Fetched 55.7 MB in 21s (2,673 kB/s) 2024-04-17T19:50:48.330 INFO:teuthology.orchestra.run.smithi018.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173995 files and directories currently installed.) 2024-04-17T19:50:48.336 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-17T19:50:48.455 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-17T19:50:49.095 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-17T19:50:50.195 INFO:teuthology.orchestra.run.smithi018.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-17T19:50:50.422 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package flex. 2024-04-17T19:50:50.524 INFO:teuthology.orchestra.run.smithi018.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173995 files and directories currently installed.) 2024-04-17T19:50:50.530 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-17T19:50:50.562 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-17T19:50:51.145 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-17T19:50:51.326 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-17T19:50:51.754 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-17T19:50:52.364 INFO:teuthology.orchestra.run.smithi018.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174068 files and directories currently installed.) 2024-04-17T19:50:52.369 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-17T19:50:52.500 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-17T19:50:52.868 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-17T19:50:53.073 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-17T19:50:53.410 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-17T19:50:53.783 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package bison. 2024-04-17T19:50:53.890 INFO:teuthology.orchestra.run.smithi018.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174068 files and directories currently installed.) 2024-04-17T19:50:53.896 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-17T19:50:53.943 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-17T19:50:54.361 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-17T19:50:54.389 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-17T19:50:54.427 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-17T19:50:54.731 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package dump. 2024-04-17T19:50:54.747 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-17T19:50:54.789 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking dump (0.4b47-3) ... 2024-04-17T19:50:55.068 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package indent. 2024-04-17T19:50:55.096 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-17T19:50:55.134 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-17T19:50:55.421 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-17T19:50:55.437 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-17T19:50:55.479 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-17T19:50:55.758 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-17T19:50:55.786 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-17T19:50:55.824 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-17T19:50:56.102 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-17T19:50:56.130 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-17T19:50:56.169 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-17T19:50:56.514 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-17T19:50:56.542 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-17T19:50:56.581 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-17T19:50:56.859 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-17T19:50:56.887 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-17T19:50:56.933 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-17T19:50:57.219 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libjson-perl. 2024-04-17T19:50:57.237 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-17T19:50:57.286 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-17T19:50:57.614 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-17T19:50:57.643 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-17T19:50:57.681 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-17T19:50:59.793 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-17T19:50:59.821 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-17T19:50:59.884 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-17T19:51:00.137 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-17T19:51:00.155 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-17T19:51:00.195 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-17T19:51:00.523 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-17T19:51:00.551 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-17T19:51:00.590 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-17T19:51:00.884 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-17T19:51:00.912 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-17T19:51:00.951 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-17T19:51:01.287 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-17T19:51:01.316 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-17T19:51:01.354 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-17T19:51:01.707 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-17T19:51:01.735 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-17T19:51:01.773 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-17T19:51:02.068 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-17T19:51:02.097 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-17T19:51:02.135 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-17T19:51:02.438 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-17T19:51:02.455 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-17T19:51:02.496 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-17T19:51:02.740 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-17T19:51:02.756 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-17T19:51:02.798 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-17T19:51:03.335 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-17T19:51:03.363 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-17T19:51:03.402 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-17T19:51:03.763 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package modemmanager. 2024-04-17T19:51:03.792 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-17T19:51:03.830 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-17T19:51:04.487 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package network-manager. 2024-04-17T19:51:04.515 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-17T19:51:04.562 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-17T19:51:05.205 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ppp. 2024-04-17T19:51:05.233 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-17T19:51:05.517 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-17T19:51:05.885 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package pptp-linux. 2024-04-17T19:51:05.913 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-17T19:51:05.959 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-17T19:51:06.287 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-17T19:51:06.316 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-17T19:51:06.362 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-17T19:51:06.715 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-17T19:51:06.743 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-17T19:51:06.782 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking postgresql-client-common (238) ... 2024-04-17T19:51:07.085 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-17T19:51:07.113 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-17T19:51:07.151 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-17T19:51:07.757 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package postgresql-common. 2024-04-17T19:51:07.785 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-17T19:51:07.842 INFO:teuthology.orchestra.run.smithi018.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-17T19:51:07.871 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking postgresql-common (238) ... 2024-04-17T19:51:08.339 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package postgresql-14. 2024-04-17T19:51:08.367 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-17T19:51:08.408 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-17T19:51:09.866 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package postgresql. 2024-04-17T19:51:09.884 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-17T19:51:09.916 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking postgresql (14+238) ... 2024-04-17T19:51:10.126 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package postgresql-client. 2024-04-17T19:51:10.143 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-17T19:51:10.184 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking postgresql-client (14+238) ... 2024-04-17T19:51:10.428 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-17T19:51:10.445 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-17T19:51:10.486 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-17T19:51:10.806 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package tcl8.6. 2024-04-17T19:51:10.835 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-17T19:51:10.872 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-17T19:51:11.125 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package tcl. 2024-04-17T19:51:11.154 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-17T19:51:11.188 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-17T19:51:11.511 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package wpasupplicant. 2024-04-17T19:51:11.539 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-17T19:51:11.577 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-17T19:51:11.948 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-17T19:51:11.965 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-17T19:51:12.006 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-17T19:51:12.290 INFO:teuthology.orchestra.run.smithi173.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-17T19:51:12.290 INFO:teuthology.orchestra.run.smithi173.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-17T19:51:12.291 INFO:teuthology.orchestra.run.smithi173.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-17T19:51:12.291 INFO:teuthology.orchestra.run.smithi173.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-17T19:51:12.292 INFO:teuthology.orchestra.run.smithi173.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-17T19:51:12.315 INFO:teuthology.orchestra.run.smithi173.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-17T19:51:12.368 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-17T19:51:12.396 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-17T19:51:12.443 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-17T19:51:12.756 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up postgresql-client-common (238) ... 2024-04-17T19:51:12.965 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-17T19:51:13.091 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-17T19:51:13.192 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-17T19:51:13.293 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-17T19:51:13.402 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-17T19:51:13.528 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-17T19:51:14.086 INFO:teuthology.orchestra.run.smithi018.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-17T19:51:14.151 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-17T19:51:14.504 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-17T19:51:14.504 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-17T19:51:14.525 INFO:teuthology.orchestra.run.smithi173.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-17T19:51:14.556 INFO:teuthology.orchestra.run.smithi173.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-17T19:51:15.012 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-17T19:51:15.085 INFO:teuthology.orchestra.run.smithi173.stdout:Preconfiguring packages ... 2024-04-17T19:51:15.146 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-17T19:51:15.242 INFO:teuthology.orchestra.run.smithi173.stdout:Fetched 55.7 MB in 50s (1,121 kB/s) 2024-04-17T19:51:15.289 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-17T19:51:15.415 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-17T19:51:15.540 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-17T19:51:15.560 INFO:teuthology.orchestra.run.smithi173.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173995 files and directories currently installed.) 2024-04-17T19:51:15.565 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-17T19:51:15.658 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-17T19:51:15.702 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-17T19:51:15.784 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-17T19:51:15.885 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-17T19:51:16.351 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-17T19:51:16.532 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-17T19:51:16.658 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up dump (0.4b47-3) ... 2024-04-17T19:51:16.768 INFO:teuthology.orchestra.run.smithi018.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-17T19:51:16.926 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-17T19:51:17.027 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-17T19:51:17.136 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-17T19:51:17.262 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-17T19:51:17.280 INFO:teuthology.orchestra.run.smithi173.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-17T19:51:17.388 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-17T19:51:17.478 INFO:teuthology.orchestra.run.smithi018.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-17T19:51:17.544 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package flex. 2024-04-17T19:51:17.548 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-17T19:51:17.638 INFO:teuthology.orchestra.run.smithi173.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173995 files and directories currently installed.) 2024-04-17T19:51:17.643 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-17T19:51:17.674 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-17T19:51:17.684 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-17T19:51:17.850 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-17T19:51:17.951 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-17T19:51:18.052 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-17T19:51:18.203 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up postgresql-client (14+238) ... 2024-04-17T19:51:18.218 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-17T19:51:18.338 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-17T19:51:18.382 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-17T19:51:18.802 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-17T19:51:18.838 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:51:18.838 INFO:teuthology.orchestra.run.smithi018.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-17T19:51:18.838 INFO:teuthology.orchestra.run.smithi018.stdout:which means they are currently configured by ifupdown: 2024-04-17T19:51:18.838 INFO:teuthology.orchestra.run.smithi018.stdout:- ens1f0 2024-04-17T19:51:18.838 INFO:teuthology.orchestra.run.smithi018.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-17T19:51:18.838 INFO:teuthology.orchestra.run.smithi018.stdout:remove their configuration from /etc/network/interfaces. 2024-04-17T19:51:18.838 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:51:18.977 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-17T19:51:19.322 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-17T19:51:19.329 INFO:teuthology.orchestra.run.smithi173.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174068 files and directories currently installed.) 2024-04-17T19:51:19.335 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-17T19:51:19.465 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-17T19:51:19.644 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-17T19:51:19.859 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-17T19:51:20.006 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-17T19:51:20.174 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-17T19:51:20.325 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-17T19:51:20.358 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-17T19:51:20.691 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package bison. 2024-04-17T19:51:20.787 INFO:teuthology.orchestra.run.smithi173.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174068 files and directories currently installed.) 2024-04-17T19:51:20.793 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-17T19:51:20.835 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-17T19:51:20.843 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-17T19:51:20.943 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up postgresql-common (238) ... 2024-04-17T19:51:21.161 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-17T19:51:21.188 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-17T19:51:21.219 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-17T19:51:21.547 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package dump. 2024-04-17T19:51:21.575 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-17T19:51:21.614 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking dump (0.4b47-3) ... 2024-04-17T19:51:21.825 INFO:teuthology.orchestra.run.smithi018.stdout:Adding user postgres to group ssl-cert 2024-04-17T19:51:21.893 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package indent. 2024-04-17T19:51:21.909 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-17T19:51:21.951 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-17T19:51:22.077 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:51:22.077 INFO:teuthology.orchestra.run.smithi018.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-17T19:51:22.196 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-17T19:51:22.224 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-17T19:51:22.251 INFO:teuthology.orchestra.run.smithi018.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-17T19:51:22.251 INFO:teuthology.orchestra.run.smithi018.stdout:Removing obsolete dictionary files: 2024-04-17T19:51:22.254 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-17T19:51:22.584 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-17T19:51:22.611 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-17T19:51:22.650 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-17T19:51:22.810 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-17T19:51:22.955 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-17T19:51:22.983 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-17T19:51:23.037 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-17T19:51:23.195 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-17T19:51:23.324 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-17T19:51:23.352 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-17T19:51:23.390 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-17T19:51:23.532 INFO:teuthology.orchestra.run.smithi018.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-17T19:51:23.549 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-17T19:51:23.605 INFO:teuthology.orchestra.run.smithi018.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-17T19:51:23.605 INFO:teuthology.orchestra.run.smithi018.stdout:This user must also own the server process. 2024-04-17T19:51:23.606 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:51:23.606 INFO:teuthology.orchestra.run.smithi018.stdout:The database cluster will be initialized with locale "en_US". 2024-04-17T19:51:23.606 INFO:teuthology.orchestra.run.smithi018.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-17T19:51:23.606 INFO:teuthology.orchestra.run.smithi018.stdout:The default text search configuration will be set to "english". 2024-04-17T19:51:23.606 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:51:23.606 INFO:teuthology.orchestra.run.smithi018.stdout:Data page checksums are disabled. 2024-04-17T19:51:23.606 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:51:23.606 INFO:teuthology.orchestra.run.smithi018.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-17T19:51:23.606 INFO:teuthology.orchestra.run.smithi018.stdout:creating subdirectories ... ok 2024-04-17T19:51:23.607 INFO:teuthology.orchestra.run.smithi018.stdout:selecting dynamic shared memory implementation ... posix 2024-04-17T19:51:23.622 INFO:teuthology.orchestra.run.smithi018.stdout:selecting default max_connections ... 100 2024-04-17T19:51:23.642 INFO:teuthology.orchestra.run.smithi018.stdout:selecting default shared_buffers ... 128MB 2024-04-17T19:51:23.643 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-17T19:51:23.649 INFO:teuthology.orchestra.run.smithi018.stdout:selecting default time zone ... Etc/UTC 2024-04-17T19:51:23.650 INFO:teuthology.orchestra.run.smithi018.stdout:creating configuration files ... ok 2024-04-17T19:51:23.659 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-17T19:51:23.718 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-17T19:51:23.765 INFO:teuthology.orchestra.run.smithi018.stdout:running bootstrap script ... ok 2024-04-17T19:51:23.988 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libjson-perl. 2024-04-17T19:51:24.004 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-17T19:51:24.046 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-17T19:51:24.299 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-17T19:51:24.324 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-17T19:51:24.366 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-17T19:51:24.425 INFO:teuthology.orchestra.run.smithi018.stdout:performing post-bootstrap initialization ... ok 2024-04-17T19:51:25.093 INFO:teuthology.orchestra.run.smithi018.stdout:syncing data to disk ... ok 2024-04-17T19:51:25.493 INFO:teuthology.orchestra.run.smithi018.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-17T19:51:26.078 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-17T19:51:26.106 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-17T19:51:26.144 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-17T19:51:26.415 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-17T19:51:26.442 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-17T19:51:26.481 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-17T19:51:26.842 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-17T19:51:26.870 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-17T19:51:26.917 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-17T19:51:27.312 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-17T19:51:27.340 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-17T19:51:27.379 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-17T19:51:27.690 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-17T19:51:27.718 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-17T19:51:27.757 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-17T19:51:28.177 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-17T19:51:28.204 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-17T19:51:28.251 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-17T19:51:28.259 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-17T19:51:28.385 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-17T19:51:28.486 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up postgresql (14+238) ... 2024-04-17T19:51:28.587 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-17T19:51:28.630 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-17T19:51:28.658 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-17T19:51:28.696 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-17T19:51:28.705 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-17T19:51:28.967 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-17T19:51:28.967 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-17T19:51:28.983 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-17T19:51:28.999 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-17T19:51:29.041 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-17T19:51:29.319 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-17T19:51:29.346 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-17T19:51:29.394 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-17T19:51:29.516 INFO:teuthology.orchestra.run.smithi018.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-17T19:51:29.608 INFO:teuthology.orchestra.run.smithi018.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-17T19:51:29.923 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-17T19:51:29.943 INFO:teuthology.orchestra.run.smithi018.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-17T19:51:29.951 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-17T19:51:29.989 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-17T19:51:30.087 INFO:teuthology.orchestra.run.smithi018.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-17T19:51:30.335 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package modemmanager. 2024-04-17T19:51:30.372 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-17T19:51:30.401 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-17T19:51:31.034 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package network-manager. 2024-04-17T19:51:31.061 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-17T19:51:31.108 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-17T19:51:31.691 INFO:teuthology.orchestra.run.smithi018.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-17T19:51:31.751 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package ppp. 2024-04-17T19:51:31.778 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-17T19:51:31.798 INFO:teuthology.orchestra.run.smithi018.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-17T19:51:32.048 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-17T19:51:32.306 INFO:teuthology.orchestra.run.smithi018.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-17T19:51:32.313 DEBUG:teuthology.parallel:result is None 2024-04-17T19:51:32.416 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package pptp-linux. 2024-04-17T19:51:32.432 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-17T19:51:32.474 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-17T19:51:32.726 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-17T19:51:32.754 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-17T19:51:32.793 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-17T19:51:33.096 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-17T19:51:33.124 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-17T19:51:33.162 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking postgresql-client-common (238) ... 2024-04-17T19:51:33.442 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-17T19:51:33.470 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-17T19:51:33.508 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-17T19:51:34.121 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package postgresql-common. 2024-04-17T19:51:34.149 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-17T19:51:34.205 INFO:teuthology.orchestra.run.smithi173.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-17T19:51:34.235 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking postgresql-common (238) ... 2024-04-17T19:51:34.703 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package postgresql-14. 2024-04-17T19:51:34.731 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-17T19:51:34.772 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-17T19:51:36.173 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package postgresql. 2024-04-17T19:51:36.202 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-17T19:51:36.239 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking postgresql (14+238) ... 2024-04-17T19:51:36.466 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package postgresql-client. 2024-04-17T19:51:36.483 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-17T19:51:36.516 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking postgresql-client (14+238) ... 2024-04-17T19:51:36.760 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-17T19:51:36.776 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-17T19:51:36.818 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-17T19:51:37.138 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package tcl8.6. 2024-04-17T19:51:37.165 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-17T19:51:37.204 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-17T19:51:37.490 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package tcl. 2024-04-17T19:51:37.518 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-17T19:51:37.562 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-17T19:51:37.868 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package wpasupplicant. 2024-04-17T19:51:37.896 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-17T19:51:37.934 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-17T19:51:38.289 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-17T19:51:38.305 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-17T19:51:38.355 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-17T19:51:38.717 INFO:teuthology.orchestra.run.smithi173.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-17T19:51:38.745 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-17T19:51:38.791 INFO:teuthology.orchestra.run.smithi173.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-17T19:51:39.071 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up postgresql-client-common (238) ... 2024-04-17T19:51:39.581 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-17T19:51:39.707 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-17T19:51:39.833 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-17T19:51:39.942 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-17T19:51:40.051 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-17T19:51:40.161 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-17T19:51:40.650 INFO:teuthology.orchestra.run.smithi173.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-17T19:51:40.725 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-17T19:51:41.070 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-17T19:51:41.070 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-17T19:51:41.519 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-17T19:51:41.645 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-17T19:51:41.771 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-17T19:51:41.906 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-17T19:51:42.032 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-17T19:51:42.157 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-17T19:51:42.283 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-17T19:51:42.393 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-17T19:51:43.023 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-17T19:51:43.149 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up dump (0.4b47-3) ... 2024-04-17T19:51:43.243 INFO:teuthology.orchestra.run.smithi173.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-17T19:51:43.309 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-17T19:51:43.435 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-17T19:51:43.561 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-17T19:51:43.687 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-17T19:51:43.813 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-17T19:51:43.902 INFO:teuthology.orchestra.run.smithi173.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-17T19:51:43.964 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-17T19:51:44.090 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-17T19:51:44.266 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-17T19:51:44.393 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-17T19:51:44.527 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-17T19:51:44.662 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up postgresql-client (14+238) ... 2024-04-17T19:51:44.787 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-17T19:51:45.266 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-17T19:51:45.266 INFO:teuthology.orchestra.run.smithi173.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-17T19:51:45.266 INFO:teuthology.orchestra.run.smithi173.stdout:which means they are currently configured by ifupdown: 2024-04-17T19:51:45.266 INFO:teuthology.orchestra.run.smithi173.stdout:- enp3s0f1 2024-04-17T19:51:45.267 INFO:teuthology.orchestra.run.smithi173.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-17T19:51:45.267 INFO:teuthology.orchestra.run.smithi173.stdout:remove their configuration from /etc/network/interfaces. 2024-04-17T19:51:45.267 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-17T19:51:45.396 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-17T19:51:45.736 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-17T19:51:46.056 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-17T19:51:46.532 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-17T19:51:46.658 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-17T19:51:46.785 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-17T19:51:46.911 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up postgresql-common (238) ... 2024-04-17T19:51:47.825 INFO:teuthology.orchestra.run.smithi173.stdout:Adding user postgres to group ssl-cert 2024-04-17T19:51:48.042 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-17T19:51:48.042 INFO:teuthology.orchestra.run.smithi173.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-17T19:51:48.244 INFO:teuthology.orchestra.run.smithi173.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-17T19:51:48.244 INFO:teuthology.orchestra.run.smithi173.stdout:Removing obsolete dictionary files: 2024-04-17T19:51:48.774 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-17T19:51:49.162 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-17T19:51:49.503 INFO:teuthology.orchestra.run.smithi173.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-17T19:51:49.517 INFO:teuthology.orchestra.run.smithi173.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-17T19:51:49.560 INFO:teuthology.orchestra.run.smithi173.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-17T19:51:49.560 INFO:teuthology.orchestra.run.smithi173.stdout:This user must also own the server process. 2024-04-17T19:51:49.560 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-17T19:51:49.560 INFO:teuthology.orchestra.run.smithi173.stdout:The database cluster will be initialized with locale "en_US". 2024-04-17T19:51:49.560 INFO:teuthology.orchestra.run.smithi173.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-17T19:51:49.560 INFO:teuthology.orchestra.run.smithi173.stdout:The default text search configuration will be set to "english". 2024-04-17T19:51:49.560 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-17T19:51:49.560 INFO:teuthology.orchestra.run.smithi173.stdout:Data page checksums are disabled. 2024-04-17T19:51:49.561 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-17T19:51:49.561 INFO:teuthology.orchestra.run.smithi173.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-17T19:51:49.561 INFO:teuthology.orchestra.run.smithi173.stdout:creating subdirectories ... ok 2024-04-17T19:51:49.561 INFO:teuthology.orchestra.run.smithi173.stdout:selecting dynamic shared memory implementation ... posix 2024-04-17T19:51:49.573 INFO:teuthology.orchestra.run.smithi173.stdout:selecting default max_connections ... 100 2024-04-17T19:51:49.591 INFO:teuthology.orchestra.run.smithi173.stdout:selecting default shared_buffers ... 128MB 2024-04-17T19:51:49.601 INFO:teuthology.orchestra.run.smithi173.stdout:selecting default time zone ... Etc/UTC 2024-04-17T19:51:49.601 INFO:teuthology.orchestra.run.smithi173.stdout:creating configuration files ... ok 2024-04-17T19:51:49.717 INFO:teuthology.orchestra.run.smithi173.stdout:running bootstrap script ... ok 2024-04-17T19:51:50.347 INFO:teuthology.orchestra.run.smithi173.stdout:performing post-bootstrap initialization ... ok 2024-04-17T19:51:51.017 INFO:teuthology.orchestra.run.smithi173.stdout:syncing data to disk ... ok 2024-04-17T19:51:51.401 INFO:teuthology.orchestra.run.smithi173.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-17T19:51:54.152 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-17T19:51:54.278 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-17T19:51:54.404 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up postgresql (14+238) ... 2024-04-17T19:51:54.530 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-17T19:51:54.665 INFO:teuthology.orchestra.run.smithi173.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-17T19:51:54.919 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-17T19:51:54.919 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-17T19:51:55.450 INFO:teuthology.orchestra.run.smithi173.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-17T19:51:55.534 INFO:teuthology.orchestra.run.smithi173.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-17T19:51:55.845 INFO:teuthology.orchestra.run.smithi173.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-17T19:51:56.005 INFO:teuthology.orchestra.run.smithi173.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-17T19:51:57.366 INFO:teuthology.orchestra.run.smithi173.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-17T19:51:57.466 INFO:teuthology.orchestra.run.smithi173.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-17T19:51:57.960 INFO:teuthology.orchestra.run.smithi173.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-17T19:51:57.965 DEBUG:teuthology.parallel:result is None 2024-04-17T19:51:57.965 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=f3a98d3f110319c567ec86bf70955c141495ccf6 2024-04-17T19:51:58.298 DEBUG:teuthology.orchestra.run.smithi018:> dpkg-query -W -f '${Version}' ceph 2024-04-17T19:51:58.319 INFO:teuthology.orchestra.run.smithi018.stdout:19.0.0-3146-gf3a98d3f-1jammy 2024-04-17T19:51:58.319 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3146-gf3a98d3f-1jammy 2024-04-17T19:51:58.319 INFO:teuthology.task.install:The correct ceph version 19.0.0-3146-gf3a98d3f-1jammy is installed. 2024-04-17T19:51:58.321 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=f3a98d3f110319c567ec86bf70955c141495ccf6 2024-04-17T19:51:58.605 DEBUG:teuthology.orchestra.run.smithi173:> dpkg-query -W -f '${Version}' ceph 2024-04-17T19:51:58.624 INFO:teuthology.orchestra.run.smithi173.stdout:19.0.0-3146-gf3a98d3f-1jammy 2024-04-17T19:51:58.624 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3146-gf3a98d3f-1jammy 2024-04-17T19:51:58.625 INFO:teuthology.task.install:The correct ceph version 19.0.0-3146-gf3a98d3f-1jammy is installed. 2024-04-17T19:51:58.626 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-17T19:51:58.626 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-17T19:51:58.627 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-17T19:51:58.641 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-17T19:51:58.641 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-17T19:51:58.682 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-17T19:51:58.682 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-17T19:51:58.682 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/usr/bin/daemon-helper 2024-04-17T19:51:58.697 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-17T19:51:58.752 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-17T19:51:58.753 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/usr/bin/daemon-helper 2024-04-17T19:51:58.765 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-17T19:51:58.819 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-17T19:51:58.819 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-17T19:51:58.819 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-17T19:51:58.833 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-17T19:51:58.888 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-17T19:51:58.888 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-17T19:51:58.902 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-17T19:51:58.955 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-17T19:51:58.955 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-17T19:51:58.955 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/usr/bin/stdin-killer 2024-04-17T19:51:58.968 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-17T19:51:59.024 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-17T19:51:59.024 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/usr/bin/stdin-killer 2024-04-17T19:51:59.036 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-17T19:51:59.091 INFO:teuthology.run_tasks:Running task ceph... 2024-04-17T19:51:59.172 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-17T19:51:59.173 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 777 /var/log/ceph 2024-04-17T19:51:59.175 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 777 /var/log/ceph 2024-04-17T19:51:59.188 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-17T19:51:59.188 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-17T19:51:59.234 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-17T19:51:59.246 INFO:tasks.ceph:Creating extra log directories... 2024-04-17T19:51:59.246 DEBUG:teuthology.orchestra.run.smithi018:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-17T19:51:59.290 DEBUG:teuthology.orchestra.run.smithi173:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-17T19:51:59.308 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-17T19:51:59.308 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-17T19:51:59.308 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-17T19:51:59.308 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-17T19:51:59.309 DEBUG:teuthology.orchestra.run.smithi018:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-17T19:51:59.349 DEBUG:teuthology.orchestra.run.smithi018:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-17T19:51:59.425 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-17T19:51:59.425 DEBUG:teuthology.orchestra.run.smithi173:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-17T19:51:59.431 DEBUG:teuthology.orchestra.run.smithi173:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-17T19:51:59.514 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-17T19:51:59.514 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-17T19:51:59.514 INFO:tasks.ceph:ctx.config {'-mds_creation_failure': [{'workunit': {'clients': {'all': ['fs/misc/trivial_sync.sh']}}}], 'archive_path': '/home/teuthworker/archive/pdonnell-2024-04-17_17:06:06-fs-wip-pdonnell-testing-20240417.021458-debug-distro-default-smithi/7660584', 'branch': 'wip-pdonnell-testing-20240417.021458-debug', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/mds_creation_retry}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7660584', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'pdonnell-2024-04-17_17:06:06-fs-wip-pdonnell-testing-20240417.021458-debug-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20240417.021458-debug'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': 'f3a98d3f110319c567ec86bf70955c141495ccf6'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'f3a98d3f110319c567ec86bf70955c141495ccf6'}}, 'subvolume_version': 1, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20240417.021458-debug', 'sha1': 'f3a98d3f110319c567ec86bf70955c141495ccf6'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 80, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 4494, 'sha1': 'f3a98d3f110319c567ec86bf70955c141495ccf6', 'sleep_before_teardown': 0, 'subset': '496/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20240417.021458-debug', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_f3a98d3f110319c567ec86bf70955c141495ccf6/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'f3a98d3f110319c567ec86bf70955c141495ccf6', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi018.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDh5kEc2zS1ZRggRbLPcFuwkQqj3DnLuCu1P1YrnNPz1+lhRW72pshOVBz5u2MiU83+1QuogDToLrG/a1rOrD08=', 'smithi173.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAmYi2nGk2H6Y33Nu+FL7jQzpRgEP2bQWs2ya5yLaNDQHs8Et/xbY7W1pDwe5paWCUA9bi6dZmI+EEPWT9wqA1c='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'f3a98d3f110319c567ec86bf70955c141495ccf6'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': 'f3a98d3f110319c567ec86bf70955c141495ccf6', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '6c637841c215537a4502385240412f1966e0faab', 'timestamp': '2024-04-17_17:06:06', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-17T19:51:59.515 DEBUG:teuthology.orchestra.run.smithi018:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-17T19:51:59.518 DEBUG:teuthology.orchestra.run.smithi173:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-17T19:51:59.553 DEBUG:teuthology.orchestra.run.smithi018:> sudo install -d -m0777 -- /var/run/ceph 2024-04-17T19:51:59.566 DEBUG:teuthology.orchestra.run.smithi173:> sudo install -d -m0777 -- /var/run/ceph 2024-04-17T19:51:59.609 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-17T19:51:59.609 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/scratch_devs of=/dev/stdout 2024-04-17T19:51:59.625 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-17T19:51:59.625 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_1 2024-04-17T19:51:59.673 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-17T19:51:59.673 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-17T19:51:59.673 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 5h/5d Inode: 874 Links: 1 2024-04-17T19:51:59.673 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T19:51:59.674 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-04-17 19:45:08.937511106 +0000 2024-04-17T19:51:59.674 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-04-17 19:45:08.677513429 +0000 2024-04-17T19:51:59.674 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-04-17 19:45:08.677513429 +0000 2024-04-17T19:51:59.674 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: - 2024-04-17T19:51:59.674 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-17T19:51:59.727 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-04-17T19:51:59.727 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-04-17T19:51:59.727 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000311138 s, 1.6 MB/s 2024-04-17T19:51:59.729 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-17T19:51:59.778 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_2 2024-04-17T19:51:59.824 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-17T19:51:59.825 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-17T19:51:59.825 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 5h/5d Inode: 893 Links: 1 2024-04-17T19:51:59.825 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T19:51:59.825 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-04-17 19:45:09.153509177 +0000 2024-04-17T19:51:59.825 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-04-17 19:45:09.149509213 +0000 2024-04-17T19:51:59.825 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-04-17 19:45:09.149509213 +0000 2024-04-17T19:51:59.825 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: - 2024-04-17T19:51:59.825 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-17T19:51:59.880 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-04-17T19:51:59.880 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-04-17T19:51:59.880 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000300082 s, 1.7 MB/s 2024-04-17T19:51:59.881 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-17T19:51:59.930 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_3 2024-04-17T19:51:59.977 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-17T19:51:59.977 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-17T19:51:59.977 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 5h/5d Inode: 909 Links: 1 2024-04-17T19:51:59.977 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T19:51:59.977 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-04-17 19:45:09.621504997 +0000 2024-04-17T19:51:59.978 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-04-17 19:45:09.617505033 +0000 2024-04-17T19:51:59.978 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-04-17 19:45:09.617505033 +0000 2024-04-17T19:51:59.978 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: - 2024-04-17T19:51:59.978 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-17T19:52:00.034 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-04-17T19:52:00.034 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-04-17T19:52:00.034 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000307665 s, 1.7 MB/s 2024-04-17T19:52:00.035 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-17T19:52:00.082 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_4 2024-04-17T19:52:00.129 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-17T19:52:00.129 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-17T19:52:00.129 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 5h/5d Inode: 929 Links: 1 2024-04-17T19:52:00.129 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T19:52:00.129 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-04-17 19:45:10.121500530 +0000 2024-04-17T19:52:00.129 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-04-17 19:45:10.117500566 +0000 2024-04-17T19:52:00.130 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-04-17 19:45:10.117500566 +0000 2024-04-17T19:52:00.130 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: - 2024-04-17T19:52:00.130 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-17T19:52:00.184 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-04-17T19:52:00.184 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-04-17T19:52:00.184 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000299406 s, 1.7 MB/s 2024-04-17T19:52:00.185 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-17T19:52:00.234 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-17T19:52:00.235 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-17T19:52:00.235 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/scratch_devs of=/dev/stdout 2024-04-17T19:52:00.240 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-17T19:52:00.241 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_1 2024-04-17T19:52:00.289 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-17T19:52:00.289 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-17T19:52:00.289 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 5h/5d Inode: 877 Links: 1 2024-04-17T19:52:00.289 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T19:52:00.289 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2024-04-17 19:45:07.106017139 +0000 2024-04-17T19:52:00.289 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2024-04-17 19:45:06.846019461 +0000 2024-04-17T19:52:00.289 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2024-04-17 19:45:06.846019461 +0000 2024-04-17T19:52:00.289 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: - 2024-04-17T19:52:00.289 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-17T19:52:00.343 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-17T19:52:00.343 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-17T19:52:00.343 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000439982 s, 1.2 MB/s 2024-04-17T19:52:00.345 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-17T19:52:00.393 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_2 2024-04-17T19:52:00.440 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-17T19:52:00.440 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-17T19:52:00.440 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 5h/5d Inode: 894 Links: 1 2024-04-17T19:52:00.440 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T19:52:00.441 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2024-04-17 19:45:07.598012743 +0000 2024-04-17T19:52:00.441 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2024-04-17 19:45:07.338015067 +0000 2024-04-17T19:52:00.441 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2024-04-17 19:45:07.338015067 +0000 2024-04-17T19:52:00.441 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: - 2024-04-17T19:52:00.441 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-17T19:52:00.494 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-17T19:52:00.494 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-17T19:52:00.494 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000354814 s, 1.4 MB/s 2024-04-17T19:52:00.495 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-17T19:52:00.542 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_3 2024-04-17T19:52:00.588 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-17T19:52:00.588 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-17T19:52:00.588 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 5h/5d Inode: 910 Links: 1 2024-04-17T19:52:00.588 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T19:52:00.588 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2024-04-17 19:45:08.106008206 +0000 2024-04-17T19:52:00.588 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2024-04-17 19:45:07.838010601 +0000 2024-04-17T19:52:00.589 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2024-04-17 19:45:07.838010601 +0000 2024-04-17T19:52:00.589 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: - 2024-04-17T19:52:00.589 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-17T19:52:00.642 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-17T19:52:00.642 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-17T19:52:00.642 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000333809 s, 1.5 MB/s 2024-04-17T19:52:00.644 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-17T19:52:00.694 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_4 2024-04-17T19:52:00.740 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-17T19:52:00.741 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-17T19:52:00.741 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 5h/5d Inode: 927 Links: 1 2024-04-17T19:52:00.741 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-17T19:52:00.741 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2024-04-17 19:45:08.590003883 +0000 2024-04-17T19:52:00.741 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2024-04-17 19:45:08.330006206 +0000 2024-04-17T19:52:00.741 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2024-04-17 19:45:08.330006206 +0000 2024-04-17T19:52:00.741 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: - 2024-04-17T19:52:00.741 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-17T19:52:00.795 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-04-17T19:52:00.795 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-04-17T19:52:00.795 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000381204 s, 1.3 MB/s 2024-04-17T19:52:00.796 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-17T19:52:00.846 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-17T19:52:00.846 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi018.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi173.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-17T19:52:00.846 INFO:tasks.ceph:Generating config... 2024-04-17T19:52:00.847 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-17T19:52:00.847 INFO:tasks.ceph:[client] debug client = 20 2024-04-17T19:52:00.847 INFO:tasks.ceph:[client] debug ms = 1 2024-04-17T19:52:00.847 INFO:tasks.ceph:[client] pid file = 2024-04-17T19:52:00.847 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-17T19:52:00.848 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-17T19:52:00.848 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-17T19:52:00.848 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-17T19:52:00.848 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-17T19:52:00.848 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-17T19:52:00.848 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-17T19:52:00.848 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-17T19:52:00.848 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-17T19:52:00.848 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-17T19:52:00.848 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-17T19:52:00.848 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-17T19:52:00.848 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-17T19:52:00.848 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-17T19:52:00.848 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-17T19:52:00.848 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-17T19:52:00.849 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-17T19:52:00.849 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-17T19:52:00.849 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-17T19:52:00.849 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-17T19:52:00.849 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-17T19:52:00.849 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-17T19:52:00.849 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-04-17T19:52:00.849 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-17T19:52:00.849 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-17T19:52:00.849 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-17T19:52:00.849 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-17T19:52:00.849 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-17T19:52:00.849 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-17T19:52:00.849 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-17T19:52:00.849 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-17T19:52:00.849 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-17T19:52:00.850 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-17T19:52:00.850 INFO:tasks.ceph:Setting up mon.a... 2024-04-17T19:52:00.850 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-17T19:52:00.916 INFO:teuthology.orchestra.run.smithi018.stdout:creating /etc/ceph/ceph.keyring 2024-04-17T19:52:00.934 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-17T19:52:00.996 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-17T19:52:01.007 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.18'), ('mon.b', '172.21.15.173'), ('mon.c', '[v2:172.21.15.173:3301,v1:172.21.15.173:6790]')] 2024-04-17T19:52:01.008 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.18,172.21.15.173,[v2:172.21.15.173:3301,v1:172.21.15.173:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-17T19:52:01.008 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-17T19:52:01.009 DEBUG:teuthology.orchestra.run.smithi018:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-17T19:52:01.052 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.18 --add b 172.21.15.173 --addv c '[v2:172.21.15.173:3301,v1:172.21.15.173:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-17T19:52:01.170 INFO:teuthology.orchestra.run.smithi018.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-17T19:52:01.170 INFO:teuthology.orchestra.run.smithi018.stdout:monmaptool: generated fsid dd480169-5a81-4623-be5f-0499aa244b28 2024-04-17T19:52:01.170 INFO:teuthology.orchestra.run.smithi018.stdout:setting min_mon_release = quincy 2024-04-17T19:52:01.170 INFO:teuthology.orchestra.run.smithi018.stdout:epoch 0 2024-04-17T19:52:01.170 INFO:teuthology.orchestra.run.smithi018.stdout:fsid dd480169-5a81-4623-be5f-0499aa244b28 2024-04-17T19:52:01.170 INFO:teuthology.orchestra.run.smithi018.stdout:last_changed 2024-04-17T19:52:01.181216+0000 2024-04-17T19:52:01.170 INFO:teuthology.orchestra.run.smithi018.stdout:created 2024-04-17T19:52:01.181216+0000 2024-04-17T19:52:01.170 INFO:teuthology.orchestra.run.smithi018.stdout:min_mon_release 17 (quincy) 2024-04-17T19:52:01.170 INFO:teuthology.orchestra.run.smithi018.stdout:election_strategy: 1 2024-04-17T19:52:01.170 INFO:teuthology.orchestra.run.smithi018.stdout:0: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.a 2024-04-17T19:52:01.171 INFO:teuthology.orchestra.run.smithi018.stdout:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-04-17T19:52:01.171 INFO:teuthology.orchestra.run.smithi018.stdout:2: [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] mon.c 2024-04-17T19:52:01.171 INFO:teuthology.orchestra.run.smithi018.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-17T19:52:01.175 DEBUG:teuthology.orchestra.run.smithi018:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-17T19:52:01.181 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID dd480169-5a81-4623-be5f-0499aa244b28... 2024-04-17T19:52:01.181 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-17T19:52:01.225 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-17T19:52:01.251 INFO:teuthology.orchestra.run.smithi018.stdout:[global] 2024-04-17T19:52:01.251 INFO:teuthology.orchestra.run.smithi018.stdout: chdir = "" 2024-04-17T19:52:01.251 INFO:teuthology.orchestra.run.smithi018.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-17T19:52:01.251 INFO:teuthology.orchestra.run.smithi018.stdout: auth supported = cephx 2024-04-17T19:52:01.251 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:52:01.251 INFO:teuthology.orchestra.run.smithi018.stdout: filestore xattr use omap = true 2024-04-17T19:52:01.251 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:52:01.251 INFO:teuthology.orchestra.run.smithi018.stdout: mon clock drift allowed = 1.000 2024-04-17T19:52:01.251 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:52:01.251 INFO:teuthology.orchestra.run.smithi018.stdout: osd crush chooseleaf type = 0 2024-04-17T19:52:01.251 INFO:teuthology.orchestra.run.smithi018.stdout: auth debug = true 2024-04-17T19:52:01.252 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:52:01.252 INFO:teuthology.orchestra.run.smithi018.stdout: ms die on old message = true 2024-04-17T19:52:01.252 INFO:teuthology.orchestra.run.smithi018.stdout: ms die on bug = true 2024-04-17T19:52:01.252 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:52:01.252 INFO:teuthology.orchestra.run.smithi018.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-17T19:52:01.252 INFO:teuthology.orchestra.run.smithi018.stdout: mon pg warn max object skew = 0 2024-04-17T19:52:01.252 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:52:01.252 INFO:teuthology.orchestra.run.smithi018.stdout: # disable pg_autoscaler by default for new pools 2024-04-17T19:52:01.252 INFO:teuthology.orchestra.run.smithi018.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-17T19:52:01.252 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:52:01.252 INFO:teuthology.orchestra.run.smithi018.stdout: osd pool default size = 2 2024-04-17T19:52:01.252 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:52:01.252 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd allow primary affinity = true 2024-04-17T19:52:01.252 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd allow pg remap = true 2024-04-17T19:52:01.252 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on legacy crush tunables = false 2024-04-17T19:52:01.253 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on crush straw calc version zero = false 2024-04-17T19:52:01.253 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on no sortbitwise = false 2024-04-17T19:52:01.253 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on osd down out interval zero = false 2024-04-17T19:52:01.253 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on too few osds = false 2024-04-17T19:52:01.253 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-17T19:52:01.253 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-17T19:52:01.253 INFO:teuthology.orchestra.run.smithi018.stdout: mon_allow_pool_size_one = true 2024-04-17T19:52:01.253 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:52:01.253 INFO:teuthology.orchestra.run.smithi018.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-17T19:52:01.253 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:52:01.253 INFO:teuthology.orchestra.run.smithi018.stdout: osd default data pool replay window = 5 2024-04-17T19:52:01.253 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:52:01.253 INFO:teuthology.orchestra.run.smithi018.stdout: mon allow pool delete = true 2024-04-17T19:52:01.253 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:52:01.253 INFO:teuthology.orchestra.run.smithi018.stdout: mon cluster log file level = debug 2024-04-17T19:52:01.253 INFO:teuthology.orchestra.run.smithi018.stdout: debug asserts on shutdown = true 2024-04-17T19:52:01.254 INFO:teuthology.orchestra.run.smithi018.stdout: mon health detail to clog = false 2024-04-17T19:52:01.254 INFO:teuthology.orchestra.run.smithi018.stdout: mon host = "172.21.15.18,172.21.15.173,[v2:172.21.15.173:3301,v1:172.21.15.173:6790]" 2024-04-17T19:52:01.254 INFO:teuthology.orchestra.run.smithi018.stdout: fsid = dd480169-5a81-4623-be5f-0499aa244b28 2024-04-17T19:52:01.254 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:52:01.254 INFO:teuthology.orchestra.run.smithi018.stdout:[osd] 2024-04-17T19:52:01.254 INFO:teuthology.orchestra.run.smithi018.stdout: osd journal size = 100 2024-04-17T19:52:01.254 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:52:01.254 INFO:teuthology.orchestra.run.smithi018.stdout: osd scrub load threshold = 5.0 2024-04-17T19:52:01.254 INFO:teuthology.orchestra.run.smithi018.stdout: osd scrub max interval = 600 2024-04-17T19:52:01.254 INFO:teuthology.orchestra.run.smithi018.stdout: osd mclock profile = high_recovery_ops 2024-04-17T19:52:01.254 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:52:01.254 INFO:teuthology.orchestra.run.smithi018.stdout: osd recover clone overlap = true 2024-04-17T19:52:01.254 INFO:teuthology.orchestra.run.smithi018.stdout: osd recovery max chunk = 1048576 2024-04-17T19:52:01.254 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:52:01.254 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug shutdown = true 2024-04-17T19:52:01.255 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug op order = true 2024-04-17T19:52:01.255 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug verify stray on activate = true 2024-04-17T19:52:01.255 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug trim objects = true 2024-04-17T19:52:01.255 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:52:01.255 INFO:teuthology.orchestra.run.smithi018.stdout: osd open classes on start = true 2024-04-17T19:52:01.255 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug pg log writeout = true 2024-04-17T19:52:01.255 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:52:01.255 INFO:teuthology.orchestra.run.smithi018.stdout: osd deep scrub update digest min age = 30 2024-04-17T19:52:01.255 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:52:01.255 INFO:teuthology.orchestra.run.smithi018.stdout: osd map max advance = 10 2024-04-17T19:52:01.255 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:52:01.255 INFO:teuthology.orchestra.run.smithi018.stdout: journal zero on create = true 2024-04-17T19:52:01.255 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:52:01.255 INFO:teuthology.orchestra.run.smithi018.stdout: filestore ondisk finisher threads = 3 2024-04-17T19:52:01.255 INFO:teuthology.orchestra.run.smithi018.stdout: filestore apply finisher threads = 3 2024-04-17T19:52:01.256 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:52:01.256 INFO:teuthology.orchestra.run.smithi018.stdout: bdev debug aio = true 2024-04-17T19:52:01.256 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug misdirected ops = true 2024-04-17T19:52:01.256 INFO:teuthology.orchestra.run.smithi018.stdout: bluestore block size = 96636764160 2024-04-17T19:52:01.256 INFO:teuthology.orchestra.run.smithi018.stdout: bluestore fsck on mount = True 2024-04-17T19:52:01.256 INFO:teuthology.orchestra.run.smithi018.stdout: debug bluefs = 20 2024-04-17T19:52:01.256 INFO:teuthology.orchestra.run.smithi018.stdout: debug bluestore = 20 2024-04-17T19:52:01.256 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2024-04-17T19:52:01.256 INFO:teuthology.orchestra.run.smithi018.stdout: debug osd = 20 2024-04-17T19:52:01.256 INFO:teuthology.orchestra.run.smithi018.stdout: debug rocksdb = 10 2024-04-17T19:52:01.256 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd backfillfull_ratio = 0.85 2024-04-17T19:52:01.256 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd full ratio = 0.9 2024-04-17T19:52:01.256 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd nearfull ratio = 0.8 2024-04-17T19:52:01.256 INFO:teuthology.orchestra.run.smithi018.stdout: osd failsafe full ratio = 0.95 2024-04-17T19:52:01.256 INFO:teuthology.orchestra.run.smithi018.stdout: osd objectstore = bluestore 2024-04-17T19:52:01.257 INFO:teuthology.orchestra.run.smithi018.stdout: osd op complaint time = 180 2024-04-17T19:52:01.257 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:52:01.257 INFO:teuthology.orchestra.run.smithi018.stdout:[mgr] 2024-04-17T19:52:01.257 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2024-04-17T19:52:01.257 INFO:teuthology.orchestra.run.smithi018.stdout: debug mgr = 20 2024-04-17T19:52:01.257 INFO:teuthology.orchestra.run.smithi018.stdout: debug mon = 20 2024-04-17T19:52:01.257 INFO:teuthology.orchestra.run.smithi018.stdout: debug auth = 20 2024-04-17T19:52:01.257 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min pgs per osd = 4 2024-04-17T19:52:01.257 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min bytes per osd = 10 2024-04-17T19:52:01.257 INFO:teuthology.orchestra.run.smithi018.stdout: mgr/telemetry/nag = false 2024-04-17T19:52:01.257 INFO:teuthology.orchestra.run.smithi018.stdout: debug client = 20 2024-04-17T19:52:01.257 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:52:01.257 INFO:teuthology.orchestra.run.smithi018.stdout:[mon] 2024-04-17T19:52:01.257 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2024-04-17T19:52:01.257 INFO:teuthology.orchestra.run.smithi018.stdout: debug mon = 20 2024-04-17T19:52:01.257 INFO:teuthology.orchestra.run.smithi018.stdout: debug paxos = 20 2024-04-17T19:52:01.257 INFO:teuthology.orchestra.run.smithi018.stdout: debug auth = 20 2024-04-17T19:52:01.258 INFO:teuthology.orchestra.run.smithi018.stdout: mon data avail warn = 5 2024-04-17T19:52:01.258 INFO:teuthology.orchestra.run.smithi018.stdout: mon mgr mkfs grace = 240 2024-04-17T19:52:01.258 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min pgs per osd = 4 2024-04-17T19:52:01.258 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd reporter subtree level = osd 2024-04-17T19:52:01.258 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd prime pg temp = true 2024-04-17T19:52:01.258 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min bytes per osd = 10 2024-04-17T19:52:01.258 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:52:01.258 INFO:teuthology.orchestra.run.smithi018.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-17T19:52:01.258 INFO:teuthology.orchestra.run.smithi018.stdout: auth mon ticket ttl = 660 # 11m 2024-04-17T19:52:01.258 INFO:teuthology.orchestra.run.smithi018.stdout: auth service ticket ttl = 240 # 4m 2024-04-17T19:52:01.258 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:52:01.258 INFO:teuthology.orchestra.run.smithi018.stdout: # don't complain about insecure global_id in the test suite 2024-04-17T19:52:01.258 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-17T19:52:01.259 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-17T19:52:01.259 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:52:01.259 INFO:teuthology.orchestra.run.smithi018.stdout: # 1m isn't quite enough 2024-04-17T19:52:01.259 INFO:teuthology.orchestra.run.smithi018.stdout: mon_down_mkfs_grace = 2m 2024-04-17T19:52:01.259 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:52:01.259 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_filestore_osds = false 2024-04-17T19:52:01.259 INFO:teuthology.orchestra.run.smithi018.stdout: mon down mkfs grace = 300 2024-04-17T19:52:01.259 INFO:teuthology.orchestra.run.smithi018.stdout: mon op complaint time = 120 2024-04-17T19:52:01.259 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:52:01.259 INFO:teuthology.orchestra.run.smithi018.stdout:[client] 2024-04-17T19:52:01.259 INFO:teuthology.orchestra.run.smithi018.stdout: rgw cache enabled = true 2024-04-17T19:52:01.259 INFO:teuthology.orchestra.run.smithi018.stdout: rgw enable ops log = true 2024-04-17T19:52:01.259 INFO:teuthology.orchestra.run.smithi018.stdout: rgw enable usage log = true 2024-04-17T19:52:01.259 INFO:teuthology.orchestra.run.smithi018.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-17T19:52:01.259 INFO:teuthology.orchestra.run.smithi018.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-17T19:52:01.260 INFO:teuthology.orchestra.run.smithi018.stdout: client mount timeout = 600 2024-04-17T19:52:01.260 INFO:teuthology.orchestra.run.smithi018.stdout: debug client = 20 2024-04-17T19:52:01.260 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2024-04-17T19:52:01.260 INFO:teuthology.orchestra.run.smithi018.stdout: pid file = "" 2024-04-17T19:52:01.260 INFO:teuthology.orchestra.run.smithi018.stdout: rados mon op timeout = 900 2024-04-17T19:52:01.260 INFO:teuthology.orchestra.run.smithi018.stdout: rados osd op timeout = 900 2024-04-17T19:52:01.260 INFO:teuthology.orchestra.run.smithi018.stdout:[mon.a] 2024-04-17T19:52:01.260 INFO:teuthology.orchestra.run.smithi018.stdout:[mon.b] 2024-04-17T19:52:01.260 INFO:teuthology.orchestra.run.smithi018.stdout:[mon.c] 2024-04-17T19:52:01.260 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.a] 2024-04-17T19:52:01.260 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.c] 2024-04-17T19:52:01.260 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.b] 2024-04-17T19:52:01.260 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.d] 2024-04-17T19:52:01.260 INFO:teuthology.orchestra.run.smithi018.stdout:[mds] 2024-04-17T19:52:01.260 INFO:teuthology.orchestra.run.smithi018.stdout: debug mds = 20 2024-04-17T19:52:01.260 INFO:teuthology.orchestra.run.smithi018.stdout: debug mds balancer = 20 2024-04-17T19:52:01.261 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2024-04-17T19:52:01.261 INFO:teuthology.orchestra.run.smithi018.stdout: mds debug frag = True 2024-04-17T19:52:01.261 INFO:teuthology.orchestra.run.smithi018.stdout: mds debug scatterstat = True 2024-04-17T19:52:01.261 INFO:teuthology.orchestra.run.smithi018.stdout: mds op complaint time = 180 2024-04-17T19:52:01.261 INFO:teuthology.orchestra.run.smithi018.stdout: mds verify scatter = True 2024-04-17T19:52:01.261 INFO:teuthology.orchestra.run.smithi018.stdout: osd op complaint time = 180 2024-04-17T19:52:01.261 INFO:teuthology.orchestra.run.smithi018.stdout: rados mon op timeout = 900 2024-04-17T19:52:01.261 INFO:teuthology.orchestra.run.smithi018.stdout: rados osd op timeout = 900 2024-04-17T19:52:01.262 INFO:teuthology.orchestra.run.smithi173.stdout:[global] 2024-04-17T19:52:01.262 INFO:teuthology.orchestra.run.smithi173.stdout: chdir = "" 2024-04-17T19:52:01.262 INFO:teuthology.orchestra.run.smithi173.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-17T19:52:01.262 INFO:teuthology.orchestra.run.smithi173.stdout: auth supported = cephx 2024-04-17T19:52:01.263 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-17T19:52:01.263 INFO:teuthology.orchestra.run.smithi173.stdout: filestore xattr use omap = true 2024-04-17T19:52:01.263 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-17T19:52:01.263 INFO:teuthology.orchestra.run.smithi173.stdout: mon clock drift allowed = 1.000 2024-04-17T19:52:01.263 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-17T19:52:01.263 INFO:teuthology.orchestra.run.smithi173.stdout: osd crush chooseleaf type = 0 2024-04-17T19:52:01.263 INFO:teuthology.orchestra.run.smithi173.stdout: auth debug = true 2024-04-17T19:52:01.263 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-17T19:52:01.263 INFO:teuthology.orchestra.run.smithi173.stdout: ms die on old message = true 2024-04-17T19:52:01.263 INFO:teuthology.orchestra.run.smithi173.stdout: ms die on bug = true 2024-04-17T19:52:01.263 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-17T19:52:01.264 INFO:teuthology.orchestra.run.smithi173.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-17T19:52:01.264 INFO:teuthology.orchestra.run.smithi173.stdout: mon pg warn max object skew = 0 2024-04-17T19:52:01.264 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-17T19:52:01.264 INFO:teuthology.orchestra.run.smithi173.stdout: # disable pg_autoscaler by default for new pools 2024-04-17T19:52:01.264 INFO:teuthology.orchestra.run.smithi173.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-17T19:52:01.264 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-17T19:52:01.264 INFO:teuthology.orchestra.run.smithi173.stdout: osd pool default size = 2 2024-04-17T19:52:01.265 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-17T19:52:01.265 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd allow primary affinity = true 2024-04-17T19:52:01.265 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd allow pg remap = true 2024-04-17T19:52:01.265 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on legacy crush tunables = false 2024-04-17T19:52:01.265 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on crush straw calc version zero = false 2024-04-17T19:52:01.265 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on no sortbitwise = false 2024-04-17T19:52:01.266 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on osd down out interval zero = false 2024-04-17T19:52:01.266 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on too few osds = false 2024-04-17T19:52:01.266 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-17T19:52:01.266 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-17T19:52:01.267 INFO:teuthology.orchestra.run.smithi173.stdout: mon_allow_pool_size_one = true 2024-04-17T19:52:01.267 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-17T19:52:01.267 INFO:teuthology.orchestra.run.smithi173.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-17T19:52:01.267 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-17T19:52:01.267 INFO:teuthology.orchestra.run.smithi173.stdout: osd default data pool replay window = 5 2024-04-17T19:52:01.268 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-17T19:52:01.268 INFO:teuthology.orchestra.run.smithi173.stdout: mon allow pool delete = true 2024-04-17T19:52:01.268 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-17T19:52:01.268 INFO:teuthology.orchestra.run.smithi173.stdout: mon cluster log file level = debug 2024-04-17T19:52:01.268 INFO:teuthology.orchestra.run.smithi173.stdout: debug asserts on shutdown = true 2024-04-17T19:52:01.268 INFO:teuthology.orchestra.run.smithi173.stdout: mon health detail to clog = false 2024-04-17T19:52:01.268 INFO:teuthology.orchestra.run.smithi173.stdout: mon host = "172.21.15.18,172.21.15.173,[v2:172.21.15.173:3301,v1:172.21.15.173:6790]" 2024-04-17T19:52:01.269 INFO:teuthology.orchestra.run.smithi173.stdout: fsid = dd480169-5a81-4623-be5f-0499aa244b28 2024-04-17T19:52:01.269 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-17T19:52:01.269 INFO:teuthology.orchestra.run.smithi173.stdout:[osd] 2024-04-17T19:52:01.269 INFO:teuthology.orchestra.run.smithi173.stdout: osd journal size = 100 2024-04-17T19:52:01.269 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-17T19:52:01.269 INFO:teuthology.orchestra.run.smithi173.stdout: osd scrub load threshold = 5.0 2024-04-17T19:52:01.269 INFO:teuthology.orchestra.run.smithi173.stdout: osd scrub max interval = 600 2024-04-17T19:52:01.269 INFO:teuthology.orchestra.run.smithi173.stdout: osd mclock profile = high_recovery_ops 2024-04-17T19:52:01.270 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-17T19:52:01.270 INFO:teuthology.orchestra.run.smithi173.stdout: osd recover clone overlap = true 2024-04-17T19:52:01.270 INFO:teuthology.orchestra.run.smithi173.stdout: osd recovery max chunk = 1048576 2024-04-17T19:52:01.270 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-17T19:52:01.270 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug shutdown = true 2024-04-17T19:52:01.270 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug op order = true 2024-04-17T19:52:01.270 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug verify stray on activate = true 2024-04-17T19:52:01.270 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug trim objects = true 2024-04-17T19:52:01.271 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-17T19:52:01.271 INFO:teuthology.orchestra.run.smithi173.stdout: osd open classes on start = true 2024-04-17T19:52:01.271 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug pg log writeout = true 2024-04-17T19:52:01.271 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-17T19:52:01.271 INFO:teuthology.orchestra.run.smithi173.stdout: osd deep scrub update digest min age = 30 2024-04-17T19:52:01.271 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-17T19:52:01.271 INFO:teuthology.orchestra.run.smithi173.stdout: osd map max advance = 10 2024-04-17T19:52:01.272 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-17T19:52:01.272 INFO:teuthology.orchestra.run.smithi173.stdout: journal zero on create = true 2024-04-17T19:52:01.272 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-17T19:52:01.272 INFO:teuthology.orchestra.run.smithi173.stdout: filestore ondisk finisher threads = 3 2024-04-17T19:52:01.272 INFO:teuthology.orchestra.run.smithi173.stdout: filestore apply finisher threads = 3 2024-04-17T19:52:01.272 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-17T19:52:01.272 INFO:teuthology.orchestra.run.smithi173.stdout: bdev debug aio = true 2024-04-17T19:52:01.272 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug misdirected ops = true 2024-04-17T19:52:01.273 INFO:teuthology.orchestra.run.smithi173.stdout: bluestore block size = 96636764160 2024-04-17T19:52:01.273 INFO:teuthology.orchestra.run.smithi173.stdout: bluestore fsck on mount = True 2024-04-17T19:52:01.273 INFO:teuthology.orchestra.run.smithi173.stdout: debug bluefs = 20 2024-04-17T19:52:01.273 INFO:teuthology.orchestra.run.smithi173.stdout: debug bluestore = 20 2024-04-17T19:52:01.273 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2024-04-17T19:52:01.273 INFO:teuthology.orchestra.run.smithi173.stdout: debug osd = 20 2024-04-17T19:52:01.273 INFO:teuthology.orchestra.run.smithi173.stdout: debug rocksdb = 10 2024-04-17T19:52:01.273 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd backfillfull_ratio = 0.85 2024-04-17T19:52:01.273 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd full ratio = 0.9 2024-04-17T19:52:01.274 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd nearfull ratio = 0.8 2024-04-17T19:52:01.274 INFO:teuthology.orchestra.run.smithi173.stdout: osd failsafe full ratio = 0.95 2024-04-17T19:52:01.274 INFO:teuthology.orchestra.run.smithi173.stdout: osd objectstore = bluestore 2024-04-17T19:52:01.274 INFO:teuthology.orchestra.run.smithi173.stdout: osd op complaint time = 180 2024-04-17T19:52:01.274 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-17T19:52:01.274 INFO:teuthology.orchestra.run.smithi173.stdout:[mgr] 2024-04-17T19:52:01.274 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2024-04-17T19:52:01.274 INFO:teuthology.orchestra.run.smithi173.stdout: debug mgr = 20 2024-04-17T19:52:01.275 INFO:teuthology.orchestra.run.smithi173.stdout: debug mon = 20 2024-04-17T19:52:01.275 INFO:teuthology.orchestra.run.smithi173.stdout: debug auth = 20 2024-04-17T19:52:01.275 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min pgs per osd = 4 2024-04-17T19:52:01.275 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min bytes per osd = 10 2024-04-17T19:52:01.275 INFO:teuthology.orchestra.run.smithi173.stdout: mgr/telemetry/nag = false 2024-04-17T19:52:01.275 INFO:teuthology.orchestra.run.smithi173.stdout: debug client = 20 2024-04-17T19:52:01.275 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-17T19:52:01.276 INFO:teuthology.orchestra.run.smithi173.stdout:[mon] 2024-04-17T19:52:01.276 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2024-04-17T19:52:01.276 INFO:teuthology.orchestra.run.smithi173.stdout: debug mon = 20 2024-04-17T19:52:01.276 INFO:teuthology.orchestra.run.smithi173.stdout: debug paxos = 20 2024-04-17T19:52:01.276 INFO:teuthology.orchestra.run.smithi173.stdout: debug auth = 20 2024-04-17T19:52:01.276 INFO:teuthology.orchestra.run.smithi173.stdout: mon data avail warn = 5 2024-04-17T19:52:01.276 INFO:teuthology.orchestra.run.smithi173.stdout: mon mgr mkfs grace = 240 2024-04-17T19:52:01.276 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min pgs per osd = 4 2024-04-17T19:52:01.276 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd reporter subtree level = osd 2024-04-17T19:52:01.276 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd prime pg temp = true 2024-04-17T19:52:01.276 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min bytes per osd = 10 2024-04-17T19:52:01.276 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-17T19:52:01.276 INFO:teuthology.orchestra.run.smithi173.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-17T19:52:01.276 INFO:teuthology.orchestra.run.smithi173.stdout: auth mon ticket ttl = 660 # 11m 2024-04-17T19:52:01.276 INFO:teuthology.orchestra.run.smithi173.stdout: auth service ticket ttl = 240 # 4m 2024-04-17T19:52:01.276 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-17T19:52:01.277 INFO:teuthology.orchestra.run.smithi173.stdout: # don't complain about insecure global_id in the test suite 2024-04-17T19:52:01.277 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-17T19:52:01.277 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-17T19:52:01.277 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-17T19:52:01.277 INFO:teuthology.orchestra.run.smithi173.stdout: # 1m isn't quite enough 2024-04-17T19:52:01.277 INFO:teuthology.orchestra.run.smithi173.stdout: mon_down_mkfs_grace = 2m 2024-04-17T19:52:01.277 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-17T19:52:01.277 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_filestore_osds = false 2024-04-17T19:52:01.277 INFO:teuthology.orchestra.run.smithi173.stdout: mon down mkfs grace = 300 2024-04-17T19:52:01.277 INFO:teuthology.orchestra.run.smithi173.stdout: mon op complaint time = 120 2024-04-17T19:52:01.277 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-04-17T19:52:01.277 INFO:teuthology.orchestra.run.smithi173.stdout:[client] 2024-04-17T19:52:01.277 INFO:teuthology.orchestra.run.smithi173.stdout: rgw cache enabled = true 2024-04-17T19:52:01.277 INFO:teuthology.orchestra.run.smithi173.stdout: rgw enable ops log = true 2024-04-17T19:52:01.277 INFO:teuthology.orchestra.run.smithi173.stdout: rgw enable usage log = true 2024-04-17T19:52:01.277 INFO:teuthology.orchestra.run.smithi173.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-17T19:52:01.278 INFO:teuthology.orchestra.run.smithi173.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-17T19:52:01.278 INFO:teuthology.orchestra.run.smithi173.stdout: client mount timeout = 600 2024-04-17T19:52:01.278 INFO:teuthology.orchestra.run.smithi173.stdout: debug client = 20 2024-04-17T19:52:01.278 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2024-04-17T19:52:01.278 INFO:teuthology.orchestra.run.smithi173.stdout: pid file = "" 2024-04-17T19:52:01.278 INFO:teuthology.orchestra.run.smithi173.stdout: rados mon op timeout = 900 2024-04-17T19:52:01.278 INFO:teuthology.orchestra.run.smithi173.stdout: rados osd op timeout = 900 2024-04-17T19:52:01.278 INFO:teuthology.orchestra.run.smithi173.stdout:[mon.a] 2024-04-17T19:52:01.278 INFO:teuthology.orchestra.run.smithi173.stdout:[mon.b] 2024-04-17T19:52:01.278 INFO:teuthology.orchestra.run.smithi173.stdout:[mon.c] 2024-04-17T19:52:01.278 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.a] 2024-04-17T19:52:01.278 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.c] 2024-04-17T19:52:01.278 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.b] 2024-04-17T19:52:01.278 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.d] 2024-04-17T19:52:01.278 INFO:teuthology.orchestra.run.smithi173.stdout:[mds] 2024-04-17T19:52:01.279 INFO:teuthology.orchestra.run.smithi173.stdout: debug mds = 20 2024-04-17T19:52:01.279 INFO:teuthology.orchestra.run.smithi173.stdout: debug mds balancer = 20 2024-04-17T19:52:01.279 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2024-04-17T19:52:01.279 INFO:teuthology.orchestra.run.smithi173.stdout: mds debug frag = True 2024-04-17T19:52:01.279 INFO:teuthology.orchestra.run.smithi173.stdout: mds debug scatterstat = True 2024-04-17T19:52:01.279 INFO:teuthology.orchestra.run.smithi173.stdout: mds op complaint time = 180 2024-04-17T19:52:01.279 INFO:teuthology.orchestra.run.smithi173.stdout: mds verify scatter = True 2024-04-17T19:52:01.279 INFO:teuthology.orchestra.run.smithi173.stdout: osd op complaint time = 180 2024-04-17T19:52:01.279 INFO:teuthology.orchestra.run.smithi173.stdout: rados mon op timeout = 900 2024-04-17T19:52:01.279 INFO:teuthology.orchestra.run.smithi173.stdout: rados osd op timeout = 900 2024-04-17T19:52:01.280 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-17T19:52:01.280 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-17T19:52:01.405 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-17T19:52:01.406 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-17T19:52:01.406 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-17T19:52:01.411 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-17T19:52:01.411 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-17T19:52:01.457 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi018.front.sepia.ceph.com 2024-04-17T19:52:01.457 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-17T19:52:01.457 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-17T19:52:01.457 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-17T19:52:01.524 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-17T19:52:01.525 DEBUG:teuthology.orchestra.run.smithi018:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-17T19:52:01.573 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi173.front.sepia.ceph.com 2024-04-17T19:52:01.573 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-17T19:52:01.573 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-17T19:52:01.573 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-17T19:52:01.596 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-17T19:52:01.596 DEBUG:teuthology.orchestra.run.smithi173:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-17T19:52:01.645 INFO:tasks.ceph:Setting up mon nodes... 2024-04-17T19:52:01.645 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-17T19:52:01.645 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-17T19:52:01.720 INFO:teuthology.orchestra.run.smithi018.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-17T19:52:01.727 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-17T19:52:01.800 INFO:teuthology.orchestra.run.smithi173.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-17T19:52:01.823 INFO:tasks.ceph:Setting up mds nodes... 2024-04-17T19:52:01.824 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-17T19:52:01.897 INFO:teuthology.orchestra.run.smithi018.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-17T19:52:01.904 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-17T19:52:01.917 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-17T19:52:02.022 INFO:teuthology.orchestra.run.smithi018.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-17T19:52:02.029 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-17T19:52:02.039 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-17T19:52:02.115 INFO:teuthology.orchestra.run.smithi173.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-17T19:52:02.121 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-17T19:52:02.133 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-17T19:52:02.243 INFO:teuthology.orchestra.run.smithi173.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-17T19:52:02.250 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-17T19:52:02.261 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-17T19:52:02.261 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-17T19:52:02.329 INFO:teuthology.orchestra.run.smithi018.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-17T19:52:02.343 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-04-17T19:52:02.399 INFO:teuthology.orchestra.run.smithi018.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-04-17T19:52:02.414 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-17T19:52:02.478 INFO:teuthology.orchestra.run.smithi173.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-17T19:52:02.492 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-04-17T19:52:02.552 INFO:teuthology.orchestra.run.smithi173.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-04-17T19:52:02.565 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-17T19:52:02.565 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi018.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi173.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-17T19:52:02.565 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-17T19:52:02.579 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-17T19:52:02.579 INFO:tasks.ceph:role: osd.0 2024-04-17T19:52:02.579 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi018.front.sepia.ceph.com 2024-04-17T19:52:02.579 DEBUG:teuthology.orchestra.run.smithi018:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-17T19:52:02.633 INFO:teuthology.orchestra.run.smithi018.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-17T19:52:02.633 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-17T19:52:02.633 INFO:teuthology.orchestra.run.smithi018.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-17T19:52:02.633 INFO:teuthology.orchestra.run.smithi018.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-17T19:52:02.633 INFO:teuthology.orchestra.run.smithi018.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-17T19:52:02.633 INFO:teuthology.orchestra.run.smithi018.stdout: = sunit=0 swidth=0 blks 2024-04-17T19:52:02.633 INFO:teuthology.orchestra.run.smithi018.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-17T19:52:02.634 INFO:teuthology.orchestra.run.smithi018.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-17T19:52:02.634 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-17T19:52:02.634 INFO:teuthology.orchestra.run.smithi018.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-17T19:52:02.660 INFO:teuthology.orchestra.run.smithi018.stdout:Discarding blocks...Done. 2024-04-17T19:52:02.662 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi018.front.sepia.ceph.com -o noatime 2024-04-17T19:52:02.662 DEBUG:teuthology.orchestra.run.smithi018:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-17T19:52:02.719 DEBUG:teuthology.orchestra.run.smithi018:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-17T19:52:02.769 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T19:52:02.770 INFO:teuthology.orchestra.run.smithi018.stderr:sudo: /sbin/restorecon: command not found 2024-04-17T19:52:02.770 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-17T19:52:02.826 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-17T19:52:02.826 INFO:tasks.ceph:role: osd.1 2024-04-17T19:52:02.827 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi018.front.sepia.ceph.com 2024-04-17T19:52:02.827 DEBUG:teuthology.orchestra.run.smithi018:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-17T19:52:02.880 INFO:teuthology.orchestra.run.smithi018.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-17T19:52:02.880 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-17T19:52:02.880 INFO:teuthology.orchestra.run.smithi018.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-17T19:52:02.880 INFO:teuthology.orchestra.run.smithi018.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-17T19:52:02.880 INFO:teuthology.orchestra.run.smithi018.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-17T19:52:02.881 INFO:teuthology.orchestra.run.smithi018.stdout: = sunit=0 swidth=0 blks 2024-04-17T19:52:02.881 INFO:teuthology.orchestra.run.smithi018.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-17T19:52:02.881 INFO:teuthology.orchestra.run.smithi018.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-17T19:52:02.881 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-17T19:52:02.881 INFO:teuthology.orchestra.run.smithi018.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-17T19:52:02.904 INFO:teuthology.orchestra.run.smithi018.stdout:Discarding blocks...Done. 2024-04-17T19:52:02.906 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi018.front.sepia.ceph.com -o noatime 2024-04-17T19:52:02.906 DEBUG:teuthology.orchestra.run.smithi018:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-17T19:52:02.966 DEBUG:teuthology.orchestra.run.smithi018:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-17T19:52:03.017 INFO:teuthology.orchestra.run.smithi018.stderr:sudo: /sbin/restorecon: command not found 2024-04-17T19:52:03.017 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T19:52:03.018 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-17T19:52:03.073 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-17T19:52:03.073 INFO:tasks.ceph:role: osd.2 2024-04-17T19:52:03.073 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi018.front.sepia.ceph.com 2024-04-17T19:52:03.074 DEBUG:teuthology.orchestra.run.smithi018:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-17T19:52:03.129 INFO:teuthology.orchestra.run.smithi018.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-17T19:52:03.129 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-17T19:52:03.129 INFO:teuthology.orchestra.run.smithi018.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-17T19:52:03.129 INFO:teuthology.orchestra.run.smithi018.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-17T19:52:03.129 INFO:teuthology.orchestra.run.smithi018.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-17T19:52:03.129 INFO:teuthology.orchestra.run.smithi018.stdout: = sunit=0 swidth=0 blks 2024-04-17T19:52:03.129 INFO:teuthology.orchestra.run.smithi018.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-17T19:52:03.129 INFO:teuthology.orchestra.run.smithi018.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-17T19:52:03.129 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-17T19:52:03.129 INFO:teuthology.orchestra.run.smithi018.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-17T19:52:03.153 INFO:teuthology.orchestra.run.smithi018.stdout:Discarding blocks...Done. 2024-04-17T19:52:03.155 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi018.front.sepia.ceph.com -o noatime 2024-04-17T19:52:03.155 DEBUG:teuthology.orchestra.run.smithi018:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-17T19:52:03.217 DEBUG:teuthology.orchestra.run.smithi018:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-17T19:52:03.270 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T19:52:03.270 INFO:teuthology.orchestra.run.smithi018.stderr:sudo: /sbin/restorecon: command not found 2024-04-17T19:52:03.271 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-17T19:52:03.323 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-17T19:52:03.323 INFO:tasks.ceph:role: osd.3 2024-04-17T19:52:03.323 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi018.front.sepia.ceph.com 2024-04-17T19:52:03.323 DEBUG:teuthology.orchestra.run.smithi018:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-17T19:52:03.377 INFO:teuthology.orchestra.run.smithi018.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-17T19:52:03.377 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-17T19:52:03.377 INFO:teuthology.orchestra.run.smithi018.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-17T19:52:03.377 INFO:teuthology.orchestra.run.smithi018.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-17T19:52:03.377 INFO:teuthology.orchestra.run.smithi018.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-17T19:52:03.377 INFO:teuthology.orchestra.run.smithi018.stdout: = sunit=0 swidth=0 blks 2024-04-17T19:52:03.377 INFO:teuthology.orchestra.run.smithi018.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-17T19:52:03.377 INFO:teuthology.orchestra.run.smithi018.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-17T19:52:03.377 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-17T19:52:03.377 INFO:teuthology.orchestra.run.smithi018.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-17T19:52:03.400 INFO:teuthology.orchestra.run.smithi018.stdout:Discarding blocks...Done. 2024-04-17T19:52:03.402 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi018.front.sepia.ceph.com -o noatime 2024-04-17T19:52:03.402 DEBUG:teuthology.orchestra.run.smithi018:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-17T19:52:03.463 DEBUG:teuthology.orchestra.run.smithi018:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-17T19:52:03.513 INFO:teuthology.orchestra.run.smithi018.stderr:sudo: /sbin/restorecon: command not found 2024-04-17T19:52:03.513 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T19:52:03.514 DEBUG:teuthology.orchestra.run.smithi018:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-17T19:52:03.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:03.659+0000 7fb73b1417c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-17T19:52:03.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:03.659+0000 7fb73b1417c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-17T19:52:03.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:03.659+0000 7fb73b1417c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-17T19:52:03.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:03.659+0000 7fb73b1417c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-17T19:52:03.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:03.659+0000 7fb73b1417c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-17T19:52:03.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:03.659+0000 7fb73b1417c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-17T19:52:06.655 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-17T19:52:06.670 DEBUG:teuthology.orchestra.run.smithi018:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-17T19:52:06.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:06.795+0000 7fd8919187c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-17T19:52:06.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:06.795+0000 7fd8919187c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-17T19:52:06.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:06.795+0000 7fd8919187c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-17T19:52:06.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:06.795+0000 7fd8919187c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-17T19:52:06.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:06.795+0000 7fd8919187c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-17T19:52:06.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:06.795+0000 7fd8919187c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-17T19:52:09.776 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-17T19:52:09.791 DEBUG:teuthology.orchestra.run.smithi018:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-17T19:52:09.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:09.907+0000 7f9c8d72d7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-17T19:52:09.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:09.907+0000 7f9c8d72d7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-17T19:52:09.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:09.907+0000 7f9c8d72d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-17T19:52:09.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:09.907+0000 7f9c8d72d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-17T19:52:09.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:09.907+0000 7f9c8d72d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-17T19:52:09.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:09.907+0000 7f9c8d72d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-17T19:52:12.893 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-17T19:52:12.907 DEBUG:teuthology.orchestra.run.smithi018:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-17T19:52:13.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:13.030+0000 7f4ef0c9e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-17T19:52:13.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:13.030+0000 7f4ef0c9e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-17T19:52:13.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:13.030+0000 7f4ef0c9e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-17T19:52:13.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:13.030+0000 7f4ef0c9e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-17T19:52:13.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:13.030+0000 7f4ef0c9e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-17T19:52:13.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:13.030+0000 7f4ef0c9e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-17T19:52:16.003 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-17T19:52:16.017 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-17T19:52:16.031 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-17T19:52:16.031 INFO:tasks.ceph:role: osd.4 2024-04-17T19:52:16.031 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi173.front.sepia.ceph.com 2024-04-17T19:52:16.031 DEBUG:teuthology.orchestra.run.smithi173:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-17T19:52:16.093 INFO:teuthology.orchestra.run.smithi173.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-17T19:52:16.093 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-17T19:52:16.094 INFO:teuthology.orchestra.run.smithi173.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-17T19:52:16.094 INFO:teuthology.orchestra.run.smithi173.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-17T19:52:16.094 INFO:teuthology.orchestra.run.smithi173.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-17T19:52:16.094 INFO:teuthology.orchestra.run.smithi173.stdout: = sunit=0 swidth=0 blks 2024-04-17T19:52:16.094 INFO:teuthology.orchestra.run.smithi173.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-17T19:52:16.094 INFO:teuthology.orchestra.run.smithi173.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-17T19:52:16.094 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-17T19:52:16.094 INFO:teuthology.orchestra.run.smithi173.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-17T19:52:16.545 INFO:teuthology.orchestra.run.smithi173.stdout:Discarding blocks...Done. 2024-04-17T19:52:16.547 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi173.front.sepia.ceph.com -o noatime 2024-04-17T19:52:16.548 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-17T19:52:16.642 DEBUG:teuthology.orchestra.run.smithi173:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-17T19:52:16.651 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T19:52:16.651 INFO:teuthology.orchestra.run.smithi173.stderr:sudo: /sbin/restorecon: command not found 2024-04-17T19:52:16.652 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-17T19:52:16.704 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-17T19:52:16.705 INFO:tasks.ceph:role: osd.5 2024-04-17T19:52:16.705 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi173.front.sepia.ceph.com 2024-04-17T19:52:16.705 DEBUG:teuthology.orchestra.run.smithi173:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-17T19:52:16.768 INFO:teuthology.orchestra.run.smithi173.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-17T19:52:16.768 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-17T19:52:16.768 INFO:teuthology.orchestra.run.smithi173.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-17T19:52:16.768 INFO:teuthology.orchestra.run.smithi173.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-17T19:52:16.768 INFO:teuthology.orchestra.run.smithi173.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-17T19:52:16.769 INFO:teuthology.orchestra.run.smithi173.stdout: = sunit=0 swidth=0 blks 2024-04-17T19:52:16.769 INFO:teuthology.orchestra.run.smithi173.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-17T19:52:16.769 INFO:teuthology.orchestra.run.smithi173.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-17T19:52:16.769 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-17T19:52:16.769 INFO:teuthology.orchestra.run.smithi173.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-17T19:52:17.232 INFO:teuthology.orchestra.run.smithi173.stdout:Discarding blocks...Done. 2024-04-17T19:52:17.234 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi173.front.sepia.ceph.com -o noatime 2024-04-17T19:52:17.234 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-17T19:52:17.387 DEBUG:teuthology.orchestra.run.smithi173:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-17T19:52:17.399 INFO:teuthology.orchestra.run.smithi173.stderr:sudo: /sbin/restorecon: command not found 2024-04-17T19:52:17.400 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T19:52:17.400 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-17T19:52:17.454 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-17T19:52:17.454 INFO:tasks.ceph:role: osd.6 2024-04-17T19:52:17.454 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi173.front.sepia.ceph.com 2024-04-17T19:52:17.454 DEBUG:teuthology.orchestra.run.smithi173:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-17T19:52:17.520 INFO:teuthology.orchestra.run.smithi173.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-17T19:52:17.520 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-17T19:52:17.520 INFO:teuthology.orchestra.run.smithi173.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-17T19:52:17.520 INFO:teuthology.orchestra.run.smithi173.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-17T19:52:17.520 INFO:teuthology.orchestra.run.smithi173.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-17T19:52:17.520 INFO:teuthology.orchestra.run.smithi173.stdout: = sunit=0 swidth=0 blks 2024-04-17T19:52:17.520 INFO:teuthology.orchestra.run.smithi173.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-17T19:52:17.520 INFO:teuthology.orchestra.run.smithi173.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-17T19:52:17.520 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-17T19:52:17.520 INFO:teuthology.orchestra.run.smithi173.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-17T19:52:17.981 INFO:teuthology.orchestra.run.smithi173.stdout:Discarding blocks...Done. 2024-04-17T19:52:17.983 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi173.front.sepia.ceph.com -o noatime 2024-04-17T19:52:17.984 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-17T19:52:18.117 DEBUG:teuthology.orchestra.run.smithi173:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-17T19:52:18.128 INFO:teuthology.orchestra.run.smithi173.stderr:sudo: /sbin/restorecon: command not found 2024-04-17T19:52:18.129 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T19:52:18.130 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-17T19:52:18.190 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-17T19:52:18.190 INFO:tasks.ceph:role: osd.7 2024-04-17T19:52:18.190 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi173.front.sepia.ceph.com 2024-04-17T19:52:18.190 DEBUG:teuthology.orchestra.run.smithi173:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-17T19:52:18.253 INFO:teuthology.orchestra.run.smithi173.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-17T19:52:18.253 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-17T19:52:18.253 INFO:teuthology.orchestra.run.smithi173.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-17T19:52:18.254 INFO:teuthology.orchestra.run.smithi173.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-17T19:52:18.254 INFO:teuthology.orchestra.run.smithi173.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-17T19:52:18.254 INFO:teuthology.orchestra.run.smithi173.stdout: = sunit=0 swidth=0 blks 2024-04-17T19:52:18.254 INFO:teuthology.orchestra.run.smithi173.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-17T19:52:18.254 INFO:teuthology.orchestra.run.smithi173.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-17T19:52:18.254 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-17T19:52:18.254 INFO:teuthology.orchestra.run.smithi173.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-17T19:52:18.676 INFO:teuthology.orchestra.run.smithi173.stdout:Discarding blocks...Done. 2024-04-17T19:52:18.680 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi173.front.sepia.ceph.com -o noatime 2024-04-17T19:52:18.680 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-17T19:52:18.763 DEBUG:teuthology.orchestra.run.smithi173:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-17T19:52:18.814 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T19:52:18.815 INFO:teuthology.orchestra.run.smithi173.stderr:sudo: /sbin/restorecon: command not found 2024-04-17T19:52:18.815 DEBUG:teuthology.orchestra.run.smithi173:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-17T19:52:18.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:18.965+0000 7f29738947c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-17T19:52:18.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:18.969+0000 7f29738947c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-17T19:52:18.961 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:18.969+0000 7f29738947c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-17T19:52:18.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:18.969+0000 7f29738947c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-17T19:52:18.962 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:18.969+0000 7f29738947c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-17T19:52:18.968 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:18.973+0000 7f29738947c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-17T19:52:21.946 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-17T19:52:21.959 DEBUG:teuthology.orchestra.run.smithi173:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-17T19:52:22.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:22.076+0000 7fce981777c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-17T19:52:22.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:22.076+0000 7fce981777c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-17T19:52:22.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:22.076+0000 7fce981777c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-17T19:52:22.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:22.076+0000 7fce981777c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-17T19:52:22.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:22.076+0000 7fce981777c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-17T19:52:22.072 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:22.076+0000 7fce981777c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-17T19:52:25.058 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-17T19:52:25.072 DEBUG:teuthology.orchestra.run.smithi173:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-17T19:52:25.187 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:25.192+0000 7f72ee7757c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-17T19:52:25.188 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:25.192+0000 7f72ee7757c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-17T19:52:25.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:25.192+0000 7f72ee7757c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-17T19:52:25.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:25.192+0000 7f72ee7757c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-17T19:52:25.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:25.192+0000 7f72ee7757c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-17T19:52:25.189 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:25.192+0000 7f72ee7757c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-17T19:52:28.181 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-17T19:52:28.195 DEBUG:teuthology.orchestra.run.smithi173:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-17T19:52:28.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:28.316+0000 7ff21588f7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-17T19:52:28.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:28.316+0000 7ff21588f7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-17T19:52:28.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:28.316+0000 7ff21588f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-17T19:52:28.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:28.316+0000 7ff21588f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-17T19:52:28.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:28.316+0000 7ff21588f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-17T19:52:28.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:28.316+0000 7ff21588f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-17T19:52:29.517 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T19:52:29.520 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T19:52:31.306 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-17T19:52:31.319 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-17T19:52:31.319 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-17T19:52:31.319 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-17T19:52:31.334 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-17T19:52:31.334 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-17T19:52:31.390 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-17T19:52:31.390 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-17T19:52:31.446 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-17T19:52:31.446 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-17T19:52:31.502 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-17T19:52:31.502 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-17T19:52:31.559 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-17T19:52:31.559 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-17T19:52:31.614 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-17T19:52:31.614 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-17T19:52:31.669 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-17T19:52:31.670 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-17T19:52:31.684 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-17T19:52:31.684 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-17T19:52:31.737 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-17T19:52:31.737 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-17T19:52:31.789 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-17T19:52:31.801 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-17T19:52:31.841 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-17T19:52:31.841 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-17T19:52:31.893 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-17T19:52:31.893 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-17T19:52:31.946 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-17T19:52:31.946 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-17T19:52:32.006 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-17T19:52:32.006 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-17T19:52:32.011 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-17T19:52:32.012 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-04-17T19:52:32.062 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-17T19:52:32.062 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-17T19:52:32.068 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-17T19:52:32.068 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-04-17T19:52:32.114 INFO:tasks.ceph:Adding keys to all mons... 2024-04-17T19:52:32.115 DEBUG:teuthology.orchestra.run.smithi018:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-17T19:52:32.117 DEBUG:teuthology.orchestra.run.smithi173:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-17T19:52:32.160 INFO:teuthology.orchestra.run.smithi018.stdout:[mgr.y] 2024-04-17T19:52:32.160 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQBhKCBmcrCgKxAABv6UOsOz79c6RJodi4OlBQ== 2024-04-17T19:52:32.160 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.a] 2024-04-17T19:52:32.160 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQBhKCBmTHcsNhAARyPR5P/nQrY07jumlAl5rg== 2024-04-17T19:52:32.160 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.c] 2024-04-17T19:52:32.160 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQBiKCBmwC4HAhAAgvSgtaA5l+lAB4fcK2l72w== 2024-04-17T19:52:32.160 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.0] 2024-04-17T19:52:32.160 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQBjKCBm3BZ6JxAAxBzJr2rfq7PbAmpOVivlcw== 2024-04-17T19:52:32.161 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.1] 2024-04-17T19:52:32.161 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQBmKCBmPtWKLxAAz7f7FZhrNiKi06bvR7k3Ow== 2024-04-17T19:52:32.161 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.2] 2024-04-17T19:52:32.161 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQBpKCBm/FszNhAA+jzVq4M03mQovpkhEzn3WA== 2024-04-17T19:52:32.161 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.3] 2024-04-17T19:52:32.161 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQBtKCBm7Y3tARAAhrt2Oky3/OxXQpEE/xOiOA== 2024-04-17T19:52:32.161 INFO:teuthology.orchestra.run.smithi018.stdout:[mgr.x] 2024-04-17T19:52:32.161 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQBhKCBm/JNyMBAAmIkDjh3IjRqrSDPFyPdW8A== 2024-04-17T19:52:32.161 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.b] 2024-04-17T19:52:32.161 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQBiKCBmuASSBxAAb8OwMlJ3Bz5P6JdjfZrk9A== 2024-04-17T19:52:32.161 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.d] 2024-04-17T19:52:32.161 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQBiKCBmrbE1DxAA9YsmnwnnCcoXWOLMB0kqeQ== 2024-04-17T19:52:32.161 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.4] 2024-04-17T19:52:32.161 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQByKCBmTt7FORAAQXbBAKvrHJInCvZ8xvITSg== 2024-04-17T19:52:32.162 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.5] 2024-04-17T19:52:32.162 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQB2KCBmPqzjBBAAEVbH+t2mbNTE1FESoqg21Q== 2024-04-17T19:52:32.162 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.6] 2024-04-17T19:52:32.162 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQB5KCBmRRLWCxAAGhuM5lBv6bO2Z3+u5a8Nrg== 2024-04-17T19:52:32.162 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.7] 2024-04-17T19:52:32.162 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQB8KCBmPRgsExAAkCt5EC9dbY7YLMXqluosLw== 2024-04-17T19:52:32.162 INFO:teuthology.orchestra.run.smithi018.stdout:[client.0] 2024-04-17T19:52:32.162 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQBiKCBm+T9FFBAA/qrVXzhYcifUOgncHZoQSg== 2024-04-17T19:52:32.162 INFO:teuthology.orchestra.run.smithi018.stdout:[client.2] 2024-04-17T19:52:32.162 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQBiKCBmB+14GBAA1d48VK38HtAPzLMmjf5q2w== 2024-04-17T19:52:32.162 INFO:teuthology.orchestra.run.smithi018.stdout:[client.1] 2024-04-17T19:52:32.162 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQBiKCBmLjQ7HRAAiAippuD44j1oj321389+Fg== 2024-04-17T19:52:32.162 INFO:teuthology.orchestra.run.smithi018.stdout:[client.3] 2024-04-17T19:52:32.162 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQBiKCBmIBifIRAABqsX2DyIKVdtryYSJG6MNA== 2024-04-17T19:52:32.168 INFO:teuthology.orchestra.run.smithi173.stdout:[mgr.y] 2024-04-17T19:52:32.168 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQBhKCBmcrCgKxAABv6UOsOz79c6RJodi4OlBQ== 2024-04-17T19:52:32.168 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.a] 2024-04-17T19:52:32.169 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQBhKCBmTHcsNhAARyPR5P/nQrY07jumlAl5rg== 2024-04-17T19:52:32.169 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.c] 2024-04-17T19:52:32.169 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQBiKCBmwC4HAhAAgvSgtaA5l+lAB4fcK2l72w== 2024-04-17T19:52:32.169 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.0] 2024-04-17T19:52:32.169 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQBjKCBm3BZ6JxAAxBzJr2rfq7PbAmpOVivlcw== 2024-04-17T19:52:32.169 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.1] 2024-04-17T19:52:32.169 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQBmKCBmPtWKLxAAz7f7FZhrNiKi06bvR7k3Ow== 2024-04-17T19:52:32.169 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.2] 2024-04-17T19:52:32.169 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQBpKCBm/FszNhAA+jzVq4M03mQovpkhEzn3WA== 2024-04-17T19:52:32.169 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.3] 2024-04-17T19:52:32.169 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQBtKCBm7Y3tARAAhrt2Oky3/OxXQpEE/xOiOA== 2024-04-17T19:52:32.169 INFO:teuthology.orchestra.run.smithi173.stdout:[mgr.x] 2024-04-17T19:52:32.169 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQBhKCBm/JNyMBAAmIkDjh3IjRqrSDPFyPdW8A== 2024-04-17T19:52:32.169 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.b] 2024-04-17T19:52:32.170 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQBiKCBmuASSBxAAb8OwMlJ3Bz5P6JdjfZrk9A== 2024-04-17T19:52:32.170 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.d] 2024-04-17T19:52:32.170 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQBiKCBmrbE1DxAA9YsmnwnnCcoXWOLMB0kqeQ== 2024-04-17T19:52:32.170 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.4] 2024-04-17T19:52:32.170 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQByKCBmTt7FORAAQXbBAKvrHJInCvZ8xvITSg== 2024-04-17T19:52:32.170 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.5] 2024-04-17T19:52:32.170 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQB2KCBmPqzjBBAAEVbH+t2mbNTE1FESoqg21Q== 2024-04-17T19:52:32.170 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.6] 2024-04-17T19:52:32.170 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQB5KCBmRRLWCxAAGhuM5lBv6bO2Z3+u5a8Nrg== 2024-04-17T19:52:32.170 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.7] 2024-04-17T19:52:32.170 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQB8KCBmPRgsExAAkCt5EC9dbY7YLMXqluosLw== 2024-04-17T19:52:32.170 INFO:teuthology.orchestra.run.smithi173.stdout:[client.0] 2024-04-17T19:52:32.170 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQBiKCBm+T9FFBAA/qrVXzhYcifUOgncHZoQSg== 2024-04-17T19:52:32.170 INFO:teuthology.orchestra.run.smithi173.stdout:[client.2] 2024-04-17T19:52:32.170 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQBiKCBmB+14GBAA1d48VK38HtAPzLMmjf5q2w== 2024-04-17T19:52:32.170 INFO:teuthology.orchestra.run.smithi173.stdout:[client.1] 2024-04-17T19:52:32.171 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQBiKCBmLjQ7HRAAiAippuD44j1oj321389+Fg== 2024-04-17T19:52:32.171 INFO:teuthology.orchestra.run.smithi173.stdout:[client.3] 2024-04-17T19:52:32.171 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQBiKCBmIBifIRAABqsX2DyIKVdtryYSJG6MNA== 2024-04-17T19:52:32.171 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-17T19:52:32.208 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-17T19:52:32.293 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-17T19:52:32.295 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-17T19:52:32.369 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-17T19:52:32.371 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-17T19:52:32.448 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T19:52:32.450 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T19:52:32.517 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T19:52:32.519 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T19:52:32.590 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T19:52:32.592 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T19:52:32.665 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T19:52:32.667 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T19:52:32.734 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-17T19:52:32.736 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-17T19:52:32.804 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-17T19:52:32.806 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-17T19:52:32.881 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-17T19:52:32.884 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-17T19:52:32.959 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T19:52:32.961 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T19:52:33.030 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T19:52:33.032 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T19:52:33.100 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T19:52:33.103 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T19:52:33.173 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T19:52:33.175 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-17T19:52:33.246 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-17T19:52:33.249 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-17T19:52:33.320 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-17T19:52:33.322 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-17T19:52:33.397 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-17T19:52:33.399 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-17T19:52:33.474 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-17T19:52:33.476 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-17T19:52:33.552 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-17T19:52:33.552 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-17T19:52:33.563 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-17T19:52:33.685 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-17T19:52:33.696 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-17T19:52:33.710 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-17T19:52:33.837 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-17T19:52:33.847 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-17T19:52:33.902 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-17T19:52:34.036 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-17T19:52:34.045 DEBUG:teuthology.orchestra.run.smithi018:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-17T19:52:34.048 DEBUG:teuthology.orchestra.run.smithi173:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-17T19:52:34.093 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-17T19:52:34.094 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-17T19:52:34.094 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-17T19:52:34.096 INFO:tasks.ceph.mon.a:Started 2024-04-17T19:52:34.097 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-17T19:52:34.097 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-17T19:52:34.139 INFO:tasks.ceph.mon.b:Started 2024-04-17T19:52:34.139 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-17T19:52:34.139 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-17T19:52:34.141 INFO:tasks.ceph.mon.c:Started 2024-04-17T19:52:34.141 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-17T19:52:34.141 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-17T19:52:34.141 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-17T19:52:34.144 INFO:tasks.ceph.mgr.y:Started 2024-04-17T19:52:34.144 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-17T19:52:34.144 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-17T19:52:34.146 INFO:tasks.ceph.mgr.x:Started 2024-04-17T19:52:34.146 INFO:tasks.ceph:Setting crush tunables to default 2024-04-17T19:52:34.146 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --cluster ceph osd crush tunables default 2024-04-17T19:52:34.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:34.302+0000 7f58d672e640 1 Processor -- start 2024-04-17T19:52:34.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:34.302+0000 7f58d672e640 1 -- start start 2024-04-17T19:52:34.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:34.302+0000 7f58d672e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f58d015c2d0 0x7f58d006e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:34.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:34.302+0000 7f58d672e640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58d006e9a0 0x7f58d00b6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:34.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:34.302+0000 7f58d672e640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58d00b72c0 con 0x7f58d00b6eb0 2024-04-17T19:52:34.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:34.302+0000 7f58d672e640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f58d006dc70 con 0x7f58d015c2d0 2024-04-17T19:52:34.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:34.302+0000 7f58d672e640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f58d00ce8b0 con 0x7f58d006e9a0 2024-04-17T19:52:34.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:34.302+0000 7f58cffff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f58d015c2d0 0x7f58d006e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:34.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:34.302+0000 7f58cffff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f58d015c2d0 0x7f58d006e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35910/0 (socket says 172.21.15.18:35910) 2024-04-17T19:52:34.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:34.302+0000 7f58cffff640 1 -- 172.21.15.18:0/643103805 learned_addr learned my addr 172.21.15.18:0/643103805 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:52:34.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:34.302+0000 7f58cffff640 1 -- 172.21.15.18:0/643103805 >> v2:172.21.15.18:3300/0 conn(0x7f58d015c2d0 msgr2=0x7f58d006e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-17T19:52:34.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:34.302+0000 7f58c77fe640 1 --2- 172.21.15.18:0/643103805 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58d006e9a0 0x7f58d00b6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:34.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:34.302+0000 7f58cffff640 1 -- 172.21.15.18:0/643103805 >> v2:172.21.15.18:3300/0 conn(0x7f58d015c2d0 msgr2=0x7f58d006e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T19:52:34.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:34.302+0000 7f58cffff640 1 --2- 172.21.15.18:0/643103805 >> v2:172.21.15.18:3300/0 conn(0x7f58d015c2d0 0x7f58d006e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T19:52:34.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:34.302+0000 7f58cffff640 1 --2- 172.21.15.18:0/643103805 >> v2:172.21.15.18:3300/0 conn(0x7f58d015c2d0 0x7f58d006e100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-17T19:52:34.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:34.302+0000 7f58c77fe640 1 -- 172.21.15.18:0/643103805 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58d006e9a0 msgr2=0x7f58d00b6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-17T19:52:34.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:34.302+0000 7f58c77fe640 1 -- 172.21.15.18:0/643103805 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58d006e9a0 msgr2=0x7f58d00b6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T19:52:34.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:34.302+0000 7f58c77fe640 1 --2- 172.21.15.18:0/643103805 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58d006e9a0 0x7f58d00b6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T19:52:34.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:34.302+0000 7f58c77fe640 1 --2- 172.21.15.18:0/643103805 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58d006e9a0 0x7f58d00b6970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-17T19:52:34.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:34.506+0000 7f58cffff640 1 --2- 172.21.15.18:0/643103805 >> v2:172.21.15.18:3300/0 conn(0x7f58d015c2d0 0x7f58d006e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:34.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:34.506+0000 7f58c77fe640 1 --2- 172.21.15.18:0/643103805 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58d006e9a0 0x7f58d00b6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:34.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:34.506+0000 7f58cffff640 1 -- 172.21.15.18:0/643103805 >> v2:172.21.15.18:3300/0 conn(0x7f58d015c2d0 msgr2=0x7f58d006e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-17T19:52:34.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:34.506+0000 7f58cffff640 1 -- 172.21.15.18:0/643103805 >> v2:172.21.15.18:3300/0 conn(0x7f58d015c2d0 msgr2=0x7f58d006e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T19:52:34.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:34.506+0000 7f58cffff640 1 --2- 172.21.15.18:0/643103805 >> v2:172.21.15.18:3300/0 conn(0x7f58d015c2d0 0x7f58d006e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T19:52:34.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:34.506+0000 7f58c77fe640 1 -- 172.21.15.18:0/643103805 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58d006e9a0 msgr2=0x7f58d00b6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-17T19:52:34.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:34.506+0000 7f58c77fe640 1 -- 172.21.15.18:0/643103805 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58d006e9a0 msgr2=0x7f58d00b6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T19:52:34.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:34.506+0000 7f58c77fe640 1 --2- 172.21.15.18:0/643103805 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58d006e9a0 0x7f58d00b6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T19:52:34.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:34.506+0000 7f58c77fe640 1 --2- 172.21.15.18:0/643103805 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58d006e9a0 0x7f58d00b6970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-17T19:52:34.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:34.506+0000 7f58cffff640 1 --2- 172.21.15.18:0/643103805 >> v2:172.21.15.18:3300/0 conn(0x7f58d015c2d0 0x7f58d006e100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-17T19:52:34.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:34.910+0000 7f58cffff640 1 --2- 172.21.15.18:0/643103805 >> v2:172.21.15.18:3300/0 conn(0x7f58d015c2d0 0x7f58d006e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:34.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:34.910+0000 7f58c77fe640 1 --2- 172.21.15.18:0/643103805 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58d006e9a0 0x7f58d00b6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:34.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:34.910+0000 7f58cffff640 1 -- 172.21.15.18:0/643103805 >> v2:172.21.15.18:3300/0 conn(0x7f58d015c2d0 msgr2=0x7f58d006e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-17T19:52:34.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:34.910+0000 7f58cffff640 1 -- 172.21.15.18:0/643103805 >> v2:172.21.15.18:3300/0 conn(0x7f58d015c2d0 msgr2=0x7f58d006e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T19:52:34.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:34.910+0000 7f58cffff640 1 --2- 172.21.15.18:0/643103805 >> v2:172.21.15.18:3300/0 conn(0x7f58d015c2d0 0x7f58d006e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T19:52:34.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:34.910+0000 7f58c77fe640 1 -- 172.21.15.18:0/643103805 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58d006e9a0 msgr2=0x7f58d00b6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-17T19:52:34.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:34.910+0000 7f58c77fe640 1 -- 172.21.15.18:0/643103805 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58d006e9a0 msgr2=0x7f58d00b6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T19:52:34.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:34.910+0000 7f58cffff640 1 --2- 172.21.15.18:0/643103805 >> v2:172.21.15.18:3300/0 conn(0x7f58d015c2d0 0x7f58d006e100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-17T19:52:34.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:34.910+0000 7f58c77fe640 1 --2- 172.21.15.18:0/643103805 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58d006e9a0 0x7f58d00b6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T19:52:34.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:34.910+0000 7f58c77fe640 1 --2- 172.21.15.18:0/643103805 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58d006e9a0 0x7f58d00b6970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-17T19:52:35.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:35.714+0000 7f58cffff640 1 --2- 172.21.15.18:0/643103805 >> v2:172.21.15.18:3300/0 conn(0x7f58d015c2d0 0x7f58d006e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:35.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:35.714+0000 7f58c77fe640 1 --2- 172.21.15.18:0/643103805 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58d006e9a0 0x7f58d00b6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:35.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:35.714+0000 7f58cffff640 1 -- 172.21.15.18:0/643103805 >> v2:172.21.15.18:3300/0 conn(0x7f58d015c2d0 msgr2=0x7f58d006e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-17T19:52:35.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:35.714+0000 7f58cffff640 1 -- 172.21.15.18:0/643103805 >> v2:172.21.15.18:3300/0 conn(0x7f58d015c2d0 msgr2=0x7f58d006e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T19:52:35.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:35.714+0000 7f58cffff640 1 --2- 172.21.15.18:0/643103805 >> v2:172.21.15.18:3300/0 conn(0x7f58d015c2d0 0x7f58d006e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T19:52:35.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:35.714+0000 7f58cffff640 1 --2- 172.21.15.18:0/643103805 >> v2:172.21.15.18:3300/0 conn(0x7f58d015c2d0 0x7f58d006e100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-17T19:52:35.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:35.714+0000 7f58c77fe640 1 -- 172.21.15.18:0/643103805 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58d006e9a0 msgr2=0x7f58d00b6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-17T19:52:35.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:35.714+0000 7f58c77fe640 1 -- 172.21.15.18:0/643103805 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58d006e9a0 msgr2=0x7f58d00b6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T19:52:35.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:35.714+0000 7f58c77fe640 1 --2- 172.21.15.18:0/643103805 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58d006e9a0 0x7f58d00b6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T19:52:35.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:35.714+0000 7f58c77fe640 1 --2- 172.21.15.18:0/643103805 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58d006e9a0 0x7f58d00b6970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-17T19:52:37.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:37.302+0000 7f58ce7fc640 1 -- 172.21.15.18:0/643103805 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58d006e9a0 msgr2=0x7f58d00b6970 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-17T19:52:37.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:37.302+0000 7f58ce7fc640 1 --2- 172.21.15.18:0/643103805 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58d006e9a0 0x7f58d00b6970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:37.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:37.302+0000 7f58ce7fc640 1 -- 172.21.15.18:0/643103805 >> v2:172.21.15.18:3300/0 conn(0x7f58d015c2d0 msgr2=0x7f58d006e100 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-17T19:52:37.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:37.302+0000 7f58ce7fc640 1 --2- 172.21.15.18:0/643103805 >> v2:172.21.15.18:3300/0 conn(0x7f58d015c2d0 0x7f58d006e100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:37.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:37.302+0000 7f58ce7fc640 1 -- 172.21.15.18:0/643103805 >> v1:172.21.15.173:6789/0 conn(0x7f58d00b6eb0 legacy=0x7f58d00cf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:37.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:37.302+0000 7f58ce7fc640 1 --2- 172.21.15.18:0/643103805 >> v2:172.21.15.173:3300/0 conn(0x7f58b0007390 0x7f58b00098a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:37.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:37.302+0000 7f58ce7fc640 1 -- 172.21.15.18:0/643103805 --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58d015c6e0 con 0x7f58b00036f0 2024-04-17T19:52:37.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:37.302+0000 7f58ce7fc640 1 -- 172.21.15.18:0/643103805 --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f58d006dc70 con 0x7f58b0007390 2024-04-17T19:52:37.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:37.302+0000 7f58c77fe640 1 --2- 172.21.15.18:0/643103805 >> v2:172.21.15.173:3300/0 conn(0x7f58b0007390 0x7f58b00098a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:37.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:37.302+0000 7f58c77fe640 1 -- 172.21.15.18:0/643103805 >> v2:172.21.15.173:3300/0 conn(0x7f58b0007390 msgr2=0x7f58b00098a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-17T19:52:37.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:37.302+0000 7f58c77fe640 1 -- 172.21.15.18:0/643103805 >> v2:172.21.15.173:3300/0 conn(0x7f58b0007390 msgr2=0x7f58b00098a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T19:52:37.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:37.302+0000 7f58c77fe640 1 --2- 172.21.15.18:0/643103805 >> v2:172.21.15.173:3300/0 conn(0x7f58b0007390 0x7f58b00098a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T19:52:37.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:37.302+0000 7f58c77fe640 1 --2- 172.21.15.18:0/643103805 >> v2:172.21.15.173:3300/0 conn(0x7f58b0007390 0x7f58b00098a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-17T19:52:37.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:37.506+0000 7f58c77fe640 1 --2- 172.21.15.18:0/643103805 >> v2:172.21.15.173:3300/0 conn(0x7f58b0007390 0x7f58b00098a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:37.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:37.506+0000 7f58c77fe640 1 -- 172.21.15.18:0/643103805 >> v2:172.21.15.173:3300/0 conn(0x7f58b0007390 msgr2=0x7f58b00098a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-17T19:52:37.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:37.506+0000 7f58c77fe640 1 -- 172.21.15.18:0/643103805 >> v2:172.21.15.173:3300/0 conn(0x7f58b0007390 msgr2=0x7f58b00098a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T19:52:37.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:37.506+0000 7f58c77fe640 1 --2- 172.21.15.18:0/643103805 >> v2:172.21.15.173:3300/0 conn(0x7f58b0007390 0x7f58b00098a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T19:52:37.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:37.506+0000 7f58c77fe640 1 --2- 172.21.15.18:0/643103805 >> v2:172.21.15.173:3300/0 conn(0x7f58b0007390 0x7f58b00098a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-17T19:52:37.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:37.910+0000 7f58c77fe640 1 --2- 172.21.15.18:0/643103805 >> v2:172.21.15.173:3300/0 conn(0x7f58b0007390 0x7f58b00098a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:37.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:37.910+0000 7f58c77fe640 1 -- 172.21.15.18:0/643103805 >> v2:172.21.15.173:3300/0 conn(0x7f58b0007390 msgr2=0x7f58b00098a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-17T19:52:37.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:37.910+0000 7f58c77fe640 1 -- 172.21.15.18:0/643103805 >> v2:172.21.15.173:3300/0 conn(0x7f58b0007390 msgr2=0x7f58b00098a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T19:52:37.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:37.910+0000 7f58c77fe640 1 --2- 172.21.15.18:0/643103805 >> v2:172.21.15.173:3300/0 conn(0x7f58b0007390 0x7f58b00098a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T19:52:37.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:37.910+0000 7f58c77fe640 1 --2- 172.21.15.18:0/643103805 >> v2:172.21.15.173:3300/0 conn(0x7f58b0007390 0x7f58b00098a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-17T19:52:38.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:38.714+0000 7f58c77fe640 1 --2- 172.21.15.18:0/643103805 >> v2:172.21.15.173:3300/0 conn(0x7f58b0007390 0x7f58b00098a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:38.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:38.714+0000 7f58c77fe640 1 -- 172.21.15.18:0/643103805 >> v2:172.21.15.173:3300/0 conn(0x7f58b0007390 msgr2=0x7f58b00098a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-17T19:52:38.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:38.714+0000 7f58c77fe640 1 -- 172.21.15.18:0/643103805 >> v2:172.21.15.173:3300/0 conn(0x7f58b0007390 msgr2=0x7f58b00098a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-17T19:52:38.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:38.714+0000 7f58c77fe640 1 --2- 172.21.15.18:0/643103805 >> v2:172.21.15.173:3300/0 conn(0x7f58b0007390 0x7f58b00098a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-17T19:52:38.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:38.714+0000 7f58c77fe640 1 --2- 172.21.15.18:0/643103805 >> v2:172.21.15.173:3300/0 conn(0x7f58b0007390 0x7f58b00098a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-17T19:52:39.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.574+0000 7f58cf7fe640 1 -- 172.21.15.18:0/643103805 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 332817301 0 0) 0x7f58d015c6e0 con 0x7f58b00036f0 2024-04-17T19:52:39.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.574+0000 7f58cf7fe640 1 -- 172.21.15.18:0/643103805 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58bc003530 con 0x7f58b00036f0 2024-04-17T19:52:39.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.574+0000 7f58cf7fe640 1 -- 172.21.15.18:0/643103805 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 645781751 0 0) 0x7f58bc003530 con 0x7f58b00036f0 2024-04-17T19:52:39.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.574+0000 7f58cf7fe640 1 -- 172.21.15.18:0/643103805 >> v2:172.21.15.173:3300/0 conn(0x7f58b0007390 msgr2=0x7f58b00098a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-17T19:52:39.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.574+0000 7f58cf7fe640 1 --2- 172.21.15.18:0/643103805 >> v2:172.21.15.173:3300/0 conn(0x7f58b0007390 0x7f58b00098a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:39.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.574+0000 7f58cf7fe640 1 -- 172.21.15.18:0/643103805 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58b000afa0 con 0x7f58b00036f0 2024-04-17T19:52:39.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.574+0000 7f58cf7fe640 1 -- 172.21.15.18:0/643103805 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3208559991 0 0) 0x7f58c000f040 con 0x7f58b00036f0 2024-04-17T19:52:39.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.574+0000 7f58cf7fe640 1 -- 172.21.15.18:0/643103805 >> v1:172.21.15.18:6789/0 conn(0x7f58b00036f0 legacy=0x7f58b0005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:39.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.574+0000 7f58d4ccb640 1 -- 172.21.15.18:0/643103805 reap_dead start 2024-04-17T19:52:39.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.578+0000 7f58cf7fe640 1 --2- 172.21.15.18:0/643103805 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58bc003a10 0x7f58bc003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:39.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.578+0000 7f58cf7fe640 1 --2- 172.21.15.18:0/643103805 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58bc004810 0x7f58bc004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:39.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.578+0000 7f58cf7fe640 1 --2- 172.21.15.18:0/643103805 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58bc0053e0 0x7f58bc00ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:39.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.578+0000 7f58cf7fe640 1 -- 172.21.15.18:0/643103805 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f58d006dc70 con 0x7f58bc0053e0 2024-04-17T19:52:39.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.578+0000 7f58cf7fe640 1 -- 172.21.15.18:0/643103805 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f58bc00c370 con 0x7f58bc004810 2024-04-17T19:52:39.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.578+0000 7f58cf7fe640 1 -- 172.21.15.18:0/643103805 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f58bc00c570 con 0x7f58bc003a10 2024-04-17T19:52:39.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.578+0000 7f58d4ccb640 1 --2- 172.21.15.18:0/643103805 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58bc0053e0 0x7f58bc00ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:39.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.578+0000 7f58cffff640 1 --2- 172.21.15.18:0/643103805 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58bc003a10 0x7f58bc003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:39.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.578+0000 7f58c77fe640 1 --2- 172.21.15.18:0/643103805 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58bc004810 0x7f58bc004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:39.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.578+0000 7f58d4ccb640 1 -- 172.21.15.18:0/643103805 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58bc003a10 msgr2=0x7f58bc003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:52:39.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.578+0000 7f58d4ccb640 1 --2- 172.21.15.18:0/643103805 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58bc003a10 0x7f58bc003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:39.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.578+0000 7f58d4ccb640 1 -- 172.21.15.18:0/643103805 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58bc004810 msgr2=0x7f58bc004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:52:39.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.578+0000 7f58d4ccb640 1 --2- 172.21.15.18:0/643103805 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58bc004810 0x7f58bc004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:39.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.578+0000 7f58d4ccb640 1 -- 172.21.15.18:0/643103805 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58bc003530 con 0x7f58bc0053e0 2024-04-17T19:52:39.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.578+0000 7f58c77fe640 1 --2- 172.21.15.18:0/643103805 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58bc004810 0x7f58bc004c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T19:52:39.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.578+0000 7f58cffff640 1 --2- 172.21.15.18:0/643103805 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58bc003a10 0x7f58bc003e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T19:52:39.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.582+0000 7f58d4ccb640 1 --2- 172.21.15.18:0/643103805 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58bc0053e0 0x7f58bc00ba90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f58d0072870 tx=0x7f58c801c140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e63db87a235d734 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:52:39.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.582+0000 7f58cf7fe640 1 -- 172.21.15.18:0/643103805 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c80018f0 con 0x7f58bc0053e0 2024-04-17T19:52:39.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.582+0000 7f58cf7fe640 1 -- 172.21.15.18:0/643103805 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58c8005d50 con 0x7f58bc0053e0 2024-04-17T19:52:39.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.582+0000 7f58cf7fe640 1 -- 172.21.15.18:0/643103805 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c8003bc0 con 0x7f58bc0053e0 2024-04-17T19:52:39.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.586+0000 7f58d672e640 1 -- 172.21.15.18:0/643103805 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58bc0053e0 msgr2=0x7f58bc00ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:39.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.586+0000 7f58d672e640 1 --2- 172.21.15.18:0/643103805 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58bc0053e0 0x7f58bc00ba90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f58d0072870 tx=0x7f58c801c140 comp rx=0 tx=0).stop 2024-04-17T19:52:39.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.586+0000 7f58d672e640 1 -- 172.21.15.18:0/643103805 shutdown_connections 2024-04-17T19:52:39.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.586+0000 7f58d672e640 1 --2- 172.21.15.18:0/643103805 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58bc0053e0 0x7f58bc00ba90 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:39.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.586+0000 7f58d672e640 1 --2- 172.21.15.18:0/643103805 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58bc004810 0x7f58bc004c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:39.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.586+0000 7f58d672e640 1 --2- 172.21.15.18:0/643103805 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58bc003a10 0x7f58bc003e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:39.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.586+0000 7f58d672e640 1 -- 172.21.15.18:0/643103805 >> 172.21.15.18:0/643103805 conn(0x7f58d009aa70 msgr2=0x7f58d009ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:52:39.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.586+0000 7f58d672e640 1 -- 172.21.15.18:0/643103805 shutdown_connections 2024-04-17T19:52:39.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.586+0000 7f58d672e640 1 -- 172.21.15.18:0/643103805 wait complete. 2024-04-17T19:52:39.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.590+0000 7f58d672e640 1 Processor -- start 2024-04-17T19:52:39.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.590+0000 7f58d672e640 1 -- start start 2024-04-17T19:52:39.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.594+0000 7f58d672e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58bc003a10 0x7f58d01569e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:39.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.594+0000 7f58d672e640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58bc004810 0x7f58d0158b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:39.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.594+0000 7f58d672e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58bc0053e0 0x7f58d01590d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:39.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.594+0000 7f58d672e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f58d006d900 con 0x7f58bc0053e0 2024-04-17T19:52:39.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.594+0000 7f58d672e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f58d00cede0 con 0x7f58bc003a10 2024-04-17T19:52:39.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.594+0000 7f58d672e640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f58d006edb0 con 0x7f58bc004810 2024-04-17T19:52:39.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.594+0000 7f58d4ccb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58bc0053e0 0x7f58d01590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:39.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.594+0000 7f58d4ccb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58bc0053e0 0x7f58d01590d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40344/0 (socket says 172.21.15.18:40344) 2024-04-17T19:52:39.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.594+0000 7f58d4ccb640 1 -- 172.21.15.18:0/484952498 learned_addr learned my addr 172.21.15.18:0/484952498 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:52:39.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.594+0000 7f58c77fe640 1 --2- 172.21.15.18:0/484952498 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58bc004810 0x7f58d0158b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:39.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.594+0000 7f58d4ccb640 1 -- 172.21.15.18:0/484952498 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58bc004810 msgr2=0x7f58d0158b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:39.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.594+0000 7f58d4ccb640 1 --2- 172.21.15.18:0/484952498 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58bc004810 0x7f58d0158b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:39.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.594+0000 7f58d4ccb640 1 -- 172.21.15.18:0/484952498 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58bc003a10 msgr2=0x7f58d01569e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:39.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.594+0000 7f58d4ccb640 1 --2- 172.21.15.18:0/484952498 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58bc003a10 0x7f58d01569e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:39.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.594+0000 7f58d4ccb640 1 -- 172.21.15.18:0/484952498 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58d009ef40 con 0x7f58bc0053e0 2024-04-17T19:52:39.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.594+0000 7f58d4ccb640 1 --2- 172.21.15.18:0/484952498 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58bc0053e0 0x7f58d01590d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f58c8000f90 tx=0x7f58bc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:52:39.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.598+0000 7f58cd7fa640 1 -- 172.21.15.18:0/484952498 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c8003b80 con 0x7f58bc0053e0 2024-04-17T19:52:39.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.598+0000 7f58cd7fa640 1 -- 172.21.15.18:0/484952498 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58c8003d20 con 0x7f58bc0053e0 2024-04-17T19:52:39.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.598+0000 7f58d672e640 1 -- 172.21.15.18:0/484952498 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58d009bd40 con 0x7f58bc0053e0 2024-04-17T19:52:39.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.598+0000 7f58cd7fa640 1 -- 172.21.15.18:0/484952498 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c8004240 con 0x7f58bc0053e0 2024-04-17T19:52:39.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.598+0000 7f58d672e640 1 -- 172.21.15.18:0/484952498 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58d015d860 con 0x7f58bc0053e0 2024-04-17T19:52:39.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.598+0000 7f58cd7fa640 1 -- 172.21.15.18:0/484952498 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f58c80b6070 con 0x7f58bc0053e0 2024-04-17T19:52:39.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.598+0000 7f58cd7fa640 1 -- 172.21.15.18:0/484952498 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f58c80077f0 con 0x7f58bc0053e0 2024-04-17T19:52:39.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.598+0000 7f58d672e640 1 -- 172.21.15.18:0/484952498 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58d015dac0 con 0x7f58bc0053e0 2024-04-17T19:52:39.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.618+0000 7f58cd7fa640 1 -- 172.21.15.18:0/484952498 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f58d00b72c0 con 0x7f58bc0053e0 2024-04-17T19:52:39.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.686+0000 7f58d672e640 1 -- 172.21.15.18:0/484952498 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f58d00b2a90 con 0x7f58bc0053e0 2024-04-17T19:52:39.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.690+0000 7f58cd7fa640 1 -- 172.21.15.18:0/484952498 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f58c80079f0 con 0x7f58bc0053e0 2024-04-17T19:52:39.685 INFO:teuthology.orchestra.run.smithi018.stderr:adjusted tunables profile to default 2024-04-17T19:52:39.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.694+0000 7f58d672e640 1 -- 172.21.15.18:0/484952498 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58bc0053e0 msgr2=0x7f58d01590d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:39.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.694+0000 7f58d672e640 1 --2- 172.21.15.18:0/484952498 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58bc0053e0 0x7f58d01590d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f58c8000f90 tx=0x7f58bc005840 comp rx=0 tx=0).stop 2024-04-17T19:52:39.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.694+0000 7f58d672e640 1 -- 172.21.15.18:0/484952498 shutdown_connections 2024-04-17T19:52:39.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.694+0000 7f58d672e640 1 --2- 172.21.15.18:0/484952498 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58bc0053e0 0x7f58d01590d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:39.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.694+0000 7f58d672e640 1 --2- 172.21.15.18:0/484952498 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58bc004810 0x7f58d0158b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:39.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.694+0000 7f58d672e640 1 --2- 172.21.15.18:0/484952498 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58bc003a10 0x7f58d01569e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:39.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.694+0000 7f58d672e640 1 -- 172.21.15.18:0/484952498 >> 172.21.15.18:0/484952498 conn(0x7f58d009aa70 msgr2=0x7f58d015b610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:52:39.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.694+0000 7f58d672e640 1 -- 172.21.15.18:0/484952498 shutdown_connections 2024-04-17T19:52:39.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:39.694+0000 7f58d672e640 1 -- 172.21.15.18:0/484952498 wait complete. 2024-04-17T19:52:39.708 INFO:tasks.ceph:check_enable_crimson: False 2024-04-17T19:52:39.708 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-17T19:52:39.709 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-17T19:52:39.709 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-17T19:52:39.721 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-17T19:52:39.721 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-17T19:52:39.778 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-17T19:52:39.778 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-17T19:52:39.807 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-17T19:52:39.814+0000 7f251ea79180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-17T19:52:39.819 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-17T19:52:39.820 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-17T19:52:39.874 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-17T19:52:39.875 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-17T19:52:39.889 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-17T19:52:39.889 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-17T19:52:39.947 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-17T19:52:39.947 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-17T19:52:40.003 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-17T19:52:40.003 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-17T19:52:40.058 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new e232d577-2508-4ea4-b355-29fbae1ff025 0 2024-04-17T19:52:40.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.264+0000 7f9960b1a640 1 Processor -- start 2024-04-17T19:52:40.258 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.264+0000 7f9960b1a640 1 -- start start 2024-04-17T19:52:40.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.264+0000 7f9960b1a640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f995c0b51b0 0x7f995c142c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:40.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.264+0000 7f9960b1a640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f995c0b55c0 0x7f995c1431c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:40.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.264+0000 7f9960b1a640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f995c0b4110 con 0x7f995c0d0480 2024-04-17T19:52:40.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.264+0000 7f9960b1a640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f995c0b4d20 con 0x7f995c0b51b0 2024-04-17T19:52:40.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.264+0000 7f9960b1a640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f995c0b43f0 con 0x7f995c0b55c0 2024-04-17T19:52:40.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.264+0000 7f9951d9b640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f995c0b51b0 0x7f995c142c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:40.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.264+0000 7f995ad9d640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f995c0b55c0 0x7f995c1431c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:40.261 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.264+0000 7f9951d9b640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f995c0b51b0 0x7f995c142c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41464/0 (socket says 172.21.15.173:41464) 2024-04-17T19:52:40.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.264+0000 7f9951d9b640 1 -- 172.21.15.173:0/2173215985 learned_addr learned my addr 172.21.15.173:0/2173215985 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-17T19:52:40.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.264+0000 7f995ad9d640 1 -- 172.21.15.173:0/2173215985 >> v2:172.21.15.173:3300/0 conn(0x7f995c0b51b0 msgr2=0x7f995c142c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:52:40.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.264+0000 7f995ad9d640 1 --2- 172.21.15.173:0/2173215985 >> v2:172.21.15.173:3300/0 conn(0x7f995c0b51b0 0x7f995c142c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:40.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.264+0000 7f995ad9d640 1 -- 172.21.15.173:0/2173215985 >> v1:172.21.15.18:6789/0 conn(0x7f995c0d0480 legacy=0x7f995c142330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:40.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.264+0000 7f995ad9d640 1 -- 172.21.15.173:0/2173215985 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f995c0b46d0 con 0x7f995c0b55c0 2024-04-17T19:52:40.262 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.264+0000 7f9951d9b640 1 --2- 172.21.15.173:0/2173215985 >> v2:172.21.15.173:3300/0 conn(0x7f995c0b51b0 0x7f995c142c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T19:52:40.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.268+0000 7f995ad9d640 1 --2- 172.21.15.173:0/2173215985 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f995c0b55c0 0x7f995c1431c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9954009d90 tx=0x7f995401c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4dda1baf1d37e40a server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:52:40.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.268+0000 7f9959d9b640 1 -- 172.21.15.173:0/2173215985 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99540b2070 con 0x7f995c0b55c0 2024-04-17T19:52:40.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.268+0000 7f9959d9b640 1 -- 172.21.15.173:0/2173215985 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99540a5830 con 0x7f995c0b55c0 2024-04-17T19:52:40.263 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.268+0000 7f9959d9b640 1 -- 172.21.15.173:0/2173215985 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99540a5c00 con 0x7f995c0b55c0 2024-04-17T19:52:40.264 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.268+0000 7f9960b1a640 1 -- 172.21.15.173:0/2173215985 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f995c0b55c0 msgr2=0x7f995c1431c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:40.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.268+0000 7f9960b1a640 1 --2- 172.21.15.173:0/2173215985 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f995c0b55c0 0x7f995c1431c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9954009d90 tx=0x7f995401c970 comp rx=0 tx=0).stop 2024-04-17T19:52:40.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.268+0000 7f9960b1a640 1 -- 172.21.15.173:0/2173215985 shutdown_connections 2024-04-17T19:52:40.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.268+0000 7f9960b1a640 1 --2- 172.21.15.173:0/2173215985 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f995c0b55c0 0x7f995c1431c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:40.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.268+0000 7f9960b1a640 1 --2- 172.21.15.173:0/2173215985 >> v2:172.21.15.173:3300/0 conn(0x7f995c0b51b0 0x7f995c142c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:40.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.268+0000 7f9960b1a640 1 -- 172.21.15.173:0/2173215985 >> 172.21.15.173:0/2173215985 conn(0x7f995c073820 msgr2=0x7f995c06bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:52:40.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.268+0000 7f9960b1a640 1 -- 172.21.15.173:0/2173215985 shutdown_connections 2024-04-17T19:52:40.265 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.268+0000 7f9960b1a640 1 -- 172.21.15.173:0/2173215985 wait complete. 2024-04-17T19:52:40.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.272+0000 7f9960b1a640 1 Processor -- start 2024-04-17T19:52:40.267 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.272+0000 7f9960b1a640 1 -- start start 2024-04-17T19:52:40.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.272+0000 7f9960b1a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f995c0b51b0 0x7f995c1415f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:40.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.272+0000 7f9960b1a640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f995c0b55c0 0x7f995c15b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:40.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.272+0000 7f9960b1a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f995c0d0480 0x7f995c15d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:40.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.272+0000 7f9960b1a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f995c166e70 con 0x7f995c0b51b0 2024-04-17T19:52:40.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.272+0000 7f9960b1a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f995c166cf0 con 0x7f995c0d0480 2024-04-17T19:52:40.270 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.272+0000 7f9960b1a640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f995c166ff0 con 0x7f995c0b55c0 2024-04-17T19:52:40.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.272+0000 7f995ad9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f995c0d0480 0x7f995c15d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:40.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.272+0000 7f9951d9b640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f995c0b55c0 0x7f995c15b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:40.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.272+0000 7f995ad9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f995c0d0480 0x7f995c15d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41472/0 (socket says 172.21.15.173:41472) 2024-04-17T19:52:40.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.272+0000 7f9951d9b640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f995c0b55c0 0x7f995c15b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.173:53512/0 (socket says 172.21.15.173:53512) 2024-04-17T19:52:40.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.272+0000 7f995ad9d640 1 -- 172.21.15.173:0/598086082 learned_addr learned my addr 172.21.15.173:0/598086082 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-17T19:52:40.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.272+0000 7f995a59c640 1 --2- 172.21.15.173:0/598086082 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f995c0b51b0 0x7f995c1415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:40.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.272+0000 7f9951d9b640 1 -- 172.21.15.173:0/598086082 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f995c0d0480 msgr2=0x7f995c15d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:40.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.272+0000 7f9951d9b640 1 --2- 172.21.15.173:0/598086082 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f995c0d0480 0x7f995c15d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:40.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.272+0000 7f9951d9b640 1 -- 172.21.15.173:0/598086082 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f995c0b51b0 msgr2=0x7f995c1415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:40.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.272+0000 7f9951d9b640 1 --2- 172.21.15.173:0/598086082 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f995c0b51b0 0x7f995c1415f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:40.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.272+0000 7f9951d9b640 1 -- 172.21.15.173:0/598086082 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f995c140340 con 0x7f995c0b55c0 2024-04-17T19:52:40.271 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.272+0000 7f995a59c640 1 --2- 172.21.15.173:0/598086082 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f995c0b51b0 0x7f995c1415f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:52:40.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.272+0000 7f995ad9d640 1 --2- 172.21.15.173:0/598086082 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f995c0d0480 0x7f995c15d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T19:52:40.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.272+0000 7f9951d9b640 1 --2- 172.21.15.173:0/598086082 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f995c0b55c0 0x7f995c15b630 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f994400e8b0 tx=0x7f994400ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:52:40.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.272+0000 7f99537fe640 1 -- 172.21.15.173:0/598086082 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9944004030 con 0x7f995c0b55c0 2024-04-17T19:52:40.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.272+0000 7f99537fe640 1 -- 172.21.15.173:0/598086082 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99440041d0 con 0x7f995c0b55c0 2024-04-17T19:52:40.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.272+0000 7f9960b1a640 1 -- 172.21.15.173:0/598086082 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f995c140870 con 0x7f995c0b55c0 2024-04-17T19:52:40.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.272+0000 7f99537fe640 1 -- 172.21.15.173:0/598086082 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f994400c940 con 0x7f995c0b55c0 2024-04-17T19:52:40.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.272+0000 7f9960b1a640 1 -- 172.21.15.173:0/598086082 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f995c140df0 con 0x7f995c0b55c0 2024-04-17T19:52:40.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.272+0000 7f99537fe640 1 -- 172.21.15.173:0/598086082 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f99440059a0 con 0x7f995c0b55c0 2024-04-17T19:52:40.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.272+0000 7f99537fe640 1 -- 172.21.15.173:0/598086082 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f9944006360 con 0x7f995c0b55c0 2024-04-17T19:52:40.272 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.276+0000 7f9960b1a640 1 -- 172.21.15.173:0/598086082 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f995c0698e0 con 0x7f995c0b55c0 2024-04-17T19:52:40.273 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.276+0000 7f99537fe640 1 -- 172.21.15.173:0/598086082 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f9944017020 con 0x7f995c0b55c0 2024-04-17T19:52:40.298 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-17T19:52:40.306+0000 7f251ea79180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-17T19:52:40.342 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.348+0000 7f9960b1a640 1 -- 172.21.15.173:0/598086082 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e232d577-2508-4ea4-b355-29fbae1ff025", "id": 0} v 0) -- 0x7f995c140060 con 0x7f995c0b55c0 2024-04-17T19:52:40.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.356+0000 7f99537fe640 1 -- 172.21.15.173:0/598086082 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e232d577-2508-4ea4-b355-29fbae1ff025", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f99440093b0 con 0x7f995c0b55c0 2024-04-17T19:52:40.354 INFO:teuthology.orchestra.run.smithi173.stdout:0 2024-04-17T19:52:40.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.356+0000 7f9960b1a640 1 -- 172.21.15.173:0/598086082 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f995c0b55c0 msgr2=0x7f995c15b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:40.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.356+0000 7f9960b1a640 1 --2- 172.21.15.173:0/598086082 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f995c0b55c0 0x7f995c15b630 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f994400e8b0 tx=0x7f994400ed70 comp rx=0 tx=0).stop 2024-04-17T19:52:40.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.356+0000 7f9960b1a640 1 -- 172.21.15.173:0/598086082 shutdown_connections 2024-04-17T19:52:40.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.356+0000 7f9960b1a640 1 --2- 172.21.15.173:0/598086082 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f995c0d0480 0x7f995c15d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:40.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.356+0000 7f9960b1a640 1 --2- 172.21.15.173:0/598086082 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f995c0b55c0 0x7f995c15b630 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:40.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.356+0000 7f9960b1a640 1 --2- 172.21.15.173:0/598086082 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f995c0b51b0 0x7f995c1415f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:40.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.356+0000 7f9960b1a640 1 -- 172.21.15.173:0/598086082 >> 172.21.15.173:0/598086082 conn(0x7f995c073820 msgr2=0x7f995c0af740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:52:40.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.356+0000 7f9960b1a640 1 -- 172.21.15.173:0/598086082 shutdown_connections 2024-04-17T19:52:40.355 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.356+0000 7f9960b1a640 1 -- 172.21.15.173:0/598086082 wait complete. 2024-04-17T19:52:40.371 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new 31810ef3-2c71-48d6-8748-b74a2968d23b 1 2024-04-17T19:52:40.490 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-04-17T19:52:40.496+0000 7f591ece7180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-17T19:52:40.500 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-17T19:52:40.506+0000 7f251ea79180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-17T19:52:40.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.524+0000 7f588e50b640 1 Processor -- start 2024-04-17T19:52:40.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.524+0000 7f588e50b640 1 -- start start 2024-04-17T19:52:40.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.524+0000 7f588e50b640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f588815c2d0 0x7f588806e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:40.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.524+0000 7f588e50b640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f588806e9a0 0x7f58880b6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:40.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.524+0000 7f588e50b640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58880b72c0 con 0x7f58880b6eb0 2024-04-17T19:52:40.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.524+0000 7f588e50b640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f588806dc70 con 0x7f588815c2d0 2024-04-17T19:52:40.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.524+0000 7f588e50b640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f58880ce8b0 con 0x7f588806e9a0 2024-04-17T19:52:40.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.524+0000 7f58877fe640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f588806e9a0 0x7f58880b6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:40.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.524+0000 7f5887fff640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f588815c2d0 0x7f588806e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:40.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.524+0000 7f5887fff640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f588815c2d0 0x7f588806e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41510/0 (socket says 172.21.15.173:41510) 2024-04-17T19:52:40.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.524+0000 7f5887fff640 1 -- 172.21.15.173:0/616229938 learned_addr learned my addr 172.21.15.173:0/616229938 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-17T19:52:40.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.524+0000 7f58877fe640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f588806e9a0 0x7f58880b6970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.173:53522/0 (socket says 172.21.15.173:53522) 2024-04-17T19:52:40.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.524+0000 7f5887fff640 1 -- 172.21.15.173:0/616229938 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f588806e9a0 msgr2=0x7f58880b6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:52:40.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.524+0000 7f5887fff640 1 --2- 172.21.15.173:0/616229938 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f588806e9a0 0x7f58880b6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:40.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.524+0000 7f5887fff640 1 -- 172.21.15.173:0/616229938 >> v1:172.21.15.18:6789/0 conn(0x7f58880b6eb0 legacy=0x7f58880cf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:40.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.524+0000 7f5887fff640 1 -- 172.21.15.173:0/616229938 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f588815c6e0 con 0x7f588815c2d0 2024-04-17T19:52:40.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.524+0000 7f58877fe640 1 --2- 172.21.15.173:0/616229938 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f588806e9a0 0x7f58880b6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T19:52:40.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.528+0000 7f5887fff640 1 --2- 172.21.15.173:0/616229938 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f588815c2d0 0x7f588806e100 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5878009870 tx=0x7f587801c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed369296fecd6a1b server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:52:40.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.528+0000 7f5886ffd640 1 -- 172.21.15.173:0/616229938 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58780b2070 con 0x7f588815c2d0 2024-04-17T19:52:40.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.528+0000 7f5886ffd640 1 -- 172.21.15.173:0/616229938 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58780a9070 con 0x7f588815c2d0 2024-04-17T19:52:40.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.528+0000 7f5886ffd640 1 -- 172.21.15.173:0/616229938 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58780ad880 con 0x7f588815c2d0 2024-04-17T19:52:40.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.528+0000 7f588e50b640 1 -- 172.21.15.173:0/616229938 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f588815c2d0 msgr2=0x7f588806e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:40.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.528+0000 7f588e50b640 1 --2- 172.21.15.173:0/616229938 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f588815c2d0 0x7f588806e100 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5878009870 tx=0x7f587801c560 comp rx=0 tx=0).stop 2024-04-17T19:52:40.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.528+0000 7f588e50b640 1 -- 172.21.15.173:0/616229938 shutdown_connections 2024-04-17T19:52:40.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.528+0000 7f588e50b640 1 --2- 172.21.15.173:0/616229938 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f588806e9a0 0x7f58880b6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:40.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.528+0000 7f588e50b640 1 --2- 172.21.15.173:0/616229938 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f588815c2d0 0x7f588806e100 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:40.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.528+0000 7f588e50b640 1 -- 172.21.15.173:0/616229938 >> 172.21.15.173:0/616229938 conn(0x7f588809aa70 msgr2=0x7f588809ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:52:40.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.528+0000 7f588e50b640 1 -- 172.21.15.173:0/616229938 shutdown_connections 2024-04-17T19:52:40.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.528+0000 7f588e50b640 1 -- 172.21.15.173:0/616229938 wait complete. 2024-04-17T19:52:40.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.528+0000 7f588e50b640 1 Processor -- start 2024-04-17T19:52:40.526 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.528+0000 7f588e50b640 1 -- start start 2024-04-17T19:52:40.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.532+0000 7f588e50b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f588806e9a0 0x7f5888159460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:40.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.532+0000 7f588e50b640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58880b6eb0 0x7f5888151a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:40.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.532+0000 7f588e50b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f588815c2d0 0x7f588815eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:40.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.532+0000 7f588e50b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f58880d0300 con 0x7f588815c2d0 2024-04-17T19:52:40.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.532+0000 7f588e50b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f588806edb0 con 0x7f588806e9a0 2024-04-17T19:52:40.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.532+0000 7f588e50b640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f58880d0480 con 0x7f58880b6eb0 2024-04-17T19:52:40.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.532+0000 7f5887fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f588806e9a0 0x7f5888159460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:40.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.532+0000 7f58877fe640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58880b6eb0 0x7f5888151a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:40.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.532+0000 7f5887fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f588806e9a0 0x7f5888159460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41522/0 (socket says 172.21.15.173:41522) 2024-04-17T19:52:40.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.532+0000 7f5887fff640 1 -- 172.21.15.173:0/2824120146 learned_addr learned my addr 172.21.15.173:0/2824120146 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-17T19:52:40.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.532+0000 7f588caa8640 1 --2- 172.21.15.173:0/2824120146 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f588815c2d0 0x7f588815eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:40.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.532+0000 7f5887fff640 1 -- 172.21.15.173:0/2824120146 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58880b6eb0 msgr2=0x7f5888151a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:40.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.532+0000 7f5887fff640 1 --2- 172.21.15.173:0/2824120146 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58880b6eb0 0x7f5888151a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:40.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.532+0000 7f5887fff640 1 -- 172.21.15.173:0/2824120146 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f588815c2d0 msgr2=0x7f588815eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:40.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.532+0000 7f5887fff640 1 --2- 172.21.15.173:0/2824120146 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f588815c2d0 0x7f588815eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:40.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.532+0000 7f5887fff640 1 -- 172.21.15.173:0/2824120146 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f588813ff60 con 0x7f588806e9a0 2024-04-17T19:52:40.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.532+0000 7f5887fff640 1 --2- 172.21.15.173:0/2824120146 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f588806e9a0 0x7f5888159460 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f587801ac10 tx=0x7f587801ada0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:52:40.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.532+0000 7f5884ff9640 1 -- 172.21.15.173:0/2824120146 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58780b2040 con 0x7f588806e9a0 2024-04-17T19:52:40.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.532+0000 7f5884ff9640 1 -- 172.21.15.173:0/2824120146 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58780be070 con 0x7f588806e9a0 2024-04-17T19:52:40.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.532+0000 7f5884ff9640 1 -- 172.21.15.173:0/2824120146 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58780b8420 con 0x7f588806e9a0 2024-04-17T19:52:40.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.532+0000 7f588e50b640 1 -- 172.21.15.173:0/2824120146 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5888140240 con 0x7f588806e9a0 2024-04-17T19:52:40.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.532+0000 7f588e50b640 1 -- 172.21.15.173:0/2824120146 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5888140800 con 0x7f588806e9a0 2024-04-17T19:52:40.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.532+0000 7f5884ff9640 1 -- 172.21.15.173:0/2824120146 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f58780ab070 con 0x7f588806e9a0 2024-04-17T19:52:40.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.532+0000 7f5884ff9640 1 -- 172.21.15.173:0/2824120146 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f58780c35a0 con 0x7f588806e9a0 2024-04-17T19:52:40.530 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.536+0000 7f588e50b640 1 -- 172.21.15.173:0/2824120146 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58880698e0 con 0x7f588806e9a0 2024-04-17T19:52:40.532 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.536+0000 7f5884ff9640 1 -- 172.21.15.173:0/2824120146 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f5878016150 con 0x7f588806e9a0 2024-04-17T19:52:40.603 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.608+0000 7f588e50b640 1 -- 172.21.15.173:0/2824120146 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd new", "uuid": "31810ef3-2c71-48d6-8748-b74a2968d23b", "id": 1} v 0) -- 0x7f58881524e0 con 0x7f588806e9a0 2024-04-17T19:52:40.609 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.612+0000 7f5884ff9640 1 -- 172.21.15.173:0/2824120146 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "31810ef3-2c71-48d6-8748-b74a2968d23b", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f5878005a70 con 0x7f588806e9a0 2024-04-17T19:52:40.609 INFO:teuthology.orchestra.run.smithi173.stdout:1 2024-04-17T19:52:40.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.616+0000 7f588e50b640 1 -- 172.21.15.173:0/2824120146 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f588806e9a0 msgr2=0x7f5888159460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:40.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.616+0000 7f588e50b640 1 --2- 172.21.15.173:0/2824120146 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f588806e9a0 0x7f5888159460 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f587801ac10 tx=0x7f587801ada0 comp rx=0 tx=0).stop 2024-04-17T19:52:40.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.616+0000 7f588e50b640 1 -- 172.21.15.173:0/2824120146 shutdown_connections 2024-04-17T19:52:40.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.616+0000 7f588e50b640 1 --2- 172.21.15.173:0/2824120146 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f588815c2d0 0x7f588815eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:40.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.616+0000 7f588e50b640 1 --2- 172.21.15.173:0/2824120146 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58880b6eb0 0x7f5888151a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:40.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.616+0000 7f588e50b640 1 --2- 172.21.15.173:0/2824120146 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f588806e9a0 0x7f5888159460 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:40.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.616+0000 7f588e50b640 1 -- 172.21.15.173:0/2824120146 >> 172.21.15.173:0/2824120146 conn(0x7f588809aa70 msgr2=0x7f588809ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:52:40.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.616+0000 7f588e50b640 1 -- 172.21.15.173:0/2824120146 shutdown_connections 2024-04-17T19:52:40.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.616+0000 7f588e50b640 1 -- 172.21.15.173:0/2824120146 wait complete. 2024-04-17T19:52:40.628 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new 5a783cc5-a41c-4967-9e11-6b8330f97d05 2 2024-04-17T19:52:40.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.780+0000 7fbad82d0640 1 Processor -- start 2024-04-17T19:52:40.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.780+0000 7fbad82d0640 1 -- start start 2024-04-17T19:52:40.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.784+0000 7fbad82d0640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbad00cdd70 0x7fbad015d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:40.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.784+0000 7fbad82d0640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fbad00737e0 0x7fbad00b46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:40.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.784+0000 7fbad82d0640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbad015e8c0 con 0x7fbad00b0780 2024-04-17T19:52:40.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.784+0000 7fbad82d0640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fbad015d9f0 con 0x7fbad00cdd70 2024-04-17T19:52:40.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.784+0000 7fbad82d0640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7fbad00ce180 con 0x7fbad00737e0 2024-04-17T19:52:40.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.784+0000 7fbad686d640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fbad00737e0 0x7fbad00b46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:40.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.784+0000 7fbad686d640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fbad00737e0 0x7fbad00b46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41538/0 (socket says 172.21.15.173:41538) 2024-04-17T19:52:40.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.784+0000 7fbad686d640 1 -- 172.21.15.173:0/592665605 learned_addr learned my addr 172.21.15.173:0/592665605 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-17T19:52:40.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.784+0000 7fbad606c640 1 --2- 172.21.15.173:0/592665605 >> v2:172.21.15.18:3300/0 conn(0x7fbad00cdd70 0x7fbad015d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:40.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.784+0000 7fbad686d640 1 -- 172.21.15.173:0/592665605 >> v2:172.21.15.18:3300/0 conn(0x7fbad00cdd70 msgr2=0x7fbad015d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:52:40.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.784+0000 7fbad686d640 1 --2- 172.21.15.173:0/592665605 >> v2:172.21.15.18:3300/0 conn(0x7fbad00cdd70 0x7fbad015d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:40.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.784+0000 7fbad686d640 1 -- 172.21.15.173:0/592665605 >> v1:172.21.15.18:6789/0 conn(0x7fbad00b0780 legacy=0x7fbad00730d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:40.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.784+0000 7fbad686d640 1 -- 172.21.15.173:0/592665605 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbad015dc40 con 0x7fbad00737e0 2024-04-17T19:52:40.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.784+0000 7fbad686d640 1 --2- 172.21.15.173:0/592665605 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbad00737e0 0x7fbad00b46b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbad0068a30 tx=0x7fbac801c930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57a6ccf3b11a81b server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:52:40.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.784+0000 7fbad506a640 1 -- 172.21.15.173:0/592665605 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac80a57f0 con 0x7fbad00737e0 2024-04-17T19:52:40.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.784+0000 7fbad506a640 1 -- 172.21.15.173:0/592665605 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbac80a5990 con 0x7fbad00737e0 2024-04-17T19:52:40.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.784+0000 7fbad506a640 1 -- 172.21.15.173:0/592665605 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac80a5d60 con 0x7fbad00737e0 2024-04-17T19:52:40.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.788+0000 7fbad82d0640 1 -- 172.21.15.173:0/592665605 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbad00737e0 msgr2=0x7fbad00b46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:40.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.788+0000 7fbad82d0640 1 --2- 172.21.15.173:0/592665605 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbad00737e0 0x7fbad00b46b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbad0068a30 tx=0x7fbac801c930 comp rx=0 tx=0).stop 2024-04-17T19:52:40.783 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.788+0000 7fbad82d0640 1 -- 172.21.15.173:0/592665605 shutdown_connections 2024-04-17T19:52:40.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.788+0000 7fbad82d0640 1 --2- 172.21.15.173:0/592665605 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbad00737e0 0x7fbad00b46b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:40.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.788+0000 7fbad82d0640 1 --2- 172.21.15.173:0/592665605 >> v2:172.21.15.18:3300/0 conn(0x7fbad00cdd70 0x7fbad015d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:40.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.788+0000 7fbad82d0640 1 -- 172.21.15.173:0/592665605 >> 172.21.15.173:0/592665605 conn(0x7fbad00d1320 msgr2=0x7fbad00d1730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:52:40.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.788+0000 7fbad82d0640 1 -- 172.21.15.173:0/592665605 shutdown_connections 2024-04-17T19:52:40.784 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.788+0000 7fbad82d0640 1 -- 172.21.15.173:0/592665605 wait complete. 2024-04-17T19:52:40.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.788+0000 7fbad82d0640 1 Processor -- start 2024-04-17T19:52:40.785 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.788+0000 7fbad82d0640 1 -- start start 2024-04-17T19:52:40.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.792+0000 7fbad82d0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbad00b0780 0x7fbad0144dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:40.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.792+0000 7fbad82d0640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbad00cdd70 0x7fbad01577d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:40.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.792+0000 7fbad82d0640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbad0167b10 0x7fbad0156ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:40.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.792+0000 7fbad82d0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbad00b0d10 con 0x7fbad00b0780 2024-04-17T19:52:40.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.792+0000 7fbad82d0640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fbad00b0b90 con 0x7fbad00cdd70 2024-04-17T19:52:40.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.792+0000 7fbad82d0640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fbad016a100 con 0x7fbad0167b10 2024-04-17T19:52:40.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.792+0000 7fbad586b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbad00cdd70 0x7fbad01577d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:40.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.792+0000 7fbad686d640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbad0167b10 0x7fbad0156ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:40.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.792+0000 7fbad586b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbad00cdd70 0x7fbad01577d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41546/0 (socket says 172.21.15.173:41546) 2024-04-17T19:52:40.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.792+0000 7fbad586b640 1 -- 172.21.15.173:0/1903330578 learned_addr learned my addr 172.21.15.173:0/1903330578 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-17T19:52:40.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.792+0000 7fbad606c640 1 --2- 172.21.15.173:0/1903330578 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbad00b0780 0x7fbad0144dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:40.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.792+0000 7fbad586b640 1 -- 172.21.15.173:0/1903330578 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbad0167b10 msgr2=0x7fbad0156ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:40.788 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.792+0000 7fbad586b640 1 --2- 172.21.15.173:0/1903330578 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbad0167b10 0x7fbad0156ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:40.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.792+0000 7fbad586b640 1 -- 172.21.15.173:0/1903330578 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbad00b0780 msgr2=0x7fbad0144dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:40.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.792+0000 7fbad586b640 1 --2- 172.21.15.173:0/1903330578 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbad00b0780 0x7fbad0144dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:40.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.792+0000 7fbad586b640 1 -- 172.21.15.173:0/1903330578 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbad0166a70 con 0x7fbad00cdd70 2024-04-17T19:52:40.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.792+0000 7fbad586b640 1 --2- 172.21.15.173:0/1903330578 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbad00cdd70 0x7fbad01577d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbac000c3c0 tx=0x7fbac000c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:52:40.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.792+0000 7fbac6ffd640 1 -- 172.21.15.173:0/1903330578 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac00052d0 con 0x7fbad00cdd70 2024-04-17T19:52:40.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.792+0000 7fbac6ffd640 1 -- 172.21.15.173:0/1903330578 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbac00054b0 con 0x7fbad00cdd70 2024-04-17T19:52:40.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.792+0000 7fbad82d0640 1 -- 172.21.15.173:0/1903330578 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbad0166d50 con 0x7fbad00cdd70 2024-04-17T19:52:40.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.792+0000 7fbac6ffd640 1 -- 172.21.15.173:0/1903330578 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac0006a50 con 0x7fbad00cdd70 2024-04-17T19:52:40.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.792+0000 7fbad82d0640 1 -- 172.21.15.173:0/1903330578 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbad0167310 con 0x7fbad00cdd70 2024-04-17T19:52:40.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.792+0000 7fbac6ffd640 1 -- 172.21.15.173:0/1903330578 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbac0006bf0 con 0x7fbad00cdd70 2024-04-17T19:52:40.789 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.792+0000 7fbac6ffd640 1 -- 172.21.15.173:0/1903330578 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fbac0011590 con 0x7fbad00cdd70 2024-04-17T19:52:40.790 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.792+0000 7fbad82d0640 1 -- 172.21.15.173:0/1903330578 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbad00698e0 con 0x7fbad00cdd70 2024-04-17T19:52:40.791 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.796+0000 7fbac6ffd640 1 -- 172.21.15.173:0/1903330578 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fbac0003650 con 0x7fbad00cdd70 2024-04-17T19:52:40.860 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.864+0000 7fbad82d0640 1 -- 172.21.15.173:0/1903330578 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5a783cc5-a41c-4967-9e11-6b8330f97d05", "id": 2} v 0) -- 0x7fbad0166790 con 0x7fbad00cdd70 2024-04-17T19:52:40.866 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.872+0000 7fbac6ffd640 1 -- 172.21.15.173:0/1903330578 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5a783cc5-a41c-4967-9e11-6b8330f97d05", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fbac0003b00 con 0x7fbad00cdd70 2024-04-17T19:52:40.867 INFO:teuthology.orchestra.run.smithi173.stdout:2 2024-04-17T19:52:40.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.872+0000 7fbad82d0640 1 -- 172.21.15.173:0/1903330578 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbad00cdd70 msgr2=0x7fbad01577d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:40.868 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.872+0000 7fbad82d0640 1 --2- 172.21.15.173:0/1903330578 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbad00cdd70 0x7fbad01577d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbac000c3c0 tx=0x7fbac000c880 comp rx=0 tx=0).stop 2024-04-17T19:52:40.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.872+0000 7fbad82d0640 1 -- 172.21.15.173:0/1903330578 shutdown_connections 2024-04-17T19:52:40.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.872+0000 7fbad82d0640 1 --2- 172.21.15.173:0/1903330578 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbad0167b10 0x7fbad0156ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:40.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.872+0000 7fbad82d0640 1 --2- 172.21.15.173:0/1903330578 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbad00cdd70 0x7fbad01577d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:40.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.872+0000 7fbad82d0640 1 --2- 172.21.15.173:0/1903330578 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbad00b0780 0x7fbad0144dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:40.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.872+0000 7fbad82d0640 1 -- 172.21.15.173:0/1903330578 >> 172.21.15.173:0/1903330578 conn(0x7fbad00d1320 msgr2=0x7fbad01559b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:52:40.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.872+0000 7fbad82d0640 1 -- 172.21.15.173:0/1903330578 shutdown_connections 2024-04-17T19:52:40.869 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:40.872+0000 7fbad82d0640 1 -- 172.21.15.173:0/1903330578 wait complete. 2024-04-17T19:52:40.887 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new b7e056d9-9da5-46e1-810d-0c3e242fe5ec 3 2024-04-17T19:52:40.999 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-04-17T19:52:41.004+0000 7f591ece7180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-17T19:52:41.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.040+0000 7ff43cd74640 1 Processor -- start 2024-04-17T19:52:41.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.040+0000 7ff43cd74640 1 -- start start 2024-04-17T19:52:41.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.044+0000 7ff43cd74640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff438070010 0x7ff43815d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:41.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.044+0000 7ff43cd74640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff438161030 con 0x7ff4380d1650 2024-04-17T19:52:41.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.044+0000 7ff43cd74640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff438161310 con 0x7ff4380cd680 2024-04-17T19:52:41.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.044+0000 7ff43cd74640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7ff438160de0 con 0x7ff438070010 2024-04-17T19:52:41.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.044+0000 7ff435d9b640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff438070010 0x7ff43815d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:41.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.044+0000 7ff43659c640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7ff4380cd680 0x7ff43806f900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:44214/0 (socket says 172.21.15.173:44214) 2024-04-17T19:52:41.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.044+0000 7ff43659c640 1 -- 172.21.15.173:0/2366637449 learned_addr learned my addr 172.21.15.173:0/2366637449 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-17T19:52:41.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.044+0000 7ff43559a640 1 -- 172.21.15.173:0/2366637449 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1879706921 0 0) 0x7ff438161310 con 0x7ff4380cd680 2024-04-17T19:52:41.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.044+0000 7ff43559a640 1 -- 172.21.15.173:0/2366637449 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff420003530 con 0x7ff4380cd680 2024-04-17T19:52:41.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.044+0000 7ff435d9b640 1 -- 172.21.15.173:0/2366637449 >> v1:172.21.15.173:6789/0 conn(0x7ff4380cd680 legacy=0x7ff43806f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:41.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.044+0000 7ff435d9b640 1 -- 172.21.15.173:0/2366637449 >> v1:172.21.15.18:6789/0 conn(0x7ff4380d1650 legacy=0x7ff4380d1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:52:41.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.044+0000 7ff435d9b640 1 -- 172.21.15.173:0/2366637449 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4381615f0 con 0x7ff438070010 2024-04-17T19:52:41.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.044+0000 7ff435d9b640 1 --2- 172.21.15.173:0/2366637449 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff438070010 0x7ff43815d330 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff42c0097f0 tx=0x7ff42c01c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2546f7ac177f543 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:52:41.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.048+0000 7ff43559a640 1 -- 172.21.15.173:0/2366637449 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff42c0b0070 con 0x7ff438070010 2024-04-17T19:52:41.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.048+0000 7ff43559a640 1 -- 172.21.15.173:0/2366637449 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff42c0ab600 con 0x7ff438070010 2024-04-17T19:52:41.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.048+0000 7ff43559a640 1 -- 172.21.15.173:0/2366637449 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff42c0ab9d0 con 0x7ff438070010 2024-04-17T19:52:41.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.048+0000 7ff43cd74640 1 -- 172.21.15.173:0/2366637449 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff438070010 msgr2=0x7ff43815d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:41.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.048+0000 7ff43cd74640 1 --2- 172.21.15.173:0/2366637449 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff438070010 0x7ff43815d330 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff42c0097f0 tx=0x7ff42c01c380 comp rx=0 tx=0).stop 2024-04-17T19:52:41.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.048+0000 7ff43cd74640 1 -- 172.21.15.173:0/2366637449 shutdown_connections 2024-04-17T19:52:41.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.048+0000 7ff43cd74640 1 --2- 172.21.15.173:0/2366637449 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff438070010 0x7ff43815d330 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:41.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.048+0000 7ff43cd74640 1 -- 172.21.15.173:0/2366637449 >> 172.21.15.173:0/2366637449 conn(0x7ff4380cf780 msgr2=0x7ff4380cfb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:52:41.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.048+0000 7ff43cd74640 1 -- 172.21.15.173:0/2366637449 shutdown_connections 2024-04-17T19:52:41.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.048+0000 7ff43cd74640 1 -- 172.21.15.173:0/2366637449 wait complete. 2024-04-17T19:52:41.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.048+0000 7ff43cd74640 1 Processor -- start 2024-04-17T19:52:41.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.048+0000 7ff43cd74640 1 -- start start 2024-04-17T19:52:41.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.052+0000 7ff43cd74640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4380cd680 0x7ff43815f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:41.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.052+0000 7ff43cd74640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff4380d1650 0x7ff43815fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:41.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.052+0000 7ff43cd74640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff438158150 0x7ff438158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:41.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.052+0000 7ff43cd74640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff43816b520 con 0x7ff4380cd680 2024-04-17T19:52:41.050 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.052+0000 7ff43cd74640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff43816b3a0 con 0x7ff438158150 2024-04-17T19:52:41.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.052+0000 7ff43cd74640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7ff43816b6a0 con 0x7ff4380d1650 2024-04-17T19:52:41.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.052+0000 7ff435d9b640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff4380d1650 0x7ff43815fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:41.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.052+0000 7ff436d9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff438158150 0x7ff438158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:41.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.052+0000 7ff435d9b640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff4380d1650 0x7ff43815fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.173:53576/0 (socket says 172.21.15.173:53576) 2024-04-17T19:52:41.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.052+0000 7ff435d9b640 1 -- 172.21.15.173:0/3563246336 learned_addr learned my addr 172.21.15.173:0/3563246336 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-17T19:52:41.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.052+0000 7ff43659c640 1 --2- 172.21.15.173:0/3563246336 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4380cd680 0x7ff43815f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:41.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.052+0000 7ff435d9b640 1 -- 172.21.15.173:0/3563246336 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff438158150 msgr2=0x7ff438158860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:41.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.052+0000 7ff435d9b640 1 --2- 172.21.15.173:0/3563246336 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff438158150 0x7ff438158860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:41.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.052+0000 7ff435d9b640 1 -- 172.21.15.173:0/3563246336 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4380cd680 msgr2=0x7ff43815f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:41.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.052+0000 7ff435d9b640 1 --2- 172.21.15.173:0/3563246336 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4380cd680 0x7ff43815f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:41.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.052+0000 7ff435d9b640 1 -- 172.21.15.173:0/3563246336 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4381597e0 con 0x7ff4380d1650 2024-04-17T19:52:41.051 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.052+0000 7ff436d9d640 1 --2- 172.21.15.173:0/3563246336 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff438158150 0x7ff438158860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T19:52:41.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.052+0000 7ff435d9b640 1 --2- 172.21.15.173:0/3563246336 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff4380d1650 0x7ff43815fa40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff42c009740 tx=0x7ff42c019120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:52:41.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.052+0000 7ff426ffd640 1 -- 172.21.15.173:0/3563246336 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff42c0b0040 con 0x7ff4380d1650 2024-04-17T19:52:41.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.052+0000 7ff426ffd640 1 -- 172.21.15.173:0/3563246336 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff42c0b9070 con 0x7ff4380d1650 2024-04-17T19:52:41.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.052+0000 7ff43cd74640 1 -- 172.21.15.173:0/3563246336 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4381663c0 con 0x7ff4380d1650 2024-04-17T19:52:41.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.052+0000 7ff426ffd640 1 -- 172.21.15.173:0/3563246336 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff42c0b4650 con 0x7ff4380d1650 2024-04-17T19:52:41.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.052+0000 7ff43cd74640 1 -- 172.21.15.173:0/3563246336 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff438166980 con 0x7ff4380d1650 2024-04-17T19:52:41.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.052+0000 7ff426ffd640 1 -- 172.21.15.173:0/3563246336 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff42c0b47f0 con 0x7ff4380d1650 2024-04-17T19:52:41.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.052+0000 7ff426ffd640 1 -- 172.21.15.173:0/3563246336 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7ff42c0bed50 con 0x7ff4380d1650 2024-04-17T19:52:41.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.052+0000 7ff43cd74640 1 -- 172.21.15.173:0/3563246336 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4380698e0 con 0x7ff4380d1650 2024-04-17T19:52:41.052 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.056+0000 7ff426ffd640 1 -- 172.21.15.173:0/3563246336 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7ff42c016090 con 0x7ff4380d1650 2024-04-17T19:52:41.075 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-17T19:52:41.082+0000 7f251ea79180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-17T19:52:41.132 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-17T19:52:41.138+0000 7f251ea79180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-17T19:52:41.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.136+0000 7ff43cd74640 1 -- 172.21.15.173:0/3563246336 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b7e056d9-9da5-46e1-810d-0c3e242fe5ec", "id": 3} v 0) -- 0x7ff43815c740 con 0x7ff4380d1650 2024-04-17T19:52:41.138 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.144+0000 7ff426ffd640 1 -- 172.21.15.173:0/3563246336 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b7e056d9-9da5-46e1-810d-0c3e242fe5ec", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7ff42c0be460 con 0x7ff4380d1650 2024-04-17T19:52:41.138 INFO:teuthology.orchestra.run.smithi173.stdout:3 2024-04-17T19:52:41.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.144+0000 7ff43cd74640 1 -- 172.21.15.173:0/3563246336 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff4380d1650 msgr2=0x7ff43815fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:41.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.144+0000 7ff43cd74640 1 --2- 172.21.15.173:0/3563246336 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff4380d1650 0x7ff43815fa40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff42c009740 tx=0x7ff42c019120 comp rx=0 tx=0).stop 2024-04-17T19:52:41.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.144+0000 7ff43cd74640 1 -- 172.21.15.173:0/3563246336 shutdown_connections 2024-04-17T19:52:41.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.144+0000 7ff43cd74640 1 --2- 172.21.15.173:0/3563246336 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff438158150 0x7ff438158860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:41.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.144+0000 7ff43cd74640 1 --2- 172.21.15.173:0/3563246336 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff4380d1650 0x7ff43815fa40 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:41.139 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.144+0000 7ff43cd74640 1 --2- 172.21.15.173:0/3563246336 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4380cd680 0x7ff43815f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:41.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.144+0000 7ff43cd74640 1 -- 172.21.15.173:0/3563246336 >> 172.21.15.173:0/3563246336 conn(0x7ff4380cf780 msgr2=0x7ff4380b2710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:52:41.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.144+0000 7ff43cd74640 1 -- 172.21.15.173:0/3563246336 shutdown_connections 2024-04-17T19:52:41.140 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.144+0000 7ff43cd74640 1 -- 172.21.15.173:0/3563246336 wait complete. 2024-04-17T19:52:41.157 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new 21df023f-bc8b-4abb-93e5-0ecc91acda0e 4 2024-04-17T19:52:41.188 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-17T19:52:41.194+0000 7f251ea79180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-17T19:52:41.241 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-04-17T19:52:41.244+0000 7f591ece7180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-17T19:52:41.269 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-17T19:52:41.274+0000 7f251ea79180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-17T19:52:41.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.312+0000 7f8e55d4b640 1 Processor -- start 2024-04-17T19:52:41.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.312+0000 7f8e55d4b640 1 -- start start 2024-04-17T19:52:41.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.316+0000 7f8e55d4b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8e500b7080 0x7f8e500d26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:41.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.316+0000 7f8e55d4b640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8e500b2e00 0x7f8e500cc260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:41.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.316+0000 7f8e55d4b640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e500d1920 con 0x7f8e500ce160 2024-04-17T19:52:41.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.316+0000 7f8e55d4b640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f8e500b3500 con 0x7f8e500b7080 2024-04-17T19:52:41.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.316+0000 7f8e55d4b640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f8e500d2250 con 0x7f8e500b2e00 2024-04-17T19:52:41.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.316+0000 7f8e4ffff640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8e500b2e00 0x7f8e500cc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:41.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.316+0000 7f8e4ffff640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8e500b2e00 0x7f8e500cc260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.173:53580/0 (socket says 172.21.15.173:53580) 2024-04-17T19:52:41.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.316+0000 7f8e4ffff640 1 -- 172.21.15.173:0/3766862825 learned_addr learned my addr 172.21.15.173:0/3766862825 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-17T19:52:41.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.316+0000 7f8e4effd640 1 --2- 172.21.15.173:0/3766862825 >> v2:172.21.15.18:3300/0 conn(0x7f8e500b7080 0x7f8e500d26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:41.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.316+0000 7f8e4ffff640 1 -- 172.21.15.173:0/3766862825 >> v2:172.21.15.18:3300/0 conn(0x7f8e500b7080 msgr2=0x7f8e500d26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:52:41.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.316+0000 7f8e4ffff640 1 --2- 172.21.15.173:0/3766862825 >> v2:172.21.15.18:3300/0 conn(0x7f8e500b7080 0x7f8e500d26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:41.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.316+0000 7f8e4ffff640 1 -- 172.21.15.173:0/3766862825 >> v1:172.21.15.18:6789/0 conn(0x7f8e500ce160 legacy=0x7f8e500b6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:41.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.316+0000 7f8e4ffff640 1 -- 172.21.15.173:0/3766862825 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e500d1c00 con 0x7f8e500b2e00 2024-04-17T19:52:41.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.316+0000 7f8e4effd640 1 --2- 172.21.15.173:0/3766862825 >> v2:172.21.15.18:3300/0 conn(0x7f8e500b7080 0x7f8e500d26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:52:41.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.316+0000 7f8e4ffff640 1 --2- 172.21.15.173:0/3766862825 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8e500b2e00 0x7f8e500cc260 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8e40009e50 tx=0x7f8e4001c9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=853f5ec5f1d30b75 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:52:41.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.316+0000 7f8e4e7fc640 1 -- 172.21.15.173:0/3766862825 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e400a5730 con 0x7f8e500b2e00 2024-04-17T19:52:41.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.316+0000 7f8e4e7fc640 1 -- 172.21.15.173:0/3766862825 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e400a58d0 con 0x7f8e500b2e00 2024-04-17T19:52:41.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.316+0000 7f8e4e7fc640 1 -- 172.21.15.173:0/3766862825 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e400a5ca0 con 0x7f8e500b2e00 2024-04-17T19:52:41.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.320+0000 7f8e55d4b640 1 -- 172.21.15.173:0/3766862825 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8e500b2e00 msgr2=0x7f8e500cc260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:41.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.320+0000 7f8e55d4b640 1 --2- 172.21.15.173:0/3766862825 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8e500b2e00 0x7f8e500cc260 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8e40009e50 tx=0x7f8e4001c9a0 comp rx=0 tx=0).stop 2024-04-17T19:52:41.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.320+0000 7f8e55d4b640 1 -- 172.21.15.173:0/3766862825 shutdown_connections 2024-04-17T19:52:41.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.320+0000 7f8e55d4b640 1 --2- 172.21.15.173:0/3766862825 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8e500b2e00 0x7f8e500cc260 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:41.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.320+0000 7f8e55d4b640 1 --2- 172.21.15.173:0/3766862825 >> v2:172.21.15.18:3300/0 conn(0x7f8e500b7080 0x7f8e500d26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:41.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.320+0000 7f8e55d4b640 1 -- 172.21.15.173:0/3766862825 >> 172.21.15.173:0/3766862825 conn(0x7f8e5009aa70 msgr2=0x7f8e5009ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:52:41.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.320+0000 7f8e55d4b640 1 -- 172.21.15.173:0/3766862825 shutdown_connections 2024-04-17T19:52:41.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.320+0000 7f8e55d4b640 1 -- 172.21.15.173:0/3766862825 wait complete. 2024-04-17T19:52:41.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.320+0000 7f8e55d4b640 1 Processor -- start 2024-04-17T19:52:41.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.320+0000 7f8e55d4b640 1 -- start start 2024-04-17T19:52:41.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.324+0000 7f8e55d4b640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8e500b2e00 0x7f8e50146840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:41.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.324+0000 7f8e55d4b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e500ce160 0x7f8e5015c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:41.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.324+0000 7f8e55d4b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8e500b21b0 0x7f8e500ca2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:41.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.324+0000 7f8e55d4b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8e5016c5e0 con 0x7f8e500b21b0 2024-04-17T19:52:41.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.324+0000 7f8e55d4b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8e5016c460 con 0x7f8e500ce160 2024-04-17T19:52:41.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.324+0000 7f8e55d4b640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f8e5016c760 con 0x7f8e500b2e00 2024-04-17T19:52:41.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.324+0000 7f8e4effd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e500ce160 0x7f8e5015c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:41.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.324+0000 7f8e4f7fe640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8e500b2e00 0x7f8e50146840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:41.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.324+0000 7f8e4effd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e500ce160 0x7f8e5015c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41568/0 (socket says 172.21.15.173:41568) 2024-04-17T19:52:41.322 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.324+0000 7f8e4effd640 1 -- 172.21.15.173:0/2704499706 learned_addr learned my addr 172.21.15.173:0/2704499706 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-17T19:52:41.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.324+0000 7f8e4ffff640 1 --2- 172.21.15.173:0/2704499706 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8e500b21b0 0x7f8e500ca2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:41.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.324+0000 7f8e4effd640 1 -- 172.21.15.173:0/2704499706 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8e500b2e00 msgr2=0x7f8e50146840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:41.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.324+0000 7f8e4effd640 1 --2- 172.21.15.173:0/2704499706 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8e500b2e00 0x7f8e50146840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:41.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.324+0000 7f8e4effd640 1 -- 172.21.15.173:0/2704499706 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8e500b21b0 msgr2=0x7f8e500ca2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:41.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.324+0000 7f8e4effd640 1 --2- 172.21.15.173:0/2704499706 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8e500b21b0 0x7f8e500ca2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:41.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.324+0000 7f8e4effd640 1 -- 172.21.15.173:0/2704499706 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e50147090 con 0x7f8e500ce160 2024-04-17T19:52:41.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.324+0000 7f8e4f7fe640 1 --2- 172.21.15.173:0/2704499706 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8e500b2e00 0x7f8e50146840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T19:52:41.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.324+0000 7f8e4effd640 1 --2- 172.21.15.173:0/2704499706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e500ce160 0x7f8e5015c6c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8e4400d800 tx=0x7f8e4400dcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:52:41.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.324+0000 7f8e37fff640 1 -- 172.21.15.173:0/2704499706 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e44018020 con 0x7f8e500ce160 2024-04-17T19:52:41.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.324+0000 7f8e37fff640 1 -- 172.21.15.173:0/2704499706 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e440096c0 con 0x7f8e500ce160 2024-04-17T19:52:41.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.324+0000 7f8e55d4b640 1 -- 172.21.15.173:0/2704499706 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e50147370 con 0x7f8e500ce160 2024-04-17T19:52:41.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.324+0000 7f8e37fff640 1 -- 172.21.15.173:0/2704499706 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e44009ab0 con 0x7f8e500ce160 2024-04-17T19:52:41.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.324+0000 7f8e55d4b640 1 -- 172.21.15.173:0/2704499706 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e50158b50 con 0x7f8e500ce160 2024-04-17T19:52:41.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.324+0000 7f8e37fff640 1 -- 172.21.15.173:0/2704499706 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8e4401b020 con 0x7f8e500ce160 2024-04-17T19:52:41.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.324+0000 7f8e37fff640 1 -- 172.21.15.173:0/2704499706 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f8e4401daf0 con 0x7f8e500ce160 2024-04-17T19:52:41.323 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.328+0000 7f8e55d4b640 1 -- 172.21.15.173:0/2704499706 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e50146e00 con 0x7f8e500ce160 2024-04-17T19:52:41.324 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-17T19:52:41.330+0000 7f251ea79180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-17T19:52:41.326 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.332+0000 7f8e37fff640 1 -- 172.21.15.173:0/2704499706 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f8e44022020 con 0x7f8e500ce160 2024-04-17T19:52:41.394 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.400+0000 7f8e55d4b640 1 -- 172.21.15.173:0/2704499706 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd new", "uuid": "21df023f-bc8b-4abb-93e5-0ecc91acda0e", "id": 4} v 0) -- 0x7f8e500698e0 con 0x7f8e500ce160 2024-04-17T19:52:41.400 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.404+0000 7f8e37fff640 1 -- 172.21.15.173:0/2704499706 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "21df023f-bc8b-4abb-93e5-0ecc91acda0e", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f8e4401d6b0 con 0x7f8e500ce160 2024-04-17T19:52:41.400 INFO:teuthology.orchestra.run.smithi173.stdout:4 2024-04-17T19:52:41.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.404+0000 7f8e55d4b640 1 -- 172.21.15.173:0/2704499706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e500ce160 msgr2=0x7f8e5015c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:41.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.404+0000 7f8e55d4b640 1 --2- 172.21.15.173:0/2704499706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e500ce160 0x7f8e5015c6c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8e4400d800 tx=0x7f8e4400dcc0 comp rx=0 tx=0).stop 2024-04-17T19:52:41.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.404+0000 7f8e55d4b640 1 -- 172.21.15.173:0/2704499706 shutdown_connections 2024-04-17T19:52:41.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.404+0000 7f8e55d4b640 1 --2- 172.21.15.173:0/2704499706 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8e500b21b0 0x7f8e500ca2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:41.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.404+0000 7f8e55d4b640 1 --2- 172.21.15.173:0/2704499706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e500ce160 0x7f8e5015c6c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:41.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.404+0000 7f8e55d4b640 1 --2- 172.21.15.173:0/2704499706 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8e500b2e00 0x7f8e50146840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:41.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.404+0000 7f8e55d4b640 1 -- 172.21.15.173:0/2704499706 >> 172.21.15.173:0/2704499706 conn(0x7f8e5009aa70 msgr2=0x7f8e500d2400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:52:41.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.404+0000 7f8e55d4b640 1 -- 172.21.15.173:0/2704499706 shutdown_connections 2024-04-17T19:52:41.402 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.404+0000 7f8e55d4b640 1 -- 172.21.15.173:0/2704499706 wait complete. 2024-04-17T19:52:41.405 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-17T19:52:41.410+0000 7f251ea79180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-17T19:52:41.419 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new e270098a-6d33-49f8-84ed-94e09a880cc3 5 2024-04-17T19:52:41.461 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-17T19:52:41.466+0000 7f251ea79180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-17T19:52:41.560 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.564+0000 7fc0ef367640 1 Processor -- start 2024-04-17T19:52:41.561 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.564+0000 7fc0ef367640 1 -- start start 2024-04-17T19:52:41.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.568+0000 7fc0ef367640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc0e80b71b0 0x7fc0e80b1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:41.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.568+0000 7fc0ef367640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc0e80b2b60 0x7fc0e80b2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:41.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.568+0000 7fc0ef367640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0e80b34b0 con 0x7fc0e80cea20 2024-04-17T19:52:41.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.568+0000 7fc0ef367640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fc0e81612f0 con 0x7fc0e80b71b0 2024-04-17T19:52:41.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.568+0000 7fc0ef367640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fc0e81615d0 con 0x7fc0e80b2b60 2024-04-17T19:52:41.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.568+0000 7fc0ec902640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc0e80b2b60 0x7fc0e80b2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:41.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.568+0000 7fc0ec902640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc0e80b2b60 0x7fc0e80b2f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.173:53602/0 (socket says 172.21.15.173:53602) 2024-04-17T19:52:41.563 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.568+0000 7fc0ed103640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc0e80b71b0 0x7fc0e80b1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:41.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.568+0000 7fc0ec902640 1 -- 172.21.15.173:0/1607887090 learned_addr learned my addr 172.21.15.173:0/1607887090 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-17T19:52:41.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.568+0000 7fc0ec902640 1 -- 172.21.15.173:0/1607887090 >> v2:172.21.15.18:3300/0 conn(0x7fc0e80b71b0 msgr2=0x7fc0e80b1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:52:41.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.568+0000 7fc0ec902640 1 --2- 172.21.15.173:0/1607887090 >> v2:172.21.15.18:3300/0 conn(0x7fc0e80b71b0 0x7fc0e80b1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:41.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.568+0000 7fc0ec902640 1 -- 172.21.15.173:0/1607887090 >> v1:172.21.15.18:6789/0 conn(0x7fc0e80cea20 legacy=0x7fc0e80cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:41.564 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.568+0000 7fc0ec902640 1 -- 172.21.15.173:0/1607887090 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0e81618b0 con 0x7fc0e80b2b60 2024-04-17T19:52:41.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.568+0000 7fc0ec902640 1 --2- 172.21.15.173:0/1607887090 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc0e80b2b60 0x7fc0e80b2f70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc0e4009870 tx=0x7fc0e401c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc6c0176fbfbc3fc server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:52:41.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.568+0000 7fc0dffff640 1 -- 172.21.15.173:0/1607887090 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0e40a9640 con 0x7fc0e80b2b60 2024-04-17T19:52:41.565 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.568+0000 7fc0dffff640 1 -- 172.21.15.173:0/1607887090 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0e40a97e0 con 0x7fc0e80b2b60 2024-04-17T19:52:41.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.568+0000 7fc0dffff640 1 -- 172.21.15.173:0/1607887090 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0e40a9bb0 con 0x7fc0e80b2b60 2024-04-17T19:52:41.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.572+0000 7fc0ef367640 1 -- 172.21.15.173:0/1607887090 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc0e80b2b60 msgr2=0x7fc0e80b2f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:41.566 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.572+0000 7fc0ef367640 1 --2- 172.21.15.173:0/1607887090 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc0e80b2b60 0x7fc0e80b2f70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc0e4009870 tx=0x7fc0e401c560 comp rx=0 tx=0).stop 2024-04-17T19:52:41.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.572+0000 7fc0ef367640 1 -- 172.21.15.173:0/1607887090 shutdown_connections 2024-04-17T19:52:41.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.572+0000 7fc0ef367640 1 --2- 172.21.15.173:0/1607887090 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc0e80b2b60 0x7fc0e80b2f70 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:41.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.572+0000 7fc0ef367640 1 --2- 172.21.15.173:0/1607887090 >> v2:172.21.15.18:3300/0 conn(0x7fc0e80b71b0 0x7fc0e80b1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:41.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.572+0000 7fc0ef367640 1 -- 172.21.15.173:0/1607887090 >> 172.21.15.173:0/1607887090 conn(0x7fc0e809aa70 msgr2=0x7fc0e809ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:52:41.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.572+0000 7fc0ef367640 1 -- 172.21.15.173:0/1607887090 shutdown_connections 2024-04-17T19:52:41.567 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.572+0000 7fc0ef367640 1 -- 172.21.15.173:0/1607887090 wait complete. 2024-04-17T19:52:41.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.572+0000 7fc0ef367640 1 Processor -- start 2024-04-17T19:52:41.568 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.572+0000 7fc0ef367640 1 -- start start 2024-04-17T19:52:41.571 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.572+0000 7fc0ef367640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc0e80b2b60 0x7fc0e80d0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:41.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.572+0000 7fc0ef367640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0e80b71b0 0x7fc0e81550b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:41.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.572+0000 7fc0ef367640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0e80cea20 0x7fc0e81663f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:41.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.572+0000 7fc0ef367640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e80b75c0 con 0x7fc0e80cea20 2024-04-17T19:52:41.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.572+0000 7fc0ef367640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e80b6ba0 con 0x7fc0e80b71b0 2024-04-17T19:52:41.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.572+0000 7fc0ef367640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fc0e80b7740 con 0x7fc0e80b2b60 2024-04-17T19:52:41.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.572+0000 7fc0ed103640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc0e80b2b60 0x7fc0e80d0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:41.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.572+0000 7fc0ec902640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0e80b71b0 0x7fc0e81550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:41.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.572+0000 7fc0ed103640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc0e80b2b60 0x7fc0e80d0e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.173:53604/0 (socket says 172.21.15.173:53604) 2024-04-17T19:52:41.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.572+0000 7fc0ed103640 1 -- 172.21.15.173:0/2537195554 learned_addr learned my addr 172.21.15.173:0/2537195554 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-17T19:52:41.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.572+0000 7fc0ed904640 1 --2- 172.21.15.173:0/2537195554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0e80cea20 0x7fc0e81663f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:41.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.576+0000 7fc0ed103640 1 -- 172.21.15.173:0/2537195554 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0e80b71b0 msgr2=0x7fc0e81550b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:41.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.576+0000 7fc0ed103640 1 --2- 172.21.15.173:0/2537195554 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0e80b71b0 0x7fc0e81550b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:41.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.576+0000 7fc0ed103640 1 -- 172.21.15.173:0/2537195554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0e80cea20 msgr2=0x7fc0e81663f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:41.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.576+0000 7fc0ed103640 1 --2- 172.21.15.173:0/2537195554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0e80cea20 0x7fc0e81663f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:41.572 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.576+0000 7fc0ed103640 1 -- 172.21.15.173:0/2537195554 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0e8155ba0 con 0x7fc0e80b2b60 2024-04-17T19:52:41.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.576+0000 7fc0ec902640 1 --2- 172.21.15.173:0/2537195554 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0e80b71b0 0x7fc0e81550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T19:52:41.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.576+0000 7fc0ed103640 1 --2- 172.21.15.173:0/2537195554 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc0e80b2b60 0x7fc0e80d0e30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc0d800e870 tx=0x7fc0d800ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:52:41.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.576+0000 7fc0ddffb640 1 -- 172.21.15.173:0/2537195554 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d8017070 con 0x7fc0e80b2b60 2024-04-17T19:52:41.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.576+0000 7fc0ddffb640 1 -- 172.21.15.173:0/2537195554 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0d800c940 con 0x7fc0e80b2b60 2024-04-17T19:52:41.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.576+0000 7fc0ef367640 1 -- 172.21.15.173:0/2537195554 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0e8155e60 con 0x7fc0e80b2b60 2024-04-17T19:52:41.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.576+0000 7fc0ddffb640 1 -- 172.21.15.173:0/2537195554 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d800cd10 con 0x7fc0e80b2b60 2024-04-17T19:52:41.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.576+0000 7fc0ef367640 1 -- 172.21.15.173:0/2537195554 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0e8156420 con 0x7fc0e80b2b60 2024-04-17T19:52:41.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.576+0000 7fc0ddffb640 1 -- 172.21.15.173:0/2537195554 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc0d801a070 con 0x7fc0e80b2b60 2024-04-17T19:52:41.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.576+0000 7fc0ddffb640 1 -- 172.21.15.173:0/2537195554 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fc0d801c9d0 con 0x7fc0e80b2b60 2024-04-17T19:52:41.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.576+0000 7fc0ef367640 1 -- 172.21.15.173:0/2537195554 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0e80698e0 con 0x7fc0e80b2b60 2024-04-17T19:52:41.573 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.576+0000 7fc0ddffb640 1 -- 172.21.15.173:0/2537195554 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fc0d801c450 con 0x7fc0e80b2b60 2024-04-17T19:52:41.620 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-17T19:52:41.626+0000 7f251ea79180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-17T19:52:41.640 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.644+0000 7fc0ef367640 1 -- 172.21.15.173:0/2537195554 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e270098a-6d33-49f8-84ed-94e09a880cc3", "id": 5} v 0) -- 0x7fc0e80d1370 con 0x7fc0e80b2b60 2024-04-17T19:52:41.646 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.648+0000 7fc0ddffb640 1 -- 172.21.15.173:0/2537195554 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e270098a-6d33-49f8-84ed-94e09a880cc3", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fc0d801c630 con 0x7fc0e80b2b60 2024-04-17T19:52:41.646 INFO:teuthology.orchestra.run.smithi173.stdout:5 2024-04-17T19:52:41.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.652+0000 7fc0ef367640 1 -- 172.21.15.173:0/2537195554 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc0e80b2b60 msgr2=0x7fc0e80d0e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:41.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.652+0000 7fc0ef367640 1 --2- 172.21.15.173:0/2537195554 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc0e80b2b60 0x7fc0e80d0e30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc0d800e870 tx=0x7fc0d800ec70 comp rx=0 tx=0).stop 2024-04-17T19:52:41.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.652+0000 7fc0ef367640 1 -- 172.21.15.173:0/2537195554 shutdown_connections 2024-04-17T19:52:41.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.652+0000 7fc0ef367640 1 --2- 172.21.15.173:0/2537195554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0e80cea20 0x7fc0e81663f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:41.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.652+0000 7fc0ef367640 1 --2- 172.21.15.173:0/2537195554 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0e80b71b0 0x7fc0e81550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:41.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.652+0000 7fc0ef367640 1 --2- 172.21.15.173:0/2537195554 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc0e80b2b60 0x7fc0e80d0e30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:41.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.652+0000 7fc0ef367640 1 -- 172.21.15.173:0/2537195554 >> 172.21.15.173:0/2537195554 conn(0x7fc0e809aa70 msgr2=0x7fc0e806c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:52:41.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.652+0000 7fc0ef367640 1 -- 172.21.15.173:0/2537195554 shutdown_connections 2024-04-17T19:52:41.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.652+0000 7fc0ef367640 1 -- 172.21.15.173:0/2537195554 wait complete. 2024-04-17T19:52:41.665 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new 93c67c8c-268d-4e32-877c-043cd3acd87c 6 2024-04-17T19:52:41.684 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-17T19:52:41.690+0000 7f251ea79180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-17T19:52:41.802 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.808+0000 7f5919c5c640 1 Processor -- start 2024-04-17T19:52:41.803 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.808+0000 7f5919c5c640 1 -- start start 2024-04-17T19:52:41.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.808+0000 7f5919c5c640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f59140737e0 0x7f591415e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:41.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.808+0000 7f5919c5c640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f59140cebd0 0x7f591415e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:41.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.808+0000 7f5919c5c640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59140cf270 con 0x7f59140ce7c0 2024-04-17T19:52:41.805 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.808+0000 7f5919c5c640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f59140cf020 con 0x7f59140cebd0 2024-04-17T19:52:41.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.808+0000 7f5919c5c640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f59140cf550 con 0x7f59140737e0 2024-04-17T19:52:41.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.808+0000 7f5912ffd640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f59140737e0 0x7f591415e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:41.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.808+0000 7f5912ffd640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f59140737e0 0x7f591415e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.173:53612/0 (socket says 172.21.15.173:53612) 2024-04-17T19:52:41.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.808+0000 7f5912ffd640 1 -- 172.21.15.173:0/1418307185 learned_addr learned my addr 172.21.15.173:0/1418307185 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-17T19:52:41.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.808+0000 7f5913fff640 1 --2- 172.21.15.173:0/1418307185 >> v2:172.21.15.173:3300/0 conn(0x7f59140cebd0 0x7f591415e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:41.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.808+0000 7f5912ffd640 1 -- 172.21.15.173:0/1418307185 >> v2:172.21.15.173:3300/0 conn(0x7f59140cebd0 msgr2=0x7f591415e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:52:41.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.808+0000 7f5912ffd640 1 --2- 172.21.15.173:0/1418307185 >> v2:172.21.15.173:3300/0 conn(0x7f59140cebd0 0x7f591415e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:41.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.808+0000 7f5912ffd640 1 -- 172.21.15.173:0/1418307185 >> v1:172.21.15.18:6789/0 conn(0x7f59140ce7c0 legacy=0x7f59140730d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:52:41.806 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.808+0000 7f5912ffd640 1 -- 172.21.15.173:0/1418307185 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f591415da00 con 0x7f59140737e0 2024-04-17T19:52:41.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.812+0000 7f5912ffd640 1 --2- 172.21.15.173:0/1418307185 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f59140737e0 0x7f591415e200 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5904006fd0 tx=0x7f590401c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f72f00e80110cabf server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:52:41.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.812+0000 7f59127fc640 1 -- 172.21.15.173:0/1418307185 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59040ab650 con 0x7f59140737e0 2024-04-17T19:52:41.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.812+0000 7f59127fc640 1 -- 172.21.15.173:0/1418307185 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59040b0070 con 0x7f59140737e0 2024-04-17T19:52:41.807 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.812+0000 7f59127fc640 1 -- 172.21.15.173:0/1418307185 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59040aba10 con 0x7f59140737e0 2024-04-17T19:52:41.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.812+0000 7f5919c5c640 1 -- 172.21.15.173:0/1418307185 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f59140737e0 msgr2=0x7f591415e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:41.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.812+0000 7f5919c5c640 1 --2- 172.21.15.173:0/1418307185 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f59140737e0 0x7f591415e200 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5904006fd0 tx=0x7f590401c4d0 comp rx=0 tx=0).stop 2024-04-17T19:52:41.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.812+0000 7f5919c5c640 1 -- 172.21.15.173:0/1418307185 shutdown_connections 2024-04-17T19:52:41.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.812+0000 7f5919c5c640 1 --2- 172.21.15.173:0/1418307185 >> v2:172.21.15.173:3300/0 conn(0x7f59140cebd0 0x7f591415e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:41.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.812+0000 7f5919c5c640 1 --2- 172.21.15.173:0/1418307185 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f59140737e0 0x7f591415e200 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:41.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.812+0000 7f5919c5c640 1 -- 172.21.15.173:0/1418307185 >> 172.21.15.173:0/1418307185 conn(0x7f59140d1320 msgr2=0x7f59140d1730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:52:41.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.812+0000 7f5919c5c640 1 -- 172.21.15.173:0/1418307185 shutdown_connections 2024-04-17T19:52:41.809 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.812+0000 7f5919c5c640 1 -- 172.21.15.173:0/1418307185 wait complete. 2024-04-17T19:52:41.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.816+0000 7f5919c5c640 1 Processor -- start 2024-04-17T19:52:41.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.816+0000 7f5919c5c640 1 -- start start 2024-04-17T19:52:41.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.816+0000 7f5919c5c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f59140ce7c0 0x7f591413ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:41.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.816+0000 7f5919c5c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59140cebd0 0x7f591414ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:41.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.816+0000 7f5919c5c640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f591414e310 0x7f5914155610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:41.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.816+0000 7f5919c5c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f591415d7c0 con 0x7f59140ce7c0 2024-04-17T19:52:41.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.816+0000 7f5919c5c640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f591415d640 con 0x7f59140cebd0 2024-04-17T19:52:41.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.816+0000 7f5919c5c640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f5914169eb0 con 0x7f591414e310 2024-04-17T19:52:41.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.816+0000 7f5912ffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59140cebd0 0x7f591414ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:41.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.816+0000 7f5913fff640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f591414e310 0x7f5914155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:41.815 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.816+0000 7f5912ffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59140cebd0 0x7f591414ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41592/0 (socket says 172.21.15.173:41592) 2024-04-17T19:52:41.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.816+0000 7f5912ffd640 1 -- 172.21.15.173:0/1919508507 learned_addr learned my addr 172.21.15.173:0/1919508507 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-17T19:52:41.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.820+0000 7f59137fe640 1 --2- 172.21.15.173:0/1919508507 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f59140ce7c0 0x7f591413ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:41.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.820+0000 7f5912ffd640 1 -- 172.21.15.173:0/1919508507 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f591414e310 msgr2=0x7f5914155610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:41.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.820+0000 7f5912ffd640 1 --2- 172.21.15.173:0/1919508507 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f591414e310 0x7f5914155610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:41.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.820+0000 7f5912ffd640 1 -- 172.21.15.173:0/1919508507 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f59140ce7c0 msgr2=0x7f591413ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:41.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.820+0000 7f5912ffd640 1 --2- 172.21.15.173:0/1919508507 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f59140ce7c0 0x7f591413ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:41.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.820+0000 7f5912ffd640 1 -- 172.21.15.173:0/1919508507 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5914149c30 con 0x7f59140cebd0 2024-04-17T19:52:41.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.820+0000 7f5913fff640 1 --2- 172.21.15.173:0/1919508507 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f591414e310 0x7f5914155610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T19:52:41.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.820+0000 7f5912ffd640 1 --2- 172.21.15.173:0/1919508507 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59140cebd0 0x7f591414ddd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f590401ab80 tx=0x7f5904019270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:52:41.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.820+0000 7f58fbfff640 1 -- 172.21.15.173:0/1919508507 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5904005ba0 con 0x7f59140cebd0 2024-04-17T19:52:41.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.820+0000 7f58fbfff640 1 -- 172.21.15.173:0/1919508507 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5904005d40 con 0x7f59140cebd0 2024-04-17T19:52:41.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.820+0000 7f5919c5c640 1 -- 172.21.15.173:0/1919508507 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5914149f10 con 0x7f59140cebd0 2024-04-17T19:52:41.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.820+0000 7f58fbfff640 1 -- 172.21.15.173:0/1919508507 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5904003b90 con 0x7f59140cebd0 2024-04-17T19:52:41.816 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.820+0000 7f5919c5c640 1 -- 172.21.15.173:0/1919508507 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5914157b40 con 0x7f59140cebd0 2024-04-17T19:52:41.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.820+0000 7f58fbfff640 1 -- 172.21.15.173:0/1919508507 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5904006280 con 0x7f59140cebd0 2024-04-17T19:52:41.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.820+0000 7f58fbfff640 1 -- 172.21.15.173:0/1919508507 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f59040be430 con 0x7f59140cebd0 2024-04-17T19:52:41.817 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.820+0000 7f5919c5c640 1 -- 172.21.15.173:0/1919508507 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59140749c0 con 0x7f59140cebd0 2024-04-17T19:52:41.818 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.820+0000 7f58fbfff640 1 -- 172.21.15.173:0/1919508507 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f59040160f0 con 0x7f59140cebd0 2024-04-17T19:52:41.848 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-04-17T19:52:41.852+0000 7f591ece7180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-17T19:52:41.895 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.900+0000 7f5919c5c640 1 -- 172.21.15.173:0/1919508507 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd new", "uuid": "93c67c8c-268d-4e32-877c-043cd3acd87c", "id": 6} v 0) -- 0x7f59140698e0 con 0x7f59140cebd0 2024-04-17T19:52:41.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.908+0000 7f58fbfff640 1 -- 172.21.15.173:0/1919508507 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "93c67c8c-268d-4e32-877c-043cd3acd87c", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f59040ab450 con 0x7f59140cebd0 2024-04-17T19:52:41.905 INFO:teuthology.orchestra.run.smithi173.stdout:6 2024-04-17T19:52:41.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.912+0000 7f5919c5c640 1 -- 172.21.15.173:0/1919508507 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59140cebd0 msgr2=0x7f591414ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:41.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.912+0000 7f5919c5c640 1 --2- 172.21.15.173:0/1919508507 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59140cebd0 0x7f591414ddd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f590401ab80 tx=0x7f5904019270 comp rx=0 tx=0).stop 2024-04-17T19:52:41.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.912+0000 7f5919c5c640 1 -- 172.21.15.173:0/1919508507 shutdown_connections 2024-04-17T19:52:41.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.912+0000 7f5919c5c640 1 --2- 172.21.15.173:0/1919508507 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f591414e310 0x7f5914155610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:41.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.912+0000 7f5919c5c640 1 --2- 172.21.15.173:0/1919508507 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f59140cebd0 0x7f591414ddd0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:41.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.912+0000 7f5919c5c640 1 --2- 172.21.15.173:0/1919508507 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f59140ce7c0 0x7f591413ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:41.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.912+0000 7f5919c5c640 1 -- 172.21.15.173:0/1919508507 >> 172.21.15.173:0/1919508507 conn(0x7f59140d1320 msgr2=0x7f59140d1730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:52:41.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.912+0000 7f5919c5c640 1 -- 172.21.15.173:0/1919508507 shutdown_connections 2024-04-17T19:52:41.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:41.912+0000 7f5919c5c640 1 -- 172.21.15.173:0/1919508507 wait complete. 2024-04-17T19:52:41.907 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-04-17T19:52:41.912+0000 7f591ece7180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-17T19:52:41.923 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new faf10eea-80de-40f6-abbb-34d07d3f59ce 7 2024-04-17T19:52:41.965 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-04-17T19:52:41.968+0000 7f591ece7180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-17T19:52:42.048 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-04-17T19:52:42.052+0000 7f591ece7180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-17T19:52:42.056 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.060+0000 7f51c601d640 1 Processor -- start 2024-04-17T19:52:42.057 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.060+0000 7f51c601d640 1 -- start start 2024-04-17T19:52:42.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.064+0000 7f51c601d640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f51c00d1f00 0x7f51c00ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:42.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.064+0000 7f51c601d640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51c0161c30 con 0x7f51c00b3670 2024-04-17T19:52:42.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.064+0000 7f51c601d640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51c0161390 con 0x7f51c00cea20 2024-04-17T19:52:42.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.064+0000 7f51c601d640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f51c015d960 con 0x7f51c00d1f00 2024-04-17T19:52:42.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.064+0000 7f51bf7fe640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f51c00d1f00 0x7f51c00ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:42.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.064+0000 7f51beffd640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f51c00cea20 0x7f51c015ddf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:44224/0 (socket says 172.21.15.173:44224) 2024-04-17T19:52:42.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.064+0000 7f51beffd640 1 -- 172.21.15.173:0/2583909632 learned_addr learned my addr 172.21.15.173:0/2583909632 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-04-17T19:52:42.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.064+0000 7f51bf7fe640 1 -- 172.21.15.173:0/2583909632 >> v1:172.21.15.173:6789/0 conn(0x7f51c00cea20 legacy=0x7f51c015ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:42.059 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.064+0000 7f51bf7fe640 1 -- 172.21.15.173:0/2583909632 >> v1:172.21.15.18:6789/0 conn(0x7f51c00b3670 legacy=0x7f51c00b3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:52:42.060 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.064+0000 7f51bf7fe640 1 -- 172.21.15.173:0/2583909632 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51c0161670 con 0x7f51c00d1f00 2024-04-17T19:52:42.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.064+0000 7f51bf7fe640 1 --2- 172.21.15.173:0/2583909632 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f51c00d1f00 0x7f51c00ce4e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f51b00097c0 tx=0x7f51b001c3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16d2b3f7eb0046c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:52:42.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.064+0000 7f51be7fc640 1 -- 172.21.15.173:0/2583909632 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b00ab5f0 con 0x7f51c00d1f00 2024-04-17T19:52:42.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.064+0000 7f51be7fc640 1 -- 172.21.15.173:0/2583909632 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51b00b0070 con 0x7f51c00d1f00 2024-04-17T19:52:42.061 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.064+0000 7f51be7fc640 1 -- 172.21.15.173:0/2583909632 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b00ab9b0 con 0x7f51c00d1f00 2024-04-17T19:52:42.062 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.068+0000 7f51c601d640 1 -- 172.21.15.173:0/2583909632 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f51c00d1f00 msgr2=0x7f51c00ce4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:42.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.068+0000 7f51c601d640 1 --2- 172.21.15.173:0/2583909632 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f51c00d1f00 0x7f51c00ce4e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f51b00097c0 tx=0x7f51b001c3d0 comp rx=0 tx=0).stop 2024-04-17T19:52:42.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.068+0000 7f51c601d640 1 -- 172.21.15.173:0/2583909632 shutdown_connections 2024-04-17T19:52:42.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.068+0000 7f51c601d640 1 --2- 172.21.15.173:0/2583909632 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f51c00d1f00 0x7f51c00ce4e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:42.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.068+0000 7f51c601d640 1 -- 172.21.15.173:0/2583909632 >> 172.21.15.173:0/2583909632 conn(0x7f51c00b6f00 msgr2=0x7f51c00b7310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:52:42.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.068+0000 7f51c601d640 1 -- 172.21.15.173:0/2583909632 shutdown_connections 2024-04-17T19:52:42.066 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.068+0000 7f51c601d640 1 -- 172.21.15.173:0/2583909632 wait complete. 2024-04-17T19:52:42.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.068+0000 7f51c601d640 1 Processor -- start 2024-04-17T19:52:42.068 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.068+0000 7f51c601d640 1 -- start start 2024-04-17T19:52:42.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.068+0000 7f51c601d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f51c00b3670 0x7f51c0143520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:42.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.068+0000 7f51c601d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51c00cea20 0x7f51c013e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:42.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.068+0000 7f51c601d640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f51c00d1f00 0x7f51c015c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:42.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.068+0000 7f51c601d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f51c00d2310 con 0x7f51c00cea20 2024-04-17T19:52:42.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.068+0000 7f51c601d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f51c00d0050 con 0x7f51c00b3670 2024-04-17T19:52:42.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.068+0000 7f51c601d640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f51c00d2490 con 0x7f51c00d1f00 2024-04-17T19:52:42.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.068+0000 7f51bf7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f51c00b3670 0x7f51c0143520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:42.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.068+0000 7f51bf7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f51c00b3670 0x7f51c0143520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:41620/0 (socket says 172.21.15.173:41620) 2024-04-17T19:52:42.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.068+0000 7f51bf7fe640 1 -- 172.21.15.173:0/1548276623 learned_addr learned my addr 172.21.15.173:0/1548276623 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-04-17T19:52:42.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.068+0000 7f51bffff640 1 --2- 172.21.15.173:0/1548276623 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f51c00d1f00 0x7f51c015c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:42.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.068+0000 7f51beffd640 1 --2- 172.21.15.173:0/1548276623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51c00cea20 0x7f51c013e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:42.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.068+0000 7f51bf7fe640 1 -- 172.21.15.173:0/1548276623 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f51c00d1f00 msgr2=0x7f51c015c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:42.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.068+0000 7f51bf7fe640 1 --2- 172.21.15.173:0/1548276623 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f51c00d1f00 0x7f51c015c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:42.069 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.068+0000 7f51bf7fe640 1 -- 172.21.15.173:0/1548276623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51c00cea20 msgr2=0x7f51c013e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:42.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.068+0000 7f51bf7fe640 1 --2- 172.21.15.173:0/1548276623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51c00cea20 0x7f51c013e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:42.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.068+0000 7f51bf7fe640 1 -- 172.21.15.173:0/1548276623 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51c0143e00 con 0x7f51c00b3670 2024-04-17T19:52:42.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.068+0000 7f51bffff640 1 --2- 172.21.15.173:0/1548276623 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f51c00d1f00 0x7f51c015c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T19:52:42.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.068+0000 7f51beffd640 1 --2- 172.21.15.173:0/1548276623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51c00cea20 0x7f51c013e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:52:42.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.072+0000 7f51bf7fe640 1 --2- 172.21.15.173:0/1548276623 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f51c00b3670 0x7f51c0143520 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f51b0018fe0 tx=0x7f51b001ac10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:52:42.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.072+0000 7f51a7fff640 1 -- 172.21.15.173:0/1548276623 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b00bf610 con 0x7f51c00b3670 2024-04-17T19:52:42.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.072+0000 7f51a7fff640 1 -- 172.21.15.173:0/1548276623 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51b00bf7d0 con 0x7f51c00b3670 2024-04-17T19:52:42.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.072+0000 7f51c601d640 1 -- 172.21.15.173:0/1548276623 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51c01440e0 con 0x7f51c00b3670 2024-04-17T19:52:42.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.072+0000 7f51a7fff640 1 -- 172.21.15.173:0/1548276623 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b00bfbc0 con 0x7f51c00b3670 2024-04-17T19:52:42.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.072+0000 7f51c601d640 1 -- 172.21.15.173:0/1548276623 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51c01446a0 con 0x7f51c00b3670 2024-04-17T19:52:42.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.072+0000 7f51a7fff640 1 -- 172.21.15.173:0/1548276623 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f51b00bd020 con 0x7f51c00b3670 2024-04-17T19:52:42.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.072+0000 7f51a7fff640 1 -- 172.21.15.173:0/1548276623 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f51b00c8c60 con 0x7f51c00b3670 2024-04-17T19:52:42.070 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.072+0000 7f51c601d640 1 -- 172.21.15.173:0/1548276623 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51c00698e0 con 0x7f51c00b3670 2024-04-17T19:52:42.071 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.072+0000 7f51a7fff640 1 -- 172.21.15.173:0/1548276623 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f51b0016050 con 0x7f51c00b3670 2024-04-17T19:52:42.102 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-04-17T19:52:42.108+0000 7f591ece7180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-17T19:52:42.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.136+0000 7f51c601d640 1 -- 172.21.15.173:0/1548276623 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd new", "uuid": "faf10eea-80de-40f6-abbb-34d07d3f59ce", "id": 7} v 0) -- 0x7f51c006fdb0 con 0x7f51c00b3670 2024-04-17T19:52:42.142 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.144+0000 7f51a7fff640 1 -- 172.21.15.173:0/1548276623 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "faf10eea-80de-40f6-abbb-34d07d3f59ce", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f51b00c8580 con 0x7f51c00b3670 2024-04-17T19:52:42.142 INFO:teuthology.orchestra.run.smithi173.stdout:7 2024-04-17T19:52:42.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.148+0000 7f51c601d640 1 -- 172.21.15.173:0/1548276623 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f51c00b3670 msgr2=0x7f51c0143520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:42.143 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.148+0000 7f51c601d640 1 --2- 172.21.15.173:0/1548276623 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f51c00b3670 0x7f51c0143520 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f51b0018fe0 tx=0x7f51b001ac10 comp rx=0 tx=0).stop 2024-04-17T19:52:42.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.148+0000 7f51c601d640 1 -- 172.21.15.173:0/1548276623 shutdown_connections 2024-04-17T19:52:42.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.148+0000 7f51c601d640 1 --2- 172.21.15.173:0/1548276623 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f51c00d1f00 0x7f51c015c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:42.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.148+0000 7f51c601d640 1 --2- 172.21.15.173:0/1548276623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51c00cea20 0x7f51c013e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:42.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.148+0000 7f51c601d640 1 --2- 172.21.15.173:0/1548276623 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f51c00b3670 0x7f51c0143520 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:42.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.148+0000 7f51c601d640 1 -- 172.21.15.173:0/1548276623 >> 172.21.15.173:0/1548276623 conn(0x7f51c00b6f00 msgr2=0x7f51c00b3a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:52:42.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.148+0000 7f51c601d640 1 -- 172.21.15.173:0/1548276623 shutdown_connections 2024-04-17T19:52:42.144 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:52:42.148+0000 7f51c601d640 1 -- 172.21.15.173:0/1548276623 wait complete. 2024-04-17T19:52:42.160 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-17T19:52:42.160 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-17T19:52:42.163 INFO:tasks.ceph.osd.0:Started 2024-04-17T19:52:42.163 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-17T19:52:42.163 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-17T19:52:42.165 INFO:tasks.ceph.osd.1:Started 2024-04-17T19:52:42.165 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-17T19:52:42.166 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-17T19:52:42.167 INFO:tasks.ceph.osd.2:Started 2024-04-17T19:52:42.167 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-17T19:52:42.168 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-17T19:52:42.169 INFO:tasks.ceph.osd.3:Started 2024-04-17T19:52:42.170 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-17T19:52:42.170 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-17T19:52:42.182 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-04-17T19:52:42.188+0000 7f591ece7180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-17T19:52:42.184 INFO:tasks.ceph.osd.4:Started 2024-04-17T19:52:42.184 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-17T19:52:42.184 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-17T19:52:42.186 INFO:tasks.ceph.osd.5:Started 2024-04-17T19:52:42.186 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-17T19:52:42.186 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-17T19:52:42.188 INFO:tasks.ceph.osd.6:Started 2024-04-17T19:52:42.188 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-17T19:52:42.188 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-17T19:52:42.192 INFO:tasks.ceph.osd.7:Started 2024-04-17T19:52:42.192 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T19:52:42.263 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-04-17T19:52:42.268+0000 7f591ece7180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-17T19:52:42.339 INFO:tasks.ceph.mgr.y.smithi018.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-17T19:52:42.339 INFO:tasks.ceph.mgr.y.smithi018.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-17T19:52:42.339 INFO:tasks.ceph.mgr.y.smithi018.stderr: from numpy import show_config as show_numpy_config 2024-04-17T19:52:42.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.350+0000 7f45f37cd640 1 Processor -- start 2024-04-17T19:52:42.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.350+0000 7f45f37cd640 1 -- start start 2024-04-17T19:52:42.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.350+0000 7f45f37cd640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f45ec0cd4c0 0x7f45ec15cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:42.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.350+0000 7f45f37cd640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f45ec0d1720 0x7f45ec0d1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:42.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.350+0000 7f45f37cd640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45ec1610c0 con 0x7f45ec06f900 2024-04-17T19:52:42.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.350+0000 7f45f37cd640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f45ec1613a0 con 0x7f45ec0d1720 2024-04-17T19:52:42.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.350+0000 7f45f37cd640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f45ec161680 con 0x7f45ec0cd4c0 2024-04-17T19:52:42.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.350+0000 7f45f1569640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f45ec0cd4c0 0x7f45ec15cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:42.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.350+0000 7f45f1d6a640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f45ec0d1720 0x7f45ec0d1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:42.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.350+0000 7f45f0d68640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f45ec06f900 0x7f45ec06fd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.18:41252/0 (socket says 172.21.15.18:41252) 2024-04-17T19:52:42.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.350+0000 7f45f0d68640 1 -- 172.21.15.18:0/3416544155 learned_addr learned my addr 172.21.15.18:0/3416544155 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:52:42.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.350+0000 7f45f1d6a640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f45ec0d1720 0x7f45ec0d1b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.18:60862/0 (socket says 172.21.15.18:60862) 2024-04-17T19:52:42.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.350+0000 7f45f1569640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f45ec0cd4c0 0x7f45ec15cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.18:60498/0 (socket says 172.21.15.18:60498) 2024-04-17T19:52:42.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.350+0000 7f45f1d6a640 1 -- 172.21.15.18:0/3416544155 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f45ec0cd4c0 msgr2=0x7f45ec15cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:52:42.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.350+0000 7f45f1d6a640 1 --2- 172.21.15.18:0/3416544155 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f45ec0cd4c0 0x7f45ec15cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:42.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.350+0000 7f45f1d6a640 1 -- 172.21.15.18:0/3416544155 >> v1:172.21.15.173:6789/0 conn(0x7f45ec06f900 legacy=0x7f45ec06fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:42.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.350+0000 7f45f1d6a640 1 -- 172.21.15.18:0/3416544155 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45ec161960 con 0x7f45ec0d1720 2024-04-17T19:52:42.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.350+0000 7f45f1569640 1 --2- 172.21.15.18:0/3416544155 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f45ec0cd4c0 0x7f45ec15cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T19:52:42.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.350+0000 7f45e3fff640 1 -- 172.21.15.18:0/3416544155 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 326737490 0 0) 0x7f45ec1610c0 con 0x7f45ec06f900 2024-04-17T19:52:42.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.354+0000 7f45f1d6a640 1 --2- 172.21.15.18:0/3416544155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f45ec0d1720 0x7f45ec0d1b30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f45e4009d90 tx=0x7f45e401c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a1582a76c15d41a server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:52:42.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.354+0000 7f45e3fff640 1 -- 172.21.15.18:0/3416544155 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e40b2070 con 0x7f45ec0d1720 2024-04-17T19:52:42.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.354+0000 7f45e3fff640 1 -- 172.21.15.18:0/3416544155 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45e40a5980 con 0x7f45ec0d1720 2024-04-17T19:52:42.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.354+0000 7f45e3fff640 1 -- 172.21.15.18:0/3416544155 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e40a5d50 con 0x7f45ec0d1720 2024-04-17T19:52:42.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.354+0000 7f45f37cd640 1 -- 172.21.15.18:0/3416544155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f45ec0d1720 msgr2=0x7f45ec0d1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:42.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.354+0000 7f45f37cd640 1 --2- 172.21.15.18:0/3416544155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f45ec0d1720 0x7f45ec0d1b30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f45e4009d90 tx=0x7f45e401c8e0 comp rx=0 tx=0).stop 2024-04-17T19:52:42.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.354+0000 7f45f37cd640 1 -- 172.21.15.18:0/3416544155 shutdown_connections 2024-04-17T19:52:42.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.354+0000 7f45f37cd640 1 --2- 172.21.15.18:0/3416544155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f45ec0d1720 0x7f45ec0d1b30 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:42.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.354+0000 7f45f37cd640 1 --2- 172.21.15.18:0/3416544155 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f45ec0cd4c0 0x7f45ec15cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:42.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.354+0000 7f45f37cd640 1 -- 172.21.15.18:0/3416544155 >> 172.21.15.18:0/3416544155 conn(0x7f45ec0cf6e0 msgr2=0x7f45ec0cfaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:52:42.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.354+0000 7f45f37cd640 1 -- 172.21.15.18:0/3416544155 shutdown_connections 2024-04-17T19:52:42.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.354+0000 7f45f37cd640 1 -- 172.21.15.18:0/3416544155 wait complete. 2024-04-17T19:52:42.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.358+0000 7f45f37cd640 1 Processor -- start 2024-04-17T19:52:42.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.358+0000 7f45f37cd640 1 -- start start 2024-04-17T19:52:42.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.358+0000 7f45f37cd640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f45ec06f900 0x7f45ec166f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:42.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.358+0000 7f45f37cd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45ec0cd4c0 0x7f45ec151600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:42.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.358+0000 7f45f37cd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f45ec0d1720 0x7f45ec0c7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:42.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.358+0000 7f45f37cd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f45ec16a270 con 0x7f45ec0cd4c0 2024-04-17T19:52:42.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.358+0000 7f45f37cd640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f45ec16a0f0 con 0x7f45ec0d1720 2024-04-17T19:52:42.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.358+0000 7f45f37cd640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f45ec16a3f0 con 0x7f45ec06f900 2024-04-17T19:52:42.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.358+0000 7f45f0d68640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45ec0cd4c0 0x7f45ec151600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:42.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.358+0000 7f45f0d68640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45ec0cd4c0 0x7f45ec151600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40358/0 (socket says 172.21.15.18:40358) 2024-04-17T19:52:42.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.358+0000 7f45f0d68640 1 -- 172.21.15.18:0/2120618561 learned_addr learned my addr 172.21.15.18:0/2120618561 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:52:42.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.358+0000 7f45f1569640 1 --2- 172.21.15.18:0/2120618561 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f45ec06f900 0x7f45ec166f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:42.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.358+0000 7f45f1d6a640 1 --2- 172.21.15.18:0/2120618561 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f45ec0d1720 0x7f45ec0c7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:42.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.358+0000 7f45f0d68640 1 -- 172.21.15.18:0/2120618561 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f45ec06f900 msgr2=0x7f45ec166f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:42.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.358+0000 7f45f0d68640 1 --2- 172.21.15.18:0/2120618561 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f45ec06f900 0x7f45ec166f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:42.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.358+0000 7f45f0d68640 1 -- 172.21.15.18:0/2120618561 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f45ec0d1720 msgr2=0x7f45ec0c7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:42.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.358+0000 7f45f0d68640 1 --2- 172.21.15.18:0/2120618561 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f45ec0d1720 0x7f45ec0c7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:42.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.358+0000 7f45f0d68640 1 -- 172.21.15.18:0/2120618561 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45ec06f520 con 0x7f45ec0cd4c0 2024-04-17T19:52:42.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.358+0000 7f45f0d68640 1 --2- 172.21.15.18:0/2120618561 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45ec0cd4c0 0x7f45ec151600 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f45dc00c450 tx=0x7f45dc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:52:42.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.358+0000 7f45e1ffb640 1 -- 172.21.15.18:0/2120618561 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45dc018070 con 0x7f45ec0cd4c0 2024-04-17T19:52:42.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.358+0000 7f45e1ffb640 1 -- 172.21.15.18:0/2120618561 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45dc0074e0 con 0x7f45ec0cd4c0 2024-04-17T19:52:42.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.358+0000 7f45f37cd640 1 -- 172.21.15.18:0/2120618561 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45ec166450 con 0x7f45ec0cd4c0 2024-04-17T19:52:42.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.358+0000 7f45e1ffb640 1 -- 172.21.15.18:0/2120618561 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45dc0049f0 con 0x7f45ec0cd4c0 2024-04-17T19:52:42.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.358+0000 7f45f37cd640 1 -- 172.21.15.18:0/2120618561 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45ec0c8a60 con 0x7f45ec0cd4c0 2024-04-17T19:52:42.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.358+0000 7f45e1ffb640 1 -- 172.21.15.18:0/2120618561 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f45dc01b070 con 0x7f45ec0cd4c0 2024-04-17T19:52:42.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.358+0000 7f45e1ffb640 1 -- 172.21.15.18:0/2120618561 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f45dc012ad0 con 0x7f45ec0cd4c0 2024-04-17T19:52:42.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.358+0000 7f45f37cd640 1 -- 172.21.15.18:0/2120618561 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45ec069950 con 0x7f45ec0cd4c0 2024-04-17T19:52:42.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.362+0000 7f45e1ffb640 1 -- 172.21.15.18:0/2120618561 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f45dc022080 con 0x7f45ec0cd4c0 2024-04-17T19:52:42.389 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-17T19:52:42.394+0000 7f251ea79180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-17T19:52:42.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.422+0000 7f45f37cd640 1 -- 172.21.15.18:0/2120618561 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f45ec160ac0 con 0x7f45ec0cd4c0 2024-04-17T19:52:42.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.422+0000 7f45e1ffb640 1 -- 172.21.15.18:0/2120618561 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f45dc004c50 con 0x7f45ec0cd4c0 2024-04-17T19:52:42.415 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:52:42.415 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":10,"fsid":"dd480169-5a81-4623-be5f-0499aa244b28","created":"2024-04-17T19:52:39.533760+0000","modified":"2024-04-17T19:52:42.144259+0000","last_up_change":"0.000000","last_in_change":"2024-04-17T19:52:42.144259+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e232d577-2508-4ea4-b355-29fbae1ff025","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"31810ef3-2c71-48d6-8748-b74a2968d23b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5a783cc5-a41c-4967-9e11-6b8330f97d05","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b7e056d9-9da5-46e1-810d-0c3e242fe5ec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"21df023f-bc8b-4abb-93e5-0ecc91acda0e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e270098a-6d33-49f8-84ed-94e09a880cc3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"93c67c8c-268d-4e32-877c-043cd3acd87c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"faf10eea-80de-40f6-abbb-34d07d3f59ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T19:52:42.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.422+0000 7f45f37cd640 1 -- 172.21.15.18:0/2120618561 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45ec0cd4c0 msgr2=0x7f45ec151600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:42.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.422+0000 7f45f37cd640 1 --2- 172.21.15.18:0/2120618561 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45ec0cd4c0 0x7f45ec151600 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f45dc00c450 tx=0x7f45dc00c910 comp rx=0 tx=0).stop 2024-04-17T19:52:42.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.422+0000 7f45f37cd640 1 -- 172.21.15.18:0/2120618561 shutdown_connections 2024-04-17T19:52:42.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.422+0000 7f45f37cd640 1 --2- 172.21.15.18:0/2120618561 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f45ec0d1720 0x7f45ec0c7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:42.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.422+0000 7f45f37cd640 1 --2- 172.21.15.18:0/2120618561 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45ec0cd4c0 0x7f45ec151600 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:42.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.422+0000 7f45f37cd640 1 --2- 172.21.15.18:0/2120618561 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f45ec06f900 0x7f45ec166f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:42.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.422+0000 7f45f37cd640 1 -- 172.21.15.18:0/2120618561 >> 172.21.15.18:0/2120618561 conn(0x7f45ec0cf6e0 msgr2=0x7f45ec157410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:52:42.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.422+0000 7f45f37cd640 1 -- 172.21.15.18:0/2120618561 shutdown_connections 2024-04-17T19:52:42.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:42.422+0000 7f45f37cd640 1 -- 172.21.15.18:0/2120618561 wait complete. 2024-04-17T19:52:42.422 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-04-17T19:52:42.424+0000 7f591ece7180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-17T19:52:42.434 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-17T19:52:42.434 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-17T19:52:42.482 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-04-17T19:52:42.488+0000 7f591ece7180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-17T19:52:42.532 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-17T19:52:42.538+0000 7f251ea79180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-17T19:52:42.689 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-17T19:52:42.694+0000 7f251ea79180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-17T19:52:42.756 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-17T19:52:42.762+0000 7f251ea79180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-17T19:52:42.820 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-04-17T19:52:42.826+0000 7fde332e27c0 -1 Falling back to public interface 2024-04-17T19:52:42.824 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-04-17T19:52:42.828+0000 7fd0209a67c0 -1 Falling back to public interface 2024-04-17T19:52:42.827 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-04-17T19:52:42.834+0000 7fd33be7d7c0 -1 Falling back to public interface 2024-04-17T19:52:42.835 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-04-17T19:52:42.842+0000 7f5e591af7c0 -1 Falling back to public interface 2024-04-17T19:52:42.840 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-17T19:52:42.844+0000 7fab21b4a7c0 -1 Falling back to public interface 2024-04-17T19:52:42.851 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-04-17T19:52:42.858+0000 7fb54664b7c0 -1 Falling back to public interface 2024-04-17T19:52:42.860 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-04-17T19:52:42.864+0000 7f1a1ae1c7c0 -1 Falling back to public interface 2024-04-17T19:52:42.871 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-17T19:52:42.876+0000 7f213cf2e7c0 -1 Falling back to public interface 2024-04-17T19:52:42.898 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-17T19:52:42.902+0000 7f251ea79180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-17T19:52:43.112 INFO:tasks.ceph.mgr.x.smithi173.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-17T19:52:43.112 INFO:tasks.ceph.mgr.x.smithi173.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-17T19:52:43.112 INFO:tasks.ceph.mgr.x.smithi173.stderr: from numpy import show_config as show_numpy_config 2024-04-17T19:52:43.152 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-04-17T19:52:43.156+0000 7f591ece7180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-17T19:52:43.239 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-17T19:52:43.307 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-04-17T19:52:43.312+0000 7f591ece7180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-17T19:52:43.380 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.386+0000 7fe2edcd7640 1 Processor -- start 2024-04-17T19:52:43.380 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.386+0000 7fe2edcd7640 1 -- start start 2024-04-17T19:52:43.382 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.386+0000 7fe2edcd7640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe2e80ce120 0x7fe2e816a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:43.382 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.386+0000 7fe2edcd7640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2e80b3400 con 0x7fe2e80b2dd0 2024-04-17T19:52:43.383 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.386+0000 7fe2edcd7640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2e80cf050 con 0x7fe2e80b7040 2024-04-17T19:52:43.383 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.386+0000 7fe2edcd7640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fe2e80b31e0 con 0x7fe2e80ce120 2024-04-17T19:52:43.383 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.386+0000 7fe2e7fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe2e80ce120 0x7fe2e816a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:43.383 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.386+0000 7fe2e77fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fe2e80b2dd0 0x7fe2e80b6930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:40828/0 (socket says 172.21.15.18:40828) 2024-04-17T19:52:43.383 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.386+0000 7fe2e77fe640 1 -- 172.21.15.18:0/3922723083 learned_addr learned my addr 172.21.15.18:0/3922723083 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:52:43.383 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.390+0000 7fe2e7fff640 1 -- 172.21.15.18:0/3922723083 >> v1:172.21.15.173:6789/0 conn(0x7fe2e80b7040 legacy=0x7fe2e80cda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:43.383 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.390+0000 7fe2e7fff640 1 -- 172.21.15.18:0/3922723083 >> v1:172.21.15.18:6789/0 conn(0x7fe2e80b2dd0 legacy=0x7fe2e80b6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:43.383 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.390+0000 7fe2e67fc640 1 -- 172.21.15.18:0/3922723083 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2758336189 0 0) 0x7fe2e80b3400 con 0x7fe2e80b2dd0 2024-04-17T19:52:43.383 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.390+0000 7fe2e7fff640 1 -- 172.21.15.18:0/3922723083 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2e80ccf30 con 0x7fe2e80ce120 2024-04-17T19:52:43.384 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.390+0000 7fe2e7fff640 1 --2- 172.21.15.18:0/3922723083 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2e80ce120 0x7fe2e816a430 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe2e0009d90 tx=0x7fe2e001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b97fa5bff0d399d server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:52:43.385 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.390+0000 7fe2e67fc640 1 -- 172.21.15.18:0/3922723083 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e00b2070 con 0x7fe2e80ce120 2024-04-17T19:52:43.385 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.390+0000 7fe2e67fc640 1 -- 172.21.15.18:0/3922723083 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2e00a5920 con 0x7fe2e80ce120 2024-04-17T19:52:43.385 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.390+0000 7fe2e67fc640 1 -- 172.21.15.18:0/3922723083 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e00a5cf0 con 0x7fe2e80ce120 2024-04-17T19:52:43.386 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.390+0000 7fe2edcd7640 1 -- 172.21.15.18:0/3922723083 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2e80ce120 msgr2=0x7fe2e816a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:43.386 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.390+0000 7fe2edcd7640 1 --2- 172.21.15.18:0/3922723083 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2e80ce120 0x7fe2e816a430 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe2e0009d90 tx=0x7fe2e001c970 comp rx=0 tx=0).stop 2024-04-17T19:52:43.386 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.390+0000 7fe2edcd7640 1 -- 172.21.15.18:0/3922723083 shutdown_connections 2024-04-17T19:52:43.386 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.390+0000 7fe2edcd7640 1 --2- 172.21.15.18:0/3922723083 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2e80ce120 0x7fe2e816a430 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:43.386 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.390+0000 7fe2edcd7640 1 -- 172.21.15.18:0/3922723083 >> 172.21.15.18:0/3922723083 conn(0x7fe2e8073b50 msgr2=0x7fe2e809aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:52:43.386 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.390+0000 7fe2edcd7640 1 -- 172.21.15.18:0/3922723083 shutdown_connections 2024-04-17T19:52:43.386 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.390+0000 7fe2edcd7640 1 -- 172.21.15.18:0/3922723083 wait complete. 2024-04-17T19:52:43.387 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.394+0000 7fe2edcd7640 1 Processor -- start 2024-04-17T19:52:43.388 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.394+0000 7fe2edcd7640 1 -- start start 2024-04-17T19:52:43.390 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.394+0000 7fe2edcd7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2e80b2dd0 0x7fe2e8152d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:43.390 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.394+0000 7fe2edcd7640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe2e80ce120 0x7fe2e815f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:43.391 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.394+0000 7fe2edcd7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2e80b23d0 0x7fe2e80af3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:43.391 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.394+0000 7fe2edcd7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e816d720 con 0x7fe2e80b2dd0 2024-04-17T19:52:43.391 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.394+0000 7fe2edcd7640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e816d5a0 con 0x7fe2e80b23d0 2024-04-17T19:52:43.391 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.394+0000 7fe2edcd7640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fe2e816d8a0 con 0x7fe2e80ce120 2024-04-17T19:52:43.391 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.394+0000 7fe2e77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2e80b2dd0 0x7fe2e8152d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:43.391 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.394+0000 7fe2e77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2e80b2dd0 0x7fe2e8152d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40386/0 (socket says 172.21.15.18:40386) 2024-04-17T19:52:43.391 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.394+0000 7fe2e77fe640 1 -- 172.21.15.18:0/1647683342 learned_addr learned my addr 172.21.15.18:0/1647683342 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:52:43.391 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.394+0000 7fe2e7fff640 1 --2- 172.21.15.18:0/1647683342 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2e80b23d0 0x7fe2e80af3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:43.391 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.394+0000 7fe2e6ffd640 1 --2- 172.21.15.18:0/1647683342 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe2e80ce120 0x7fe2e815f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:43.391 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.394+0000 7fe2e77fe640 1 -- 172.21.15.18:0/1647683342 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe2e80ce120 msgr2=0x7fe2e815f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:43.391 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.394+0000 7fe2e77fe640 1 --2- 172.21.15.18:0/1647683342 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe2e80ce120 0x7fe2e815f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:43.391 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.394+0000 7fe2e77fe640 1 -- 172.21.15.18:0/1647683342 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2e80b23d0 msgr2=0x7fe2e80af3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:43.392 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.394+0000 7fe2e77fe640 1 --2- 172.21.15.18:0/1647683342 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2e80b23d0 0x7fe2e80af3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:43.392 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.394+0000 7fe2e77fe640 1 -- 172.21.15.18:0/1647683342 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2e815f5b0 con 0x7fe2e80b2dd0 2024-04-17T19:52:43.392 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.394+0000 7fe2e7fff640 1 --2- 172.21.15.18:0/1647683342 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2e80b23d0 0x7fe2e80af3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:52:43.392 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.394+0000 7fe2e77fe640 1 --2- 172.21.15.18:0/1647683342 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2e80b2dd0 0x7fe2e8152d10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe2d800c3a0 tx=0x7fe2d800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:52:43.392 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.394+0000 7fe2cffff640 1 -- 172.21.15.18:0/1647683342 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d8017070 con 0x7fe2e80b2dd0 2024-04-17T19:52:43.392 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.394+0000 7fe2cffff640 1 -- 172.21.15.18:0/1647683342 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2d8007500 con 0x7fe2e80b2dd0 2024-04-17T19:52:43.392 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.394+0000 7fe2edcd7640 1 -- 172.21.15.18:0/1647683342 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2e81536b0 con 0x7fe2e80b2dd0 2024-04-17T19:52:43.392 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.394+0000 7fe2cffff640 1 -- 172.21.15.18:0/1647683342 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d80059f0 con 0x7fe2e80b2dd0 2024-04-17T19:52:43.392 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.394+0000 7fe2edcd7640 1 -- 172.21.15.18:0/1647683342 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2e8153c70 con 0x7fe2e80b2dd0 2024-04-17T19:52:43.392 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.394+0000 7fe2cffff640 1 -- 172.21.15.18:0/1647683342 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe2d801a070 con 0x7fe2e80b2dd0 2024-04-17T19:52:43.392 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.394+0000 7fe2cffff640 1 -- 172.21.15.18:0/1647683342 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fe2d8012ad0 con 0x7fe2e80b2dd0 2024-04-17T19:52:43.393 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.398+0000 7fe2edcd7640 1 -- 172.21.15.18:0/1647683342 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2e80699c0 con 0x7fe2e80b2dd0 2024-04-17T19:52:43.393 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.398+0000 7fe2cffff640 1 -- 172.21.15.18:0/1647683342 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fe2d8021020 con 0x7fe2e80b2dd0 2024-04-17T19:52:43.475 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.482+0000 7fe2edcd7640 1 -- 172.21.15.18:0/1647683342 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe2e80ce7b0 con 0x7fe2e80b2dd0 2024-04-17T19:52:43.476 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.482+0000 7fe2cffff640 1 -- 172.21.15.18:0/1647683342 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fe2d8005b90 con 0x7fe2e80b2dd0 2024-04-17T19:52:43.476 INFO:teuthology.misc.health.smithi018.stdout: 2024-04-17T19:52:43.476 INFO:teuthology.misc.health.smithi018.stdout:{"epoch":10,"fsid":"dd480169-5a81-4623-be5f-0499aa244b28","created":"2024-04-17T19:52:39.533760+0000","modified":"2024-04-17T19:52:42.144259+0000","last_up_change":"0.000000","last_in_change":"2024-04-17T19:52:42.144259+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e232d577-2508-4ea4-b355-29fbae1ff025","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"31810ef3-2c71-48d6-8748-b74a2968d23b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5a783cc5-a41c-4967-9e11-6b8330f97d05","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b7e056d9-9da5-46e1-810d-0c3e242fe5ec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"21df023f-bc8b-4abb-93e5-0ecc91acda0e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e270098a-6d33-49f8-84ed-94e09a880cc3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"93c67c8c-268d-4e32-877c-043cd3acd87c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"faf10eea-80de-40f6-abbb-34d07d3f59ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T19:52:43.477 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.482+0000 7fe2edcd7640 1 -- 172.21.15.18:0/1647683342 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2e80b2dd0 msgr2=0x7fe2e8152d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:43.477 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.482+0000 7fe2edcd7640 1 --2- 172.21.15.18:0/1647683342 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2e80b2dd0 0x7fe2e8152d10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe2d800c3a0 tx=0x7fe2d800c860 comp rx=0 tx=0).stop 2024-04-17T19:52:43.478 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.482+0000 7fe2edcd7640 1 -- 172.21.15.18:0/1647683342 shutdown_connections 2024-04-17T19:52:43.478 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.482+0000 7fe2edcd7640 1 --2- 172.21.15.18:0/1647683342 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2e80b23d0 0x7fe2e80af3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:43.478 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.482+0000 7fe2edcd7640 1 --2- 172.21.15.18:0/1647683342 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe2e80ce120 0x7fe2e815f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:43.478 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.482+0000 7fe2edcd7640 1 --2- 172.21.15.18:0/1647683342 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2e80b2dd0 0x7fe2e8152d10 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:43.478 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.482+0000 7fe2edcd7640 1 -- 172.21.15.18:0/1647683342 >> 172.21.15.18:0/1647683342 conn(0x7fe2e8073b50 msgr2=0x7fe2e80b6930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:52:43.478 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.482+0000 7fe2edcd7640 1 -- 172.21.15.18:0/1647683342 shutdown_connections 2024-04-17T19:52:43.478 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:43.482+0000 7fe2edcd7640 1 -- 172.21.15.18:0/1647683342 wait complete. 2024-04-17T19:52:43.483 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-04-17T19:52:43.488+0000 7f591ece7180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-17T19:52:43.493 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-17T19:52:43.553 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-04-17T19:52:43.556+0000 7f591ece7180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-17T19:52:43.574 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-17T19:52:43.582+0000 7f251ea79180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-17T19:52:43.654 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-17T19:52:43.658+0000 7f251ea79180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-17T19:52:43.694 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-04-17T19:52:43.700+0000 7f591ece7180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-17T19:52:43.844 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-17T19:52:43.849+0000 7f251ea79180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-17T19:52:43.922 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-17T19:52:43.925+0000 7f251ea79180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-17T19:52:44.230 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-17T19:52:44.233+0000 7f251ea79180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-17T19:52:44.294 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-17T19:52:44.301+0000 7f251ea79180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-17T19:52:44.323 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-04-17T19:52:44.328+0000 7f591ece7180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-17T19:52:44.403 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-04-17T19:52:44.408+0000 7f591ece7180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-17T19:52:44.586 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-04-17T19:52:44.588+0000 7f591ece7180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-17T19:52:44.660 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-04-17T19:52:44.664+0000 7f591ece7180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-17T19:52:44.949 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-04-17T19:52:44.952+0000 7f591ece7180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-17T19:52:45.011 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-04-17T19:52:45.016+0000 7f591ece7180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-17T19:52:45.339 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-17T19:52:45.345+0000 7f24c5d29640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-17T19:52:45.339 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-17T19:52:45.345+0000 7f24c5d29640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-17T19:52:46.473 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-17T19:52:46.480+0000 7fab21b4a7c0 -1 osd.6 0 log_to_monitors true 2024-04-17T19:52:46.610 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-04-17T19:52:46.613+0000 7fde332e27c0 -1 osd.0 0 log_to_monitors true 2024-04-17T19:52:46.646 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-04-17T19:52:46.653+0000 7fb54664b7c0 -1 osd.3 0 log_to_monitors true 2024-04-17T19:52:46.709 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-04-17T19:52:46.716+0000 7fd0209a67c0 -1 osd.5 0 log_to_monitors true 2024-04-17T19:52:46.743 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-17T19:52:46.752+0000 7f213cf2e7c0 -1 osd.4 0 log_to_monitors true 2024-04-17T19:52:46.745 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-04-17T19:52:46.749+0000 7f5e591af7c0 -1 osd.1 0 log_to_monitors true 2024-04-17T19:52:46.756 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-04-17T19:52:46.761+0000 7fd33be7d7c0 -1 osd.2 0 log_to_monitors true 2024-04-17T19:52:46.759 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-04-17T19:52:46.768+0000 7f1a1ae1c7c0 -1 osd.7 0 log_to_monitors true 2024-04-17T19:52:48.543 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-17T19:52:48.552+0000 7fab1daf1640 -1 osd.6 0 waiting for initial osdmap 2024-04-17T19:52:48.582 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-04-17T19:52:48.592+0000 7fab158f2640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-17T19:52:50.193 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-04-17T19:52:50.197+0000 7fd337e24640 -1 osd.2 0 waiting for initial osdmap 2024-04-17T19:52:50.217 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-04-17T19:52:50.221+0000 7fb5425f2640 -1 osd.3 0 waiting for initial osdmap 2024-04-17T19:52:50.227 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-04-17T19:52:50.233+0000 7fd32fc25640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-17T19:52:50.259 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-04-17T19:52:50.265+0000 7fb53a3f3640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-17T19:52:50.300 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-17T19:52:50.340 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-04-17T19:52:50.345+0000 7f5e55156640 -1 osd.1 0 waiting for initial osdmap 2024-04-17T19:52:50.379 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-04-17T19:52:50.385+0000 7f5e4cf57640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-17T19:52:50.408 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-04-17T19:52:50.413+0000 7fde2f289640 -1 osd.0 0 waiting for initial osdmap 2024-04-17T19:52:50.431 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.437+0000 7f1f7d3e5640 1 Processor -- start 2024-04-17T19:52:50.431 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.437+0000 7f1f7d3e5640 1 -- start start 2024-04-17T19:52:50.433 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.437+0000 7f1f7d3e5640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f1f780ce9d0 0x7f1f780cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:50.433 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.437+0000 7f1f7d3e5640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1f7815b840 0x7f1f7815bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:50.433 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.437+0000 7f1f7d3e5640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f780ce160 con 0x7f1f780b6930 2024-04-17T19:52:50.433 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.437+0000 7f1f7d3e5640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f1f7806ee50 con 0x7f1f7815b840 2024-04-17T19:52:50.433 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.437+0000 7f1f7d3e5640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f1f781608d0 con 0x7f1f780ce9d0 2024-04-17T19:52:50.433 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.437+0000 7f1f777fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1f7815b840 0x7f1f7815bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:50.433 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.437+0000 7f1f767fc640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f1f780b6930 0x7f1f780b6d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:50282/0 (socket says 172.21.15.18:50282) 2024-04-17T19:52:50.433 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.437+0000 7f1f767fc640 1 -- 172.21.15.18:0/1968801011 learned_addr learned my addr 172.21.15.18:0/1968801011 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:52:50.433 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.437+0000 7f1f777fe640 1 -- 172.21.15.18:0/1968801011 >> v2:172.21.15.173:3300/0 conn(0x7f1f780ce9d0 msgr2=0x7f1f780cdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:52:50.433 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.437+0000 7f1f777fe640 1 --2- 172.21.15.18:0/1968801011 >> v2:172.21.15.173:3300/0 conn(0x7f1f780ce9d0 0x7f1f780cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:50.433 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.437+0000 7f1f777fe640 1 -- 172.21.15.18:0/1968801011 >> v1:172.21.15.18:6789/0 conn(0x7f1f780b6930 legacy=0x7f1f780b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:50.433 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.437+0000 7f1f777fe640 1 -- 172.21.15.18:0/1968801011 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f7815ffa0 con 0x7f1f7815b840 2024-04-17T19:52:50.435 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.441+0000 7f1f777fe640 1 --2- 172.21.15.18:0/1968801011 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f7815b840 0x7f1f7815bc50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1f780743c0 tx=0x7f1f7001c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=307c215208ef4cbc server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:52:50.435 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.441+0000 7f1f75ffb640 1 -- 172.21.15.18:0/1968801011 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f700a6670 con 0x7f1f7815b840 2024-04-17T19:52:50.435 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.441+0000 7f1f75ffb640 1 -- 172.21.15.18:0/1968801011 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f700a6810 con 0x7f1f7815b840 2024-04-17T19:52:50.435 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.441+0000 7f1f75ffb640 1 -- 172.21.15.18:0/1968801011 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f700a6be0 con 0x7f1f7815b840 2024-04-17T19:52:50.436 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.441+0000 7f1f7d3e5640 1 -- 172.21.15.18:0/1968801011 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f7815b840 msgr2=0x7f1f7815bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:50.436 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.441+0000 7f1f7d3e5640 1 --2- 172.21.15.18:0/1968801011 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f7815b840 0x7f1f7815bc50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1f780743c0 tx=0x7f1f7001c8a0 comp rx=0 tx=0).stop 2024-04-17T19:52:50.436 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.441+0000 7f1f7d3e5640 1 -- 172.21.15.18:0/1968801011 shutdown_connections 2024-04-17T19:52:50.436 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.441+0000 7f1f7d3e5640 1 --2- 172.21.15.18:0/1968801011 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f7815b840 0x7f1f7815bc50 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:50.436 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.441+0000 7f1f7d3e5640 1 --2- 172.21.15.18:0/1968801011 >> v2:172.21.15.173:3300/0 conn(0x7f1f780ce9d0 0x7f1f780cdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:50.436 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.441+0000 7f1f7d3e5640 1 -- 172.21.15.18:0/1968801011 >> 172.21.15.18:0/1968801011 conn(0x7f1f78073b50 msgr2=0x7f1f7809aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:52:50.436 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.441+0000 7f1f7d3e5640 1 -- 172.21.15.18:0/1968801011 shutdown_connections 2024-04-17T19:52:50.436 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.441+0000 7f1f7d3e5640 1 -- 172.21.15.18:0/1968801011 wait complete. 2024-04-17T19:52:50.437 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.441+0000 7f1f7d3e5640 1 Processor -- start 2024-04-17T19:52:50.437 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.441+0000 7f1f7d3e5640 1 -- start start 2024-04-17T19:52:50.439 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.445+0000 7f1f7d3e5640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1f780b6930 0x7f1f78155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:50.439 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.445+0000 7f1f7d3e5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f780ce9d0 0x7f1f780c3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:50.440 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.445+0000 7f1f7d3e5640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1f7815b840 0x7f1f78147440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:50.440 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.445+0000 7f1f7d3e5640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1f780cede0 con 0x7f1f780ce9d0 2024-04-17T19:52:50.440 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.445+0000 7f1f7d3e5640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1f7806cdf0 con 0x7f1f780b6930 2024-04-17T19:52:50.440 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.445+0000 7f1f7d3e5640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f1f78148240 con 0x7f1f7815b840 2024-04-17T19:52:50.440 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.445+0000 7f1f767fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f780ce9d0 0x7f1f780c3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:50.440 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.445+0000 7f1f767fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f780ce9d0 0x7f1f780c3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46280/0 (socket says 172.21.15.18:46280) 2024-04-17T19:52:50.440 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.445+0000 7f1f767fc640 1 -- 172.21.15.18:0/1976720753 learned_addr learned my addr 172.21.15.18:0/1976720753 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:52:50.440 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.445+0000 7f1f777fe640 1 --2- 172.21.15.18:0/1976720753 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1f7815b840 0x7f1f78147440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:50.440 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.445+0000 7f1f76ffd640 1 --2- 172.21.15.18:0/1976720753 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1f780b6930 0x7f1f78155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:50.440 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.445+0000 7f1f767fc640 1 -- 172.21.15.18:0/1976720753 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1f7815b840 msgr2=0x7f1f78147440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:50.440 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.445+0000 7f1f767fc640 1 --2- 172.21.15.18:0/1976720753 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1f7815b840 0x7f1f78147440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:50.440 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.445+0000 7f1f767fc640 1 -- 172.21.15.18:0/1976720753 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1f780b6930 msgr2=0x7f1f78155d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:50.440 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.445+0000 7f1f767fc640 1 --2- 172.21.15.18:0/1976720753 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1f780b6930 0x7f1f78155d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:50.440 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.445+0000 7f1f767fc640 1 -- 172.21.15.18:0/1976720753 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f78155290 con 0x7f1f780ce9d0 2024-04-17T19:52:50.441 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-04-17T19:52:50.445+0000 7fde2708a640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-17T19:52:50.442 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.445+0000 7f1f767fc640 1 --2- 172.21.15.18:0/1976720753 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f780ce9d0 0x7f1f780c3ab0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c00c370 tx=0x7f1f6c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:52:50.442 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.445+0000 7f1f5f7fe640 1 -- 172.21.15.18:0/1976720753 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c017070 con 0x7f1f780ce9d0 2024-04-17T19:52:50.442 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.445+0000 7f1f5f7fe640 1 -- 172.21.15.18:0/1976720753 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f6c005cf0 con 0x7f1f780ce9d0 2024-04-17T19:52:50.442 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.445+0000 7f1f5f7fe640 1 -- 172.21.15.18:0/1976720753 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c0072f0 con 0x7f1f780ce9d0 2024-04-17T19:52:50.442 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.445+0000 7f1f7d3e5640 1 -- 172.21.15.18:0/1976720753 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f780c4850 con 0x7f1f780ce9d0 2024-04-17T19:52:50.442 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.445+0000 7f1f7d3e5640 1 -- 172.21.15.18:0/1976720753 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f78155500 con 0x7f1f780ce9d0 2024-04-17T19:52:50.442 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.445+0000 7f1f7d3e5640 1 -- 172.21.15.18:0/1976720753 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f780699c0 con 0x7f1f780ce9d0 2024-04-17T19:52:50.442 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.445+0000 7f1f5f7fe640 1 -- 172.21.15.18:0/1976720753 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 4) ==== 87931+0+0 (secure 0 0 0) 0x7f1f6c01a070 con 0x7f1f780ce9d0 2024-04-17T19:52:50.442 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.445+0000 7f1f5f7fe640 1 --2- 172.21.15.18:0/1976720753 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f1f640682f0 0x7f1f6406a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:50.442 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.445+0000 7f1f5f7fe640 1 -- 172.21.15.18:0/1976720753 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2511+0+0 (secure 0 0 0) 0x7f1f6c084f30 con 0x7f1f780ce9d0 2024-04-17T19:52:50.443 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.445+0000 7f1f76ffd640 1 --2- 172.21.15.18:0/1976720753 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f1f640682f0 0x7f1f6406a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:50.443 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.449+0000 7f1f76ffd640 1 --2- 172.21.15.18:0/1976720753 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f1f640682f0 0x7f1f6406a800 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1f780b2560 tx=0x7f1f68008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:52:50.451 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.457+0000 7f1f5f7fe640 1 -- 172.21.15.18:0/1976720753 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1f780c4850 con 0x7f1f780ce9d0 2024-04-17T19:52:50.458 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-17T19:52:50.464+0000 7f2138ed5640 -1 osd.4 0 waiting for initial osdmap 2024-04-17T19:52:50.471 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-04-17T19:52:50.480+0000 7fd01c94d640 -1 osd.5 0 waiting for initial osdmap 2024-04-17T19:52:50.491 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-04-17T19:52:50.500+0000 7f2130cd6640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-17T19:52:50.503 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-04-17T19:52:50.512+0000 7fd01474e640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-17T19:52:50.533 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-04-17T19:52:50.540+0000 7f1a16dc3640 -1 osd.7 0 waiting for initial osdmap 2024-04-17T19:52:50.559 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-04-17T19:52:50.568+0000 7f1a0ebc4640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-17T19:52:50.623 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.629+0000 7f1f7d3e5640 1 -- 172.21.15.18:0/1976720753 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1f780ce7b0 con 0x7f1f780ce9d0 2024-04-17T19:52:50.623 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.629+0000 7f1f5f7fe640 1 -- 172.21.15.18:0/1976720753 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+7555 (secure 0 0 0) 0x7f1f6c055b70 con 0x7f1f780ce9d0 2024-04-17T19:52:50.624 INFO:teuthology.misc.health.smithi018.stdout: 2024-04-17T19:52:50.624 INFO:teuthology.misc.health.smithi018.stdout:{"epoch":14,"fsid":"dd480169-5a81-4623-be5f-0499aa244b28","created":"2024-04-17T19:52:39.533760+0000","modified":"2024-04-17T19:52:49.598371+0000","last_up_change":"2024-04-17T19:52:49.598371+0000","last_in_change":"2024-04-17T19:52:42.144259+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e232d577-2508-4ea4-b355-29fbae1ff025","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"31810ef3-2c71-48d6-8748-b74a2968d23b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5a783cc5-a41c-4967-9e11-6b8330f97d05","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b7e056d9-9da5-46e1-810d-0c3e242fe5ec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"21df023f-bc8b-4abb-93e5-0ecc91acda0e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e270098a-6d33-49f8-84ed-94e09a880cc3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"93c67c8c-268d-4e32-877c-043cd3acd87c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6809","nonce":761678552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6811","nonce":761678552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6815","nonce":761678552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6813","nonce":761678552}]},"public_addr":"172.21.15.173:6809/761678552","cluster_addr":"172.21.15.173:6811/761678552","heartbeat_back_addr":"172.21.15.173:6815/761678552","heartbeat_front_addr":"172.21.15.173:6813/761678552","state":["exists","up"]},{"osd":7,"uuid":"faf10eea-80de-40f6-abbb-34d07d3f59ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T19:52:50.626 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.629+0000 7f1f7d3e5640 1 -- 172.21.15.18:0/1976720753 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f1f640682f0 msgr2=0x7f1f6406a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:50.626 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.629+0000 7f1f7d3e5640 1 --2- 172.21.15.18:0/1976720753 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f1f640682f0 0x7f1f6406a800 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1f780b2560 tx=0x7f1f68008040 comp rx=0 tx=0).stop 2024-04-17T19:52:50.626 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.629+0000 7f1f7d3e5640 1 -- 172.21.15.18:0/1976720753 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f780ce9d0 msgr2=0x7f1f780c3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:50.626 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.629+0000 7f1f7d3e5640 1 --2- 172.21.15.18:0/1976720753 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f780ce9d0 0x7f1f780c3ab0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c00c370 tx=0x7f1f6c00c830 comp rx=0 tx=0).stop 2024-04-17T19:52:50.626 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.629+0000 7f1f7d3e5640 1 -- 172.21.15.18:0/1976720753 shutdown_connections 2024-04-17T19:52:50.627 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.629+0000 7f1f7d3e5640 1 --2- 172.21.15.18:0/1976720753 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f1f640682f0 0x7f1f6406a800 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:50.627 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.629+0000 7f1f7d3e5640 1 --2- 172.21.15.18:0/1976720753 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1f7815b840 0x7f1f78147440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:50.627 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.629+0000 7f1f7d3e5640 1 --2- 172.21.15.18:0/1976720753 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f780ce9d0 0x7f1f780c3ab0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:50.627 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.629+0000 7f1f7d3e5640 1 --2- 172.21.15.18:0/1976720753 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1f780b6930 0x7f1f78155d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:50.627 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.629+0000 7f1f7d3e5640 1 -- 172.21.15.18:0/1976720753 >> 172.21.15.18:0/1976720753 conn(0x7f1f78073b50 msgr2=0x7f1f780b0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:52:50.627 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.629+0000 7f1f7d3e5640 1 -- 172.21.15.18:0/1976720753 shutdown_connections 2024-04-17T19:52:50.627 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:50.629+0000 7f1f7d3e5640 1 -- 172.21.15.18:0/1976720753 wait complete. 2024-04-17T19:52:50.642 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-04-17T19:52:57.448 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-17T19:52:57.606 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.609+0000 7fd665e17640 1 Processor -- start 2024-04-17T19:52:57.607 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.613+0000 7fd665e17640 1 -- start start 2024-04-17T19:52:57.610 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.613+0000 7fd665e17640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd66015b480 0x7fd6600b5650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:57.610 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.613+0000 7fd665e17640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd66015b890 0x7fd6600b5b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:57.610 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.613+0000 7fd665e17640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd66006cd80 con 0x7fd66006c5e0 2024-04-17T19:52:57.610 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.613+0000 7fd665e17640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7fd6600ceaf0 con 0x7fd66015b480 2024-04-17T19:52:57.611 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.613+0000 7fd665e17640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fd6600cedd0 con 0x7fd66015b890 2024-04-17T19:52:57.611 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.613+0000 7fd65f7fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fd66006c5e0 0x7fd6600cf5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:57634/0 (socket says 172.21.15.18:57634) 2024-04-17T19:52:57.611 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.613+0000 7fd65f7fe640 1 -- 172.21.15.18:0/2455277217 learned_addr learned my addr 172.21.15.18:0/2455277217 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:52:57.611 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.613+0000 7fd656ffd640 1 --2- 172.21.15.18:0/2455277217 >> v2:172.21.15.173:3300/0 conn(0x7fd66015b480 0x7fd6600b5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:57.611 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.613+0000 7fd65ffff640 1 --2- 172.21.15.18:0/2455277217 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd66015b890 0x7fd6600b5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:57.611 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.613+0000 7fd65effd640 1 -- 172.21.15.18:0/2455277217 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3135795374 0 0) 0x7fd66006cd80 con 0x7fd66006c5e0 2024-04-17T19:52:57.611 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.613+0000 7fd65effd640 1 -- 172.21.15.18:0/2455277217 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd64c005740 con 0x7fd66006c5e0 2024-04-17T19:52:57.611 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.613+0000 7fd65effd640 1 -- 172.21.15.18:0/2455277217 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2830665017 0 0) 0x7fd64c005740 con 0x7fd66006c5e0 2024-04-17T19:52:57.611 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.613+0000 7fd65effd640 1 -- 172.21.15.18:0/2455277217 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd66015b890 msgr2=0x7fd6600b5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:52:57.611 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.613+0000 7fd65effd640 1 --2- 172.21.15.18:0/2455277217 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd66015b890 0x7fd6600b5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:57.611 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.613+0000 7fd65effd640 1 -- 172.21.15.18:0/2455277217 >> v2:172.21.15.173:3300/0 conn(0x7fd66015b480 msgr2=0x7fd6600b5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:52:57.611 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.613+0000 7fd65effd640 1 --2- 172.21.15.18:0/2455277217 >> v2:172.21.15.173:3300/0 conn(0x7fd66015b480 0x7fd6600b5650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:57.611 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.613+0000 7fd65effd640 1 -- 172.21.15.18:0/2455277217 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6600cf0b0 con 0x7fd66006c5e0 2024-04-17T19:52:57.611 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.613+0000 7fd65effd640 1 -- 172.21.15.18:0/2455277217 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3208559991 0 0) 0x7fd650001680 con 0x7fd66006c5e0 2024-04-17T19:52:57.612 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.613+0000 7fd65effd640 1 -- 172.21.15.18:0/2455277217 >> v1:172.21.15.18:6789/0 conn(0x7fd66006c5e0 legacy=0x7fd6600cf5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:57.612 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.613+0000 7fd65effd640 1 --2- 172.21.15.18:0/2455277217 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd64c005bd0 0x7fd64c006040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:57.612 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.613+0000 7fd65effd640 1 --2- 172.21.15.18:0/2455277217 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd66015b890 0x7fd64c006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:57.612 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.613+0000 7fd65effd640 1 --2- 172.21.15.18:0/2455277217 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd64c006f60 0x7fd64c007370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:57.612 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.613+0000 7fd65effd640 1 -- 172.21.15.18:0/2455277217 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd6600ceaf0 con 0x7fd64c005bd0 2024-04-17T19:52:57.612 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.613+0000 7fd65effd640 1 -- 172.21.15.18:0/2455277217 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd6600cedd0 con 0x7fd64c006f60 2024-04-17T19:52:57.612 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.613+0000 7fd65effd640 1 -- 172.21.15.18:0/2455277217 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fd64c00dbe0 con 0x7fd66015b890 2024-04-17T19:52:57.612 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.613+0000 7fd65f7fe640 1 --2- 172.21.15.18:0/2455277217 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd64c005bd0 0x7fd64c006040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:57.612 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.613+0000 7fd656ffd640 1 --2- 172.21.15.18:0/2455277217 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd66015b890 0x7fd64c006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:57.612 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.613+0000 7fd65ffff640 1 --2- 172.21.15.18:0/2455277217 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd64c006f60 0x7fd64c007370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:57.612 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.613+0000 7fd65f7fe640 1 -- 172.21.15.18:0/2455277217 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd66015b890 msgr2=0x7fd64c006a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:52:57.612 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.613+0000 7fd65f7fe640 1 --2- 172.21.15.18:0/2455277217 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd66015b890 0x7fd64c006a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:57.612 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.613+0000 7fd65f7fe640 1 -- 172.21.15.18:0/2455277217 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd64c006f60 msgr2=0x7fd64c007370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:52:57.612 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.613+0000 7fd65f7fe640 1 --2- 172.21.15.18:0/2455277217 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd64c006f60 0x7fd64c007370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:57.613 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.613+0000 7fd65f7fe640 1 -- 172.21.15.18:0/2455277217 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd64c005740 con 0x7fd64c005bd0 2024-04-17T19:52:57.613 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.613+0000 7fd656ffd640 1 --2- 172.21.15.18:0/2455277217 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd66015b890 0x7fd64c006a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:52:57.613 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.613+0000 7fd65ffff640 1 --2- 172.21.15.18:0/2455277217 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd64c006f60 0x7fd64c007370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:52:57.614 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.617+0000 7fd65f7fe640 1 --2- 172.21.15.18:0/2455277217 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd64c005bd0 0x7fd64c006040 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd65000c210 tx=0x7fd65001cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8e09b54a06cd486 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:52:57.614 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.617+0000 7fd65effd640 1 -- 172.21.15.18:0/2455277217 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd650007d60 con 0x7fd64c005bd0 2024-04-17T19:52:57.614 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.617+0000 7fd65effd640 1 -- 172.21.15.18:0/2455277217 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6500a9020 con 0x7fd64c005bd0 2024-04-17T19:52:57.614 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.617+0000 7fd65effd640 1 -- 172.21.15.18:0/2455277217 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd650005b20 con 0x7fd64c005bd0 2024-04-17T19:52:57.614 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.617+0000 7fd665e17640 1 -- 172.21.15.18:0/2455277217 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd64c005bd0 msgr2=0x7fd64c006040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:57.614 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.617+0000 7fd665e17640 1 --2- 172.21.15.18:0/2455277217 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd64c005bd0 0x7fd64c006040 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd65000c210 tx=0x7fd65001cc20 comp rx=0 tx=0).stop 2024-04-17T19:52:57.614 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.617+0000 7fd65ffff640 1 -- 172.21.15.18:0/2455277217 reap_dead start 2024-04-17T19:52:57.614 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.617+0000 7fd665e17640 1 -- 172.21.15.18:0/2455277217 shutdown_connections 2024-04-17T19:52:57.614 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.617+0000 7fd665e17640 1 -- 172.21.15.18:0/2455277217 >> 172.21.15.18:0/2455277217 conn(0x7fd6600b2810 msgr2=0x7fd6600b2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:52:57.615 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.617+0000 7fd665e17640 1 -- 172.21.15.18:0/2455277217 shutdown_connections 2024-04-17T19:52:57.615 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.617+0000 7fd665e17640 1 -- 172.21.15.18:0/2455277217 wait complete. 2024-04-17T19:52:57.615 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.621+0000 7fd665e17640 1 Processor -- start 2024-04-17T19:52:57.615 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.621+0000 7fd665e17640 1 -- start start 2024-04-17T19:52:57.618 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.621+0000 7fd665e17640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd64c005bd0 0x7fd660140800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:57.618 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.621+0000 7fd665e17640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd66013ffb0 0x7fd660143240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:57.618 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.621+0000 7fd665e17640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd660152b10 0x7fd660152f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:57.618 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.621+0000 7fd665e17640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd6600b3c90 con 0x7fd64c005bd0 2024-04-17T19:52:57.618 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.621+0000 7fd665e17640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd6600b3b10 con 0x7fd66013ffb0 2024-04-17T19:52:57.618 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.621+0000 7fd665e17640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fd6600b3e10 con 0x7fd660152b10 2024-04-17T19:52:57.618 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.621+0000 7fd65f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd64c005bd0 0x7fd660140800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:57.618 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.621+0000 7fd65f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd64c005bd0 0x7fd660140800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36162/0 (socket says 172.21.15.18:36162) 2024-04-17T19:52:57.618 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.621+0000 7fd65f7fe640 1 -- 172.21.15.18:0/2690278330 learned_addr learned my addr 172.21.15.18:0/2690278330 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:52:57.618 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.621+0000 7fd65ffff640 1 --2- 172.21.15.18:0/2690278330 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd660152b10 0x7fd660152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:57.618 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.621+0000 7fd656ffd640 1 --2- 172.21.15.18:0/2690278330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd66013ffb0 0x7fd660143240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:57.619 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.621+0000 7fd65f7fe640 1 -- 172.21.15.18:0/2690278330 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd660152b10 msgr2=0x7fd660152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:57.619 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.621+0000 7fd65f7fe640 1 --2- 172.21.15.18:0/2690278330 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd660152b10 0x7fd660152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:57.619 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.621+0000 7fd65f7fe640 1 -- 172.21.15.18:0/2690278330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd66013ffb0 msgr2=0x7fd660143240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:57.619 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.621+0000 7fd65f7fe640 1 --2- 172.21.15.18:0/2690278330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd66013ffb0 0x7fd660143240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:57.619 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.621+0000 7fd65f7fe640 1 -- 172.21.15.18:0/2690278330 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd660151d90 con 0x7fd64c005bd0 2024-04-17T19:52:57.619 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.621+0000 7fd65f7fe640 1 --2- 172.21.15.18:0/2690278330 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd64c005bd0 0x7fd660140800 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd65000c210 tx=0x7fd64c007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:52:57.619 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.621+0000 7fd65cff9640 1 -- 172.21.15.18:0/2690278330 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd650005d00 con 0x7fd64c005bd0 2024-04-17T19:52:57.619 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.621+0000 7fd65cff9640 1 -- 172.21.15.18:0/2690278330 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6500047f0 con 0x7fd64c005bd0 2024-04-17T19:52:57.619 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.621+0000 7fd665e17640 1 -- 172.21.15.18:0/2690278330 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd660152030 con 0x7fd64c005bd0 2024-04-17T19:52:57.619 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.621+0000 7fd65cff9640 1 -- 172.21.15.18:0/2690278330 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd650004ba0 con 0x7fd64c005bd0 2024-04-17T19:52:57.619 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.621+0000 7fd665e17640 1 -- 172.21.15.18:0/2690278330 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6601525f0 con 0x7fd64c005bd0 2024-04-17T19:52:57.620 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.621+0000 7fd665e17640 1 -- 172.21.15.18:0/2690278330 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6600699c0 con 0x7fd64c005bd0 2024-04-17T19:52:57.620 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.625+0000 7fd65cff9640 1 -- 172.21.15.18:0/2690278330 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd6500a57d0 con 0x7fd64c005bd0 2024-04-17T19:52:57.620 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.625+0000 7fd65cff9640 1 --2- 172.21.15.18:0/2690278330 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fd640068380 0x7fd64006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:57.620 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.625+0000 7fd65cff9640 1 -- 172.21.15.18:0/2690278330 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fd65011f900 con 0x7fd64c005bd0 2024-04-17T19:52:57.621 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.625+0000 7fd656ffd640 1 --2- 172.21.15.18:0/2690278330 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fd640068380 0x7fd64006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:57.621 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.625+0000 7fd656ffd640 1 --2- 172.21.15.18:0/2690278330 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fd640068380 0x7fd64006a890 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd648009160 tx=0x7fd648008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:52:57.624 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.629+0000 7fd65cff9640 1 -- 172.21.15.18:0/2690278330 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd6500b4070 con 0x7fd64c005bd0 2024-04-17T19:52:57.788 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.793+0000 7fd665e17640 1 -- 172.21.15.18:0/2690278330 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd660070130 con 0x7fd64c005bd0 2024-04-17T19:52:57.790 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.793+0000 7fd65cff9640 1 -- 172.21.15.18:0/2690278330 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12872 (secure 0 0 0) 0x7fd650016930 con 0x7fd64c005bd0 2024-04-17T19:52:57.790 INFO:teuthology.misc.health.smithi018.stdout: 2024-04-17T19:52:57.790 INFO:teuthology.misc.health.smithi018.stdout:{"epoch":19,"fsid":"dd480169-5a81-4623-be5f-0499aa244b28","created":"2024-04-17T19:52:39.533760+0000","modified":"2024-04-17T19:52:55.269542+0000","last_up_change":"2024-04-17T19:52:51.229698+0000","last_in_change":"2024-04-17T19:52:42.144259+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T19:52:52.391648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e232d577-2508-4ea4-b355-29fbae1ff025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6801","nonce":2323038417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6803","nonce":2323038417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6807","nonce":2323038417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6805","nonce":2323038417}]},"public_addr":"172.21.15.18:6801/2323038417","cluster_addr":"172.21.15.18:6803/2323038417","heartbeat_back_addr":"172.21.15.18:6807/2323038417","heartbeat_front_addr":"172.21.15.18:6805/2323038417","state":["exists","up"]},{"osd":1,"uuid":"31810ef3-2c71-48d6-8748-b74a2968d23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6817","nonce":1283678238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6819","nonce":1283678238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6823","nonce":1283678238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6821","nonce":1283678238}]},"public_addr":"172.21.15.18:6817/1283678238","cluster_addr":"172.21.15.18:6819/1283678238","heartbeat_back_addr":"172.21.15.18:6823/1283678238","heartbeat_front_addr":"172.21.15.18:6821/1283678238","state":["exists","up"]},{"osd":2,"uuid":"5a783cc5-a41c-4967-9e11-6b8330f97d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6809","nonce":1212875862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6811","nonce":1212875862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6815","nonce":1212875862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6813","nonce":1212875862}]},"public_addr":"172.21.15.18:6809/1212875862","cluster_addr":"172.21.15.18:6811/1212875862","heartbeat_back_addr":"172.21.15.18:6815/1212875862","heartbeat_front_addr":"172.21.15.18:6813/1212875862","state":["exists","up"]},{"osd":3,"uuid":"b7e056d9-9da5-46e1-810d-0c3e242fe5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6825","nonce":2428878428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6827","nonce":2428878428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6831","nonce":2428878428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6829","nonce":2428878428}]},"public_addr":"172.21.15.18:6825/2428878428","cluster_addr":"172.21.15.18:6827/2428878428","heartbeat_back_addr":"172.21.15.18:6831/2428878428","heartbeat_front_addr":"172.21.15.18:6829/2428878428","state":["exists","up"]},{"osd":4,"uuid":"21df023f-bc8b-4abb-93e5-0ecc91acda0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6825","nonce":1421511819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6827","nonce":1421511819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6831","nonce":1421511819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6829","nonce":1421511819}]},"public_addr":"172.21.15.173:6825/1421511819","cluster_addr":"172.21.15.173:6827/1421511819","heartbeat_back_addr":"172.21.15.173:6831/1421511819","heartbeat_front_addr":"172.21.15.173:6829/1421511819","state":["exists","up"]},{"osd":5,"uuid":"e270098a-6d33-49f8-84ed-94e09a880cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6801","nonce":4221907702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6803","nonce":4221907702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6807","nonce":4221907702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6805","nonce":4221907702}]},"public_addr":"172.21.15.173:6801/4221907702","cluster_addr":"172.21.15.173:6803/4221907702","heartbeat_back_addr":"172.21.15.173:6807/4221907702","heartbeat_front_addr":"172.21.15.173:6805/4221907702","state":["exists","up"]},{"osd":6,"uuid":"93c67c8c-268d-4e32-877c-043cd3acd87c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6809","nonce":761678552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6811","nonce":761678552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6815","nonce":761678552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6813","nonce":761678552}]},"public_addr":"172.21.15.173:6809/761678552","cluster_addr":"172.21.15.173:6811/761678552","heartbeat_back_addr":"172.21.15.173:6815/761678552","heartbeat_front_addr":"172.21.15.173:6813/761678552","state":["exists","up"]},{"osd":7,"uuid":"faf10eea-80de-40f6-abbb-34d07d3f59ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6817","nonce":383724537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6819","nonce":383724537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6823","nonce":383724537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6821","nonce":383724537}]},"public_addr":"172.21.15.173:6817/383724537","cluster_addr":"172.21.15.173:6819/383724537","heartbeat_back_addr":"172.21.15.173:6823/383724537","heartbeat_front_addr":"172.21.15.173:6821/383724537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.668924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.761747+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.768128+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.632252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.742608+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.734327+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.477107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.818292+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T19:52:57.793 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.797+0000 7fd665e17640 1 -- 172.21.15.18:0/2690278330 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fd640068380 msgr2=0x7fd64006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:57.793 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.797+0000 7fd665e17640 1 --2- 172.21.15.18:0/2690278330 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fd640068380 0x7fd64006a890 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd648009160 tx=0x7fd648008040 comp rx=0 tx=0).stop 2024-04-17T19:52:57.793 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.797+0000 7fd665e17640 1 -- 172.21.15.18:0/2690278330 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd64c005bd0 msgr2=0x7fd660140800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:57.793 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.797+0000 7fd665e17640 1 --2- 172.21.15.18:0/2690278330 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd64c005bd0 0x7fd660140800 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd65000c210 tx=0x7fd64c007a50 comp rx=0 tx=0).stop 2024-04-17T19:52:57.793 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.797+0000 7fd665e17640 1 -- 172.21.15.18:0/2690278330 shutdown_connections 2024-04-17T19:52:57.793 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.797+0000 7fd665e17640 1 --2- 172.21.15.18:0/2690278330 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fd640068380 0x7fd64006a890 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:57.793 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.797+0000 7fd665e17640 1 --2- 172.21.15.18:0/2690278330 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd660152b10 0x7fd660152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:57.793 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.797+0000 7fd665e17640 1 --2- 172.21.15.18:0/2690278330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd66013ffb0 0x7fd660143240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:57.793 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.797+0000 7fd665e17640 1 --2- 172.21.15.18:0/2690278330 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd64c005bd0 0x7fd660140800 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:57.794 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.797+0000 7fd665e17640 1 -- 172.21.15.18:0/2690278330 >> 172.21.15.18:0/2690278330 conn(0x7fd6600b2810 msgr2=0x7fd6600b4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:52:57.794 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.797+0000 7fd665e17640 1 -- 172.21.15.18:0/2690278330 shutdown_connections 2024-04-17T19:52:57.794 INFO:teuthology.misc.health.smithi018.stderr:2024-04-17T19:52:57.797+0000 7fd665e17640 1 -- 172.21.15.18:0/2690278330 wait complete. 2024-04-17T19:52:57.810 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-17T19:52:57.810 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-17T19:52:57.811 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-17T19:52:57.811 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-17T19:52:57.813 INFO:tasks.ceph.mds.a:Started 2024-04-17T19:52:57.813 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-17T19:52:57.813 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-17T19:52:57.815 INFO:tasks.ceph.mds.c:Started 2024-04-17T19:52:57.815 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-17T19:52:57.815 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-17T19:52:57.818 INFO:tasks.ceph.mds.b:Started 2024-04-17T19:52:57.818 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-17T19:52:57.818 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-17T19:52:57.821 INFO:tasks.ceph.mds.d:Started 2024-04-17T19:52:57.821 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-17T19:52:57.821 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T19:52:57.918 INFO:tasks.ceph.mds.c.smithi018.stdout:starting mds.c at 2024-04-17T19:52:57.923 INFO:tasks.ceph.mds.a.smithi018.stdout:starting mds.a at 2024-04-17T19:52:57.938 INFO:tasks.ceph.mds.b.smithi173.stdout:starting mds.b at 2024-04-17T19:52:57.943 INFO:tasks.ceph.mds.d.smithi173.stdout:starting mds.d at 2024-04-17T19:52:57.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.973+0000 7f89444f3640 1 Processor -- start 2024-04-17T19:52:57.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.973+0000 7f89444f3640 1 -- start start 2024-04-17T19:52:57.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.973+0000 7f89444f3640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f893c0d24a0 0x7f893c15d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:57.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.973+0000 7f89444f3640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f893c0cf6c0 0x7f893c0cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:57.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.973+0000 7f89444f3640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f893c06e9a0 con 0x7f893c0b6850 2024-04-17T19:52:57.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.973+0000 7f89444f3640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f893c06ec80 con 0x7f893c0d24a0 2024-04-17T19:52:57.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.973+0000 7f89444f3640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f893c0d19c0 con 0x7f893c0cf6c0 2024-04-17T19:52:57.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.973+0000 7f894228f640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f893c0d24a0 0x7f893c15d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:57.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.973+0000 7f894228f640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f893c0d24a0 0x7f893c15d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36210/0 (socket says 172.21.15.18:36210) 2024-04-17T19:52:57.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.973+0000 7f8941a8e640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f893c0b6850 0x7f893c0b6c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:57658/0 (socket says 172.21.15.18:57658) 2024-04-17T19:52:57.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.973+0000 7f894228f640 1 -- 172.21.15.18:0/2803026092 learned_addr learned my addr 172.21.15.18:0/2803026092 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:52:57.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.973+0000 7f8942a90640 1 --2- 172.21.15.18:0/2803026092 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f893c0cf6c0 0x7f893c0cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:57.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.973+0000 7f894228f640 1 -- 172.21.15.18:0/2803026092 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f893c0cf6c0 msgr2=0x7f893c0cfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:52:57.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.973+0000 7f894228f640 1 --2- 172.21.15.18:0/2803026092 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f893c0cf6c0 0x7f893c0cfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:57.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.973+0000 7f894228f640 1 -- 172.21.15.18:0/2803026092 >> v1:172.21.15.18:6789/0 conn(0x7f893c0b6850 legacy=0x7f893c0b6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:57.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.973+0000 7f894228f640 1 -- 172.21.15.18:0/2803026092 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f893c0d1ca0 con 0x7f893c0d24a0 2024-04-17T19:52:57.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.973+0000 7f8942a90640 1 --2- 172.21.15.18:0/2803026092 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f893c0cf6c0 0x7f893c0cfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:52:57.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.977+0000 7f894228f640 1 --2- 172.21.15.18:0/2803026092 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f893c0d24a0 0x7f893c15d1a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f892c009870 tx=0x7f892c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8927bc9b7b026fae server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:52:57.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.977+0000 7f894128d640 1 -- 172.21.15.18:0/2803026092 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f892c0b0070 con 0x7f893c0d24a0 2024-04-17T19:52:57.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.977+0000 7f894128d640 1 -- 172.21.15.18:0/2803026092 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f892c0ab600 con 0x7f893c0d24a0 2024-04-17T19:52:57.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.977+0000 7f894128d640 1 -- 172.21.15.18:0/2803026092 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f892c0ab9d0 con 0x7f893c0d24a0 2024-04-17T19:52:57.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.977+0000 7f89444f3640 1 -- 172.21.15.18:0/2803026092 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f893c0d24a0 msgr2=0x7f893c15d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:57.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.977+0000 7f89444f3640 1 --2- 172.21.15.18:0/2803026092 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f893c0d24a0 0x7f893c15d1a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f892c009870 tx=0x7f892c01c560 comp rx=0 tx=0).stop 2024-04-17T19:52:57.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.977+0000 7f89444f3640 1 -- 172.21.15.18:0/2803026092 shutdown_connections 2024-04-17T19:52:57.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.977+0000 7f89444f3640 1 --2- 172.21.15.18:0/2803026092 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f893c0cf6c0 0x7f893c0cfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:57.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.977+0000 7f89444f3640 1 --2- 172.21.15.18:0/2803026092 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f893c0d24a0 0x7f893c15d1a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:57.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.977+0000 7f89444f3640 1 -- 172.21.15.18:0/2803026092 >> 172.21.15.18:0/2803026092 conn(0x7f893c09aa70 msgr2=0x7f893c09ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:52:57.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.977+0000 7f89444f3640 1 -- 172.21.15.18:0/2803026092 shutdown_connections 2024-04-17T19:52:57.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.977+0000 7f89444f3640 1 -- 172.21.15.18:0/2803026092 wait complete. 2024-04-17T19:52:57.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.981+0000 7f89444f3640 1 Processor -- start 2024-04-17T19:52:57.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.981+0000 7f89444f3640 1 -- start start 2024-04-17T19:52:57.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.981+0000 7f89444f3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f893c0b6850 0x7f893c152360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:57.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.981+0000 7f89444f3640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f893c0cf6c0 0x7f893c158f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:57.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.981+0000 7f89444f3640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f893c0d24a0 0x7f893c159460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:57.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.981+0000 7f89444f3640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f893c06cdf0 con 0x7f893c0b6850 2024-04-17T19:52:57.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.981+0000 7f89444f3640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f893c06ef60 con 0x7f893c0d24a0 2024-04-17T19:52:57.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.981+0000 7f89444f3640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f893c06cf70 con 0x7f893c0cf6c0 2024-04-17T19:52:57.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.981+0000 7f894228f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f893c0b6850 0x7f893c152360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:57.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.981+0000 7f894228f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f893c0b6850 0x7f893c152360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36222/0 (socket says 172.21.15.18:36222) 2024-04-17T19:52:57.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.981+0000 7f894228f640 1 -- 172.21.15.18:0/2362079301 learned_addr learned my addr 172.21.15.18:0/2362079301 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:52:57.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.981+0000 7f8942a90640 1 --2- 172.21.15.18:0/2362079301 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f893c0d24a0 0x7f893c159460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:57.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.981+0000 7f8941a8e640 1 --2- 172.21.15.18:0/2362079301 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f893c0cf6c0 0x7f893c158f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:57.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.981+0000 7f894228f640 1 -- 172.21.15.18:0/2362079301 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f893c0cf6c0 msgr2=0x7f893c158f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:57.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.981+0000 7f894228f640 1 --2- 172.21.15.18:0/2362079301 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f893c0cf6c0 0x7f893c158f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:57.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.981+0000 7f894228f640 1 -- 172.21.15.18:0/2362079301 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f893c0d24a0 msgr2=0x7f893c159460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:57.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.981+0000 7f894228f640 1 --2- 172.21.15.18:0/2362079301 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f893c0d24a0 0x7f893c159460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:57.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.981+0000 7f894228f640 1 -- 172.21.15.18:0/2362079301 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f893c157490 con 0x7f893c0b6850 2024-04-17T19:52:57.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.981+0000 7f894228f640 1 --2- 172.21.15.18:0/2362079301 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f893c0b6850 0x7f893c152360 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f892c01a190 tx=0x7f892c019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:52:57.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.981+0000 7f8932ffd640 1 -- 172.21.15.18:0/2362079301 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f892c0b0040 con 0x7f893c0b6850 2024-04-17T19:52:57.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.981+0000 7f8932ffd640 1 -- 172.21.15.18:0/2362079301 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f892c0b9070 con 0x7f893c0b6850 2024-04-17T19:52:57.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.981+0000 7f89444f3640 1 -- 172.21.15.18:0/2362079301 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f893c153f10 con 0x7f893c0b6850 2024-04-17T19:52:57.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.981+0000 7f8932ffd640 1 -- 172.21.15.18:0/2362079301 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f892c0b4830 con 0x7f893c0b6850 2024-04-17T19:52:57.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.981+0000 7f89444f3640 1 -- 172.21.15.18:0/2362079301 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f893c1546f0 con 0x7f893c0b6850 2024-04-17T19:52:57.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.985+0000 7f89444f3640 1 -- 172.21.15.18:0/2362079301 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f893c069950 con 0x7f893c0b6850 2024-04-17T19:52:57.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.985+0000 7f8932ffd640 1 -- 172.21.15.18:0/2362079301 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f892c0b49d0 con 0x7f893c0b6850 2024-04-17T19:52:57.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.985+0000 7f8932ffd640 1 --2- 172.21.15.18:0/2362079301 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f8920068380 0x7f892006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:57.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.985+0000 7f8941a8e640 1 --2- 172.21.15.18:0/2362079301 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f8920068380 0x7f892006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:57.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.985+0000 7f8932ffd640 1 -- 172.21.15.18:0/2362079301 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f892c120450 con 0x7f893c0b6850 2024-04-17T19:52:57.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.985+0000 7f8941a8e640 1 --2- 172.21.15.18:0/2362079301 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f8920068380 0x7f892006a890 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f893c0b4990 tx=0x7f8938007e90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:52:57.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:57.989+0000 7f8932ffd640 1 -- 172.21.15.18:0/2362079301 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f892c016150 con 0x7f893c0b6850 2024-04-17T19:52:58.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.153+0000 7f89444f3640 1 -- 172.21.15.18:0/2362079301 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f893c169b00 con 0x7f893c0b6850 2024-04-17T19:52:58.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.157+0000 7f8932ffd640 1 -- 172.21.15.18:0/2362079301 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12872 (secure 0 0 0) 0x7f892c0f05e0 con 0x7f893c0b6850 2024-04-17T19:52:58.152 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:52:58.152 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":19,"fsid":"dd480169-5a81-4623-be5f-0499aa244b28","created":"2024-04-17T19:52:39.533760+0000","modified":"2024-04-17T19:52:55.269542+0000","last_up_change":"2024-04-17T19:52:51.229698+0000","last_in_change":"2024-04-17T19:52:42.144259+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T19:52:52.391648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e232d577-2508-4ea4-b355-29fbae1ff025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6801","nonce":2323038417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6803","nonce":2323038417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6807","nonce":2323038417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6805","nonce":2323038417}]},"public_addr":"172.21.15.18:6801/2323038417","cluster_addr":"172.21.15.18:6803/2323038417","heartbeat_back_addr":"172.21.15.18:6807/2323038417","heartbeat_front_addr":"172.21.15.18:6805/2323038417","state":["exists","up"]},{"osd":1,"uuid":"31810ef3-2c71-48d6-8748-b74a2968d23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6817","nonce":1283678238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6819","nonce":1283678238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6823","nonce":1283678238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6821","nonce":1283678238}]},"public_addr":"172.21.15.18:6817/1283678238","cluster_addr":"172.21.15.18:6819/1283678238","heartbeat_back_addr":"172.21.15.18:6823/1283678238","heartbeat_front_addr":"172.21.15.18:6821/1283678238","state":["exists","up"]},{"osd":2,"uuid":"5a783cc5-a41c-4967-9e11-6b8330f97d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6809","nonce":1212875862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6811","nonce":1212875862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6815","nonce":1212875862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6813","nonce":1212875862}]},"public_addr":"172.21.15.18:6809/1212875862","cluster_addr":"172.21.15.18:6811/1212875862","heartbeat_back_addr":"172.21.15.18:6815/1212875862","heartbeat_front_addr":"172.21.15.18:6813/1212875862","state":["exists","up"]},{"osd":3,"uuid":"b7e056d9-9da5-46e1-810d-0c3e242fe5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6825","nonce":2428878428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6827","nonce":2428878428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6831","nonce":2428878428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6829","nonce":2428878428}]},"public_addr":"172.21.15.18:6825/2428878428","cluster_addr":"172.21.15.18:6827/2428878428","heartbeat_back_addr":"172.21.15.18:6831/2428878428","heartbeat_front_addr":"172.21.15.18:6829/2428878428","state":["exists","up"]},{"osd":4,"uuid":"21df023f-bc8b-4abb-93e5-0ecc91acda0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6825","nonce":1421511819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6827","nonce":1421511819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6831","nonce":1421511819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6829","nonce":1421511819}]},"public_addr":"172.21.15.173:6825/1421511819","cluster_addr":"172.21.15.173:6827/1421511819","heartbeat_back_addr":"172.21.15.173:6831/1421511819","heartbeat_front_addr":"172.21.15.173:6829/1421511819","state":["exists","up"]},{"osd":5,"uuid":"e270098a-6d33-49f8-84ed-94e09a880cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6801","nonce":4221907702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6803","nonce":4221907702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6807","nonce":4221907702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6805","nonce":4221907702}]},"public_addr":"172.21.15.173:6801/4221907702","cluster_addr":"172.21.15.173:6803/4221907702","heartbeat_back_addr":"172.21.15.173:6807/4221907702","heartbeat_front_addr":"172.21.15.173:6805/4221907702","state":["exists","up"]},{"osd":6,"uuid":"93c67c8c-268d-4e32-877c-043cd3acd87c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6809","nonce":761678552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6811","nonce":761678552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6815","nonce":761678552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6813","nonce":761678552}]},"public_addr":"172.21.15.173:6809/761678552","cluster_addr":"172.21.15.173:6811/761678552","heartbeat_back_addr":"172.21.15.173:6815/761678552","heartbeat_front_addr":"172.21.15.173:6813/761678552","state":["exists","up"]},{"osd":7,"uuid":"faf10eea-80de-40f6-abbb-34d07d3f59ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6817","nonce":383724537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6819","nonce":383724537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6823","nonce":383724537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6821","nonce":383724537}]},"public_addr":"172.21.15.173:6817/383724537","cluster_addr":"172.21.15.173:6819/383724537","heartbeat_back_addr":"172.21.15.173:6823/383724537","heartbeat_front_addr":"172.21.15.173:6821/383724537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.668924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.761747+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.768128+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.632252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.742608+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.734327+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.477107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.818292+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T19:52:58.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.157+0000 7f89444f3640 1 -- 172.21.15.18:0/2362079301 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f8920068380 msgr2=0x7f892006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:58.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.157+0000 7f89444f3640 1 --2- 172.21.15.18:0/2362079301 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f8920068380 0x7f892006a890 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f893c0b4990 tx=0x7f8938007e90 comp rx=0 tx=0).stop 2024-04-17T19:52:58.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.157+0000 7f89444f3640 1 -- 172.21.15.18:0/2362079301 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f893c0b6850 msgr2=0x7f893c152360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:58.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.157+0000 7f89444f3640 1 --2- 172.21.15.18:0/2362079301 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f893c0b6850 0x7f893c152360 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f892c01a190 tx=0x7f892c019300 comp rx=0 tx=0).stop 2024-04-17T19:52:58.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.157+0000 7f89444f3640 1 -- 172.21.15.18:0/2362079301 shutdown_connections 2024-04-17T19:52:58.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.157+0000 7f89444f3640 1 --2- 172.21.15.18:0/2362079301 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f8920068380 0x7f892006a890 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:58.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.157+0000 7f89444f3640 1 --2- 172.21.15.18:0/2362079301 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f893c0d24a0 0x7f893c159460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:58.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.157+0000 7f89444f3640 1 --2- 172.21.15.18:0/2362079301 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f893c0cf6c0 0x7f893c158f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:58.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.157+0000 7f89444f3640 1 --2- 172.21.15.18:0/2362079301 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f893c0b6850 0x7f893c152360 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:58.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.157+0000 7f89444f3640 1 -- 172.21.15.18:0/2362079301 >> 172.21.15.18:0/2362079301 conn(0x7f893c09aa70 msgr2=0x7f893c06d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:52:58.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.157+0000 7f89444f3640 1 -- 172.21.15.18:0/2362079301 shutdown_connections 2024-04-17T19:52:58.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.157+0000 7f89444f3640 1 -- 172.21.15.18:0/2362079301 wait complete. 2024-04-17T19:52:58.173 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T19:52:52.391648+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-17T19:52:58.173 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T19:52:58.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.341+0000 7f730d70d640 1 Processor -- start 2024-04-17T19:52:58.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.341+0000 7f730d70d640 1 -- start start 2024-04-17T19:52:58.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.341+0000 7f730d70d640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f73080b82a0 0x7f730806cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:58.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.341+0000 7f730d70d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f73080b86b0 0x7f730806d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:58.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.341+0000 7f730d70d640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f730806be80 con 0x7f7308162fa0 2024-04-17T19:52:58.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.341+0000 7f730d70d640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f73080cfd90 con 0x7f73080b86b0 2024-04-17T19:52:58.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.341+0000 7f730d70d640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f730806c160 con 0x7f73080b82a0 2024-04-17T19:52:58.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.341+0000 7f73067fc640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f73080b86b0 0x7f730806d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:58.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.341+0000 7f73067fc640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f73080b86b0 0x7f730806d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36226/0 (socket says 172.21.15.18:36226) 2024-04-17T19:52:58.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.341+0000 7f73067fc640 1 -- 172.21.15.18:0/2299318777 learned_addr learned my addr 172.21.15.18:0/2299318777 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:52:58.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.341+0000 7f7306ffd640 1 --2- 172.21.15.18:0/2299318777 >> v2:172.21.15.173:3300/0 conn(0x7f73080b82a0 0x7f730806cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:58.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.341+0000 7f73067fc640 1 -- 172.21.15.18:0/2299318777 >> v2:172.21.15.173:3300/0 conn(0x7f73080b82a0 msgr2=0x7f730806cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:52:58.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.341+0000 7f73067fc640 1 --2- 172.21.15.18:0/2299318777 >> v2:172.21.15.173:3300/0 conn(0x7f73080b82a0 0x7f730806cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:58.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.341+0000 7f73067fc640 1 -- 172.21.15.18:0/2299318777 >> v1:172.21.15.173:6789/0 conn(0x7f7308162fa0 legacy=0x7f73081633b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:52:58.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.341+0000 7f73067fc640 1 -- 172.21.15.18:0/2299318777 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f730806c440 con 0x7f73080b86b0 2024-04-17T19:52:58.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.345+0000 7f73067fc640 1 --2- 172.21.15.18:0/2299318777 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73080b86b0 0x7f730806d180 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f730808e140 tx=0x7f72f001c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54968e79fe6efaa1 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:52:58.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.345+0000 7f7305ffb640 1 -- 172.21.15.18:0/2299318777 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f00b1070 con 0x7f73080b86b0 2024-04-17T19:52:58.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.345+0000 7f7305ffb640 1 -- 172.21.15.18:0/2299318777 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72f00ac410 con 0x7f73080b86b0 2024-04-17T19:52:58.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.345+0000 7f7305ffb640 1 -- 172.21.15.18:0/2299318777 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f00ac7e0 con 0x7f73080b86b0 2024-04-17T19:52:58.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.345+0000 7f730d70d640 1 -- 172.21.15.18:0/2299318777 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73080b86b0 msgr2=0x7f730806d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:58.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.345+0000 7f730d70d640 1 --2- 172.21.15.18:0/2299318777 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73080b86b0 0x7f730806d180 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f730808e140 tx=0x7f72f001c390 comp rx=0 tx=0).stop 2024-04-17T19:52:58.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.345+0000 7f730d70d640 1 -- 172.21.15.18:0/2299318777 shutdown_connections 2024-04-17T19:52:58.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.345+0000 7f730d70d640 1 --2- 172.21.15.18:0/2299318777 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73080b86b0 0x7f730806d180 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:58.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.345+0000 7f730d70d640 1 --2- 172.21.15.18:0/2299318777 >> v2:172.21.15.173:3300/0 conn(0x7f73080b82a0 0x7f730806cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:58.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.345+0000 7f730d70d640 1 -- 172.21.15.18:0/2299318777 >> 172.21.15.18:0/2299318777 conn(0x7f73080b6cf0 msgr2=0x7f73080b7100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:52:58.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.345+0000 7f730d70d640 1 -- 172.21.15.18:0/2299318777 shutdown_connections 2024-04-17T19:52:58.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.345+0000 7f730d70d640 1 -- 172.21.15.18:0/2299318777 wait complete. 2024-04-17T19:52:58.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.349+0000 7f730d70d640 1 Processor -- start 2024-04-17T19:52:58.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.349+0000 7f730d70d640 1 -- start start 2024-04-17T19:52:58.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.349+0000 7f730d70d640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f73080b82a0 0x7f7308152f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:58.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.349+0000 7f730d70d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73080b86b0 0x7f7308157e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:58.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.349+0000 7f730d70d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7308162fa0 0x7f7308158370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:58.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.349+0000 7f730d70d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f730816ccb0 con 0x7f7308162fa0 2024-04-17T19:52:58.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.349+0000 7f730d70d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f730816cb30 con 0x7f73080b86b0 2024-04-17T19:52:58.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.349+0000 7f730d70d640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f730816ce30 con 0x7f73080b82a0 2024-04-17T19:52:58.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.349+0000 7f73077fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7308162fa0 0x7f7308158370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:58.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.349+0000 7f73077fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7308162fa0 0x7f7308158370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36242/0 (socket says 172.21.15.18:36242) 2024-04-17T19:52:58.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.349+0000 7f73077fe640 1 -- 172.21.15.18:0/3797012094 learned_addr learned my addr 172.21.15.18:0/3797012094 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:52:58.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.349+0000 7f73067fc640 1 --2- 172.21.15.18:0/3797012094 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73080b86b0 0x7f7308157e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:58.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.349+0000 7f7306ffd640 1 --2- 172.21.15.18:0/3797012094 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f73080b82a0 0x7f7308152f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:58.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.349+0000 7f73077fe640 1 -- 172.21.15.18:0/3797012094 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f73080b82a0 msgr2=0x7f7308152f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:58.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.349+0000 7f73077fe640 1 --2- 172.21.15.18:0/3797012094 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f73080b82a0 0x7f7308152f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:58.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.349+0000 7f73077fe640 1 -- 172.21.15.18:0/3797012094 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73080b86b0 msgr2=0x7f7308157e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:58.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.349+0000 7f73077fe640 1 --2- 172.21.15.18:0/3797012094 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73080b86b0 0x7f7308157e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:58.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.349+0000 7f73077fe640 1 -- 172.21.15.18:0/3797012094 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f730815a380 con 0x7f7308162fa0 2024-04-17T19:52:58.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.349+0000 7f7306ffd640 1 --2- 172.21.15.18:0/3797012094 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f73080b82a0 0x7f7308152f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:52:58.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.349+0000 7f73077fe640 1 --2- 172.21.15.18:0/3797012094 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7308162fa0 0x7f7308158370 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f730000b9e0 tx=0x7f730000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:52:58.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.349+0000 7f72ff7fe640 1 -- 172.21.15.18:0/3797012094 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7300003b80 con 0x7f7308162fa0 2024-04-17T19:52:58.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.349+0000 7f72ff7fe640 1 -- 172.21.15.18:0/3797012094 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7300003d20 con 0x7f7308162fa0 2024-04-17T19:52:58.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.349+0000 7f72ff7fe640 1 -- 172.21.15.18:0/3797012094 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f730000cb60 con 0x7f7308162fa0 2024-04-17T19:52:58.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.349+0000 7f730d70d640 1 -- 172.21.15.18:0/3797012094 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f730815a660 con 0x7f7308162fa0 2024-04-17T19:52:58.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.349+0000 7f730d70d640 1 -- 172.21.15.18:0/3797012094 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f730815ac20 con 0x7f7308162fa0 2024-04-17T19:52:58.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.349+0000 7f730d70d640 1 -- 172.21.15.18:0/3797012094 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7308159f30 con 0x7f7308162fa0 2024-04-17T19:52:58.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.353+0000 7f72ff7fe640 1 -- 172.21.15.18:0/3797012094 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7300006d10 con 0x7f7308162fa0 2024-04-17T19:52:58.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.353+0000 7f72ff7fe640 1 --2- 172.21.15.18:0/3797012094 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f72e8068380 0x7f72e806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:58.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.353+0000 7f72ff7fe640 1 -- 172.21.15.18:0/3797012094 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f7300086110 con 0x7f7308162fa0 2024-04-17T19:52:58.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.353+0000 7f7306ffd640 1 --2- 172.21.15.18:0/3797012094 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f72e8068380 0x7f72e806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:58.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.353+0000 7f7306ffd640 1 --2- 172.21.15.18:0/3797012094 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f72e8068380 0x7f72e806a890 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f730808db30 tx=0x7f72f8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:52:58.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.357+0000 7f72ff7fe640 1 -- 172.21.15.18:0/3797012094 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7308159f30 con 0x7f7308162fa0 2024-04-17T19:52:58.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.517+0000 7f730d70d640 1 -- 172.21.15.18:0/3797012094 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f730815a110 con 0x7f7308162fa0 2024-04-17T19:52:58.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.517+0000 7f72ff7fe640 1 -- 172.21.15.18:0/3797012094 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) ==== 93+0+10 (secure 0 0 0) 0x7f73000563d0 con 0x7f7308162fa0 2024-04-17T19:52:58.514 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-17T19:52:58.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.521+0000 7f730d70d640 1 -- 172.21.15.18:0/3797012094 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f72e8068380 msgr2=0x7f72e806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:58.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.521+0000 7f730d70d640 1 --2- 172.21.15.18:0/3797012094 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f72e8068380 0x7f72e806a890 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f730808db30 tx=0x7f72f8008040 comp rx=0 tx=0).stop 2024-04-17T19:52:58.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.521+0000 7f730d70d640 1 -- 172.21.15.18:0/3797012094 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7308162fa0 msgr2=0x7f7308158370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:58.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.521+0000 7f730d70d640 1 --2- 172.21.15.18:0/3797012094 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7308162fa0 0x7f7308158370 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f730000b9e0 tx=0x7f730000bea0 comp rx=0 tx=0).stop 2024-04-17T19:52:58.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.521+0000 7f730d70d640 1 -- 172.21.15.18:0/3797012094 shutdown_connections 2024-04-17T19:52:58.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.521+0000 7f730d70d640 1 --2- 172.21.15.18:0/3797012094 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f72e8068380 0x7f72e806a890 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:58.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.521+0000 7f730d70d640 1 --2- 172.21.15.18:0/3797012094 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7308162fa0 0x7f7308158370 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:58.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.521+0000 7f730d70d640 1 --2- 172.21.15.18:0/3797012094 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73080b86b0 0x7f7308157e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:58.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.521+0000 7f730d70d640 1 --2- 172.21.15.18:0/3797012094 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f73080b82a0 0x7f7308152f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:58.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.521+0000 7f730d70d640 1 -- 172.21.15.18:0/3797012094 >> 172.21.15.18:0/3797012094 conn(0x7f73080b6cf0 msgr2=0x7f730806cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:52:58.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.521+0000 7f730d70d640 1 -- 172.21.15.18:0/3797012094 shutdown_connections 2024-04-17T19:52:58.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.521+0000 7f730d70d640 1 -- 172.21.15.18:0/3797012094 wait complete. 2024-04-17T19:52:58.533 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T19:52:58.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.693+0000 7fb5fed67640 1 Processor -- start 2024-04-17T19:52:58.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.693+0000 7fb5fed67640 1 -- start start 2024-04-17T19:52:58.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.693+0000 7fb5fed67640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb5f806d470 0x7fb5f815f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:58.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.693+0000 7fb5fed67640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb5f80b44b0 0x7fb5f80b48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:58.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.693+0000 7fb5fed67640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5f81607b0 con 0x7fb5f80b0120 2024-04-17T19:52:58.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.693+0000 7fb5fed67640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fb5f80b0530 con 0x7fb5f80b44b0 2024-04-17T19:52:58.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.693+0000 7fb5fed67640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7fb5f815ff10 con 0x7fb5f806d470 2024-04-17T19:52:58.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.693+0000 7fb5fd304640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb5f80b44b0 0x7fb5f80b48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:58.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.693+0000 7fb5fcb03640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fb5f80b0120 0x7fb5f806cd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:57674/0 (socket says 172.21.15.18:57674) 2024-04-17T19:52:58.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.693+0000 7fb5fcb03640 1 -- 172.21.15.18:0/2869173645 learned_addr learned my addr 172.21.15.18:0/2869173645 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:52:58.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.693+0000 7fb5f7fff640 1 --2- 172.21.15.18:0/2869173645 >> v2:172.21.15.173:3300/0 conn(0x7fb5f806d470 0x7fb5f815f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:58.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.693+0000 7fb5fd304640 1 -- 172.21.15.18:0/2869173645 >> v2:172.21.15.173:3300/0 conn(0x7fb5f806d470 msgr2=0x7fb5f815f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:52:58.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.693+0000 7fb5fd304640 1 --2- 172.21.15.18:0/2869173645 >> v2:172.21.15.173:3300/0 conn(0x7fb5f806d470 0x7fb5f815f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:58.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.693+0000 7fb5fd304640 1 -- 172.21.15.18:0/2869173645 >> v1:172.21.15.18:6789/0 conn(0x7fb5f80b0120 legacy=0x7fb5f806cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:58.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.693+0000 7fb5fd304640 1 -- 172.21.15.18:0/2869173645 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5f81601f0 con 0x7fb5f80b44b0 2024-04-17T19:52:58.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.697+0000 7fb5fd304640 1 --2- 172.21.15.18:0/2869173645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5f80b44b0 0x7fb5f80b48c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8162d50 tx=0x7fb5e001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab357edb5d63bac2 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:52:58.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.697+0000 7fb5f77fe640 1 -- 172.21.15.18:0/2869173645 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e00b1070 con 0x7fb5f80b44b0 2024-04-17T19:52:58.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.697+0000 7fb5f77fe640 1 -- 172.21.15.18:0/2869173645 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5e00ac620 con 0x7fb5f80b44b0 2024-04-17T19:52:58.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.697+0000 7fb5f77fe640 1 -- 172.21.15.18:0/2869173645 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e00ac9f0 con 0x7fb5f80b44b0 2024-04-17T19:52:58.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.697+0000 7fb5fed67640 1 -- 172.21.15.18:0/2869173645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5f80b44b0 msgr2=0x7fb5f80b48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:58.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.697+0000 7fb5fed67640 1 --2- 172.21.15.18:0/2869173645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5f80b44b0 0x7fb5f80b48c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8162d50 tx=0x7fb5e001c3c0 comp rx=0 tx=0).stop 2024-04-17T19:52:58.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.697+0000 7fb5fed67640 1 -- 172.21.15.18:0/2869173645 shutdown_connections 2024-04-17T19:52:58.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.697+0000 7fb5fed67640 1 --2- 172.21.15.18:0/2869173645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5f80b44b0 0x7fb5f80b48c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:58.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.697+0000 7fb5fed67640 1 --2- 172.21.15.18:0/2869173645 >> v2:172.21.15.173:3300/0 conn(0x7fb5f806d470 0x7fb5f815f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:58.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.697+0000 7fb5fed67640 1 -- 172.21.15.18:0/2869173645 >> 172.21.15.18:0/2869173645 conn(0x7fb5f8072bb0 msgr2=0x7fb5f8072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:52:58.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.697+0000 7fb5fed67640 1 -- 172.21.15.18:0/2869173645 shutdown_connections 2024-04-17T19:52:58.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.697+0000 7fb5fed67640 1 -- 172.21.15.18:0/2869173645 wait complete. 2024-04-17T19:52:58.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.697+0000 7fb5fed67640 1 Processor -- start 2024-04-17T19:52:58.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.697+0000 7fb5fed67640 1 -- start start 2024-04-17T19:52:58.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.701+0000 7fb5fed67640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5f80b0120 0x7fb5f81431a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:58.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.701+0000 7fb5fed67640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5f80b44b0 0x7fb5f8151750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:58.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.701+0000 7fb5fed67640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb5f80b1e10 0x7fb5f80b14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:58.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.701+0000 7fb5fed67640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f816c200 con 0x7fb5f80b44b0 2024-04-17T19:52:58.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.701+0000 7fb5fed67640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f816c080 con 0x7fb5f80b0120 2024-04-17T19:52:58.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.701+0000 7fb5fed67640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fb5f816c380 con 0x7fb5f80b1e10 2024-04-17T19:52:58.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.701+0000 7fb5f7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5f80b44b0 0x7fb5f8151750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:58.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.701+0000 7fb5f7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5f80b44b0 0x7fb5f8151750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36262/0 (socket says 172.21.15.18:36262) 2024-04-17T19:52:58.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.701+0000 7fb5f7fff640 1 -- 172.21.15.18:0/3095171625 learned_addr learned my addr 172.21.15.18:0/3095171625 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:52:58.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.701+0000 7fb5fcb03640 1 --2- 172.21.15.18:0/3095171625 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5f80b0120 0x7fb5f81431a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:58.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.701+0000 7fb5fd304640 1 --2- 172.21.15.18:0/3095171625 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb5f80b1e10 0x7fb5f80b14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:58.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.701+0000 7fb5f7fff640 1 -- 172.21.15.18:0/3095171625 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb5f80b1e10 msgr2=0x7fb5f80b14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:58.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.701+0000 7fb5f7fff640 1 --2- 172.21.15.18:0/3095171625 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb5f80b1e10 0x7fb5f80b14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:58.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.701+0000 7fb5f7fff640 1 -- 172.21.15.18:0/3095171625 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5f80b0120 msgr2=0x7fb5f81431a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:58.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.701+0000 7fb5f7fff640 1 --2- 172.21.15.18:0/3095171625 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5f80b0120 0x7fb5f81431a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:58.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.701+0000 7fb5f7fff640 1 -- 172.21.15.18:0/3095171625 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5f80b0780 con 0x7fb5f80b44b0 2024-04-17T19:52:58.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.701+0000 7fb5f7fff640 1 --2- 172.21.15.18:0/3095171625 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5f80b44b0 0x7fb5f8151750 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8007de0 tx=0x7fb5e800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:52:58.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.701+0000 7fb5f57fa640 1 -- 172.21.15.18:0/3095171625 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e8014420 con 0x7fb5f80b44b0 2024-04-17T19:52:58.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.701+0000 7fb5f57fa640 1 -- 172.21.15.18:0/3095171625 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5e8019070 con 0x7fb5f80b44b0 2024-04-17T19:52:58.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.701+0000 7fb5fed67640 1 -- 172.21.15.18:0/3095171625 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5f80b1a10 con 0x7fb5f80b44b0 2024-04-17T19:52:58.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.701+0000 7fb5f57fa640 1 -- 172.21.15.18:0/3095171625 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e80147e0 con 0x7fb5f80b44b0 2024-04-17T19:52:58.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.701+0000 7fb5fed67640 1 -- 172.21.15.18:0/3095171625 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5f80b0cd0 con 0x7fb5f80b44b0 2024-04-17T19:52:58.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.701+0000 7fb5fed67640 1 -- 172.21.15.18:0/3095171625 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5f80b2250 con 0x7fb5f80b44b0 2024-04-17T19:52:58.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.701+0000 7fb5f57fa640 1 -- 172.21.15.18:0/3095171625 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb5e8014980 con 0x7fb5f80b44b0 2024-04-17T19:52:58.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.705+0000 7fb5f57fa640 1 --2- 172.21.15.18:0/3095171625 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fb5d80683b0 0x7fb5d806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:52:58.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.705+0000 7fb5f57fa640 1 -- 172.21.15.18:0/3095171625 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fb5e8086e20 con 0x7fb5f80b44b0 2024-04-17T19:52:58.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.705+0000 7fb5fcb03640 1 --2- 172.21.15.18:0/3095171625 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fb5d80683b0 0x7fb5d806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:52:58.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.705+0000 7fb5fcb03640 1 --2- 172.21.15.18:0/3095171625 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fb5d80683b0 0x7fb5d806a8c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0000f70 tx=0x7fb5f0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:52:58.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.709+0000 7fb5f57fa640 1 -- 172.21.15.18:0/3095171625 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb5f80b2250 con 0x7fb5f80b44b0 2024-04-17T19:52:58.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.909+0000 7fb5fed67640 1 -- 172.21.15.18:0/3095171625 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb5f8069950 con 0x7fb5f80b44b0 2024-04-17T19:52:58.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.909+0000 7fb5f57fa640 1 -- 172.21.15.18:0/3095171625 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7fb5e8057050 con 0x7fb5f80b44b0 2024-04-17T19:52:58.906 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:52:58.907 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1926349198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1926349198},{"type":"v1","addr":"172.21.15.18:6837","nonce":1926349198}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-17T19:52:58.907 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 2 2024-04-17T19:52:58.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.913+0000 7fb5fed67640 1 -- 172.21.15.18:0/3095171625 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fb5d80683b0 msgr2=0x7fb5d806a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:58.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.913+0000 7fb5fed67640 1 --2- 172.21.15.18:0/3095171625 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fb5d80683b0 0x7fb5d806a8c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0000f70 tx=0x7fb5f0009040 comp rx=0 tx=0).stop 2024-04-17T19:52:58.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.913+0000 7fb5fed67640 1 -- 172.21.15.18:0/3095171625 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5f80b44b0 msgr2=0x7fb5f8151750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:52:58.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.913+0000 7fb5fed67640 1 --2- 172.21.15.18:0/3095171625 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5f80b44b0 0x7fb5f8151750 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8007de0 tx=0x7fb5e800e4b0 comp rx=0 tx=0).stop 2024-04-17T19:52:58.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.913+0000 7fb5fed67640 1 -- 172.21.15.18:0/3095171625 shutdown_connections 2024-04-17T19:52:58.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.913+0000 7fb5fed67640 1 --2- 172.21.15.18:0/3095171625 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fb5d80683b0 0x7fb5d806a8c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:58.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.913+0000 7fb5fed67640 1 --2- 172.21.15.18:0/3095171625 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb5f80b1e10 0x7fb5f80b14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:58.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.913+0000 7fb5fed67640 1 --2- 172.21.15.18:0/3095171625 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5f80b44b0 0x7fb5f8151750 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:58.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.913+0000 7fb5fed67640 1 --2- 172.21.15.18:0/3095171625 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5f80b0120 0x7fb5f81431a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:52:58.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.913+0000 7fb5fed67640 1 -- 172.21.15.18:0/3095171625 >> 172.21.15.18:0/3095171625 conn(0x7fb5f8072bb0 msgr2=0x7fb5f81609a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:52:58.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.913+0000 7fb5fed67640 1 -- 172.21.15.18:0/3095171625 shutdown_connections 2024-04-17T19:52:58.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:52:58.913+0000 7fb5fed67640 1 -- 172.21.15.18:0/3095171625 wait complete. 2024-04-17T19:52:59.586 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T19:52:59.589 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T19:53:00.928 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T19:53:01.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.097+0000 7f9e7efd7640 1 Processor -- start 2024-04-17T19:53:01.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.097+0000 7f9e7efd7640 1 -- start start 2024-04-17T19:53:01.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.097+0000 7f9e7efd7640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9e7815e1a0 0x7f9e780ce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:01.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.097+0000 7f9e7efd7640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9e780cef10 0x7f9e7815e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:01.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.097+0000 7f9e7efd7640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e780d0020 con 0x7f9e7815ee50 2024-04-17T19:53:01.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.097+0000 7f9e7efd7640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f9e780cd930 con 0x7f9e780cef10 2024-04-17T19:53:01.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.097+0000 7f9e7efd7640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f9e780cdc10 con 0x7f9e7815e1a0 2024-04-17T19:53:01.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.097+0000 7f9e77fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9e780cef10 0x7f9e7815e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:01.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.097+0000 7f9e7d574640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f9e7815ee50 0x7f9e7806cd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:57676/0 (socket says 172.21.15.18:57676) 2024-04-17T19:53:01.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.097+0000 7f9e7d574640 1 -- 172.21.15.18:0/2691932668 learned_addr learned my addr 172.21.15.18:0/2691932668 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:01.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.097+0000 7f9e7cd73640 1 --2- 172.21.15.18:0/2691932668 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9e7815e1a0 0x7f9e780ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:01.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.097+0000 7f9e77fff640 1 -- 172.21.15.18:0/2691932668 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9e7815e1a0 msgr2=0x7f9e780ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:01.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.097+0000 7f9e77fff640 1 --2- 172.21.15.18:0/2691932668 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9e7815e1a0 0x7f9e780ce9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:01.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.097+0000 7f9e77fff640 1 -- 172.21.15.18:0/2691932668 >> v1:172.21.15.18:6789/0 conn(0x7f9e7815ee50 legacy=0x7f9e7806cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:01.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.097+0000 7f9e77fff640 1 -- 172.21.15.18:0/2691932668 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e780cdef0 con 0x7f9e780cef10 2024-04-17T19:53:01.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.097+0000 7f9e777fe640 1 -- 172.21.15.18:0/2691932668 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1805962940 0 0) 0x7f9e780d0020 con 0x7f9e7815ee50 2024-04-17T19:53:01.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.097+0000 7f9e7cd73640 1 --2- 172.21.15.18:0/2691932668 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9e7815e1a0 0x7f9e780ce9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:53:01.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.101+0000 7f9e77fff640 1 --2- 172.21.15.18:0/2691932668 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e780cef10 0x7f9e7815e910 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c0097c0 tx=0x7f9e6c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2300e9e615f4f5b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:01.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.101+0000 7f9e777fe640 1 -- 172.21.15.18:0/2691932668 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c0b0070 con 0x7f9e780cef10 2024-04-17T19:53:01.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.101+0000 7f9e777fe640 1 -- 172.21.15.18:0/2691932668 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e6c0ab600 con 0x7f9e780cef10 2024-04-17T19:53:01.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.101+0000 7f9e777fe640 1 -- 172.21.15.18:0/2691932668 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c0ab9d0 con 0x7f9e780cef10 2024-04-17T19:53:01.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.101+0000 7f9e7efd7640 1 -- 172.21.15.18:0/2691932668 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e780cef10 msgr2=0x7f9e7815e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:01.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.101+0000 7f9e7efd7640 1 --2- 172.21.15.18:0/2691932668 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e780cef10 0x7f9e7815e910 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c0097c0 tx=0x7f9e6c01c410 comp rx=0 tx=0).stop 2024-04-17T19:53:01.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.101+0000 7f9e7efd7640 1 -- 172.21.15.18:0/2691932668 shutdown_connections 2024-04-17T19:53:01.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.101+0000 7f9e7efd7640 1 --2- 172.21.15.18:0/2691932668 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e780cef10 0x7f9e7815e910 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:01.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.101+0000 7f9e7efd7640 1 --2- 172.21.15.18:0/2691932668 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9e7815e1a0 0x7f9e780ce9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:01.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.101+0000 7f9e7efd7640 1 -- 172.21.15.18:0/2691932668 >> 172.21.15.18:0/2691932668 conn(0x7f9e78072bb0 msgr2=0x7f9e78072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:01.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.101+0000 7f9e7efd7640 1 -- 172.21.15.18:0/2691932668 shutdown_connections 2024-04-17T19:53:01.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.101+0000 7f9e7efd7640 1 -- 172.21.15.18:0/2691932668 wait complete. 2024-04-17T19:53:01.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.105+0000 7f9e7efd7640 1 Processor -- start 2024-04-17T19:53:01.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.105+0000 7f9e7efd7640 1 -- start start 2024-04-17T19:53:01.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.105+0000 7f9e7efd7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e780cef10 0x7f9e78150210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:01.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.105+0000 7f9e7efd7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e7815e1a0 0x7f9e78150750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:01.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.105+0000 7f9e7efd7640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9e7815ee50 0x7f9e7814ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:01.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.105+0000 7f9e7efd7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9e78157b90 con 0x7f9e7815e1a0 2024-04-17T19:53:01.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.105+0000 7f9e7efd7640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9e78157a10 con 0x7f9e780cef10 2024-04-17T19:53:01.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.105+0000 7f9e7efd7640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f9e7806d470 con 0x7f9e7815ee50 2024-04-17T19:53:01.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.105+0000 7f9e77fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e7815e1a0 0x7f9e78150750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:01.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.105+0000 7f9e77fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e7815e1a0 0x7f9e78150750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36272/0 (socket says 172.21.15.18:36272) 2024-04-17T19:53:01.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.105+0000 7f9e77fff640 1 -- 172.21.15.18:0/2953696663 learned_addr learned my addr 172.21.15.18:0/2953696663 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:01.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.105+0000 7f9e7d574640 1 --2- 172.21.15.18:0/2953696663 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9e7815ee50 0x7f9e7814ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:01.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.105+0000 7f9e7cd73640 1 --2- 172.21.15.18:0/2953696663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e780cef10 0x7f9e78150210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:01.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.105+0000 7f9e77fff640 1 -- 172.21.15.18:0/2953696663 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9e7815ee50 msgr2=0x7f9e7814ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:01.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.105+0000 7f9e77fff640 1 --2- 172.21.15.18:0/2953696663 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9e7815ee50 0x7f9e7814ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:01.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.105+0000 7f9e77fff640 1 -- 172.21.15.18:0/2953696663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e780cef10 msgr2=0x7f9e78150210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:01.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.105+0000 7f9e77fff640 1 --2- 172.21.15.18:0/2953696663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e780cef10 0x7f9e78150210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:01.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.105+0000 7f9e77fff640 1 -- 172.21.15.18:0/2953696663 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e78155cd0 con 0x7f9e7815e1a0 2024-04-17T19:53:01.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.105+0000 7f9e77fff640 1 --2- 172.21.15.18:0/2953696663 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e7815e1a0 0x7f9e78150750 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c0ae040 tx=0x7f9e6c0191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:01.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.105+0000 7f9e757fa640 1 -- 172.21.15.18:0/2953696663 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c0b0040 con 0x7f9e7815e1a0 2024-04-17T19:53:01.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.105+0000 7f9e757fa640 1 -- 172.21.15.18:0/2953696663 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e6c0b4410 con 0x7f9e7815e1a0 2024-04-17T19:53:01.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.105+0000 7f9e7efd7640 1 -- 172.21.15.18:0/2953696663 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e781561d0 con 0x7f9e7815e1a0 2024-04-17T19:53:01.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.105+0000 7f9e757fa640 1 -- 172.21.15.18:0/2953696663 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c0b47e0 con 0x7f9e7815e1a0 2024-04-17T19:53:01.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.105+0000 7f9e7efd7640 1 -- 172.21.15.18:0/2953696663 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e780b4b50 con 0x7f9e7815e1a0 2024-04-17T19:53:01.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.105+0000 7f9e7efd7640 1 -- 172.21.15.18:0/2953696663 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e78069950 con 0x7f9e7815e1a0 2024-04-17T19:53:01.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.109+0000 7f9e757fa640 1 -- 172.21.15.18:0/2953696663 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9e6c0bc020 con 0x7f9e7815e1a0 2024-04-17T19:53:01.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.109+0000 7f9e757fa640 1 --2- 172.21.15.18:0/2953696663 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f9e640683b0 0x7f9e6406a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:01.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.109+0000 7f9e757fa640 1 -- 172.21.15.18:0/2953696663 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f9e6c11fb40 con 0x7f9e7815e1a0 2024-04-17T19:53:01.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.109+0000 7f9e7cd73640 1 --2- 172.21.15.18:0/2953696663 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f9e640683b0 0x7f9e6406a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:01.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.109+0000 7f9e7cd73640 1 --2- 172.21.15.18:0/2953696663 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f9e640683b0 0x7f9e6406a8c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9e68006fd0 tx=0x7f9e68008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:01.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.113+0000 7f9e757fa640 1 -- 172.21.15.18:0/2953696663 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9e6c0c3020 con 0x7f9e7815e1a0 2024-04-17T19:53:01.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.309+0000 7f9e7efd7640 1 -- 172.21.15.18:0/2953696663 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9e78155f60 con 0x7f9e7815e1a0 2024-04-17T19:53:01.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.313+0000 7f9e757fa640 1 -- 172.21.15.18:0/2953696663 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3864 (secure 0 0 0) 0x7f9e6c016090 con 0x7f9e7815e1a0 2024-04-17T19:53:01.308 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:53:01.308 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/729504609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":729504609},{"type":"v1","addr":"172.21.15.173:6833","nonce":729504609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4261,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/3797017174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3797017174},{"type":"v1","addr":"172.21.15.173:6835","nonce":3797017174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/995848920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":995848920},{"type":"v1","addr":"172.21.15.18:6835","nonce":995848920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1926349198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1926349198},{"type":"v1","addr":"172.21.15.18:6837","nonce":1926349198}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-17T19:53:01.308 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 3 2024-04-17T19:53:01.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.313+0000 7f9e7efd7640 1 -- 172.21.15.18:0/2953696663 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f9e640683b0 msgr2=0x7f9e6406a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:01.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.313+0000 7f9e7efd7640 1 --2- 172.21.15.18:0/2953696663 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f9e640683b0 0x7f9e6406a8c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9e68006fd0 tx=0x7f9e68008040 comp rx=0 tx=0).stop 2024-04-17T19:53:01.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.313+0000 7f9e7efd7640 1 -- 172.21.15.18:0/2953696663 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e7815e1a0 msgr2=0x7f9e78150750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:01.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.313+0000 7f9e7efd7640 1 --2- 172.21.15.18:0/2953696663 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e7815e1a0 0x7f9e78150750 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c0ae040 tx=0x7f9e6c0191b0 comp rx=0 tx=0).stop 2024-04-17T19:53:01.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.313+0000 7f9e7efd7640 1 -- 172.21.15.18:0/2953696663 shutdown_connections 2024-04-17T19:53:01.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.313+0000 7f9e7efd7640 1 --2- 172.21.15.18:0/2953696663 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f9e640683b0 0x7f9e6406a8c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:01.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.313+0000 7f9e7efd7640 1 --2- 172.21.15.18:0/2953696663 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9e7815ee50 0x7f9e7814ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:01.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.313+0000 7f9e7efd7640 1 --2- 172.21.15.18:0/2953696663 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e7815e1a0 0x7f9e78150750 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:01.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.313+0000 7f9e7efd7640 1 --2- 172.21.15.18:0/2953696663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e780cef10 0x7f9e78150210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:01.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.313+0000 7f9e7efd7640 1 -- 172.21.15.18:0/2953696663 >> 172.21.15.18:0/2953696663 conn(0x7f9e78072bb0 msgr2=0x7f9e78072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:01.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.313+0000 7f9e7efd7640 1 -- 172.21.15.18:0/2953696663 shutdown_connections 2024-04-17T19:53:01.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.313+0000 7f9e7efd7640 1 -- 172.21.15.18:0/2953696663 wait complete. 2024-04-17T19:53:01.330 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T19:53:01.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.485+0000 7ffab0417640 1 Processor -- start 2024-04-17T19:53:01.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.485+0000 7ffab0417640 1 -- start start 2024-04-17T19:53:01.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.485+0000 7ffab0417640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffaa80cd550 0x7ffaa8073080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:01.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.485+0000 7ffab0417640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ffaa80cd960 0x7ffaa80735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:01.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.485+0000 7ffab0417640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffaa80d0fe0 con 0x7ffaa80d0bd0 2024-04-17T19:53:01.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.485+0000 7ffab0417640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7ffaa815de60 con 0x7ffaa80cd960 2024-04-17T19:53:01.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.485+0000 7ffab0417640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7ffaa815e140 con 0x7ffaa80cd550 2024-04-17T19:53:01.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.485+0000 7ffaad9b2640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffaa80cd550 0x7ffaa8073080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:01.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.485+0000 7ffaad9b2640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffaa80cd550 0x7ffaa8073080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.18:54860/0 (socket says 172.21.15.18:54860) 2024-04-17T19:53:01.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.485+0000 7ffaad9b2640 1 -- 172.21.15.18:0/1552883364 learned_addr learned my addr 172.21.15.18:0/1552883364 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:01.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.485+0000 7ffaae9b4640 1 --2- 172.21.15.18:0/1552883364 >> v2:172.21.15.173:3300/0 conn(0x7ffaa80cd960 0x7ffaa80735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:01.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.485+0000 7ffaad9b2640 1 -- 172.21.15.18:0/1552883364 >> v2:172.21.15.173:3300/0 conn(0x7ffaa80cd960 msgr2=0x7ffaa80735c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:01.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.485+0000 7ffaad9b2640 1 --2- 172.21.15.18:0/1552883364 >> v2:172.21.15.173:3300/0 conn(0x7ffaa80cd960 0x7ffaa80735c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:01.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.485+0000 7ffaad9b2640 1 -- 172.21.15.18:0/1552883364 >> v1:172.21.15.173:6789/0 conn(0x7ffaa80d0bd0 legacy=0x7ffaa815d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:01.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.485+0000 7ffaad9b2640 1 -- 172.21.15.18:0/1552883364 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaa815e420 con 0x7ffaa80cd550 2024-04-17T19:53:01.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.485+0000 7ffaae9b4640 1 --2- 172.21.15.18:0/1552883364 >> v2:172.21.15.173:3300/0 conn(0x7ffaa80cd960 0x7ffaa80735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T19:53:01.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.489+0000 7ffaad9b2640 1 --2- 172.21.15.18:0/1552883364 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffaa80cd550 0x7ffaa8073080 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ffa98009870 tx=0x7ffa9801c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9774fcb5252453de server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:01.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.489+0000 7ffaad1b1640 1 -- 172.21.15.18:0/1552883364 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa980a7070 con 0x7ffaa80cd550 2024-04-17T19:53:01.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.489+0000 7ffaad1b1640 1 -- 172.21.15.18:0/1552883364 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa980b0070 con 0x7ffaa80cd550 2024-04-17T19:53:01.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.489+0000 7ffaad1b1640 1 -- 172.21.15.18:0/1552883364 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa980ab890 con 0x7ffaa80cd550 2024-04-17T19:53:01.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.493+0000 7ffab0417640 1 -- 172.21.15.18:0/1552883364 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffaa80cd550 msgr2=0x7ffaa8073080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:01.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.493+0000 7ffab0417640 1 --2- 172.21.15.18:0/1552883364 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffaa80cd550 0x7ffaa8073080 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ffa98009870 tx=0x7ffa9801c560 comp rx=0 tx=0).stop 2024-04-17T19:53:01.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.493+0000 7ffab0417640 1 -- 172.21.15.18:0/1552883364 shutdown_connections 2024-04-17T19:53:01.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.493+0000 7ffab0417640 1 --2- 172.21.15.18:0/1552883364 >> v2:172.21.15.173:3300/0 conn(0x7ffaa80cd960 0x7ffaa80735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:01.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.493+0000 7ffab0417640 1 --2- 172.21.15.18:0/1552883364 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffaa80cd550 0x7ffaa8073080 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:01.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.493+0000 7ffab0417640 1 -- 172.21.15.18:0/1552883364 >> 172.21.15.18:0/1552883364 conn(0x7ffaa80b38c0 msgr2=0x7ffaa80d12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:01.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.493+0000 7ffab0417640 1 -- 172.21.15.18:0/1552883364 shutdown_connections 2024-04-17T19:53:01.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.493+0000 7ffab0417640 1 -- 172.21.15.18:0/1552883364 wait complete. 2024-04-17T19:53:01.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.493+0000 7ffab0417640 1 Processor -- start 2024-04-17T19:53:01.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.493+0000 7ffab0417640 1 -- start start 2024-04-17T19:53:01.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.493+0000 7ffab0417640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffaa80cd550 0x7ffaa8142080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:01.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.493+0000 7ffab0417640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffaa80cd960 0x7ffaa8150820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:01.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.493+0000 7ffab0417640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffaa80d0bd0 0x7ffaa8150d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:01.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.493+0000 7ffab0417640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa816a910 con 0x7ffaa80d0bd0 2024-04-17T19:53:01.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.493+0000 7ffab0417640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa816a790 con 0x7ffaa80cd550 2024-04-17T19:53:01.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.493+0000 7ffab0417640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7ffaa816aa90 con 0x7ffaa80cd960 2024-04-17T19:53:01.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.497+0000 7ffaae9b4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffaa80d0bd0 0x7ffaa8150d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:01.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.497+0000 7ffaae9b4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffaa80d0bd0 0x7ffaa8150d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36274/0 (socket says 172.21.15.18:36274) 2024-04-17T19:53:01.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.497+0000 7ffaae9b4640 1 -- 172.21.15.18:0/2834058002 learned_addr learned my addr 172.21.15.18:0/2834058002 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:01.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.497+0000 7ffaae1b3640 1 --2- 172.21.15.18:0/2834058002 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffaa80cd550 0x7ffaa8142080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:01.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.497+0000 7ffaad9b2640 1 --2- 172.21.15.18:0/2834058002 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffaa80cd960 0x7ffaa8150820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:01.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.497+0000 7ffaae9b4640 1 -- 172.21.15.18:0/2834058002 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffaa80cd960 msgr2=0x7ffaa8150820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:01.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.497+0000 7ffaae9b4640 1 --2- 172.21.15.18:0/2834058002 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffaa80cd960 0x7ffaa8150820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:01.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.497+0000 7ffaae9b4640 1 -- 172.21.15.18:0/2834058002 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffaa80cd550 msgr2=0x7ffaa8142080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:01.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.497+0000 7ffaae9b4640 1 --2- 172.21.15.18:0/2834058002 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffaa80cd550 0x7ffaa8142080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:01.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.497+0000 7ffaae9b4640 1 -- 172.21.15.18:0/2834058002 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaa8149950 con 0x7ffaa80d0bd0 2024-04-17T19:53:01.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.497+0000 7ffaae9b4640 1 --2- 172.21.15.18:0/2834058002 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffaa80d0bd0 0x7ffaa8150d60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ffaa000ef90 tx=0x7ffaa000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:01.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.497+0000 7ffa9effd640 1 -- 172.21.15.18:0/2834058002 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa0018020 con 0x7ffaa80d0bd0 2024-04-17T19:53:01.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.497+0000 7ffa9effd640 1 -- 172.21.15.18:0/2834058002 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaa0014480 con 0x7ffaa80d0bd0 2024-04-17T19:53:01.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.497+0000 7ffab0417640 1 -- 172.21.15.18:0/2834058002 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaa8149c30 con 0x7ffaa80d0bd0 2024-04-17T19:53:01.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.497+0000 7ffa9effd640 1 -- 172.21.15.18:0/2834058002 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa0014850 con 0x7ffaa80d0bd0 2024-04-17T19:53:01.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.497+0000 7ffab0417640 1 -- 172.21.15.18:0/2834058002 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaa814a1f0 con 0x7ffaa80d0bd0 2024-04-17T19:53:01.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.497+0000 7ffab0417640 1 -- 172.21.15.18:0/2834058002 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffaa81496c0 con 0x7ffaa80d0bd0 2024-04-17T19:53:01.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.497+0000 7ffa9effd640 1 -- 172.21.15.18:0/2834058002 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ffaa001b020 con 0x7ffaa80d0bd0 2024-04-17T19:53:01.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.497+0000 7ffa9effd640 1 --2- 172.21.15.18:0/2834058002 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7ffa8c068380 0x7ffa8c06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:01.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.497+0000 7ffa9effd640 1 -- 172.21.15.18:0/2834058002 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7ffaa0087870 con 0x7ffaa80d0bd0 2024-04-17T19:53:01.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.497+0000 7ffaae1b3640 1 --2- 172.21.15.18:0/2834058002 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7ffa8c068380 0x7ffa8c06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:01.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.497+0000 7ffaae1b3640 1 --2- 172.21.15.18:0/2834058002 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7ffa8c068380 0x7ffa8c06a890 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8074380 tx=0x7ffaa4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:01.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.501+0000 7ffa9effd640 1 -- 172.21.15.18:0/2834058002 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ffaa0022030 con 0x7ffaa80d0bd0 2024-04-17T19:53:01.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.665+0000 7ffab0417640 1 -- 172.21.15.18:0/2834058002 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffaa80ce4a0 con 0x7ffaa80d0bd0 2024-04-17T19:53:01.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.665+0000 7ffa9effd640 1 -- 172.21.15.18:0/2834058002 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12872 (secure 0 0 0) 0x7ffaa0010040 con 0x7ffaa80d0bd0 2024-04-17T19:53:01.663 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:53:01.663 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":19,"fsid":"dd480169-5a81-4623-be5f-0499aa244b28","created":"2024-04-17T19:52:39.533760+0000","modified":"2024-04-17T19:52:55.269542+0000","last_up_change":"2024-04-17T19:52:51.229698+0000","last_in_change":"2024-04-17T19:52:42.144259+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T19:52:52.391648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e232d577-2508-4ea4-b355-29fbae1ff025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6801","nonce":2323038417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6803","nonce":2323038417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6807","nonce":2323038417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6805","nonce":2323038417}]},"public_addr":"172.21.15.18:6801/2323038417","cluster_addr":"172.21.15.18:6803/2323038417","heartbeat_back_addr":"172.21.15.18:6807/2323038417","heartbeat_front_addr":"172.21.15.18:6805/2323038417","state":["exists","up"]},{"osd":1,"uuid":"31810ef3-2c71-48d6-8748-b74a2968d23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6817","nonce":1283678238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6819","nonce":1283678238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6823","nonce":1283678238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6821","nonce":1283678238}]},"public_addr":"172.21.15.18:6817/1283678238","cluster_addr":"172.21.15.18:6819/1283678238","heartbeat_back_addr":"172.21.15.18:6823/1283678238","heartbeat_front_addr":"172.21.15.18:6821/1283678238","state":["exists","up"]},{"osd":2,"uuid":"5a783cc5-a41c-4967-9e11-6b8330f97d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6809","nonce":1212875862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6811","nonce":1212875862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6815","nonce":1212875862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6813","nonce":1212875862}]},"public_addr":"172.21.15.18:6809/1212875862","cluster_addr":"172.21.15.18:6811/1212875862","heartbeat_back_addr":"172.21.15.18:6815/1212875862","heartbeat_front_addr":"172.21.15.18:6813/1212875862","state":["exists","up"]},{"osd":3,"uuid":"b7e056d9-9da5-46e1-810d-0c3e242fe5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6825","nonce":2428878428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6827","nonce":2428878428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6831","nonce":2428878428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6829","nonce":2428878428}]},"public_addr":"172.21.15.18:6825/2428878428","cluster_addr":"172.21.15.18:6827/2428878428","heartbeat_back_addr":"172.21.15.18:6831/2428878428","heartbeat_front_addr":"172.21.15.18:6829/2428878428","state":["exists","up"]},{"osd":4,"uuid":"21df023f-bc8b-4abb-93e5-0ecc91acda0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6825","nonce":1421511819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6827","nonce":1421511819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6831","nonce":1421511819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6829","nonce":1421511819}]},"public_addr":"172.21.15.173:6825/1421511819","cluster_addr":"172.21.15.173:6827/1421511819","heartbeat_back_addr":"172.21.15.173:6831/1421511819","heartbeat_front_addr":"172.21.15.173:6829/1421511819","state":["exists","up"]},{"osd":5,"uuid":"e270098a-6d33-49f8-84ed-94e09a880cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6801","nonce":4221907702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6803","nonce":4221907702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6807","nonce":4221907702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6805","nonce":4221907702}]},"public_addr":"172.21.15.173:6801/4221907702","cluster_addr":"172.21.15.173:6803/4221907702","heartbeat_back_addr":"172.21.15.173:6807/4221907702","heartbeat_front_addr":"172.21.15.173:6805/4221907702","state":["exists","up"]},{"osd":6,"uuid":"93c67c8c-268d-4e32-877c-043cd3acd87c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6809","nonce":761678552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6811","nonce":761678552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6815","nonce":761678552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6813","nonce":761678552}]},"public_addr":"172.21.15.173:6809/761678552","cluster_addr":"172.21.15.173:6811/761678552","heartbeat_back_addr":"172.21.15.173:6815/761678552","heartbeat_front_addr":"172.21.15.173:6813/761678552","state":["exists","up"]},{"osd":7,"uuid":"faf10eea-80de-40f6-abbb-34d07d3f59ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6817","nonce":383724537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6819","nonce":383724537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6823","nonce":383724537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6821","nonce":383724537}]},"public_addr":"172.21.15.173:6817/383724537","cluster_addr":"172.21.15.173:6819/383724537","heartbeat_back_addr":"172.21.15.173:6823/383724537","heartbeat_front_addr":"172.21.15.173:6821/383724537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.668924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.761747+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.768128+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.632252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.742608+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.734327+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.477107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.818292+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T19:53:01.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.669+0000 7ffab0417640 1 -- 172.21.15.18:0/2834058002 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7ffa8c068380 msgr2=0x7ffa8c06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:01.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.669+0000 7ffab0417640 1 --2- 172.21.15.18:0/2834058002 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7ffa8c068380 0x7ffa8c06a890 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8074380 tx=0x7ffaa4009040 comp rx=0 tx=0).stop 2024-04-17T19:53:01.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.669+0000 7ffab0417640 1 -- 172.21.15.18:0/2834058002 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffaa80d0bd0 msgr2=0x7ffaa8150d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:01.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.669+0000 7ffab0417640 1 --2- 172.21.15.18:0/2834058002 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffaa80d0bd0 0x7ffaa8150d60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ffaa000ef90 tx=0x7ffaa000c490 comp rx=0 tx=0).stop 2024-04-17T19:53:01.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.669+0000 7ffab0417640 1 -- 172.21.15.18:0/2834058002 shutdown_connections 2024-04-17T19:53:01.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.669+0000 7ffab0417640 1 --2- 172.21.15.18:0/2834058002 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7ffa8c068380 0x7ffa8c06a890 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:01.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.669+0000 7ffab0417640 1 --2- 172.21.15.18:0/2834058002 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffaa80d0bd0 0x7ffaa8150d60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:01.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.669+0000 7ffab0417640 1 --2- 172.21.15.18:0/2834058002 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffaa80cd960 0x7ffaa8150820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:01.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.669+0000 7ffab0417640 1 --2- 172.21.15.18:0/2834058002 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffaa80cd550 0x7ffaa8142080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:01.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.669+0000 7ffab0417640 1 -- 172.21.15.18:0/2834058002 >> 172.21.15.18:0/2834058002 conn(0x7ffaa80b38c0 msgr2=0x7ffaa81600c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:01.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.669+0000 7ffab0417640 1 -- 172.21.15.18:0/2834058002 shutdown_connections 2024-04-17T19:53:01.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.669+0000 7ffab0417640 1 -- 172.21.15.18:0/2834058002 wait complete. 2024-04-17T19:53:01.683 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T19:52:52.391648+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-17T19:53:01.683 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T19:53:01.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.833+0000 7ff59ea01640 1 Processor -- start 2024-04-17T19:53:01.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.833+0000 7ff59ea01640 1 -- start start 2024-04-17T19:53:01.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.833+0000 7ff59ea01640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff59806cd60 0x7ff59806d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:01.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.833+0000 7ff59ea01640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff59815c7c0 0x7ff59815cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:01.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.833+0000 7ff59ea01640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff59806f9f0 0x7ff59806fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:01.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.833+0000 7ff59ea01640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7ff59815fc90 con 0x7ff59815c7c0 2024-04-17T19:53:01.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.833+0000 7ff59ea01640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7ff59806d6b0 con 0x7ff59806f9f0 2024-04-17T19:53:01.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.833+0000 7ff59ea01640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7ff598142870 con 0x7ff59806cd60 2024-04-17T19:53:01.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.833+0000 7ff5977fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff59815c7c0 0x7ff59815cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:01.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.833+0000 7ff5977fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff59815c7c0 0x7ff59815cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36278/0 (socket says 172.21.15.18:36278) 2024-04-17T19:53:01.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.833+0000 7ff5977fe640 1 -- 172.21.15.18:0/3438806137 learned_addr learned my addr 172.21.15.18:0/3438806137 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:01.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.833+0000 7ff597fff640 1 --2- 172.21.15.18:0/3438806137 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff59806cd60 0x7ff59806d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:01.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.833+0000 7ff59cf9e640 1 --2- 172.21.15.18:0/3438806137 >> v2:172.21.15.173:3300/0 conn(0x7ff59806f9f0 0x7ff59806fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:01.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.833+0000 7ff5977fe640 1 -- 172.21.15.18:0/3438806137 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff59806cd60 msgr2=0x7ff59806d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:01.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.833+0000 7ff5977fe640 1 --2- 172.21.15.18:0/3438806137 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff59806cd60 0x7ff59806d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:01.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.833+0000 7ff5977fe640 1 -- 172.21.15.18:0/3438806137 >> v2:172.21.15.173:3300/0 conn(0x7ff59806f9f0 msgr2=0x7ff59806fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:01.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.833+0000 7ff5977fe640 1 --2- 172.21.15.18:0/3438806137 >> v2:172.21.15.173:3300/0 conn(0x7ff59806f9f0 0x7ff59806fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:01.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.833+0000 7ff5977fe640 1 -- 172.21.15.18:0/3438806137 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff59815ff00 con 0x7ff59815c7c0 2024-04-17T19:53:01.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.837+0000 7ff5977fe640 1 --2- 172.21.15.18:0/3438806137 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff59815c7c0 0x7ff59815cbd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff5980b4b50 tx=0x7ff58c01e700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa1bed8876a23ea3 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:01.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.837+0000 7ff596ffd640 1 -- 172.21.15.18:0/3438806137 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff58c0b2600 con 0x7ff59815c7c0 2024-04-17T19:53:01.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.837+0000 7ff596ffd640 1 -- 172.21.15.18:0/3438806137 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff58c0b27a0 con 0x7ff59815c7c0 2024-04-17T19:53:01.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.837+0000 7ff596ffd640 1 -- 172.21.15.18:0/3438806137 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff58c0b2b70 con 0x7ff59815c7c0 2024-04-17T19:53:01.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.837+0000 7ff59ea01640 1 -- 172.21.15.18:0/3438806137 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff59815c7c0 msgr2=0x7ff59815cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:01.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.837+0000 7ff59ea01640 1 --2- 172.21.15.18:0/3438806137 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff59815c7c0 0x7ff59815cbd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff5980b4b50 tx=0x7ff58c01e700 comp rx=0 tx=0).stop 2024-04-17T19:53:01.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.837+0000 7ff59ea01640 1 -- 172.21.15.18:0/3438806137 shutdown_connections 2024-04-17T19:53:01.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.837+0000 7ff59ea01640 1 --2- 172.21.15.18:0/3438806137 >> v2:172.21.15.173:3300/0 conn(0x7ff59806f9f0 0x7ff59806fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:01.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.837+0000 7ff59ea01640 1 --2- 172.21.15.18:0/3438806137 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff59815c7c0 0x7ff59815cbd0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:01.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.837+0000 7ff59ea01640 1 --2- 172.21.15.18:0/3438806137 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff59806cd60 0x7ff59806d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:01.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.837+0000 7ff59ea01640 1 -- 172.21.15.18:0/3438806137 >> 172.21.15.18:0/3438806137 conn(0x7ff598072bb0 msgr2=0x7ff598072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:01.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.837+0000 7ff59ea01640 1 -- 172.21.15.18:0/3438806137 shutdown_connections 2024-04-17T19:53:01.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.837+0000 7ff59ea01640 1 -- 172.21.15.18:0/3438806137 wait complete. 2024-04-17T19:53:01.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.841+0000 7ff59ea01640 1 Processor -- start 2024-04-17T19:53:01.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.841+0000 7ff59ea01640 1 -- start start 2024-04-17T19:53:01.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.841+0000 7ff59ea01640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff59806cd60 0x7ff598155440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:01.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.841+0000 7ff59ea01640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff59806f9f0 0x7ff598133de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:01.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.841+0000 7ff59ea01640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff59815c7c0 0x7ff598134320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:01.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.841+0000 7ff59ea01640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff5981609e0 con 0x7ff59806f9f0 2024-04-17T19:53:01.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.841+0000 7ff59ea01640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff598070750 con 0x7ff59806cd60 2024-04-17T19:53:01.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.841+0000 7ff59ea01640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7ff5981f4d10 con 0x7ff59815c7c0 2024-04-17T19:53:01.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.841+0000 7ff5977fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff59806f9f0 0x7ff598133de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:01.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.841+0000 7ff5977fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff59806f9f0 0x7ff598133de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36290/0 (socket says 172.21.15.18:36290) 2024-04-17T19:53:01.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.841+0000 7ff5977fe640 1 -- 172.21.15.18:0/52521917 learned_addr learned my addr 172.21.15.18:0/52521917 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:01.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.841+0000 7ff597fff640 1 --2- 172.21.15.18:0/52521917 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff59806cd60 0x7ff598155440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:01.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.841+0000 7ff5977fe640 1 -- 172.21.15.18:0/52521917 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff59815c7c0 msgr2=0x7ff598134320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:01.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.841+0000 7ff5977fe640 1 --2- 172.21.15.18:0/52521917 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff59815c7c0 0x7ff598134320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:01.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.841+0000 7ff5977fe640 1 -- 172.21.15.18:0/52521917 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff59806cd60 msgr2=0x7ff598155440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:01.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.841+0000 7ff5977fe640 1 --2- 172.21.15.18:0/52521917 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff59806cd60 0x7ff598155440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:01.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.841+0000 7ff5977fe640 1 -- 172.21.15.18:0/52521917 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5981368b0 con 0x7ff59806f9f0 2024-04-17T19:53:01.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.841+0000 7ff597fff640 1 --2- 172.21.15.18:0/52521917 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff59806cd60 0x7ff598155440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:53:01.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.841+0000 7ff5977fe640 1 --2- 172.21.15.18:0/52521917 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff59806f9f0 0x7ff598133de0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff58c01cdb0 tx=0x7ff58c01b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:01.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.841+0000 7ff594ff9640 1 -- 172.21.15.18:0/52521917 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff58c0b2600 con 0x7ff59806f9f0 2024-04-17T19:53:01.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.841+0000 7ff594ff9640 1 -- 172.21.15.18:0/52521917 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff58c0aa800 con 0x7ff59806f9f0 2024-04-17T19:53:01.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.841+0000 7ff59ea01640 1 -- 172.21.15.18:0/52521917 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff598136b50 con 0x7ff59806f9f0 2024-04-17T19:53:01.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.841+0000 7ff594ff9640 1 -- 172.21.15.18:0/52521917 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff58c0aabd0 con 0x7ff59806f9f0 2024-04-17T19:53:01.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.841+0000 7ff59ea01640 1 -- 172.21.15.18:0/52521917 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff598136e30 con 0x7ff59806f9f0 2024-04-17T19:53:01.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.841+0000 7ff59ea01640 1 -- 172.21.15.18:0/52521917 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff598069950 con 0x7ff59806f9f0 2024-04-17T19:53:01.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.841+0000 7ff594ff9640 1 -- 172.21.15.18:0/52521917 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff58c0bd060 con 0x7ff59806f9f0 2024-04-17T19:53:01.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.845+0000 7ff594ff9640 1 --2- 172.21.15.18:0/52521917 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7ff584068380 0x7ff58406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:01.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.845+0000 7ff594ff9640 1 -- 172.21.15.18:0/52521917 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7ff58c11fd10 con 0x7ff59806f9f0 2024-04-17T19:53:01.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.845+0000 7ff597fff640 1 --2- 172.21.15.18:0/52521917 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7ff584068380 0x7ff58406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:01.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.845+0000 7ff597fff640 1 --2- 172.21.15.18:0/52521917 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7ff584068380 0x7ff58406a890 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff5980b0750 tx=0x7ff588008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:01.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:01.849+0000 7ff594ff9640 1 -- 172.21.15.18:0/52521917 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff58c125020 con 0x7ff59806f9f0 2024-04-17T19:53:02.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.013+0000 7ff59ea01640 1 -- 172.21.15.18:0/52521917 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff5980b3a40 con 0x7ff59806f9f0 2024-04-17T19:53:02.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.013+0000 7ff594ff9640 1 -- 172.21.15.18:0/52521917 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) ==== 93+0+10 (secure 0 0 0) 0x7ff5981368b0 con 0x7ff59806f9f0 2024-04-17T19:53:02.009 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-17T19:53:02.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.013+0000 7ff59ea01640 1 -- 172.21.15.18:0/52521917 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7ff584068380 msgr2=0x7ff58406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:02.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.013+0000 7ff59ea01640 1 --2- 172.21.15.18:0/52521917 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7ff584068380 0x7ff58406a890 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff5980b0750 tx=0x7ff588008040 comp rx=0 tx=0).stop 2024-04-17T19:53:02.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.013+0000 7ff59ea01640 1 -- 172.21.15.18:0/52521917 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff59806f9f0 msgr2=0x7ff598133de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:02.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.013+0000 7ff59ea01640 1 --2- 172.21.15.18:0/52521917 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff59806f9f0 0x7ff598133de0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff58c01cdb0 tx=0x7ff58c01b4a0 comp rx=0 tx=0).stop 2024-04-17T19:53:02.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.017+0000 7ff59ea01640 1 -- 172.21.15.18:0/52521917 shutdown_connections 2024-04-17T19:53:02.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.017+0000 7ff59ea01640 1 --2- 172.21.15.18:0/52521917 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7ff584068380 0x7ff58406a890 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:02.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.017+0000 7ff59ea01640 1 --2- 172.21.15.18:0/52521917 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff59815c7c0 0x7ff598134320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:02.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.017+0000 7ff59ea01640 1 --2- 172.21.15.18:0/52521917 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff59806f9f0 0x7ff598133de0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:02.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.017+0000 7ff59ea01640 1 --2- 172.21.15.18:0/52521917 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff59806cd60 0x7ff598155440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:02.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.017+0000 7ff59ea01640 1 -- 172.21.15.18:0/52521917 >> 172.21.15.18:0/52521917 conn(0x7ff598072bb0 msgr2=0x7ff59815e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:02.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.017+0000 7ff59ea01640 1 -- 172.21.15.18:0/52521917 shutdown_connections 2024-04-17T19:53:02.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.017+0000 7ff59ea01640 1 -- 172.21.15.18:0/52521917 wait complete. 2024-04-17T19:53:02.030 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-17T19:53:02.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.189+0000 7fe572861640 1 Processor -- start 2024-04-17T19:53:02.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.189+0000 7fe572861640 1 -- start start 2024-04-17T19:53:02.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.189+0000 7fe572861640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe56c15e1a0 0x7fe56c0ce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:02.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.189+0000 7fe572861640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe56c06cd60 0x7fe56c06d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:02.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.189+0000 7fe572861640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe56c06d6b0 con 0x7fe56c0cef10 2024-04-17T19:53:02.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.189+0000 7fe572861640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7fe56c0d0020 con 0x7fe56c15e1a0 2024-04-17T19:53:02.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.189+0000 7fe572861640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fe56c0cd930 con 0x7fe56c06cd60 2024-04-17T19:53:02.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.189+0000 7fe56b7fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fe56c0cef10 0x7fe56c15e910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:57680/0 (socket says 172.21.15.18:57680) 2024-04-17T19:53:02.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.189+0000 7fe56b7fe640 1 -- 172.21.15.18:0/4191878720 learned_addr learned my addr 172.21.15.18:0/4191878720 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:02.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.189+0000 7fe56bfff640 1 --2- 172.21.15.18:0/4191878720 >> v2:172.21.15.173:3300/0 conn(0x7fe56c15e1a0 0x7fe56c0ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:02.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.189+0000 7fe570dfe640 1 --2- 172.21.15.18:0/4191878720 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe56c06cd60 0x7fe56c06d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:02.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.189+0000 7fe56affd640 1 -- 172.21.15.18:0/4191878720 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3436395543 0 0) 0x7fe554001120 con 0x7fe56c0cef10 2024-04-17T19:53:02.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.189+0000 7fe56affd640 1 -- 172.21.15.18:0/4191878720 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe558003530 con 0x7fe56c0cef10 2024-04-17T19:53:02.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.189+0000 7fe56affd640 1 -- 172.21.15.18:0/4191878720 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 342625513 0 0) 0x7fe558003530 con 0x7fe56c0cef10 2024-04-17T19:53:02.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.189+0000 7fe56bfff640 1 -- 172.21.15.18:0/4191878720 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe56c06cd60 msgr2=0x7fe56c06d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:02.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.189+0000 7fe56bfff640 1 --2- 172.21.15.18:0/4191878720 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe56c06cd60 0x7fe56c06d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:02.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.189+0000 7fe56bfff640 1 -- 172.21.15.18:0/4191878720 >> v1:172.21.15.18:6789/0 conn(0x7fe56c0cef10 legacy=0x7fe56c15e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:02.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.189+0000 7fe56bfff640 1 -- 172.21.15.18:0/4191878720 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe56c0cdc10 con 0x7fe56c15e1a0 2024-04-17T19:53:02.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.193+0000 7fe56bfff640 1 --2- 172.21.15.18:0/4191878720 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe56c15e1a0 0x7fe56c0ce9d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe564009d90 tx=0x7fe56401c7d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c77979325224fb8d server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:02.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.193+0000 7fe56affd640 1 -- 172.21.15.18:0/4191878720 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5640b2070 con 0x7fe56c15e1a0 2024-04-17T19:53:02.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.193+0000 7fe56affd640 1 -- 172.21.15.18:0/4191878720 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5640a55d0 con 0x7fe56c15e1a0 2024-04-17T19:53:02.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.193+0000 7fe56affd640 1 -- 172.21.15.18:0/4191878720 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe554001850 con 0x7fe56c15e1a0 2024-04-17T19:53:02.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.193+0000 7fe572861640 1 -- 172.21.15.18:0/4191878720 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe56c15e1a0 msgr2=0x7fe56c0ce9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:02.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.193+0000 7fe572861640 1 --2- 172.21.15.18:0/4191878720 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe56c15e1a0 0x7fe56c0ce9d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe564009d90 tx=0x7fe56401c7d0 comp rx=0 tx=0).stop 2024-04-17T19:53:02.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.193+0000 7fe572861640 1 -- 172.21.15.18:0/4191878720 shutdown_connections 2024-04-17T19:53:02.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.193+0000 7fe572861640 1 --2- 172.21.15.18:0/4191878720 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe56c06cd60 0x7fe56c06d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:02.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.193+0000 7fe572861640 1 --2- 172.21.15.18:0/4191878720 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe56c15e1a0 0x7fe56c0ce9d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:02.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.193+0000 7fe572861640 1 -- 172.21.15.18:0/4191878720 >> 172.21.15.18:0/4191878720 conn(0x7fe56c072bb0 msgr2=0x7fe56c072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:02.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.193+0000 7fe572861640 1 -- 172.21.15.18:0/4191878720 shutdown_connections 2024-04-17T19:53:02.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.193+0000 7fe572861640 1 -- 172.21.15.18:0/4191878720 wait complete. 2024-04-17T19:53:02.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.197+0000 7fe572861640 1 Processor -- start 2024-04-17T19:53:02.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.197+0000 7fe572861640 1 -- start start 2024-04-17T19:53:02.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.197+0000 7fe572861640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe56c06cd60 0x7fe56c144cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:02.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.197+0000 7fe572861640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe56c0cef10 0x7fe56c14de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:02.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.197+0000 7fe572861640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe56c15e1a0 0x7fe56c14e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:02.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.197+0000 7fe572861640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe56c15e730 con 0x7fe56c0cef10 2024-04-17T19:53:02.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.197+0000 7fe572861640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe56c15e5b0 con 0x7fe56c15e1a0 2024-04-17T19:53:02.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.197+0000 7fe572861640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fe56c15f020 con 0x7fe56c06cd60 2024-04-17T19:53:02.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.197+0000 7fe56b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe56c0cef10 0x7fe56c14de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:02.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.197+0000 7fe56b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe56c0cef10 0x7fe56c14de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36292/0 (socket says 172.21.15.18:36292) 2024-04-17T19:53:02.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.197+0000 7fe56b7fe640 1 -- 172.21.15.18:0/3304690051 learned_addr learned my addr 172.21.15.18:0/3304690051 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:02.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.197+0000 7fe56bfff640 1 --2- 172.21.15.18:0/3304690051 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe56c06cd60 0x7fe56c144cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:02.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.197+0000 7fe570dfe640 1 --2- 172.21.15.18:0/3304690051 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe56c15e1a0 0x7fe56c14e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:02.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.197+0000 7fe56b7fe640 1 -- 172.21.15.18:0/3304690051 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe56c06cd60 msgr2=0x7fe56c144cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:02.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.197+0000 7fe56b7fe640 1 --2- 172.21.15.18:0/3304690051 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe56c06cd60 0x7fe56c144cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:02.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.197+0000 7fe56b7fe640 1 -- 172.21.15.18:0/3304690051 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe56c15e1a0 msgr2=0x7fe56c14e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:02.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.197+0000 7fe56b7fe640 1 --2- 172.21.15.18:0/3304690051 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe56c15e1a0 0x7fe56c14e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:02.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.197+0000 7fe56b7fe640 1 -- 172.21.15.18:0/3304690051 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe56c145230 con 0x7fe56c0cef10 2024-04-17T19:53:02.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.197+0000 7fe56bfff640 1 --2- 172.21.15.18:0/3304690051 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe56c06cd60 0x7fe56c144cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:53:02.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.197+0000 7fe570dfe640 1 --2- 172.21.15.18:0/3304690051 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe56c15e1a0 0x7fe56c14e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:53:02.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.197+0000 7fe56b7fe640 1 --2- 172.21.15.18:0/3304690051 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe56c0cef10 0x7fe56c14de60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe55400c750 tx=0x7fe55400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:02.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.197+0000 7fe568ff9640 1 -- 172.21.15.18:0/3304690051 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe554005ae0 con 0x7fe56c0cef10 2024-04-17T19:53:02.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.197+0000 7fe568ff9640 1 -- 172.21.15.18:0/3304690051 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe554005c80 con 0x7fe56c0cef10 2024-04-17T19:53:02.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.197+0000 7fe572861640 1 -- 172.21.15.18:0/3304690051 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe56c14a930 con 0x7fe56c0cef10 2024-04-17T19:53:02.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.197+0000 7fe568ff9640 1 -- 172.21.15.18:0/3304690051 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe554007290 con 0x7fe56c0cef10 2024-04-17T19:53:02.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.197+0000 7fe572861640 1 -- 172.21.15.18:0/3304690051 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe56c14aef0 con 0x7fe56c0cef10 2024-04-17T19:53:02.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.201+0000 7fe572861640 1 -- 172.21.15.18:0/3304690051 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe56c069950 con 0x7fe56c0cef10 2024-04-17T19:53:02.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.201+0000 7fe568ff9640 1 -- 172.21.15.18:0/3304690051 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe554007430 con 0x7fe56c0cef10 2024-04-17T19:53:02.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.201+0000 7fe568ff9640 1 --2- 172.21.15.18:0/3304690051 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fe54c068380 0x7fe54c06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:02.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.201+0000 7fe568ff9640 1 -- 172.21.15.18:0/3304690051 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fe554086450 con 0x7fe56c0cef10 2024-04-17T19:53:02.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.201+0000 7fe56bfff640 1 --2- 172.21.15.18:0/3304690051 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fe54c068380 0x7fe54c06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:02.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.201+0000 7fe56bfff640 1 --2- 172.21.15.18:0/3304690051 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fe54c068380 0x7fe54c06a890 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe5640af000 tx=0x7fe5640a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:02.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.205+0000 7fe568ff9640 1 -- 172.21.15.18:0/3304690051 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe56c06d6b0 con 0x7fe56c0cef10 2024-04-17T19:53:02.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.365+0000 7fe572861640 1 -- 172.21.15.18:0/3304690051 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fe56c14a680 con 0x7fe56c0cef10 2024-04-17T19:53:02.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.365+0000 7fe568ff9640 1 -- 172.21.15.18:0/3304690051 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) ==== 84+0+65 (secure 0 0 0) 0x7fe554007720 con 0x7fe56c0cef10 2024-04-17T19:53:02.360 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:53:02.360 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2024-04-17T19:53:02.360 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-17T19:53:02.360 INFO:teuthology.orchestra.run.smithi018.stdout: "poolnum": 1, 2024-04-17T19:53:02.361 INFO:teuthology.orchestra.run.smithi018.stdout: "poolname": ".mgr" 2024-04-17T19:53:02.361 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-17T19:53:02.361 INFO:teuthology.orchestra.run.smithi018.stdout:] 2024-04-17T19:53:02.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.365+0000 7fe572861640 1 -- 172.21.15.18:0/3304690051 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fe54c068380 msgr2=0x7fe54c06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:02.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.365+0000 7fe572861640 1 --2- 172.21.15.18:0/3304690051 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fe54c068380 0x7fe54c06a890 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe5640af000 tx=0x7fe5640a7070 comp rx=0 tx=0).stop 2024-04-17T19:53:02.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.365+0000 7fe572861640 1 -- 172.21.15.18:0/3304690051 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe56c0cef10 msgr2=0x7fe56c14de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:02.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.365+0000 7fe572861640 1 --2- 172.21.15.18:0/3304690051 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe56c0cef10 0x7fe56c14de60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe55400c750 tx=0x7fe55400cc10 comp rx=0 tx=0).stop 2024-04-17T19:53:02.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.365+0000 7fe572861640 1 -- 172.21.15.18:0/3304690051 shutdown_connections 2024-04-17T19:53:02.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.365+0000 7fe572861640 1 --2- 172.21.15.18:0/3304690051 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fe54c068380 0x7fe54c06a890 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:02.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.365+0000 7fe572861640 1 --2- 172.21.15.18:0/3304690051 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe56c15e1a0 0x7fe56c14e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:02.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.365+0000 7fe572861640 1 --2- 172.21.15.18:0/3304690051 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe56c0cef10 0x7fe56c14de60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:02.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.365+0000 7fe572861640 1 --2- 172.21.15.18:0/3304690051 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe56c06cd60 0x7fe56c144cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:02.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.365+0000 7fe572861640 1 -- 172.21.15.18:0/3304690051 >> 172.21.15.18:0/3304690051 conn(0x7fe56c072bb0 msgr2=0x7fe56c06e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:02.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.365+0000 7fe572861640 1 -- 172.21.15.18:0/3304690051 shutdown_connections 2024-04-17T19:53:02.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.365+0000 7fe572861640 1 -- 172.21.15.18:0/3304690051 wait complete. 2024-04-17T19:53:02.380 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-17T19:53:02.380 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-17T19:53:02.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.541+0000 7f3443042640 1 Processor -- start 2024-04-17T19:53:02.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.541+0000 7f3443042640 1 -- start start 2024-04-17T19:53:02.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.541+0000 7f3443042640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f343c0cece0 0x7f343c161500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:02.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.541+0000 7f3443042640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f343c0cdc10 con 0x7f343c0cf0f0 2024-04-17T19:53:02.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.541+0000 7f3443042640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f343c0cdef0 con 0x7f343c161a40 2024-04-17T19:53:02.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.541+0000 7f3443042640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f343c0ce4b0 con 0x7f343c0cece0 2024-04-17T19:53:02.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.541+0000 7f343bfff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f343c0cf0f0 0x7f343c0b1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:57690/0 (socket says 172.21.15.18:57690) 2024-04-17T19:53:02.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.541+0000 7f3440dde640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f343c0cece0 0x7f343c161500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:02.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.541+0000 7f343bfff640 1 -- 172.21.15.18:0/386955664 learned_addr learned my addr 172.21.15.18:0/386955664 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:02.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.541+0000 7f343b7fe640 1 -- 172.21.15.18:0/386955664 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1744290551 0 0) 0x7f343c0cdc10 con 0x7f343c0cf0f0 2024-04-17T19:53:02.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.541+0000 7f343b7fe640 1 -- 172.21.15.18:0/386955664 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3424003530 con 0x7f343c0cf0f0 2024-04-17T19:53:02.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.541+0000 7f3440dde640 1 -- 172.21.15.18:0/386955664 >> v1:172.21.15.173:6789/0 conn(0x7f343c161a40 legacy=0x7f343c0b6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:02.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.541+0000 7f3440dde640 1 -- 172.21.15.18:0/386955664 >> v1:172.21.15.18:6789/0 conn(0x7f343c0cf0f0 legacy=0x7f343c0b1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:02.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.541+0000 7f3440dde640 1 -- 172.21.15.18:0/386955664 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f343c0ce1d0 con 0x7f343c0cece0 2024-04-17T19:53:02.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.545+0000 7f3440dde640 1 --2- 172.21.15.18:0/386955664 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f343c0cece0 0x7f343c161500 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f342c009d90 tx=0x7f342c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cf50288df208e9c server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:02.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.545+0000 7f343b7fe640 1 -- 172.21.15.18:0/386955664 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f342c0b2070 con 0x7f343c0cece0 2024-04-17T19:53:02.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.545+0000 7f343b7fe640 1 -- 172.21.15.18:0/386955664 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f342c0a5830 con 0x7f343c0cece0 2024-04-17T19:53:02.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.545+0000 7f343b7fe640 1 -- 172.21.15.18:0/386955664 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f342c0a5c00 con 0x7f343c0cece0 2024-04-17T19:53:02.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.545+0000 7f3443042640 1 -- 172.21.15.18:0/386955664 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f343c0cece0 msgr2=0x7f343c161500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:02.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.545+0000 7f3443042640 1 --2- 172.21.15.18:0/386955664 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f343c0cece0 0x7f343c161500 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f342c009d90 tx=0x7f342c01c970 comp rx=0 tx=0).stop 2024-04-17T19:53:02.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.545+0000 7f3443042640 1 -- 172.21.15.18:0/386955664 shutdown_connections 2024-04-17T19:53:02.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.545+0000 7f3443042640 1 --2- 172.21.15.18:0/386955664 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f343c0cece0 0x7f343c161500 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:02.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.545+0000 7f3443042640 1 -- 172.21.15.18:0/386955664 >> 172.21.15.18:0/386955664 conn(0x7f343c09aa70 msgr2=0x7f343c09ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:02.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.545+0000 7f3443042640 1 -- 172.21.15.18:0/386955664 shutdown_connections 2024-04-17T19:53:02.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.545+0000 7f3443042640 1 -- 172.21.15.18:0/386955664 wait complete. 2024-04-17T19:53:02.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.549+0000 7f3443042640 1 Processor -- start 2024-04-17T19:53:02.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.549+0000 7f3443042640 1 -- start start 2024-04-17T19:53:02.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.549+0000 7f3443042640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f343c0cece0 0x7f343c1549b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:02.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.549+0000 7f3443042640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f343c0cf0f0 0x7f343c0c9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:02.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.549+0000 7f3443042640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f343c161a40 0x7f343c0ca030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:02.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.549+0000 7f3443042640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f343c0b2810 con 0x7f343c0cf0f0 2024-04-17T19:53:02.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.549+0000 7f3443042640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f343c0b71b0 con 0x7f343c161a40 2024-04-17T19:53:02.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.549+0000 7f3443042640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f343c0b1c60 con 0x7f343c0cece0 2024-04-17T19:53:02.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.549+0000 7f343bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f343c0cf0f0 0x7f343c0c9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:02.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.549+0000 7f343bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f343c0cf0f0 0x7f343c0c9af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36304/0 (socket says 172.21.15.18:36304) 2024-04-17T19:53:02.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.549+0000 7f343bfff640 1 -- 172.21.15.18:0/749565927 learned_addr learned my addr 172.21.15.18:0/749565927 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:02.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.549+0000 7f3440dde640 1 --2- 172.21.15.18:0/749565927 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f343c0cece0 0x7f343c1549b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:02.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.549+0000 7f34415df640 1 --2- 172.21.15.18:0/749565927 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f343c161a40 0x7f343c0ca030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:02.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.549+0000 7f343bfff640 1 -- 172.21.15.18:0/749565927 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f343c0cece0 msgr2=0x7f343c1549b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:02.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.549+0000 7f343bfff640 1 --2- 172.21.15.18:0/749565927 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f343c0cece0 0x7f343c1549b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:02.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.549+0000 7f343bfff640 1 -- 172.21.15.18:0/749565927 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f343c161a40 msgr2=0x7f343c0ca030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:02.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.549+0000 7f343bfff640 1 --2- 172.21.15.18:0/749565927 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f343c161a40 0x7f343c0ca030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:02.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.549+0000 7f343bfff640 1 -- 172.21.15.18:0/749565927 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f343c0cb6c0 con 0x7f343c0cf0f0 2024-04-17T19:53:02.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.549+0000 7f34415df640 1 --2- 172.21.15.18:0/749565927 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f343c161a40 0x7f343c0ca030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:53:02.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.549+0000 7f343bfff640 1 --2- 172.21.15.18:0/749565927 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f343c0cf0f0 0x7f343c0c9af0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f343000c450 tx=0x7f343000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:02.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.549+0000 7f34397fa640 1 -- 172.21.15.18:0/749565927 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3430017070 con 0x7f343c0cf0f0 2024-04-17T19:53:02.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.549+0000 7f34397fa640 1 -- 172.21.15.18:0/749565927 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3430005cf0 con 0x7f343c0cf0f0 2024-04-17T19:53:02.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.549+0000 7f3443042640 1 -- 172.21.15.18:0/749565927 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f343c0cb9a0 con 0x7f343c0cf0f0 2024-04-17T19:53:02.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.549+0000 7f34397fa640 1 -- 172.21.15.18:0/749565927 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3430007270 con 0x7f343c0cf0f0 2024-04-17T19:53:02.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.549+0000 7f3443042640 1 -- 172.21.15.18:0/749565927 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f343c0caa30 con 0x7f343c0cf0f0 2024-04-17T19:53:02.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.549+0000 7f3443042640 1 -- 172.21.15.18:0/749565927 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f343c0ca570 con 0x7f343c0cf0f0 2024-04-17T19:53:02.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.549+0000 7f34397fa640 1 -- 172.21.15.18:0/749565927 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f343001a070 con 0x7f343c0cf0f0 2024-04-17T19:53:02.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.553+0000 7f34397fa640 1 --2- 172.21.15.18:0/749565927 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f34280683b0 0x7f342806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:02.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.553+0000 7f34397fa640 1 -- 172.21.15.18:0/749565927 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f34300859a0 con 0x7f343c0cf0f0 2024-04-17T19:53:02.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.553+0000 7f3440dde640 1 --2- 172.21.15.18:0/749565927 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f34280683b0 0x7f342806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:02.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.553+0000 7f3440dde640 1 --2- 172.21.15.18:0/749565927 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f34280683b0 0x7f342806a8c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f342c0af000 tx=0x7f342c0a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:02.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.557+0000 7f34397fa640 1 -- 172.21.15.18:0/749565927 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f343c0ca570 con 0x7f343c0cf0f0 2024-04-17T19:53:02.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:02.717+0000 7f3443042640 1 -- 172.21.15.18:0/749565927 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f343c069950 con 0x7f343c0cf0f0 2024-04-17T19:53:03.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.409+0000 7f34397fa640 1 -- 172.21.15.18:0/749565927 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) ==== 138+0+0 (secure 0 0 0) 0x7f3430055b50 con 0x7f343c0cf0f0 2024-04-17T19:53:03.407 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' created 2024-04-17T19:53:03.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.413+0000 7f3443042640 1 -- 172.21.15.18:0/749565927 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f34280683b0 msgr2=0x7f342806a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:03.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.413+0000 7f3443042640 1 --2- 172.21.15.18:0/749565927 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f34280683b0 0x7f342806a8c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f342c0af000 tx=0x7f342c0a7070 comp rx=0 tx=0).stop 2024-04-17T19:53:03.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.413+0000 7f3443042640 1 -- 172.21.15.18:0/749565927 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f343c0cf0f0 msgr2=0x7f343c0c9af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:03.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.413+0000 7f3443042640 1 --2- 172.21.15.18:0/749565927 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f343c0cf0f0 0x7f343c0c9af0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f343000c450 tx=0x7f343000c910 comp rx=0 tx=0).stop 2024-04-17T19:53:03.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.413+0000 7f3443042640 1 -- 172.21.15.18:0/749565927 shutdown_connections 2024-04-17T19:53:03.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.413+0000 7f3443042640 1 --2- 172.21.15.18:0/749565927 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f34280683b0 0x7f342806a8c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:03.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.413+0000 7f3443042640 1 --2- 172.21.15.18:0/749565927 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f343c161a40 0x7f343c0ca030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:03.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.413+0000 7f3443042640 1 --2- 172.21.15.18:0/749565927 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f343c0cf0f0 0x7f343c0c9af0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:03.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.413+0000 7f3443042640 1 --2- 172.21.15.18:0/749565927 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f343c0cece0 0x7f343c1549b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:03.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.413+0000 7f3443042640 1 -- 172.21.15.18:0/749565927 >> 172.21.15.18:0/749565927 conn(0x7f343c09aa70 msgr2=0x7f343c0ae990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:03.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.413+0000 7f3443042640 1 -- 172.21.15.18:0/749565927 shutdown_connections 2024-04-17T19:53:03.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.413+0000 7f3443042640 1 -- 172.21.15.18:0/749565927 wait complete. 2024-04-17T19:53:03.443 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-04-17T19:53:03.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.613+0000 7f20ee02f640 1 Processor -- start 2024-04-17T19:53:03.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.613+0000 7f20ee02f640 1 -- start start 2024-04-17T19:53:03.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.617+0000 7f20ee02f640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f20e806cd50 0x7f20e806d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:03.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.617+0000 7f20ee02f640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20e815f7a0 con 0x7f20e80d0510 2024-04-17T19:53:03.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.617+0000 7f20ee02f640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20e80d4710 con 0x7f20e80cf9f0 2024-04-17T19:53:03.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.617+0000 7f20ee02f640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f20e806c1b0 con 0x7f20e806cd50 2024-04-17T19:53:03.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.617+0000 7f20e6ffd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f20e80d0510 0x7f20e806c640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:57696/0 (socket says 172.21.15.18:57696) 2024-04-17T19:53:03.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.617+0000 7f20e6ffd640 1 -- 172.21.15.18:0/459089928 learned_addr learned my addr 172.21.15.18:0/459089928 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:03.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.617+0000 7f20e7fff640 1 --2- 172.21.15.18:0/459089928 >> v2:172.21.15.18:3300/0 conn(0x7f20e806cd50 0x7f20e806d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:03.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.617+0000 7f20e67fc640 1 -- 172.21.15.18:0/459089928 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2694779014 0 0) 0x7f20e815f7a0 con 0x7f20e80d0510 2024-04-17T19:53:03.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.617+0000 7f20e67fc640 1 -- 172.21.15.18:0/459089928 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20d0003530 con 0x7f20e80d0510 2024-04-17T19:53:03.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.617+0000 7f20e7fff640 1 -- 172.21.15.18:0/459089928 >> v1:172.21.15.173:6789/0 conn(0x7f20e80cf9f0 legacy=0x7f20e80cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:03.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.617+0000 7f20e7fff640 1 -- 172.21.15.18:0/459089928 >> v1:172.21.15.18:6789/0 conn(0x7f20e80d0510 legacy=0x7f20e806c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:03.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.617+0000 7f20e7fff640 1 -- 172.21.15.18:0/459089928 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20e806d6a0 con 0x7f20e806cd50 2024-04-17T19:53:03.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.621+0000 7f20e7fff640 1 --2- 172.21.15.18:0/459089928 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20e806cd50 0x7f20e806d160 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f20e0009d90 tx=0x7f20e001c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ace603f92e884f84 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:03.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.621+0000 7f20e67fc640 1 -- 172.21.15.18:0/459089928 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e00b2070 con 0x7f20e806cd50 2024-04-17T19:53:03.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.621+0000 7f20e67fc640 1 -- 172.21.15.18:0/459089928 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20e00a5710 con 0x7f20e806cd50 2024-04-17T19:53:03.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.621+0000 7f20e67fc640 1 -- 172.21.15.18:0/459089928 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e00a5ac0 con 0x7f20e806cd50 2024-04-17T19:53:03.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.621+0000 7f20ee02f640 1 -- 172.21.15.18:0/459089928 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20e806cd50 msgr2=0x7f20e806d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:03.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.621+0000 7f20ee02f640 1 --2- 172.21.15.18:0/459089928 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20e806cd50 0x7f20e806d160 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f20e0009d90 tx=0x7f20e001c850 comp rx=0 tx=0).stop 2024-04-17T19:53:03.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.621+0000 7f20ee02f640 1 -- 172.21.15.18:0/459089928 shutdown_connections 2024-04-17T19:53:03.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.621+0000 7f20ee02f640 1 --2- 172.21.15.18:0/459089928 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20e806cd50 0x7f20e806d160 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:03.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.621+0000 7f20ee02f640 1 -- 172.21.15.18:0/459089928 >> 172.21.15.18:0/459089928 conn(0x7f20e80d1ec0 msgr2=0x7f20e80d4db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:03.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.621+0000 7f20ee02f640 1 -- 172.21.15.18:0/459089928 shutdown_connections 2024-04-17T19:53:03.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.621+0000 7f20ee02f640 1 -- 172.21.15.18:0/459089928 wait complete. 2024-04-17T19:53:03.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.621+0000 7f20ee02f640 1 Processor -- start 2024-04-17T19:53:03.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.621+0000 7f20ee02f640 1 -- start start 2024-04-17T19:53:03.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.625+0000 7f20ee02f640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f20e806cd50 0x7f20e8151870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:03.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.625+0000 7f20ee02f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20e80cf9f0 0x7f20e8158d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:03.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.625+0000 7f20ee02f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20e80d0510 0x7f20e8159250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:03.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.625+0000 7f20ee02f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f20e80b8440 con 0x7f20e80cf9f0 2024-04-17T19:53:03.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.625+0000 7f20ee02f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f20e80b82c0 con 0x7f20e80d0510 2024-04-17T19:53:03.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.625+0000 7f20ee02f640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f20e80b43c0 con 0x7f20e806cd50 2024-04-17T19:53:03.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.625+0000 7f20e6ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20e80cf9f0 0x7f20e8158d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:03.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.625+0000 7f20e6ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20e80cf9f0 0x7f20e8158d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36316/0 (socket says 172.21.15.18:36316) 2024-04-17T19:53:03.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.625+0000 7f20e6ffd640 1 -- 172.21.15.18:0/970069828 learned_addr learned my addr 172.21.15.18:0/970069828 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:03.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.625+0000 7f20e7fff640 1 --2- 172.21.15.18:0/970069828 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20e80d0510 0x7f20e8159250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:03.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.625+0000 7f20e77fe640 1 --2- 172.21.15.18:0/970069828 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f20e806cd50 0x7f20e8151870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:03.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.625+0000 7f20e6ffd640 1 -- 172.21.15.18:0/970069828 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f20e806cd50 msgr2=0x7f20e8151870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:03.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.625+0000 7f20e6ffd640 1 --2- 172.21.15.18:0/970069828 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f20e806cd50 0x7f20e8151870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:03.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.625+0000 7f20e6ffd640 1 -- 172.21.15.18:0/970069828 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20e80d0510 msgr2=0x7f20e8159250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:03.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.625+0000 7f20e6ffd640 1 --2- 172.21.15.18:0/970069828 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20e80d0510 0x7f20e8159250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:03.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.625+0000 7f20e6ffd640 1 -- 172.21.15.18:0/970069828 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20e8151db0 con 0x7f20e80cf9f0 2024-04-17T19:53:03.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.625+0000 7f20e7fff640 1 --2- 172.21.15.18:0/970069828 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20e80d0510 0x7f20e8159250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:53:03.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.625+0000 7f20e6ffd640 1 --2- 172.21.15.18:0/970069828 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20e80cf9f0 0x7f20e8158d10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f20dc00c400 tx=0x7f20dc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:03.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.625+0000 7f20cffff640 1 -- 172.21.15.18:0/970069828 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20dc017070 con 0x7f20e80cf9f0 2024-04-17T19:53:03.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.625+0000 7f20cffff640 1 -- 172.21.15.18:0/970069828 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20dc005cf0 con 0x7f20e80cf9f0 2024-04-17T19:53:03.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.625+0000 7f20cffff640 1 -- 172.21.15.18:0/970069828 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20dc0072d0 con 0x7f20e80cf9f0 2024-04-17T19:53:03.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.625+0000 7f20ee02f640 1 -- 172.21.15.18:0/970069828 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20e8153b50 con 0x7f20e80cf9f0 2024-04-17T19:53:03.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.625+0000 7f20ee02f640 1 -- 172.21.15.18:0/970069828 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20e8154110 con 0x7f20e80cf9f0 2024-04-17T19:53:03.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.625+0000 7f20ee02f640 1 -- 172.21.15.18:0/970069828 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20e80699c0 con 0x7f20e80cf9f0 2024-04-17T19:53:03.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.625+0000 7f20cffff640 1 -- 172.21.15.18:0/970069828 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f20dc007470 con 0x7f20e80cf9f0 2024-04-17T19:53:03.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.625+0000 7f20cffff640 1 --2- 172.21.15.18:0/970069828 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f20d4068380 0x7f20d406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:03.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.629+0000 7f20cffff640 1 -- 172.21.15.18:0/970069828 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5227+0+0 (secure 0 0 0) 0x7f20dc085f20 con 0x7f20e80cf9f0 2024-04-17T19:53:03.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.629+0000 7f20e77fe640 1 --2- 172.21.15.18:0/970069828 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f20d4068380 0x7f20d406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:03.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.629+0000 7f20e77fe640 1 --2- 172.21.15.18:0/970069828 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f20d4068380 0x7f20d406a890 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f20d8007fd0 tx=0x7f20d8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:03.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.633+0000 7f20cffff640 1 -- 172.21.15.18:0/970069828 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f20dc056120 con 0x7f20e80cf9f0 2024-04-17T19:53:03.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:03.797+0000 7f20ee02f640 1 -- 172.21.15.18:0/970069828 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f20e80d31d0 con 0x7f20e80cf9f0 2024-04-17T19:53:04.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.421+0000 7f20cffff640 1 -- 172.21.15.18:0/970069828 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v21) ==== 171+0+0 (secure 0 0 0) 0x7f20dc05a420 con 0x7f20e80cf9f0 2024-04-17T19:53:04.419 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' created 2024-04-17T19:53:04.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.425+0000 7f20ee02f640 1 -- 172.21.15.18:0/970069828 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f20d4068380 msgr2=0x7f20d406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:04.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.425+0000 7f20ee02f640 1 --2- 172.21.15.18:0/970069828 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f20d4068380 0x7f20d406a890 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f20d8007fd0 tx=0x7f20d8009040 comp rx=0 tx=0).stop 2024-04-17T19:53:04.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.425+0000 7f20ee02f640 1 -- 172.21.15.18:0/970069828 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20e80cf9f0 msgr2=0x7f20e8158d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:04.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.425+0000 7f20ee02f640 1 --2- 172.21.15.18:0/970069828 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20e80cf9f0 0x7f20e8158d10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f20dc00c400 tx=0x7f20dc00c8c0 comp rx=0 tx=0).stop 2024-04-17T19:53:04.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.425+0000 7f20ee02f640 1 -- 172.21.15.18:0/970069828 shutdown_connections 2024-04-17T19:53:04.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.425+0000 7f20ee02f640 1 --2- 172.21.15.18:0/970069828 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f20d4068380 0x7f20d406a890 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:04.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.425+0000 7f20ee02f640 1 --2- 172.21.15.18:0/970069828 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20e80d0510 0x7f20e8159250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:04.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.425+0000 7f20ee02f640 1 --2- 172.21.15.18:0/970069828 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20e80cf9f0 0x7f20e8158d10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:04.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.425+0000 7f20ee02f640 1 --2- 172.21.15.18:0/970069828 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f20e806cd50 0x7f20e8151870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:04.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.425+0000 7f20ee02f640 1 -- 172.21.15.18:0/970069828 >> 172.21.15.18:0/970069828 conn(0x7f20e80d1ec0 msgr2=0x7f20e80b57f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:04.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.425+0000 7f20ee02f640 1 -- 172.21.15.18:0/970069828 shutdown_connections 2024-04-17T19:53:04.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.425+0000 7f20ee02f640 1 -- 172.21.15.18:0/970069828 wait complete. 2024-04-17T19:53:04.464 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-17T19:53:04.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.625+0000 7fc86e4cb640 1 Processor -- start 2024-04-17T19:53:04.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.625+0000 7fc86e4cb640 1 -- start start 2024-04-17T19:53:04.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.625+0000 7fc86e4cb640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc86806eee0 0x7fc868070cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:04.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.625+0000 7fc86e4cb640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc868071210 0x7fc8680cdd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:04.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.625+0000 7fc86e4cb640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc8680ce2a0 0x7fc868163030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:04.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.625+0000 7fc86e4cb640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fc868071620 con 0x7fc86806eee0 2024-04-17T19:53:04.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.625+0000 7fc86e4cb640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7fc8680ce6b0 con 0x7fc868071210 2024-04-17T19:53:04.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.625+0000 7fc86e4cb640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fc86806de40 con 0x7fc8680ce2a0 2024-04-17T19:53:04.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.625+0000 7fc867fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc86806eee0 0x7fc868070cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:04.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.625+0000 7fc867fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc86806eee0 0x7fc868070cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44820/0 (socket says 172.21.15.18:44820) 2024-04-17T19:53:04.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.625+0000 7fc867fff640 1 -- 172.21.15.18:0/372442925 learned_addr learned my addr 172.21.15.18:0/372442925 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:04.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.625+0000 7fc8677fe640 1 --2- 172.21.15.18:0/372442925 >> v2:172.21.15.173:3300/0 conn(0x7fc868071210 0x7fc8680cdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:04.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.625+0000 7fc86ca68640 1 --2- 172.21.15.18:0/372442925 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc8680ce2a0 0x7fc868163030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:04.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.625+0000 7fc867fff640 1 -- 172.21.15.18:0/372442925 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc8680ce2a0 msgr2=0x7fc868163030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:04.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.625+0000 7fc867fff640 1 --2- 172.21.15.18:0/372442925 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc8680ce2a0 0x7fc868163030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:04.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.625+0000 7fc867fff640 1 -- 172.21.15.18:0/372442925 >> v2:172.21.15.173:3300/0 conn(0x7fc868071210 msgr2=0x7fc8680cdd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:04.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.625+0000 7fc867fff640 1 --2- 172.21.15.18:0/372442925 >> v2:172.21.15.173:3300/0 conn(0x7fc868071210 0x7fc8680cdd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:04.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.625+0000 7fc867fff640 1 -- 172.21.15.18:0/372442925 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc86806e120 con 0x7fc86806eee0 2024-04-17T19:53:04.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.629+0000 7fc867fff640 1 --2- 172.21.15.18:0/372442925 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc86806eee0 0x7fc868070cd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc868076390 tx=0x7fc85801f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=349a44c8a5cb34b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:04.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.629+0000 7fc866ffd640 1 -- 172.21.15.18:0/372442925 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8580b4070 con 0x7fc86806eee0 2024-04-17T19:53:04.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.629+0000 7fc866ffd640 1 -- 172.21.15.18:0/372442925 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8580af400 con 0x7fc86806eee0 2024-04-17T19:53:04.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.629+0000 7fc866ffd640 1 -- 172.21.15.18:0/372442925 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8580af7d0 con 0x7fc86806eee0 2024-04-17T19:53:04.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.629+0000 7fc86e4cb640 1 -- 172.21.15.18:0/372442925 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc86806eee0 msgr2=0x7fc868070cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:04.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.629+0000 7fc86e4cb640 1 --2- 172.21.15.18:0/372442925 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc86806eee0 0x7fc868070cd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc868076390 tx=0x7fc85801f1e0 comp rx=0 tx=0).stop 2024-04-17T19:53:04.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.629+0000 7fc86e4cb640 1 -- 172.21.15.18:0/372442925 shutdown_connections 2024-04-17T19:53:04.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.629+0000 7fc86e4cb640 1 --2- 172.21.15.18:0/372442925 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc8680ce2a0 0x7fc868163030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:04.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.629+0000 7fc86e4cb640 1 --2- 172.21.15.18:0/372442925 >> v2:172.21.15.173:3300/0 conn(0x7fc868071210 0x7fc8680cdd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:04.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.629+0000 7fc86e4cb640 1 --2- 172.21.15.18:0/372442925 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc86806eee0 0x7fc868070cd0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:04.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.629+0000 7fc86e4cb640 1 -- 172.21.15.18:0/372442925 >> 172.21.15.18:0/372442925 conn(0x7fc8680d2bf0 msgr2=0x7fc8680d3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:04.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.629+0000 7fc86e4cb640 1 -- 172.21.15.18:0/372442925 shutdown_connections 2024-04-17T19:53:04.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.629+0000 7fc86e4cb640 1 -- 172.21.15.18:0/372442925 wait complete. 2024-04-17T19:53:04.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.633+0000 7fc86e4cb640 1 Processor -- start 2024-04-17T19:53:04.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.633+0000 7fc86e4cb640 1 -- start start 2024-04-17T19:53:04.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.633+0000 7fc86e4cb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc86806eee0 0x7fc86815fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:04.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.633+0000 7fc86e4cb640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc868071210 0x7fc86814ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:04.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.633+0000 7fc86e4cb640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc8680ce2a0 0x7fc86814b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:04.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.633+0000 7fc86e4cb640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc86806e9c0 con 0x7fc86806eee0 2024-04-17T19:53:04.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.633+0000 7fc86e4cb640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc86806e6e0 con 0x7fc868071210 2024-04-17T19:53:04.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.633+0000 7fc86e4cb640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fc86815f8f0 con 0x7fc8680ce2a0 2024-04-17T19:53:04.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.633+0000 7fc867fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc86806eee0 0x7fc86815fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:04.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.633+0000 7fc867fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc86806eee0 0x7fc86815fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44836/0 (socket says 172.21.15.18:44836) 2024-04-17T19:53:04.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.633+0000 7fc867fff640 1 -- 172.21.15.18:0/3266357864 learned_addr learned my addr 172.21.15.18:0/3266357864 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:04.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.633+0000 7fc8677fe640 1 --2- 172.21.15.18:0/3266357864 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc868071210 0x7fc86814ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:04.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.633+0000 7fc86ca68640 1 --2- 172.21.15.18:0/3266357864 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc8680ce2a0 0x7fc86814b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:04.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.633+0000 7fc867fff640 1 -- 172.21.15.18:0/3266357864 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc8680ce2a0 msgr2=0x7fc86814b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:04.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.633+0000 7fc867fff640 1 --2- 172.21.15.18:0/3266357864 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc8680ce2a0 0x7fc86814b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:04.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.633+0000 7fc867fff640 1 -- 172.21.15.18:0/3266357864 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc868071210 msgr2=0x7fc86814ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:04.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.633+0000 7fc867fff640 1 --2- 172.21.15.18:0/3266357864 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc868071210 0x7fc86814ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:04.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.633+0000 7fc867fff640 1 -- 172.21.15.18:0/3266357864 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc86814c170 con 0x7fc86806eee0 2024-04-17T19:53:04.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.633+0000 7fc867fff640 1 --2- 172.21.15.18:0/3266357864 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc86806eee0 0x7fc86815fb00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc8580b2040 tx=0x7fc85801bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:04.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.633+0000 7fc864ff9640 1 -- 172.21.15.18:0/3266357864 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8580c0070 con 0x7fc86806eee0 2024-04-17T19:53:04.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.637+0000 7fc864ff9640 1 -- 172.21.15.18:0/3266357864 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8580afe10 con 0x7fc86806eee0 2024-04-17T19:53:04.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.637+0000 7fc864ff9640 1 -- 172.21.15.18:0/3266357864 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8580b4040 con 0x7fc86806eee0 2024-04-17T19:53:04.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.637+0000 7fc86e4cb640 1 -- 172.21.15.18:0/3266357864 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc86814c450 con 0x7fc86806eee0 2024-04-17T19:53:04.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.637+0000 7fc86e4cb640 1 -- 172.21.15.18:0/3266357864 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc86814ca10 con 0x7fc86806eee0 2024-04-17T19:53:04.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.637+0000 7fc86e4cb640 1 -- 172.21.15.18:0/3266357864 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc868069950 con 0x7fc86806eee0 2024-04-17T19:53:04.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.637+0000 7fc864ff9640 1 -- 172.21.15.18:0/3266357864 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc8580c3070 con 0x7fc86806eee0 2024-04-17T19:53:04.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.637+0000 7fc864ff9640 1 --2- 172.21.15.18:0/3266357864 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fc848068380 0x7fc84806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:04.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.637+0000 7fc864ff9640 1 -- 172.21.15.18:0/3266357864 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5609+0+0 (secure 0 0 0) 0x7fc8581240b0 con 0x7fc86806eee0 2024-04-17T19:53:04.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.637+0000 7fc8677fe640 1 --2- 172.21.15.18:0/3266357864 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fc848068380 0x7fc84806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:04.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.637+0000 7fc8677fe640 1 --2- 172.21.15.18:0/3266357864 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fc848068380 0x7fc84806a890 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc8681f9800 tx=0x7fc850008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:04.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.641+0000 7fc864ff9640 1 -- 172.21.15.18:0/3266357864 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc858018d40 con 0x7fc86806eee0 2024-04-17T19:53:04.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:04.845+0000 7fc86e4cb640 1 -- 172.21.15.18:0/3266357864 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fc86815d8a0 con 0x7fc86806eee0 2024-04-17T19:53:05.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.461+0000 7fc864ff9640 1 -- 172.21.15.18:0/3266357864 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fc8580f4640 con 0x7fc86806eee0 2024-04-17T19:53:05.457 INFO:teuthology.orchestra.run.smithi018.stderr:new fs with metadata pool 2 and data pool 3 2024-04-17T19:53:05.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.465+0000 7fc86e4cb640 1 -- 172.21.15.18:0/3266357864 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fc848068380 msgr2=0x7fc84806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:05.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.465+0000 7fc86e4cb640 1 --2- 172.21.15.18:0/3266357864 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fc848068380 0x7fc84806a890 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc8681f9800 tx=0x7fc850008040 comp rx=0 tx=0).stop 2024-04-17T19:53:05.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.465+0000 7fc86e4cb640 1 -- 172.21.15.18:0/3266357864 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc86806eee0 msgr2=0x7fc86815fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:05.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.465+0000 7fc86e4cb640 1 --2- 172.21.15.18:0/3266357864 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc86806eee0 0x7fc86815fb00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc8580b2040 tx=0x7fc85801bf80 comp rx=0 tx=0).stop 2024-04-17T19:53:05.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.465+0000 7fc86e4cb640 1 -- 172.21.15.18:0/3266357864 shutdown_connections 2024-04-17T19:53:05.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.465+0000 7fc86e4cb640 1 --2- 172.21.15.18:0/3266357864 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fc848068380 0x7fc84806a890 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:05.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.465+0000 7fc86e4cb640 1 --2- 172.21.15.18:0/3266357864 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc8680ce2a0 0x7fc86814b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:05.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.465+0000 7fc86e4cb640 1 --2- 172.21.15.18:0/3266357864 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc868071210 0x7fc86814ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:05.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.465+0000 7fc86e4cb640 1 --2- 172.21.15.18:0/3266357864 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc86806eee0 0x7fc86815fb00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:05.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.465+0000 7fc86e4cb640 1 -- 172.21.15.18:0/3266357864 >> 172.21.15.18:0/3266357864 conn(0x7fc8680d2bf0 msgr2=0x7fc8680d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:05.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.465+0000 7fc86e4cb640 1 -- 172.21.15.18:0/3266357864 shutdown_connections 2024-04-17T19:53:05.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.465+0000 7fc86e4cb640 1 -- 172.21.15.18:0/3266357864 wait complete. 2024-04-17T19:53:05.495 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-04-17T19:53:05.495 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-04-17T19:53:05.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.653+0000 7f9dd656a640 1 Processor -- start 2024-04-17T19:53:05.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.653+0000 7f9dd656a640 1 -- start start 2024-04-17T19:53:05.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.653+0000 7f9dd656a640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9dd015e1a0 0x7f9dd00ce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:05.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.653+0000 7f9dd656a640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f9dd00cef10 0x7f9dd015e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:05.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.653+0000 7f9dd656a640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9dd015ee50 0x7f9dd006cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:05.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.653+0000 7f9dd656a640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f9dd00d0020 con 0x7f9dd015e1a0 2024-04-17T19:53:05.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.653+0000 7f9dd656a640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f9dd00cd930 con 0x7f9dd00cef10 2024-04-17T19:53:05.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.653+0000 7f9dd656a640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f9dd00cdc10 con 0x7f9dd015ee50 2024-04-17T19:53:05.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.653+0000 7f9dcffff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9dd015e1a0 0x7f9dd00ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:05.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.653+0000 7f9dcffff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9dd015e1a0 0x7f9dd00ce9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44840/0 (socket says 172.21.15.18:44840) 2024-04-17T19:53:05.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.653+0000 7f9dcffff640 1 -- 172.21.15.18:0/4120622026 learned_addr learned my addr 172.21.15.18:0/4120622026 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:05.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.653+0000 7f9dc7fff640 1 --2- 172.21.15.18:0/4120622026 >> v2:172.21.15.173:3300/0 conn(0x7f9dd00cef10 0x7f9dd015e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:05.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.653+0000 7f9dd4b07640 1 --2- 172.21.15.18:0/4120622026 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9dd015ee50 0x7f9dd006cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:05.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.653+0000 7f9dcffff640 1 -- 172.21.15.18:0/4120622026 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9dd015ee50 msgr2=0x7f9dd006cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:05.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.653+0000 7f9dcffff640 1 --2- 172.21.15.18:0/4120622026 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9dd015ee50 0x7f9dd006cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:05.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.653+0000 7f9dcffff640 1 -- 172.21.15.18:0/4120622026 >> v2:172.21.15.173:3300/0 conn(0x7f9dd00cef10 msgr2=0x7f9dd015e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:05.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.653+0000 7f9dcffff640 1 --2- 172.21.15.18:0/4120622026 >> v2:172.21.15.173:3300/0 conn(0x7f9dd00cef10 0x7f9dd015e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:05.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.653+0000 7f9dcffff640 1 -- 172.21.15.18:0/4120622026 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dd00cdef0 con 0x7f9dd015e1a0 2024-04-17T19:53:05.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.657+0000 7f9dcffff640 1 --2- 172.21.15.18:0/4120622026 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9dd015e1a0 0x7f9dd00ce9d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9dd00b6110 tx=0x7f9dc001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53741d580a95dfa3 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:05.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.657+0000 7f9dcf7fe640 1 -- 172.21.15.18:0/4120622026 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc00b0070 con 0x7f9dd015e1a0 2024-04-17T19:53:05.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.657+0000 7f9dcf7fe640 1 -- 172.21.15.18:0/4120622026 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dc00ab600 con 0x7f9dd015e1a0 2024-04-17T19:53:05.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.657+0000 7f9dcf7fe640 1 -- 172.21.15.18:0/4120622026 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc00ab9d0 con 0x7f9dd015e1a0 2024-04-17T19:53:05.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.657+0000 7f9dd656a640 1 -- 172.21.15.18:0/4120622026 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9dd015e1a0 msgr2=0x7f9dd00ce9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:05.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.657+0000 7f9dd656a640 1 --2- 172.21.15.18:0/4120622026 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9dd015e1a0 0x7f9dd00ce9d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9dd00b6110 tx=0x7f9dc001c490 comp rx=0 tx=0).stop 2024-04-17T19:53:05.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.657+0000 7f9dd656a640 1 -- 172.21.15.18:0/4120622026 shutdown_connections 2024-04-17T19:53:05.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.657+0000 7f9dd656a640 1 --2- 172.21.15.18:0/4120622026 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9dd015ee50 0x7f9dd006cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:05.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.657+0000 7f9dd656a640 1 --2- 172.21.15.18:0/4120622026 >> v2:172.21.15.173:3300/0 conn(0x7f9dd00cef10 0x7f9dd015e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:05.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.657+0000 7f9dd656a640 1 --2- 172.21.15.18:0/4120622026 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9dd015e1a0 0x7f9dd00ce9d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:05.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.657+0000 7f9dd656a640 1 -- 172.21.15.18:0/4120622026 >> 172.21.15.18:0/4120622026 conn(0x7f9dd0072bb0 msgr2=0x7f9dd0072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:05.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.657+0000 7f9dd656a640 1 -- 172.21.15.18:0/4120622026 shutdown_connections 2024-04-17T19:53:05.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.657+0000 7f9dd656a640 1 -- 172.21.15.18:0/4120622026 wait complete. 2024-04-17T19:53:05.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.661+0000 7f9dd656a640 1 Processor -- start 2024-04-17T19:53:05.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.661+0000 7f9dd656a640 1 -- start start 2024-04-17T19:53:05.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.661+0000 7f9dd656a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9dd00cef10 0x7f9dd014e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:05.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.661+0000 7f9dd656a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9dd015ee50 0x7f9dd01527f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:05.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.661+0000 7f9dd656a640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9dd014c760 0x7f9dd00ae3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:05.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.661+0000 7f9dd656a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd0157b90 con 0x7f9dd00cef10 2024-04-17T19:53:05.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.661+0000 7f9dd656a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd0157a10 con 0x7f9dd015ee50 2024-04-17T19:53:05.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.661+0000 7f9dd656a640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f9dd006f0f0 con 0x7f9dd014c760 2024-04-17T19:53:05.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.661+0000 7f9dcffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9dd00cef10 0x7f9dd014e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:05.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.661+0000 7f9dcffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9dd00cef10 0x7f9dd014e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44854/0 (socket says 172.21.15.18:44854) 2024-04-17T19:53:05.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.661+0000 7f9dcffff640 1 -- 172.21.15.18:0/666671985 learned_addr learned my addr 172.21.15.18:0/666671985 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:05.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.661+0000 7f9dc7fff640 1 --2- 172.21.15.18:0/666671985 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9dd015ee50 0x7f9dd01527f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:05.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.661+0000 7f9dd4b07640 1 --2- 172.21.15.18:0/666671985 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9dd014c760 0x7f9dd00ae3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:05.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.661+0000 7f9dcffff640 1 -- 172.21.15.18:0/666671985 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9dd014c760 msgr2=0x7f9dd00ae3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:05.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.661+0000 7f9dcffff640 1 --2- 172.21.15.18:0/666671985 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9dd014c760 0x7f9dd00ae3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:05.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.661+0000 7f9dcffff640 1 -- 172.21.15.18:0/666671985 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9dd015ee50 msgr2=0x7f9dd01527f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:05.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.661+0000 7f9dcffff640 1 --2- 172.21.15.18:0/666671985 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9dd015ee50 0x7f9dd01527f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:05.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.661+0000 7f9dcffff640 1 -- 172.21.15.18:0/666671985 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dd0151ff0 con 0x7f9dd00cef10 2024-04-17T19:53:05.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.661+0000 7f9dcffff640 1 --2- 172.21.15.18:0/666671985 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9dd00cef10 0x7f9dd014e370 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9dc00ae040 tx=0x7f9dc0019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:05.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.661+0000 7f9dcd7fa640 1 -- 172.21.15.18:0/666671985 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc00b0040 con 0x7f9dd00cef10 2024-04-17T19:53:05.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.661+0000 7f9dcd7fa640 1 -- 172.21.15.18:0/666671985 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dc00b9070 con 0x7f9dd00cef10 2024-04-17T19:53:05.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.661+0000 7f9dd656a640 1 -- 172.21.15.18:0/666671985 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dd014eff0 con 0x7f9dd00cef10 2024-04-17T19:53:05.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.661+0000 7f9dcd7fa640 1 -- 172.21.15.18:0/666671985 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc00b4680 con 0x7f9dd00cef10 2024-04-17T19:53:05.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.665+0000 7f9dd656a640 1 -- 172.21.15.18:0/666671985 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dd014f2d0 con 0x7f9dd00cef10 2024-04-17T19:53:05.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.665+0000 7f9dd656a640 1 -- 172.21.15.18:0/666671985 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dd0069950 con 0x7f9dd00cef10 2024-04-17T19:53:05.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.665+0000 7f9dcd7fa640 1 -- 172.21.15.18:0/666671985 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9dc00b4820 con 0x7f9dd00cef10 2024-04-17T19:53:05.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.665+0000 7f9dcd7fa640 1 --2- 172.21.15.18:0/666671985 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f9db0068380 0x7f9db006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:05.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.665+0000 7f9dcd7fa640 1 -- 172.21.15.18:0/666671985 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f9dc01206e0 con 0x7f9dd00cef10 2024-04-17T19:53:05.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.665+0000 7f9dc7fff640 1 --2- 172.21.15.18:0/666671985 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f9db0068380 0x7f9db006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:05.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.665+0000 7f9dc7fff640 1 --2- 172.21.15.18:0/666671985 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f9db0068380 0x7f9db006a890 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9dd00afb80 tx=0x7f9db8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:05.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.669+0000 7f9dcd7fa640 1 -- 172.21.15.18:0/666671985 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9dc0016110 con 0x7f9dd00cef10 2024-04-17T19:53:05.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:05.841+0000 7f9dd656a640 1 -- 172.21.15.18:0/666671985 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f9dd0157f20 con 0x7f9dd00cef10 2024-04-17T19:53:06.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.453+0000 7f9dcd7fa640 1 -- 172.21.15.18:0/666671985 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v23) ==== 157+0+0 (secure 0 0 0) 0x7f9dc00f0c90 con 0x7f9dd00cef10 2024-04-17T19:53:06.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.457+0000 7f9dd656a640 1 -- 172.21.15.18:0/666671985 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f9db0068380 msgr2=0x7f9db006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:06.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.457+0000 7f9dd656a640 1 --2- 172.21.15.18:0/666671985 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f9db0068380 0x7f9db006a890 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9dd00afb80 tx=0x7f9db8008040 comp rx=0 tx=0).stop 2024-04-17T19:53:06.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.457+0000 7f9dd656a640 1 -- 172.21.15.18:0/666671985 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9dd00cef10 msgr2=0x7f9dd014e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:06.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.457+0000 7f9dd656a640 1 --2- 172.21.15.18:0/666671985 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9dd00cef10 0x7f9dd014e370 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9dc00ae040 tx=0x7f9dc0019230 comp rx=0 tx=0).stop 2024-04-17T19:53:06.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.457+0000 7f9dd656a640 1 -- 172.21.15.18:0/666671985 shutdown_connections 2024-04-17T19:53:06.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.457+0000 7f9dd656a640 1 --2- 172.21.15.18:0/666671985 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f9db0068380 0x7f9db006a890 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:06.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.457+0000 7f9dd656a640 1 --2- 172.21.15.18:0/666671985 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9dd014c760 0x7f9dd00ae3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:06.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.457+0000 7f9dd656a640 1 --2- 172.21.15.18:0/666671985 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9dd015ee50 0x7f9dd01527f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:06.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.457+0000 7f9dd656a640 1 --2- 172.21.15.18:0/666671985 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9dd00cef10 0x7f9dd014e370 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:06.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.457+0000 7f9dd656a640 1 -- 172.21.15.18:0/666671985 >> 172.21.15.18:0/666671985 conn(0x7f9dd0072bb0 msgr2=0x7f9dd0150680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:06.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.457+0000 7f9dd656a640 1 -- 172.21.15.18:0/666671985 shutdown_connections 2024-04-17T19:53:06.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.457+0000 7f9dd656a640 1 -- 172.21.15.18:0/666671985 wait complete. 2024-04-17T19:53:06.475 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-04-17T19:53:06.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.641+0000 7fce21581640 1 Processor -- start 2024-04-17T19:53:06.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.641+0000 7fce21581640 1 -- start start 2024-04-17T19:53:06.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.641+0000 7fce21581640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fce1c0cdce0 0x7fce1c0ce0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:06.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.641+0000 7fce21581640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fce1c072ff0 0x7fce1c073400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:06.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.641+0000 7fce21581640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce1c0ce630 con 0x7fce1c073940 2024-04-17T19:53:06.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.641+0000 7fce21581640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fce1c160e50 con 0x7fce1c0cdce0 2024-04-17T19:53:06.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.641+0000 7fce21581640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fce1c1610f0 con 0x7fce1c072ff0 2024-04-17T19:53:06.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.641+0000 7fce1affd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fce1c0cdce0 0x7fce1c0ce0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:06.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.641+0000 7fce1affd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fce1c0cdce0 0x7fce1c0ce0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44868/0 (socket says 172.21.15.18:44868) 2024-04-17T19:53:06.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.641+0000 7fce1affd640 1 -- 172.21.15.18:0/4200777066 learned_addr learned my addr 172.21.15.18:0/4200777066 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:06.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.641+0000 7fce1a7fc640 1 --2- 172.21.15.18:0/4200777066 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fce1c072ff0 0x7fce1c073400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:06.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.641+0000 7fce1affd640 1 -- 172.21.15.18:0/4200777066 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fce1c072ff0 msgr2=0x7fce1c073400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:06.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.641+0000 7fce1affd640 1 --2- 172.21.15.18:0/4200777066 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fce1c072ff0 0x7fce1c073400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:06.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.641+0000 7fce1affd640 1 -- 172.21.15.18:0/4200777066 >> v1:172.21.15.18:6789/0 conn(0x7fce1c073940 legacy=0x7fce1c0cf940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:06.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.641+0000 7fce1affd640 1 -- 172.21.15.18:0/4200777066 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce1c1613d0 con 0x7fce1c0cdce0 2024-04-17T19:53:06.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.641+0000 7fce19ffb640 1 -- 172.21.15.18:0/4200777066 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 607070966 0 0) 0x7fce14001120 con 0x7fce1c073940 2024-04-17T19:53:06.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.645+0000 7fce1affd640 1 --2- 172.21.15.18:0/4200777066 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce1c0cdce0 0x7fce1c0ce0f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fce0c009e50 tx=0x7fce0c01ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44af2394f9d6d51f server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:06.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.645+0000 7fce19ffb640 1 -- 172.21.15.18:0/4200777066 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce0c0a58d0 con 0x7fce1c0cdce0 2024-04-17T19:53:06.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.645+0000 7fce19ffb640 1 -- 172.21.15.18:0/4200777066 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce0c0a5a70 con 0x7fce1c0cdce0 2024-04-17T19:53:06.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.645+0000 7fce19ffb640 1 -- 172.21.15.18:0/4200777066 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce0c0a5e40 con 0x7fce1c0cdce0 2024-04-17T19:53:06.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.645+0000 7fce21581640 1 -- 172.21.15.18:0/4200777066 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce1c0cdce0 msgr2=0x7fce1c0ce0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:06.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.645+0000 7fce21581640 1 --2- 172.21.15.18:0/4200777066 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce1c0cdce0 0x7fce1c0ce0f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fce0c009e50 tx=0x7fce0c01ca00 comp rx=0 tx=0).stop 2024-04-17T19:53:06.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.645+0000 7fce21581640 1 -- 172.21.15.18:0/4200777066 shutdown_connections 2024-04-17T19:53:06.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.645+0000 7fce21581640 1 --2- 172.21.15.18:0/4200777066 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fce1c072ff0 0x7fce1c073400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:06.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.645+0000 7fce21581640 1 --2- 172.21.15.18:0/4200777066 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce1c0cdce0 0x7fce1c0ce0f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:06.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.645+0000 7fce21581640 1 -- 172.21.15.18:0/4200777066 >> 172.21.15.18:0/4200777066 conn(0x7fce1c0b3b60 msgr2=0x7fce1c0d1330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:06.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.645+0000 7fce21581640 1 -- 172.21.15.18:0/4200777066 shutdown_connections 2024-04-17T19:53:06.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.645+0000 7fce21581640 1 -- 172.21.15.18:0/4200777066 wait complete. 2024-04-17T19:53:06.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.649+0000 7fce21581640 1 Processor -- start 2024-04-17T19:53:06.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.649+0000 7fce21581640 1 -- start start 2024-04-17T19:53:06.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.649+0000 7fce21581640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fce1c072ff0 0x7fce1c144df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:06.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.649+0000 7fce21581640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce1c073940 0x7fce1c147d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:06.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.649+0000 7fce21581640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce1c0cdce0 0x7fce1c1482d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:06.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.649+0000 7fce21581640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fce1c157c60 con 0x7fce1c0cdce0 2024-04-17T19:53:06.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.649+0000 7fce21581640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fce1c073d50 con 0x7fce1c073940 2024-04-17T19:53:06.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.649+0000 7fce21581640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fce1c15e700 con 0x7fce1c072ff0 2024-04-17T19:53:06.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.649+0000 7fce1b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce1c0cdce0 0x7fce1c1482d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:06.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.649+0000 7fce1b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce1c0cdce0 0x7fce1c1482d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44880/0 (socket says 172.21.15.18:44880) 2024-04-17T19:53:06.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.649+0000 7fce1b7fe640 1 -- 172.21.15.18:0/815171442 learned_addr learned my addr 172.21.15.18:0/815171442 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:06.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.649+0000 7fce1affd640 1 --2- 172.21.15.18:0/815171442 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fce1c072ff0 0x7fce1c144df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:06.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.649+0000 7fce1a7fc640 1 --2- 172.21.15.18:0/815171442 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce1c073940 0x7fce1c147d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:06.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.649+0000 7fce1b7fe640 1 -- 172.21.15.18:0/815171442 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fce1c072ff0 msgr2=0x7fce1c144df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:06.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.649+0000 7fce1b7fe640 1 --2- 172.21.15.18:0/815171442 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fce1c072ff0 0x7fce1c144df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:06.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.649+0000 7fce1b7fe640 1 -- 172.21.15.18:0/815171442 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce1c073940 msgr2=0x7fce1c147d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:06.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.649+0000 7fce1b7fe640 1 --2- 172.21.15.18:0/815171442 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce1c073940 0x7fce1c147d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:06.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.649+0000 7fce1b7fe640 1 -- 172.21.15.18:0/815171442 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce1c145400 con 0x7fce1c0cdce0 2024-04-17T19:53:06.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.649+0000 7fce1b7fe640 1 --2- 172.21.15.18:0/815171442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce1c0cdce0 0x7fce1c1482d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fce1400c410 tx=0x7fce1400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:06.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.649+0000 7fce037fe640 1 -- 172.21.15.18:0/815171442 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce14017070 con 0x7fce1c0cdce0 2024-04-17T19:53:06.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.649+0000 7fce037fe640 1 -- 172.21.15.18:0/815171442 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce14003600 con 0x7fce1c0cdce0 2024-04-17T19:53:06.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.649+0000 7fce21581640 1 -- 172.21.15.18:0/815171442 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce1c14a950 con 0x7fce1c0cdce0 2024-04-17T19:53:06.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.649+0000 7fce037fe640 1 -- 172.21.15.18:0/815171442 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce140039f0 con 0x7fce1c0cdce0 2024-04-17T19:53:06.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.649+0000 7fce21581640 1 -- 172.21.15.18:0/815171442 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce1c0b2750 con 0x7fce1c0cdce0 2024-04-17T19:53:06.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.649+0000 7fce21581640 1 -- 172.21.15.18:0/815171442 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce1c069a60 con 0x7fce1c0cdce0 2024-04-17T19:53:06.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.653+0000 7fce037fe640 1 -- 172.21.15.18:0/815171442 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fce1401a070 con 0x7fce1c0cdce0 2024-04-17T19:53:06.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.653+0000 7fce037fe640 1 --2- 172.21.15.18:0/815171442 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fce08068380 0x7fce0806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:06.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.653+0000 7fce037fe640 1 -- 172.21.15.18:0/815171442 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6007+0+0 (secure 0 0 0) 0x7fce14086120 con 0x7fce1c0cdce0 2024-04-17T19:53:06.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.653+0000 7fce1affd640 1 --2- 172.21.15.18:0/815171442 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fce08068380 0x7fce0806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:06.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.653+0000 7fce1affd640 1 --2- 172.21.15.18:0/815171442 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fce08068380 0x7fce0806a890 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fce0c0ae000 tx=0x7fce0c0a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:06.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.657+0000 7fce037fe640 1 -- 172.21.15.18:0/815171442 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fce14021020 con 0x7fce1c0cdce0 2024-04-17T19:53:06.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:06.817+0000 7fce21581640 1 -- 172.21.15.18:0/815171442 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fce1c0cf4e0 con 0x7fce1c0cdce0 2024-04-17T19:53:07.936 INFO:tasks.ceph.mds.a.smithi018.stderr:2024-04-17T19:53:07.941+0000 7f1ddf4ac640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-17T19:53:08.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.469+0000 7fce037fe640 1 -- 172.21.15.18:0/815171442 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v25) ==== 228+0+0 (secure 0 0 0) 0x7fce1c0ce630 con 0x7fce1c0cdce0 2024-04-17T19:53:08.465 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data_ec' created 2024-04-17T19:53:08.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.473+0000 7fce21581640 1 -- 172.21.15.18:0/815171442 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fce08068380 msgr2=0x7fce0806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:08.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.473+0000 7fce21581640 1 --2- 172.21.15.18:0/815171442 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fce08068380 0x7fce0806a890 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fce0c0ae000 tx=0x7fce0c0a7070 comp rx=0 tx=0).stop 2024-04-17T19:53:08.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.473+0000 7fce21581640 1 -- 172.21.15.18:0/815171442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce1c0cdce0 msgr2=0x7fce1c1482d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:08.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.473+0000 7fce21581640 1 --2- 172.21.15.18:0/815171442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce1c0cdce0 0x7fce1c1482d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fce1400c410 tx=0x7fce1400c810 comp rx=0 tx=0).stop 2024-04-17T19:53:08.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.473+0000 7fce21581640 1 -- 172.21.15.18:0/815171442 shutdown_connections 2024-04-17T19:53:08.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.473+0000 7fce21581640 1 --2- 172.21.15.18:0/815171442 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fce08068380 0x7fce0806a890 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:08.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.473+0000 7fce21581640 1 --2- 172.21.15.18:0/815171442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce1c0cdce0 0x7fce1c1482d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:08.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.473+0000 7fce21581640 1 --2- 172.21.15.18:0/815171442 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce1c073940 0x7fce1c147d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:08.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.473+0000 7fce21581640 1 --2- 172.21.15.18:0/815171442 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fce1c072ff0 0x7fce1c144df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:08.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.473+0000 7fce21581640 1 -- 172.21.15.18:0/815171442 >> 172.21.15.18:0/815171442 conn(0x7fce1c0b3b60 msgr2=0x7fce1c14fba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:08.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.473+0000 7fce21581640 1 -- 172.21.15.18:0/815171442 shutdown_connections 2024-04-17T19:53:08.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.473+0000 7fce21581640 1 -- 172.21.15.18:0/815171442 wait complete. 2024-04-17T19:53:08.500 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-04-17T19:53:08.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.665+0000 7f74b0214640 1 Processor -- start 2024-04-17T19:53:08.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.665+0000 7f74b0214640 1 -- start start 2024-04-17T19:53:08.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.665+0000 7f74b0214640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f74a80d24a0 0x7f74a815d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:08.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.665+0000 7f74b0214640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f74a80b6850 0x7f74a80b6c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:08.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.665+0000 7f74b0214640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f74a80cf6c0 0x7f74a80cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:08.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.665+0000 7f74b0214640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f74a80b71a0 con 0x7f74a80cf6c0 2024-04-17T19:53:08.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.665+0000 7f74b0214640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f74a806e9a0 con 0x7f74a80d24a0 2024-04-17T19:53:08.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.665+0000 7f74b0214640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f74a806ec80 con 0x7f74a80b6850 2024-04-17T19:53:08.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.665+0000 7f74ae7b1640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f74a80cf6c0 0x7f74a80cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:08.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.665+0000 7f74ae7b1640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f74a80cf6c0 0x7f74a80cfad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44882/0 (socket says 172.21.15.18:44882) 2024-04-17T19:53:08.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.665+0000 7f74ae7b1640 1 -- 172.21.15.18:0/4097646923 learned_addr learned my addr 172.21.15.18:0/4097646923 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:08.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.665+0000 7f74adfb0640 1 --2- 172.21.15.18:0/4097646923 >> v2:172.21.15.173:3300/0 conn(0x7f74a80d24a0 0x7f74a815d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:08.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.665+0000 7f74ad7af640 1 --2- 172.21.15.18:0/4097646923 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f74a80b6850 0x7f74a80b6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:08.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.665+0000 7f74ae7b1640 1 -- 172.21.15.18:0/4097646923 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f74a80b6850 msgr2=0x7f74a80b6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:08.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.665+0000 7f74ae7b1640 1 --2- 172.21.15.18:0/4097646923 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f74a80b6850 0x7f74a80b6c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:08.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.665+0000 7f74ae7b1640 1 -- 172.21.15.18:0/4097646923 >> v2:172.21.15.173:3300/0 conn(0x7f74a80d24a0 msgr2=0x7f74a815d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:08.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.665+0000 7f74ae7b1640 1 --2- 172.21.15.18:0/4097646923 >> v2:172.21.15.173:3300/0 conn(0x7f74a80d24a0 0x7f74a815d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:08.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.665+0000 7f74ae7b1640 1 -- 172.21.15.18:0/4097646923 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74a80d19c0 con 0x7f74a80cf6c0 2024-04-17T19:53:08.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.669+0000 7f74ae7b1640 1 --2- 172.21.15.18:0/4097646923 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74a80cf6c0 0x7f74a80cfad0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f74a8072380 tx=0x7f74a001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b9553c003062581 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:08.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.669+0000 7f74acfae640 1 -- 172.21.15.18:0/4097646923 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a00a5670 con 0x7f74a80cf6c0 2024-04-17T19:53:08.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.669+0000 7f74acfae640 1 -- 172.21.15.18:0/4097646923 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74a00a5810 con 0x7f74a80cf6c0 2024-04-17T19:53:08.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.669+0000 7f74acfae640 1 -- 172.21.15.18:0/4097646923 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a00a5be0 con 0x7f74a80cf6c0 2024-04-17T19:53:08.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.669+0000 7f74b0214640 1 -- 172.21.15.18:0/4097646923 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74a80cf6c0 msgr2=0x7f74a80cfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:08.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.669+0000 7f74b0214640 1 --2- 172.21.15.18:0/4097646923 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74a80cf6c0 0x7f74a80cfad0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f74a8072380 tx=0x7f74a001c9f0 comp rx=0 tx=0).stop 2024-04-17T19:53:08.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.669+0000 7f74b0214640 1 -- 172.21.15.18:0/4097646923 shutdown_connections 2024-04-17T19:53:08.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.669+0000 7f74b0214640 1 --2- 172.21.15.18:0/4097646923 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74a80cf6c0 0x7f74a80cfad0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:08.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.669+0000 7f74b0214640 1 --2- 172.21.15.18:0/4097646923 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f74a80b6850 0x7f74a80b6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:08.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.669+0000 7f74b0214640 1 --2- 172.21.15.18:0/4097646923 >> v2:172.21.15.173:3300/0 conn(0x7f74a80d24a0 0x7f74a815d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:08.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.669+0000 7f74b0214640 1 -- 172.21.15.18:0/4097646923 >> 172.21.15.18:0/4097646923 conn(0x7f74a809aa70 msgr2=0x7f74a809ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:08.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.669+0000 7f74b0214640 1 -- 172.21.15.18:0/4097646923 shutdown_connections 2024-04-17T19:53:08.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.669+0000 7f74b0214640 1 -- 172.21.15.18:0/4097646923 wait complete. 2024-04-17T19:53:08.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.673+0000 7f74b0214640 1 Processor -- start 2024-04-17T19:53:08.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.673+0000 7f74b0214640 1 -- start start 2024-04-17T19:53:08.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.673+0000 7f74b0214640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f74a80b6850 0x7f74a80ca710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:08.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.673+0000 7f74b0214640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74a80cf6c0 0x7f74a81fb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:08.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.673+0000 7f74b0214640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f74a80d24a0 0x7f74a8165180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:08.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.673+0000 7f74b0214640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f74a806ef60 con 0x7f74a80cf6c0 2024-04-17T19:53:08.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.673+0000 7f74b0214640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f74a815c4e0 con 0x7f74a80b6850 2024-04-17T19:53:08.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.673+0000 7f74b0214640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f74a806df00 con 0x7f74a80d24a0 2024-04-17T19:53:08.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.673+0000 7f74ad7af640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74a80cf6c0 0x7f74a81fb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:08.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.673+0000 7f74ad7af640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74a80cf6c0 0x7f74a81fb700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44894/0 (socket says 172.21.15.18:44894) 2024-04-17T19:53:08.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.673+0000 7f74ad7af640 1 -- 172.21.15.18:0/3017679143 learned_addr learned my addr 172.21.15.18:0/3017679143 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:08.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.673+0000 7f74adfb0640 1 --2- 172.21.15.18:0/3017679143 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f74a80b6850 0x7f74a80ca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:08.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.673+0000 7f74ae7b1640 1 --2- 172.21.15.18:0/3017679143 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f74a80d24a0 0x7f74a8165180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:08.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.673+0000 7f74ad7af640 1 -- 172.21.15.18:0/3017679143 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f74a80d24a0 msgr2=0x7f74a8165180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:08.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.673+0000 7f74ad7af640 1 --2- 172.21.15.18:0/3017679143 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f74a80d24a0 0x7f74a8165180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:08.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.673+0000 7f74ad7af640 1 -- 172.21.15.18:0/3017679143 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f74a80b6850 msgr2=0x7f74a80ca710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:08.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.673+0000 7f74ad7af640 1 --2- 172.21.15.18:0/3017679143 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f74a80b6850 0x7f74a80ca710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:08.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.673+0000 7f74ad7af640 1 -- 172.21.15.18:0/3017679143 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74a80c8cf0 con 0x7f74a80cf6c0 2024-04-17T19:53:08.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.673+0000 7f74ae7b1640 1 --2- 172.21.15.18:0/3017679143 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f74a80d24a0 0x7f74a8165180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:53:08.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.673+0000 7f74ad7af640 1 --2- 172.21.15.18:0/3017679143 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74a80cf6c0 0x7f74a81fb700 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f749800d830 tx=0x7f749800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:08.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.673+0000 7f749e7fc640 1 -- 172.21.15.18:0/3017679143 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7498018030 con 0x7f74a80cf6c0 2024-04-17T19:53:08.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.673+0000 7f749e7fc640 1 -- 172.21.15.18:0/3017679143 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f749800be10 con 0x7f74a80cf6c0 2024-04-17T19:53:08.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.673+0000 7f74b0214640 1 -- 172.21.15.18:0/3017679143 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74a80c8fd0 con 0x7f74a80cf6c0 2024-04-17T19:53:08.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.673+0000 7f749e7fc640 1 -- 172.21.15.18:0/3017679143 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74980098b0 con 0x7f74a80cf6c0 2024-04-17T19:53:08.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.673+0000 7f74b0214640 1 -- 172.21.15.18:0/3017679143 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74a80c9590 con 0x7f74a80cf6c0 2024-04-17T19:53:08.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.673+0000 7f74b0214640 1 -- 172.21.15.18:0/3017679143 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74a8069950 con 0x7f74a80cf6c0 2024-04-17T19:53:08.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.677+0000 7f749e7fc640 1 -- 172.21.15.18:0/3017679143 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f749801b070 con 0x7f74a80cf6c0 2024-04-17T19:53:08.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.677+0000 7f749e7fc640 1 --2- 172.21.15.18:0/3017679143 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f748c068380 0x7f748c06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:08.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.677+0000 7f749e7fc640 1 -- 172.21.15.18:0/3017679143 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6500+0+0 (secure 0 0 0) 0x7f7498086e00 con 0x7f74a80cf6c0 2024-04-17T19:53:08.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.677+0000 7f74adfb0640 1 --2- 172.21.15.18:0/3017679143 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f748c068380 0x7f748c06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:08.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.677+0000 7f74adfb0640 1 --2- 172.21.15.18:0/3017679143 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f748c068380 0x7f748c06a890 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f74a8072b50 tx=0x7f74a4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:08.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.681+0000 7f749e7fc640 1 -- 172.21.15.18:0/3017679143 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7498057130 con 0x7f74a80cf6c0 2024-04-17T19:53:08.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:08.845+0000 7f74b0214640 1 -- 172.21.15.18:0/3017679143 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f74a80b41e0 con 0x7f74a80cf6c0 2024-04-17T19:53:09.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.481+0000 7f749e7fc640 1 -- 172.21.15.18:0/3017679143 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v26) ==== 169+0+0 (secure 0 0 0) 0x7f7498056a30 con 0x7f74a80cf6c0 2024-04-17T19:53:09.476 INFO:teuthology.orchestra.run.smithi018.stderr:set pool 4 allow_ec_overwrites to true 2024-04-17T19:53:09.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.485+0000 7f74b0214640 1 -- 172.21.15.18:0/3017679143 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f748c068380 msgr2=0x7f748c06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:09.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.485+0000 7f74b0214640 1 --2- 172.21.15.18:0/3017679143 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f748c068380 0x7f748c06a890 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f74a8072b50 tx=0x7f74a4008040 comp rx=0 tx=0).stop 2024-04-17T19:53:09.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.485+0000 7f74b0214640 1 -- 172.21.15.18:0/3017679143 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74a80cf6c0 msgr2=0x7f74a81fb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:09.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.485+0000 7f74b0214640 1 --2- 172.21.15.18:0/3017679143 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74a80cf6c0 0x7f74a81fb700 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f749800d830 tx=0x7f749800dcf0 comp rx=0 tx=0).stop 2024-04-17T19:53:09.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.485+0000 7f74b0214640 1 -- 172.21.15.18:0/3017679143 shutdown_connections 2024-04-17T19:53:09.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.485+0000 7f74b0214640 1 --2- 172.21.15.18:0/3017679143 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f748c068380 0x7f748c06a890 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:09.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.485+0000 7f74b0214640 1 --2- 172.21.15.18:0/3017679143 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f74a80d24a0 0x7f74a8165180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:09.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.485+0000 7f74b0214640 1 --2- 172.21.15.18:0/3017679143 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74a80cf6c0 0x7f74a81fb700 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:09.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.485+0000 7f74b0214640 1 --2- 172.21.15.18:0/3017679143 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f74a80b6850 0x7f74a80ca710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:09.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.485+0000 7f74b0214640 1 -- 172.21.15.18:0/3017679143 >> 172.21.15.18:0/3017679143 conn(0x7f74a809aa70 msgr2=0x7f74a806c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:09.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.485+0000 7f74b0214640 1 -- 172.21.15.18:0/3017679143 shutdown_connections 2024-04-17T19:53:09.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.485+0000 7f74b0214640 1 -- 172.21.15.18:0/3017679143 wait complete. 2024-04-17T19:53:09.516 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-04-17T19:53:09.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.681+0000 7f33d7bb2640 1 Processor -- start 2024-04-17T19:53:09.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.681+0000 7f33d7bb2640 1 -- start start 2024-04-17T19:53:09.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.681+0000 7f33d7bb2640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f33d00d26e0 0x7f33d00b2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:09.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.681+0000 7f33d7bb2640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33d00d1920 con 0x7f33d00b7080 2024-04-17T19:53:09.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.681+0000 7f33d7bb2640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33d00d1c00 con 0x7f33d00ce160 2024-04-17T19:53:09.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.681+0000 7f33d7bb2640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f33d00b3500 con 0x7f33d00d26e0 2024-04-17T19:53:09.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.681+0000 7f33d514d640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f33d00b7080 0x7f33d00cc260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:38510/0 (socket says 172.21.15.18:38510) 2024-04-17T19:53:09.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.681+0000 7f33d514d640 1 -- 172.21.15.18:0/2078850650 learned_addr learned my addr 172.21.15.18:0/2078850650 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:09.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.681+0000 7f33d614f640 1 --2- 172.21.15.18:0/2078850650 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f33d00d26e0 0x7f33d00b2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:09.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.681+0000 7f33d494c640 1 -- 172.21.15.18:0/2078850650 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 247197682 0 0) 0x7f33d00d1920 con 0x7f33d00b7080 2024-04-17T19:53:09.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.681+0000 7f33d494c640 1 -- 172.21.15.18:0/2078850650 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33bc003530 con 0x7f33d00b7080 2024-04-17T19:53:09.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.681+0000 7f33d494c640 1 -- 172.21.15.18:0/2078850650 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 368819851 0 0) 0x7f33bc003530 con 0x7f33d00b7080 2024-04-17T19:53:09.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.681+0000 7f33d494c640 1 -- 172.21.15.18:0/2078850650 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f33d00d26e0 msgr2=0x7f33d00b2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:09.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.681+0000 7f33d494c640 1 --2- 172.21.15.18:0/2078850650 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f33d00d26e0 0x7f33d00b2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:09.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.681+0000 7f33d494c640 1 -- 172.21.15.18:0/2078850650 >> v1:172.21.15.173:6789/0 conn(0x7f33d00ce160 legacy=0x7f33d00b6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:09.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.681+0000 7f33d494c640 1 -- 172.21.15.18:0/2078850650 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33d00d1ee0 con 0x7f33d00b7080 2024-04-17T19:53:09.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.681+0000 7f33d494c640 1 -- 172.21.15.18:0/2078850650 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3208559991 0 0) 0x7f33c0001680 con 0x7f33d00b7080 2024-04-17T19:53:09.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.681+0000 7f33d494c640 1 -- 172.21.15.18:0/2078850650 >> v1:172.21.15.18:6789/0 conn(0x7f33d00b7080 legacy=0x7f33d00cc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:09.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.681+0000 7f33d494c640 1 --2- 172.21.15.18:0/2078850650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33bc0039f0 0x7f33bc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:09.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.681+0000 7f33d494c640 1 --2- 172.21.15.18:0/2078850650 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f33d00d26e0 0x7f33bc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:09.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.681+0000 7f33d494c640 1 --2- 172.21.15.18:0/2078850650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33bc004d50 0x7f33bc005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:09.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.681+0000 7f33d494c640 1 -- 172.21.15.18:0/2078850650 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f33d00b3500 con 0x7f33bc0039f0 2024-04-17T19:53:09.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.681+0000 7f33d494c640 1 -- 172.21.15.18:0/2078850650 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f33bc00bb60 con 0x7f33bc004d50 2024-04-17T19:53:09.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.681+0000 7f33d494c640 1 -- 172.21.15.18:0/2078850650 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f33bc00bd10 con 0x7f33d00d26e0 2024-04-17T19:53:09.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.681+0000 7f33d594e640 1 --2- 172.21.15.18:0/2078850650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33bc0039f0 0x7f33bc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:09.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.681+0000 7f33d514d640 1 --2- 172.21.15.18:0/2078850650 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f33d00d26e0 0x7f33bc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:09.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.681+0000 7f33d614f640 1 --2- 172.21.15.18:0/2078850650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33bc004d50 0x7f33bc005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:09.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.681+0000 7f33d594e640 1 -- 172.21.15.18:0/2078850650 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f33d00d26e0 msgr2=0x7f33bc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:09.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.681+0000 7f33d594e640 1 --2- 172.21.15.18:0/2078850650 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f33d00d26e0 0x7f33bc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:09.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.681+0000 7f33d594e640 1 -- 172.21.15.18:0/2078850650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33bc004d50 msgr2=0x7f33bc005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:09.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.681+0000 7f33d594e640 1 --2- 172.21.15.18:0/2078850650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33bc004d50 0x7f33bc005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:09.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.681+0000 7f33d594e640 1 -- 172.21.15.18:0/2078850650 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33bc003530 con 0x7f33bc0039f0 2024-04-17T19:53:09.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.681+0000 7f33d614f640 1 --2- 172.21.15.18:0/2078850650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33bc004d50 0x7f33bc005160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:53:09.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.685+0000 7f33d594e640 1 --2- 172.21.15.18:0/2078850650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33bc0039f0 0x7f33bc003e20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f33cc001860 tx=0x7f33d00cd180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3764e49c2426e6dc server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:09.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.685+0000 7f33d494c640 1 -- 172.21.15.18:0/2078850650 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33cc0b0070 con 0x7f33bc0039f0 2024-04-17T19:53:09.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.685+0000 7f33d494c640 1 -- 172.21.15.18:0/2078850650 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33cc0ab600 con 0x7f33bc0039f0 2024-04-17T19:53:09.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.685+0000 7f33d494c640 1 -- 172.21.15.18:0/2078850650 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33cc001460 con 0x7f33bc0039f0 2024-04-17T19:53:09.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.685+0000 7f33d7bb2640 1 -- 172.21.15.18:0/2078850650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33bc0039f0 msgr2=0x7f33bc003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:09.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.685+0000 7f33d7bb2640 1 --2- 172.21.15.18:0/2078850650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33bc0039f0 0x7f33bc003e20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f33cc001860 tx=0x7f33d00cd180 comp rx=0 tx=0).stop 2024-04-17T19:53:09.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.685+0000 7f33d614f640 1 -- 172.21.15.18:0/2078850650 reap_dead start 2024-04-17T19:53:09.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.685+0000 7f33d7bb2640 1 -- 172.21.15.18:0/2078850650 shutdown_connections 2024-04-17T19:53:09.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.685+0000 7f33d7bb2640 1 -- 172.21.15.18:0/2078850650 >> 172.21.15.18:0/2078850650 conn(0x7f33d009aa70 msgr2=0x7f33d009ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:09.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.685+0000 7f33d7bb2640 1 -- 172.21.15.18:0/2078850650 shutdown_connections 2024-04-17T19:53:09.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.685+0000 7f33d7bb2640 1 -- 172.21.15.18:0/2078850650 wait complete. 2024-04-17T19:53:09.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.689+0000 7f33d7bb2640 1 Processor -- start 2024-04-17T19:53:09.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.689+0000 7f33d7bb2640 1 -- start start 2024-04-17T19:53:09.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.689+0000 7f33d7bb2640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33d00ae970 0x7f33d0154c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:09.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.689+0000 7f33d7bb2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33d00b0390 0x7f33d0142ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:09.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.689+0000 7f33d7bb2640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f33d00b07a0 0x7f33d0143420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:09.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.689+0000 7f33d7bb2640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f33d016b460 con 0x7f33d00b0390 2024-04-17T19:53:09.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.689+0000 7f33d7bb2640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f33d00d2250 con 0x7f33d00ae970 2024-04-17T19:53:09.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.689+0000 7f33d7bb2640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f33d016b5e0 con 0x7f33d00b07a0 2024-04-17T19:53:09.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.689+0000 7f33d514d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33d00b0390 0x7f33d0142ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:09.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.689+0000 7f33d514d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33d00b0390 0x7f33d0142ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44922/0 (socket says 172.21.15.18:44922) 2024-04-17T19:53:09.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.689+0000 7f33d594e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33d00ae970 0x7f33d0154c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:09.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.689+0000 7f33d514d640 1 -- 172.21.15.18:0/1454691702 learned_addr learned my addr 172.21.15.18:0/1454691702 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:09.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.689+0000 7f33d614f640 1 --2- 172.21.15.18:0/1454691702 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f33d00b07a0 0x7f33d0143420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:09.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.689+0000 7f33d514d640 1 -- 172.21.15.18:0/1454691702 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f33d00b07a0 msgr2=0x7f33d0143420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:09.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.689+0000 7f33d514d640 1 --2- 172.21.15.18:0/1454691702 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f33d00b07a0 0x7f33d0143420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:09.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.689+0000 7f33d514d640 1 -- 172.21.15.18:0/1454691702 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33d00ae970 msgr2=0x7f33d0154c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:09.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.689+0000 7f33d514d640 1 --2- 172.21.15.18:0/1454691702 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33d00ae970 0x7f33d0154c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:09.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.689+0000 7f33d514d640 1 -- 172.21.15.18:0/1454691702 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33d0140e50 con 0x7f33d00b0390 2024-04-17T19:53:09.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.689+0000 7f33d514d640 1 --2- 172.21.15.18:0/1454691702 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33d00b0390 0x7f33d0142ee0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f33c000e7b0 tx=0x7f33c000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:09.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.689+0000 7f33c67fc640 1 -- 172.21.15.18:0/1454691702 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33c000ee60 con 0x7f33d00b0390 2024-04-17T19:53:09.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.689+0000 7f33c67fc640 1 -- 172.21.15.18:0/1454691702 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33c0018070 con 0x7f33d00b0390 2024-04-17T19:53:09.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.689+0000 7f33c67fc640 1 -- 172.21.15.18:0/1454691702 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33c000ca90 con 0x7f33d00b0390 2024-04-17T19:53:09.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.689+0000 7f33d7bb2640 1 -- 172.21.15.18:0/1454691702 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33d01410f0 con 0x7f33d00b0390 2024-04-17T19:53:09.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.689+0000 7f33d7bb2640 1 -- 172.21.15.18:0/1454691702 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33d01416b0 con 0x7f33d00b0390 2024-04-17T19:53:09.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.693+0000 7f33d7bb2640 1 -- 172.21.15.18:0/1454691702 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33d00698e0 con 0x7f33d00b0390 2024-04-17T19:53:09.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.693+0000 7f33c67fc640 1 -- 172.21.15.18:0/1454691702 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f33c000cc30 con 0x7f33d00b0390 2024-04-17T19:53:09.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.693+0000 7f33c67fc640 1 --2- 172.21.15.18:0/1454691702 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f33b40683b0 0x7f33b406a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:09.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.693+0000 7f33c67fc640 1 -- 172.21.15.18:0/1454691702 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6500+0+0 (secure 0 0 0) 0x7f33c00868e0 con 0x7f33d00b0390 2024-04-17T19:53:09.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.693+0000 7f33d594e640 1 --2- 172.21.15.18:0/1454691702 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f33b40683b0 0x7f33b406a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:09.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.693+0000 7f33d594e640 1 --2- 172.21.15.18:0/1454691702 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f33b40683b0 0x7f33b406a8c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f33cc0ad000 tx=0x7f33cc005040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:09.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.697+0000 7f33c67fc640 1 -- 172.21.15.18:0/1454691702 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f33c00565c0 con 0x7f33d00b0390 2024-04-17T19:53:09.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:09.897+0000 7f33d7bb2640 1 -- 172.21.15.18:0/1454691702 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f33d006d9b0 con 0x7f33d00b0390 2024-04-17T19:53:10.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.493+0000 7f33c67fc640 1 -- 172.21.15.18:0/1454691702 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) ==== 137+0+0 (secure 0 0 0) 0x7f33c005a8c0 con 0x7f33d00b0390 2024-04-17T19:53:10.491 INFO:teuthology.orchestra.run.smithi018.stderr:added data pool 4 to fsmap 2024-04-17T19:53:10.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.501+0000 7f33d7bb2640 1 -- 172.21.15.18:0/1454691702 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f33b40683b0 msgr2=0x7f33b406a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:10.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.501+0000 7f33d7bb2640 1 --2- 172.21.15.18:0/1454691702 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f33b40683b0 0x7f33b406a8c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f33cc0ad000 tx=0x7f33cc005040 comp rx=0 tx=0).stop 2024-04-17T19:53:10.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.501+0000 7f33d7bb2640 1 -- 172.21.15.18:0/1454691702 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33d00b0390 msgr2=0x7f33d0142ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:10.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.501+0000 7f33d7bb2640 1 --2- 172.21.15.18:0/1454691702 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33d00b0390 0x7f33d0142ee0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f33c000e7b0 tx=0x7f33c000ec70 comp rx=0 tx=0).stop 2024-04-17T19:53:10.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.501+0000 7f33d7bb2640 1 -- 172.21.15.18:0/1454691702 shutdown_connections 2024-04-17T19:53:10.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.501+0000 7f33d7bb2640 1 --2- 172.21.15.18:0/1454691702 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f33b40683b0 0x7f33b406a8c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:10.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.501+0000 7f33d7bb2640 1 --2- 172.21.15.18:0/1454691702 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f33d00b07a0 0x7f33d0143420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:10.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.501+0000 7f33d7bb2640 1 --2- 172.21.15.18:0/1454691702 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33d00b0390 0x7f33d0142ee0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:10.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.501+0000 7f33d7bb2640 1 --2- 172.21.15.18:0/1454691702 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33d00ae970 0x7f33d0154c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:10.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.501+0000 7f33d7bb2640 1 -- 172.21.15.18:0/1454691702 >> 172.21.15.18:0/1454691702 conn(0x7f33d009aa70 msgr2=0x7f33d015fc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:10.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.501+0000 7f33d7bb2640 1 -- 172.21.15.18:0/1454691702 shutdown_connections 2024-04-17T19:53:10.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.501+0000 7f33d7bb2640 1 -- 172.21.15.18:0/1454691702 wait complete. 2024-04-17T19:53:10.529 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T19:53:10.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.693+0000 7f8f3bc51640 1 Processor -- start 2024-04-17T19:53:10.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.693+0000 7f8f3bc51640 1 -- start start 2024-04-17T19:53:10.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.693+0000 7f8f3bc51640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8f3415d1f0 0x7f8f34160640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:10.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.693+0000 7f8f3bc51640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8f34070de0 0x7f8f340711f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:10.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.693+0000 7f8f3bc51640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f3415d600 con 0x7f8f340d0920 2024-04-17T19:53:10.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.693+0000 7f8f3bc51640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f8f34160b80 con 0x7f8f3415d1f0 2024-04-17T19:53:10.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.693+0000 7f8f3bc51640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f8f34071730 con 0x7f8f34070de0 2024-04-17T19:53:10.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.693+0000 7f8f399ed640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8f3415d1f0 0x7f8f34160640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:10.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.693+0000 7f8f399ed640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8f3415d1f0 0x7f8f34160640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44928/0 (socket says 172.21.15.18:44928) 2024-04-17T19:53:10.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.693+0000 7f8f399ed640 1 -- 172.21.15.18:0/2275461286 learned_addr learned my addr 172.21.15.18:0/2275461286 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:10.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.697+0000 7f8f391ec640 1 --2- 172.21.15.18:0/2275461286 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8f34070de0 0x7f8f340711f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:10.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.697+0000 7f8f399ed640 1 -- 172.21.15.18:0/2275461286 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8f34070de0 msgr2=0x7f8f340711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:10.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.697+0000 7f8f399ed640 1 --2- 172.21.15.18:0/2275461286 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8f34070de0 0x7f8f340711f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:10.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.697+0000 7f8f399ed640 1 -- 172.21.15.18:0/2275461286 >> v1:172.21.15.173:6789/0 conn(0x7f8f340d0920 legacy=0x7f8f340d0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:10.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.697+0000 7f8f399ed640 1 -- 172.21.15.18:0/2275461286 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f340b2580 con 0x7f8f3415d1f0 2024-04-17T19:53:10.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.697+0000 7f8f399ed640 1 --2- 172.21.15.18:0/2275461286 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f3415d1f0 0x7f8f34160640 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8f30009870 tx=0x7f8f3001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=570131a542c16a2f server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:10.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.697+0000 7f8f389eb640 1 -- 172.21.15.18:0/2275461286 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f300a9620 con 0x7f8f3415d1f0 2024-04-17T19:53:10.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.697+0000 7f8f389eb640 1 -- 172.21.15.18:0/2275461286 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f300a97c0 con 0x7f8f3415d1f0 2024-04-17T19:53:10.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.697+0000 7f8f389eb640 1 -- 172.21.15.18:0/2275461286 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f300a9b90 con 0x7f8f3415d1f0 2024-04-17T19:53:10.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.697+0000 7f8f3bc51640 1 -- 172.21.15.18:0/2275461286 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f3415d1f0 msgr2=0x7f8f34160640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:10.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.697+0000 7f8f3bc51640 1 --2- 172.21.15.18:0/2275461286 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f3415d1f0 0x7f8f34160640 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8f30009870 tx=0x7f8f3001c560 comp rx=0 tx=0).stop 2024-04-17T19:53:10.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.697+0000 7f8f3bc51640 1 -- 172.21.15.18:0/2275461286 shutdown_connections 2024-04-17T19:53:10.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.697+0000 7f8f3bc51640 1 --2- 172.21.15.18:0/2275461286 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8f34070de0 0x7f8f340711f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:10.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.697+0000 7f8f3bc51640 1 --2- 172.21.15.18:0/2275461286 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f3415d1f0 0x7f8f34160640 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:10.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.697+0000 7f8f3bc51640 1 -- 172.21.15.18:0/2275461286 >> 172.21.15.18:0/2275461286 conn(0x7f8f340cf7d0 msgr2=0x7f8f340cfbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:10.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.697+0000 7f8f3bc51640 1 -- 172.21.15.18:0/2275461286 shutdown_connections 2024-04-17T19:53:10.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.697+0000 7f8f3bc51640 1 -- 172.21.15.18:0/2275461286 wait complete. 2024-04-17T19:53:10.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.701+0000 7f8f3bc51640 1 Processor -- start 2024-04-17T19:53:10.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.701+0000 7f8f3bc51640 1 -- start start 2024-04-17T19:53:10.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.701+0000 7f8f3bc51640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f34070de0 0x7f8f3406dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:10.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.701+0000 7f8f3bc51640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f340d0920 0x7f8f3406f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:10.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.701+0000 7f8f3bc51640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8f3415d1f0 0x7f8f3406fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:10.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.701+0000 7f8f3bc51640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8f34164010 con 0x7f8f340d0920 2024-04-17T19:53:10.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.701+0000 7f8f3bc51640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8f34163af0 con 0x7f8f34070de0 2024-04-17T19:53:10.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.701+0000 7f8f3bc51640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f8f340b8260 con 0x7f8f3415d1f0 2024-04-17T19:53:10.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.701+0000 7f8f391ec640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f340d0920 0x7f8f3406f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:10.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.701+0000 7f8f391ec640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f340d0920 0x7f8f3406f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44938/0 (socket says 172.21.15.18:44938) 2024-04-17T19:53:10.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.701+0000 7f8f391ec640 1 -- 172.21.15.18:0/3697581509 learned_addr learned my addr 172.21.15.18:0/3697581509 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:10.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.701+0000 7f8f399ed640 1 --2- 172.21.15.18:0/3697581509 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f34070de0 0x7f8f3406dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:10.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.701+0000 7f8f391ec640 1 -- 172.21.15.18:0/3697581509 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8f3415d1f0 msgr2=0x7f8f3406fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:10.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.701+0000 7f8f3a1ee640 1 --2- 172.21.15.18:0/3697581509 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8f3415d1f0 0x7f8f3406fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:10.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.701+0000 7f8f391ec640 1 --2- 172.21.15.18:0/3697581509 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8f3415d1f0 0x7f8f3406fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:10.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.701+0000 7f8f391ec640 1 -- 172.21.15.18:0/3697581509 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f34070de0 msgr2=0x7f8f3406dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:10.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.701+0000 7f8f391ec640 1 --2- 172.21.15.18:0/3697581509 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f34070de0 0x7f8f3406dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:10.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.701+0000 7f8f391ec640 1 -- 172.21.15.18:0/3697581509 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f341570c0 con 0x7f8f340d0920 2024-04-17T19:53:10.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.701+0000 7f8f3a1ee640 1 --2- 172.21.15.18:0/3697581509 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8f3415d1f0 0x7f8f3406fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:53:10.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.701+0000 7f8f399ed640 1 --2- 172.21.15.18:0/3697581509 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f34070de0 0x7f8f3406dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:53:10.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.701+0000 7f8f391ec640 1 --2- 172.21.15.18:0/3697581509 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f340d0920 0x7f8f3406f9b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8f2800d620 tx=0x7f8f2800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:10.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.701+0000 7f8f267fc640 1 -- 172.21.15.18:0/3697581509 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f2800b620 con 0x7f8f340d0920 2024-04-17T19:53:10.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.705+0000 7f8f267fc640 1 -- 172.21.15.18:0/3697581509 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f28019070 con 0x7f8f340d0920 2024-04-17T19:53:10.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.705+0000 7f8f3bc51640 1 -- 172.21.15.18:0/3697581509 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f340c94b0 con 0x7f8f340d0920 2024-04-17T19:53:10.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.705+0000 7f8f267fc640 1 -- 172.21.15.18:0/3697581509 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f2800b9e0 con 0x7f8f340d0920 2024-04-17T19:53:10.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.705+0000 7f8f3bc51640 1 -- 172.21.15.18:0/3697581509 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f341569b0 con 0x7f8f340d0920 2024-04-17T19:53:10.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.705+0000 7f8f3bc51640 1 -- 172.21.15.18:0/3697581509 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f340c92a0 con 0x7f8f340d0920 2024-04-17T19:53:10.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.705+0000 7f8f267fc640 1 -- 172.21.15.18:0/3697581509 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8f2800bb80 con 0x7f8f340d0920 2024-04-17T19:53:10.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.705+0000 7f8f267fc640 1 --2- 172.21.15.18:0/3697581509 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f8f18068380 0x7f8f1806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:10.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.705+0000 7f8f267fc640 1 -- 172.21.15.18:0/3697581509 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f8f28087b50 con 0x7f8f340d0920 2024-04-17T19:53:10.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.705+0000 7f8f399ed640 1 --2- 172.21.15.18:0/3697581509 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f8f18068380 0x7f8f1806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:10.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.705+0000 7f8f399ed640 1 --2- 172.21.15.18:0/3697581509 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f8f18068380 0x7f8f1806a890 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8f300ae000 tx=0x7f8f300b3040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:10.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.709+0000 7f8f267fc640 1 -- 172.21.15.18:0/3697581509 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8f28087e20 con 0x7f8f340d0920 2024-04-17T19:53:10.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.909+0000 7f8f3bc51640 1 -- 172.21.15.18:0/3697581509 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8f34156e50 con 0x7f8f340d0920 2024-04-17T19:53:10.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.909+0000 7f8f267fc640 1 -- 172.21.15.18:0/3697581509 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5177 (secure 0 0 0) 0x7f8f28057e30 con 0x7f8f340d0920 2024-04-17T19:53:10.905 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:53:10.905 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/729504609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":729504609},{"type":"v1","addr":"172.21.15.173:6833","nonce":729504609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4261,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/3797017174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3797017174},{"type":"v1","addr":"172.21.15.173:6835","nonce":3797017174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/995848920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":995848920},{"type":"v1","addr":"172.21.15.18:6835","nonce":995848920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-17T19:53:04.851226+0000","modified":"2024-04-17T19:53:09.904317+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6837/1926349198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1926349198},{"type":"v1","addr":"172.21.15.18:6837","nonce":1926349198}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1}]} 2024-04-17T19:53:10.905 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 7 2024-04-17T19:53:10.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.909+0000 7f8f3bc51640 1 -- 172.21.15.18:0/3697581509 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f8f18068380 msgr2=0x7f8f1806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:10.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.909+0000 7f8f3bc51640 1 --2- 172.21.15.18:0/3697581509 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f8f18068380 0x7f8f1806a890 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8f300ae000 tx=0x7f8f300b3040 comp rx=0 tx=0).stop 2024-04-17T19:53:10.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.909+0000 7f8f3bc51640 1 -- 172.21.15.18:0/3697581509 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f340d0920 msgr2=0x7f8f3406f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:10.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.909+0000 7f8f3bc51640 1 --2- 172.21.15.18:0/3697581509 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f340d0920 0x7f8f3406f9b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8f2800d620 tx=0x7f8f2800dae0 comp rx=0 tx=0).stop 2024-04-17T19:53:10.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.909+0000 7f8f3bc51640 1 -- 172.21.15.18:0/3697581509 shutdown_connections 2024-04-17T19:53:10.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.909+0000 7f8f3bc51640 1 --2- 172.21.15.18:0/3697581509 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f8f18068380 0x7f8f1806a890 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:10.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.909+0000 7f8f3bc51640 1 --2- 172.21.15.18:0/3697581509 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8f3415d1f0 0x7f8f3406fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:10.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.909+0000 7f8f3bc51640 1 --2- 172.21.15.18:0/3697581509 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f340d0920 0x7f8f3406f9b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:10.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.909+0000 7f8f3bc51640 1 --2- 172.21.15.18:0/3697581509 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f34070de0 0x7f8f3406dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:10.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.909+0000 7f8f3bc51640 1 -- 172.21.15.18:0/3697581509 >> 172.21.15.18:0/3697581509 conn(0x7f8f340cf7d0 msgr2=0x7f8f3415ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:10.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.913+0000 7f8f3bc51640 1 -- 172.21.15.18:0/3697581509 shutdown_connections 2024-04-17T19:53:10.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:10.913+0000 7f8f3bc51640 1 -- 172.21.15.18:0/3697581509 wait complete. 2024-04-17T19:53:10.927 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T19:53:11.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.085+0000 7f2930c7e640 1 Processor -- start 2024-04-17T19:53:11.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.085+0000 7f2930c7e640 1 -- start start 2024-04-17T19:53:11.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.089+0000 7f2930c7e640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f292c0d3b80 0x7f292c0cff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:11.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.089+0000 7f2930c7e640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f292c0d0450 0x7f292c1631c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:11.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.089+0000 7f2930c7e640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f292c0d0860 con 0x7f292c163700 2024-04-17T19:53:11.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.089+0000 7f2930c7e640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f292c0d3f90 con 0x7f292c0d3b80 2024-04-17T19:53:11.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.089+0000 7f2930c7e640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f292c160be0 con 0x7f292c0d0450 2024-04-17T19:53:11.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.089+0000 7f2929d9b640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f292c0d0450 0x7f292c1631c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:11.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.089+0000 7f292a59c640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f292c0d3b80 0x7f292c0cff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:11.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.089+0000 7f292a59c640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f292c0d3b80 0x7f292c0cff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.18:50318/0 (socket says 172.21.15.18:50318) 2024-04-17T19:53:11.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.089+0000 7f2929d9b640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f292c0d0450 0x7f292c1631c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.18:49758/0 (socket says 172.21.15.18:49758) 2024-04-17T19:53:11.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.089+0000 7f292a59c640 1 -- 172.21.15.18:0/3151140795 learned_addr learned my addr 172.21.15.18:0/3151140795 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:11.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.089+0000 7f292ad9d640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f292c163700 0x7f292c06c1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.18:60692/0 (socket says 172.21.15.18:60692) 2024-04-17T19:53:11.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.089+0000 7f292a59c640 1 -- 172.21.15.18:0/3151140795 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f292c0d0450 msgr2=0x7f292c1631c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:11.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.089+0000 7f292a59c640 1 --2- 172.21.15.18:0/3151140795 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f292c0d0450 0x7f292c1631c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:11.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.089+0000 7f292a59c640 1 -- 172.21.15.18:0/3151140795 >> v1:172.21.15.173:6789/0 conn(0x7f292c163700 legacy=0x7f292c06c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:11.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.089+0000 7f292a59c640 1 -- 172.21.15.18:0/3151140795 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f292c0d41b0 con 0x7f292c0d3b80 2024-04-17T19:53:11.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.093+0000 7f292a59c640 1 --2- 172.21.15.18:0/3151140795 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f292c0d3b80 0x7f292c0cff10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f291c009870 tx=0x7f291c01c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e57467f8e4e5230 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:11.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.093+0000 7f292959a640 1 -- 172.21.15.18:0/3151140795 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f291c0ab650 con 0x7f292c0d3b80 2024-04-17T19:53:11.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.093+0000 7f292959a640 1 -- 172.21.15.18:0/3151140795 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f291c0b0070 con 0x7f292c0d3b80 2024-04-17T19:53:11.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.093+0000 7f292959a640 1 -- 172.21.15.18:0/3151140795 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f291c0aba10 con 0x7f292c0d3b80 2024-04-17T19:53:11.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.093+0000 7f2930c7e640 1 -- 172.21.15.18:0/3151140795 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f292c0d3b80 msgr2=0x7f292c0cff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:11.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.093+0000 7f2930c7e640 1 --2- 172.21.15.18:0/3151140795 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f292c0d3b80 0x7f292c0cff10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f291c009870 tx=0x7f291c01c560 comp rx=0 tx=0).stop 2024-04-17T19:53:11.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.093+0000 7f2930c7e640 1 -- 172.21.15.18:0/3151140795 shutdown_connections 2024-04-17T19:53:11.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.093+0000 7f2930c7e640 1 --2- 172.21.15.18:0/3151140795 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f292c0d0450 0x7f292c1631c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:11.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.093+0000 7f2930c7e640 1 --2- 172.21.15.18:0/3151140795 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f292c0d3b80 0x7f292c0cff10 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:11.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.093+0000 7f2930c7e640 1 -- 172.21.15.18:0/3151140795 >> 172.21.15.18:0/3151140795 conn(0x7f292c0d4ed0 msgr2=0x7f292c0d52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:11.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.093+0000 7f2930c7e640 1 -- 172.21.15.18:0/3151140795 shutdown_connections 2024-04-17T19:53:11.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.093+0000 7f2930c7e640 1 -- 172.21.15.18:0/3151140795 wait complete. 2024-04-17T19:53:11.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.093+0000 7f2930c7e640 1 Processor -- start 2024-04-17T19:53:11.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.093+0000 7f2930c7e640 1 -- start start 2024-04-17T19:53:11.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.097+0000 7f2930c7e640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f292c0d0450 0x7f292c14a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:11.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.097+0000 7f2930c7e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f292c0d3b80 0x7f292c14e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:11.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.097+0000 7f2930c7e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f292c163700 0x7f292c14e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:11.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.097+0000 7f2930c7e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f292c15fdd0 con 0x7f292c163700 2024-04-17T19:53:11.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.097+0000 7f2930c7e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f292c163f20 con 0x7f292c0d3b80 2024-04-17T19:53:11.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.097+0000 7f2930c7e640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f292c15ff50 con 0x7f292c0d0450 2024-04-17T19:53:11.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.097+0000 7f292ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f292c163700 0x7f292c14e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:11.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.097+0000 7f292ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f292c163700 0x7f292c14e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44954/0 (socket says 172.21.15.18:44954) 2024-04-17T19:53:11.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.097+0000 7f292ad9d640 1 -- 172.21.15.18:0/424024638 learned_addr learned my addr 172.21.15.18:0/424024638 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:11.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.097+0000 7f2929d9b640 1 --2- 172.21.15.18:0/424024638 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f292c0d3b80 0x7f292c14e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:11.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.097+0000 7f292a59c640 1 --2- 172.21.15.18:0/424024638 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f292c0d0450 0x7f292c14a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:11.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.097+0000 7f292ad9d640 1 -- 172.21.15.18:0/424024638 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f292c0d0450 msgr2=0x7f292c14a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:11.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.097+0000 7f292ad9d640 1 --2- 172.21.15.18:0/424024638 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f292c0d0450 0x7f292c14a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:11.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.097+0000 7f292ad9d640 1 -- 172.21.15.18:0/424024638 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f292c0d3b80 msgr2=0x7f292c14e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:11.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.097+0000 7f292ad9d640 1 --2- 172.21.15.18:0/424024638 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f292c0d3b80 0x7f292c14e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:11.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.097+0000 7f292ad9d640 1 -- 172.21.15.18:0/424024638 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f292c14aa70 con 0x7f292c163700 2024-04-17T19:53:11.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.097+0000 7f292ad9d640 1 --2- 172.21.15.18:0/424024638 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f292c163700 0x7f292c14e630 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f292400c730 tx=0x7f292400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:11.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.097+0000 7f291affd640 1 -- 172.21.15.18:0/424024638 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2924018070 con 0x7f292c163700 2024-04-17T19:53:11.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.097+0000 7f2930c7e640 1 -- 172.21.15.18:0/424024638 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f292c152a70 con 0x7f292c163700 2024-04-17T19:53:11.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.097+0000 7f291affd640 1 -- 172.21.15.18:0/424024638 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2924004d70 con 0x7f292c163700 2024-04-17T19:53:11.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.097+0000 7f291affd640 1 -- 172.21.15.18:0/424024638 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f292400a860 con 0x7f292c163700 2024-04-17T19:53:11.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.097+0000 7f2930c7e640 1 -- 172.21.15.18:0/424024638 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f292c1584f0 con 0x7f292c163700 2024-04-17T19:53:11.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.097+0000 7f2930c7e640 1 -- 172.21.15.18:0/424024638 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f292c069950 con 0x7f292c163700 2024-04-17T19:53:11.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.097+0000 7f291affd640 1 -- 172.21.15.18:0/424024638 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f292401b070 con 0x7f292c163700 2024-04-17T19:53:11.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.101+0000 7f291affd640 1 --2- 172.21.15.18:0/424024638 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f290c068380 0x7f290c06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:11.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.101+0000 7f291affd640 1 -- 172.21.15.18:0/424024638 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f29240861c0 con 0x7f292c163700 2024-04-17T19:53:11.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.101+0000 7f292a59c640 1 --2- 172.21.15.18:0/424024638 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f290c068380 0x7f290c06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:11.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.101+0000 7f292a59c640 1 --2- 172.21.15.18:0/424024638 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f290c068380 0x7f290c06a890 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f291c0af000 tx=0x7f291c0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:11.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.105+0000 7f291affd640 1 -- 172.21.15.18:0/424024638 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f292c0d0860 con 0x7f292c163700 2024-04-17T19:53:11.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.269+0000 7f2930c7e640 1 -- 172.21.15.18:0/424024638 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f292c0d3540 con 0x7f292c163700 2024-04-17T19:53:11.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.273+0000 7f291affd640 1 -- 172.21.15.18:0/424024638 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18506 (secure 0 0 0) 0x7f2924056440 con 0x7f292c163700 2024-04-17T19:53:11.268 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:53:11.269 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":27,"fsid":"dd480169-5a81-4623-be5f-0499aa244b28","created":"2024-04-17T19:52:39.533760+0000","modified":"2024-04-17T19:53:09.903922+0000","last_up_change":"2024-04-17T19:52:51.229698+0000","last_in_change":"2024-04-17T19:52:42.144259+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T19:52:52.391648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T19:53:02.734240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T19:53:03.813028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T19:53:07.478812+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e232d577-2508-4ea4-b355-29fbae1ff025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6801","nonce":2323038417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6803","nonce":2323038417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6807","nonce":2323038417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6805","nonce":2323038417}]},"public_addr":"172.21.15.18:6801/2323038417","cluster_addr":"172.21.15.18:6803/2323038417","heartbeat_back_addr":"172.21.15.18:6807/2323038417","heartbeat_front_addr":"172.21.15.18:6805/2323038417","state":["exists","up"]},{"osd":1,"uuid":"31810ef3-2c71-48d6-8748-b74a2968d23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6817","nonce":1283678238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6819","nonce":1283678238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6823","nonce":1283678238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6821","nonce":1283678238}]},"public_addr":"172.21.15.18:6817/1283678238","cluster_addr":"172.21.15.18:6819/1283678238","heartbeat_back_addr":"172.21.15.18:6823/1283678238","heartbeat_front_addr":"172.21.15.18:6821/1283678238","state":["exists","up"]},{"osd":2,"uuid":"5a783cc5-a41c-4967-9e11-6b8330f97d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6809","nonce":1212875862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6811","nonce":1212875862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6815","nonce":1212875862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6813","nonce":1212875862}]},"public_addr":"172.21.15.18:6809/1212875862","cluster_addr":"172.21.15.18:6811/1212875862","heartbeat_back_addr":"172.21.15.18:6815/1212875862","heartbeat_front_addr":"172.21.15.18:6813/1212875862","state":["exists","up"]},{"osd":3,"uuid":"b7e056d9-9da5-46e1-810d-0c3e242fe5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6825","nonce":2428878428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6827","nonce":2428878428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6831","nonce":2428878428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6829","nonce":2428878428}]},"public_addr":"172.21.15.18:6825/2428878428","cluster_addr":"172.21.15.18:6827/2428878428","heartbeat_back_addr":"172.21.15.18:6831/2428878428","heartbeat_front_addr":"172.21.15.18:6829/2428878428","state":["exists","up"]},{"osd":4,"uuid":"21df023f-bc8b-4abb-93e5-0ecc91acda0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6825","nonce":1421511819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6827","nonce":1421511819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6831","nonce":1421511819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6829","nonce":1421511819}]},"public_addr":"172.21.15.173:6825/1421511819","cluster_addr":"172.21.15.173:6827/1421511819","heartbeat_back_addr":"172.21.15.173:6831/1421511819","heartbeat_front_addr":"172.21.15.173:6829/1421511819","state":["exists","up"]},{"osd":5,"uuid":"e270098a-6d33-49f8-84ed-94e09a880cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6801","nonce":4221907702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6803","nonce":4221907702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6807","nonce":4221907702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6805","nonce":4221907702}]},"public_addr":"172.21.15.173:6801/4221907702","cluster_addr":"172.21.15.173:6803/4221907702","heartbeat_back_addr":"172.21.15.173:6807/4221907702","heartbeat_front_addr":"172.21.15.173:6805/4221907702","state":["exists","up"]},{"osd":6,"uuid":"93c67c8c-268d-4e32-877c-043cd3acd87c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6809","nonce":761678552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6811","nonce":761678552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6815","nonce":761678552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6813","nonce":761678552}]},"public_addr":"172.21.15.173:6809/761678552","cluster_addr":"172.21.15.173:6811/761678552","heartbeat_back_addr":"172.21.15.173:6815/761678552","heartbeat_front_addr":"172.21.15.173:6813/761678552","state":["exists","up"]},{"osd":7,"uuid":"faf10eea-80de-40f6-abbb-34d07d3f59ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6817","nonce":383724537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6819","nonce":383724537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6823","nonce":383724537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6821","nonce":383724537}]},"public_addr":"172.21.15.173:6817/383724537","cluster_addr":"172.21.15.173:6819/383724537","heartbeat_back_addr":"172.21.15.173:6823/383724537","heartbeat_front_addr":"172.21.15.173:6821/383724537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.668924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.761747+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.768128+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.632252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.742608+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.734327+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.477107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.818292+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T19:53:11.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.273+0000 7f2930c7e640 1 -- 172.21.15.18:0/424024638 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f290c068380 msgr2=0x7f290c06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:11.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.273+0000 7f2930c7e640 1 --2- 172.21.15.18:0/424024638 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f290c068380 0x7f290c06a890 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f291c0af000 tx=0x7f291c0a7000 comp rx=0 tx=0).stop 2024-04-17T19:53:11.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.273+0000 7f2930c7e640 1 -- 172.21.15.18:0/424024638 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f292c163700 msgr2=0x7f292c14e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:11.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.273+0000 7f2930c7e640 1 --2- 172.21.15.18:0/424024638 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f292c163700 0x7f292c14e630 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f292400c730 tx=0x7f292400cbf0 comp rx=0 tx=0).stop 2024-04-17T19:53:11.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.273+0000 7f2930c7e640 1 -- 172.21.15.18:0/424024638 shutdown_connections 2024-04-17T19:53:11.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.273+0000 7f2930c7e640 1 --2- 172.21.15.18:0/424024638 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f290c068380 0x7f290c06a890 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:11.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.273+0000 7f2930c7e640 1 --2- 172.21.15.18:0/424024638 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f292c163700 0x7f292c14e630 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:11.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.273+0000 7f2930c7e640 1 --2- 172.21.15.18:0/424024638 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f292c0d3b80 0x7f292c14e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:11.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.273+0000 7f2930c7e640 1 --2- 172.21.15.18:0/424024638 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f292c0d0450 0x7f292c14a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:11.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.273+0000 7f2930c7e640 1 -- 172.21.15.18:0/424024638 >> 172.21.15.18:0/424024638 conn(0x7f292c0d4ed0 msgr2=0x7f292c0b86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:11.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.273+0000 7f2930c7e640 1 -- 172.21.15.18:0/424024638 shutdown_connections 2024-04-17T19:53:11.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.273+0000 7f2930c7e640 1 -- 172.21.15.18:0/424024638 wait complete. 2024-04-17T19:53:11.291 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T19:53:11.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.445+0000 7fb50f076640 1 Processor -- start 2024-04-17T19:53:11.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.445+0000 7fb50f076640 1 -- start start 2024-04-17T19:53:11.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.445+0000 7fb50f076640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb50806d470 0x7fb50815f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:11.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.445+0000 7fb50f076640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb5080b44b0 0x7fb5080b48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:11.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.445+0000 7fb50f076640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5081607b0 con 0x7fb5080b0120 2024-04-17T19:53:11.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.445+0000 7fb50f076640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fb5080b0530 con 0x7fb5080b44b0 2024-04-17T19:53:11.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.445+0000 7fb50f076640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fb50815ff10 con 0x7fb50806d470 2024-04-17T19:53:11.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.445+0000 7fb50ce12640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fb5080b0120 0x7fb50806cd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:38520/0 (socket says 172.21.15.18:38520) 2024-04-17T19:53:11.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.445+0000 7fb50d613640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb5080b44b0 0x7fb5080b48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:11.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.445+0000 7fb50ce12640 1 -- 172.21.15.18:0/2476365073 learned_addr learned my addr 172.21.15.18:0/2476365073 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:11.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.445+0000 7fb507fff640 1 --2- 172.21.15.18:0/2476365073 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb50806d470 0x7fb50815f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:11.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.445+0000 7fb50d613640 1 -- 172.21.15.18:0/2476365073 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb50806d470 msgr2=0x7fb50815f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:11.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.445+0000 7fb50d613640 1 --2- 172.21.15.18:0/2476365073 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb50806d470 0x7fb50815f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:11.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.445+0000 7fb50d613640 1 -- 172.21.15.18:0/2476365073 >> v1:172.21.15.18:6789/0 conn(0x7fb5080b0120 legacy=0x7fb50806cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:11.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.445+0000 7fb50d613640 1 -- 172.21.15.18:0/2476365073 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5081601f0 con 0x7fb5080b44b0 2024-04-17T19:53:11.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.449+0000 7fb50d613640 1 --2- 172.21.15.18:0/2476365073 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5080b44b0 0x7fb5080b48c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb500009d90 tx=0x7fb50001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c51c7c258dc66e04 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:11.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.449+0000 7fb5077fe640 1 -- 172.21.15.18:0/2476365073 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5000b2070 con 0x7fb5080b44b0 2024-04-17T19:53:11.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.449+0000 7fb5077fe640 1 -- 172.21.15.18:0/2476365073 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5000a5a00 con 0x7fb5080b44b0 2024-04-17T19:53:11.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.449+0000 7fb5077fe640 1 -- 172.21.15.18:0/2476365073 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5000a5dd0 con 0x7fb5080b44b0 2024-04-17T19:53:11.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.449+0000 7fb50f076640 1 -- 172.21.15.18:0/2476365073 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5080b44b0 msgr2=0x7fb5080b48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:11.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.449+0000 7fb50f076640 1 --2- 172.21.15.18:0/2476365073 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5080b44b0 0x7fb5080b48c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb500009d90 tx=0x7fb50001c940 comp rx=0 tx=0).stop 2024-04-17T19:53:11.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.449+0000 7fb50f076640 1 -- 172.21.15.18:0/2476365073 shutdown_connections 2024-04-17T19:53:11.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.449+0000 7fb50f076640 1 --2- 172.21.15.18:0/2476365073 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5080b44b0 0x7fb5080b48c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:11.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.449+0000 7fb50f076640 1 --2- 172.21.15.18:0/2476365073 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb50806d470 0x7fb50815f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:11.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.449+0000 7fb50f076640 1 -- 172.21.15.18:0/2476365073 >> 172.21.15.18:0/2476365073 conn(0x7fb508072bb0 msgr2=0x7fb508072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:11.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.449+0000 7fb50f076640 1 -- 172.21.15.18:0/2476365073 shutdown_connections 2024-04-17T19:53:11.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.449+0000 7fb50f076640 1 -- 172.21.15.18:0/2476365073 wait complete. 2024-04-17T19:53:11.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.453+0000 7fb50f076640 1 Processor -- start 2024-04-17T19:53:11.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.453+0000 7fb50f076640 1 -- start start 2024-04-17T19:53:11.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.453+0000 7fb50f076640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5080b0120 0x7fb5081577a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:11.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.453+0000 7fb50f076640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5080b44b0 0x7fb508155b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:11.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.453+0000 7fb50f076640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb508157130 0x7fb5081560b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:11.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.453+0000 7fb50f076640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb50816c200 con 0x7fb5080b44b0 2024-04-17T19:53:11.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.453+0000 7fb50f076640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb50816c080 con 0x7fb5080b0120 2024-04-17T19:53:11.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.453+0000 7fb50f076640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fb50816c380 con 0x7fb508157130 2024-04-17T19:53:11.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.453+0000 7fb507fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5080b44b0 0x7fb508155b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:11.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.453+0000 7fb507fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5080b44b0 0x7fb508155b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44964/0 (socket says 172.21.15.18:44964) 2024-04-17T19:53:11.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.453+0000 7fb507fff640 1 -- 172.21.15.18:0/2744951114 learned_addr learned my addr 172.21.15.18:0/2744951114 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:11.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.453+0000 7fb50ce12640 1 --2- 172.21.15.18:0/2744951114 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5080b0120 0x7fb5081577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:11.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.453+0000 7fb50d613640 1 --2- 172.21.15.18:0/2744951114 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb508157130 0x7fb5081560b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:11.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.453+0000 7fb507fff640 1 -- 172.21.15.18:0/2744951114 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb508157130 msgr2=0x7fb5081560b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:11.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.453+0000 7fb507fff640 1 --2- 172.21.15.18:0/2744951114 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb508157130 0x7fb5081560b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:11.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.453+0000 7fb507fff640 1 -- 172.21.15.18:0/2744951114 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5080b0120 msgr2=0x7fb5081577a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:11.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.453+0000 7fb507fff640 1 --2- 172.21.15.18:0/2744951114 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5080b0120 0x7fb5081577a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:11.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.453+0000 7fb507fff640 1 -- 172.21.15.18:0/2744951114 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5080cd470 con 0x7fb5080b44b0 2024-04-17T19:53:11.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.453+0000 7fb507fff640 1 --2- 172.21.15.18:0/2744951114 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5080b44b0 0x7fb508155b70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc00e8a0 tx=0x7fb4fc00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:11.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.453+0000 7fb5057fa640 1 -- 172.21.15.18:0/2744951114 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc017070 con 0x7fb5080b44b0 2024-04-17T19:53:11.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.453+0000 7fb5057fa640 1 -- 172.21.15.18:0/2744951114 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4fc00c940 con 0x7fb5080b44b0 2024-04-17T19:53:11.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.453+0000 7fb50f076640 1 -- 172.21.15.18:0/2744951114 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb508158110 con 0x7fb5080b44b0 2024-04-17T19:53:11.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.453+0000 7fb5057fa640 1 -- 172.21.15.18:0/2744951114 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc00ccf0 con 0x7fb5080b44b0 2024-04-17T19:53:11.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.453+0000 7fb50f076640 1 -- 172.21.15.18:0/2744951114 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5081586d0 con 0x7fb5080b44b0 2024-04-17T19:53:11.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.457+0000 7fb50f076640 1 -- 172.21.15.18:0/2744951114 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb508157e80 con 0x7fb5080b44b0 2024-04-17T19:53:11.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.457+0000 7fb5057fa640 1 -- 172.21.15.18:0/2744951114 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb4fc01a070 con 0x7fb5080b44b0 2024-04-17T19:53:11.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.457+0000 7fb5057fa640 1 --2- 172.21.15.18:0/2744951114 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fb4f40683b0 0x7fb4f406a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:11.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.457+0000 7fb50ce12640 1 --2- 172.21.15.18:0/2744951114 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fb4f40683b0 0x7fb4f406a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:11.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.457+0000 7fb5057fa640 1 -- 172.21.15.18:0/2744951114 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fb4fc086f40 con 0x7fb5080b44b0 2024-04-17T19:53:11.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.457+0000 7fb50ce12640 1 --2- 172.21.15.18:0/2744951114 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fb4f40683b0 0x7fb4f406a8c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb4f8000f70 tx=0x7fb4f8007e90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:11.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.461+0000 7fb5057fa640 1 -- 172.21.15.18:0/2744951114 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb4fc056ae0 con 0x7fb5080b44b0 2024-04-17T19:53:11.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.633+0000 7fb50f076640 1 -- 172.21.15.18:0/2744951114 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb508069950 con 0x7fb5080b44b0 2024-04-17T19:53:11.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.637+0000 7fb5057fa640 1 -- 172.21.15.18:0/2744951114 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18506 (secure 0 0 0) 0x7fb4fc05ade0 con 0x7fb5080b44b0 2024-04-17T19:53:11.632 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:53:11.632 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":27,"fsid":"dd480169-5a81-4623-be5f-0499aa244b28","created":"2024-04-17T19:52:39.533760+0000","modified":"2024-04-17T19:53:09.903922+0000","last_up_change":"2024-04-17T19:52:51.229698+0000","last_in_change":"2024-04-17T19:52:42.144259+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T19:52:52.391648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T19:53:02.734240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T19:53:03.813028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T19:53:07.478812+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e232d577-2508-4ea4-b355-29fbae1ff025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6801","nonce":2323038417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6803","nonce":2323038417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6807","nonce":2323038417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6805","nonce":2323038417}]},"public_addr":"172.21.15.18:6801/2323038417","cluster_addr":"172.21.15.18:6803/2323038417","heartbeat_back_addr":"172.21.15.18:6807/2323038417","heartbeat_front_addr":"172.21.15.18:6805/2323038417","state":["exists","up"]},{"osd":1,"uuid":"31810ef3-2c71-48d6-8748-b74a2968d23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6817","nonce":1283678238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6819","nonce":1283678238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6823","nonce":1283678238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6821","nonce":1283678238}]},"public_addr":"172.21.15.18:6817/1283678238","cluster_addr":"172.21.15.18:6819/1283678238","heartbeat_back_addr":"172.21.15.18:6823/1283678238","heartbeat_front_addr":"172.21.15.18:6821/1283678238","state":["exists","up"]},{"osd":2,"uuid":"5a783cc5-a41c-4967-9e11-6b8330f97d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6809","nonce":1212875862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6811","nonce":1212875862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6815","nonce":1212875862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6813","nonce":1212875862}]},"public_addr":"172.21.15.18:6809/1212875862","cluster_addr":"172.21.15.18:6811/1212875862","heartbeat_back_addr":"172.21.15.18:6815/1212875862","heartbeat_front_addr":"172.21.15.18:6813/1212875862","state":["exists","up"]},{"osd":3,"uuid":"b7e056d9-9da5-46e1-810d-0c3e242fe5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6825","nonce":2428878428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6827","nonce":2428878428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6831","nonce":2428878428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6829","nonce":2428878428}]},"public_addr":"172.21.15.18:6825/2428878428","cluster_addr":"172.21.15.18:6827/2428878428","heartbeat_back_addr":"172.21.15.18:6831/2428878428","heartbeat_front_addr":"172.21.15.18:6829/2428878428","state":["exists","up"]},{"osd":4,"uuid":"21df023f-bc8b-4abb-93e5-0ecc91acda0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6825","nonce":1421511819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6827","nonce":1421511819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6831","nonce":1421511819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6829","nonce":1421511819}]},"public_addr":"172.21.15.173:6825/1421511819","cluster_addr":"172.21.15.173:6827/1421511819","heartbeat_back_addr":"172.21.15.173:6831/1421511819","heartbeat_front_addr":"172.21.15.173:6829/1421511819","state":["exists","up"]},{"osd":5,"uuid":"e270098a-6d33-49f8-84ed-94e09a880cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6801","nonce":4221907702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6803","nonce":4221907702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6807","nonce":4221907702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6805","nonce":4221907702}]},"public_addr":"172.21.15.173:6801/4221907702","cluster_addr":"172.21.15.173:6803/4221907702","heartbeat_back_addr":"172.21.15.173:6807/4221907702","heartbeat_front_addr":"172.21.15.173:6805/4221907702","state":["exists","up"]},{"osd":6,"uuid":"93c67c8c-268d-4e32-877c-043cd3acd87c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6809","nonce":761678552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6811","nonce":761678552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6815","nonce":761678552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6813","nonce":761678552}]},"public_addr":"172.21.15.173:6809/761678552","cluster_addr":"172.21.15.173:6811/761678552","heartbeat_back_addr":"172.21.15.173:6815/761678552","heartbeat_front_addr":"172.21.15.173:6813/761678552","state":["exists","up"]},{"osd":7,"uuid":"faf10eea-80de-40f6-abbb-34d07d3f59ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6817","nonce":383724537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6819","nonce":383724537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6823","nonce":383724537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6821","nonce":383724537}]},"public_addr":"172.21.15.173:6817/383724537","cluster_addr":"172.21.15.173:6819/383724537","heartbeat_back_addr":"172.21.15.173:6823/383724537","heartbeat_front_addr":"172.21.15.173:6821/383724537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.668924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.761747+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.768128+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.632252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.742608+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.734327+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.477107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.818292+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T19:53:11.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.637+0000 7fb50f076640 1 -- 172.21.15.18:0/2744951114 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fb4f40683b0 msgr2=0x7fb4f406a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:11.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.637+0000 7fb50f076640 1 --2- 172.21.15.18:0/2744951114 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fb4f40683b0 0x7fb4f406a8c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb4f8000f70 tx=0x7fb4f8007e90 comp rx=0 tx=0).stop 2024-04-17T19:53:11.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.637+0000 7fb50f076640 1 -- 172.21.15.18:0/2744951114 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5080b44b0 msgr2=0x7fb508155b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:11.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.637+0000 7fb50f076640 1 --2- 172.21.15.18:0/2744951114 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5080b44b0 0x7fb508155b70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc00e8a0 tx=0x7fb4fc00eca0 comp rx=0 tx=0).stop 2024-04-17T19:53:11.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.637+0000 7fb50f076640 1 -- 172.21.15.18:0/2744951114 shutdown_connections 2024-04-17T19:53:11.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.637+0000 7fb50f076640 1 --2- 172.21.15.18:0/2744951114 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fb4f40683b0 0x7fb4f406a8c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:11.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.637+0000 7fb50f076640 1 --2- 172.21.15.18:0/2744951114 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb508157130 0x7fb5081560b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:11.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.637+0000 7fb50f076640 1 --2- 172.21.15.18:0/2744951114 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5080b44b0 0x7fb508155b70 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:11.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.637+0000 7fb50f076640 1 --2- 172.21.15.18:0/2744951114 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5080b0120 0x7fb5081577a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:11.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.637+0000 7fb50f076640 1 -- 172.21.15.18:0/2744951114 >> 172.21.15.18:0/2744951114 conn(0x7fb508072bb0 msgr2=0x7fb5080b1710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:11.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.637+0000 7fb50f076640 1 -- 172.21.15.18:0/2744951114 shutdown_connections 2024-04-17T19:53:11.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.637+0000 7fb50f076640 1 -- 172.21.15.18:0/2744951114 wait complete. 2024-04-17T19:53:11.670 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T19:53:11.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.821+0000 7fa674e6e640 1 Processor -- start 2024-04-17T19:53:11.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.821+0000 7fa674e6e640 1 -- start start 2024-04-17T19:53:11.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.821+0000 7fa674e6e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa6700b0120 0x7fa67015f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:11.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.821+0000 7fa674e6e640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa6700b44b0 0x7fa6700b48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:11.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.821+0000 7fa674e6e640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6701607b0 con 0x7fa67006cd60 2024-04-17T19:53:11.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.821+0000 7fa674e6e640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fa6700b0530 con 0x7fa6700b0120 2024-04-17T19:53:11.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.821+0000 7fa674e6e640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7fa67015ff10 con 0x7fa6700b44b0 2024-04-17T19:53:11.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.821+0000 7fa66dd9b640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fa67006cd60 0x7fa67006d170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:38528/0 (socket says 172.21.15.18:38528) 2024-04-17T19:53:11.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.821+0000 7fa66dd9b640 1 -- 172.21.15.18:0/3476429121 learned_addr learned my addr 172.21.15.18:0/3476429121 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:11.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.821+0000 7fa66e59c640 1 --2- 172.21.15.18:0/3476429121 >> v2:172.21.15.18:3300/0 conn(0x7fa6700b0120 0x7fa67015f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:11.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.821+0000 7fa66d59a640 1 -- 172.21.15.18:0/3476429121 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3574828277 0 0) 0x7fa6701607b0 con 0x7fa67006cd60 2024-04-17T19:53:11.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.821+0000 7fa66d59a640 1 -- 172.21.15.18:0/3476429121 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa658003530 con 0x7fa67006cd60 2024-04-17T19:53:11.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.821+0000 7fa66ed9d640 1 --2- 172.21.15.18:0/3476429121 >> v2:172.21.15.173:3300/0 conn(0x7fa6700b44b0 0x7fa6700b48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:11.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.821+0000 7fa66e59c640 1 -- 172.21.15.18:0/3476429121 >> v2:172.21.15.173:3300/0 conn(0x7fa6700b44b0 msgr2=0x7fa6700b48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:11.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.821+0000 7fa66e59c640 1 --2- 172.21.15.18:0/3476429121 >> v2:172.21.15.173:3300/0 conn(0x7fa6700b44b0 0x7fa6700b48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:11.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.821+0000 7fa66e59c640 1 -- 172.21.15.18:0/3476429121 >> v1:172.21.15.18:6789/0 conn(0x7fa67006cd60 legacy=0x7fa67006d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:11.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.821+0000 7fa66d59a640 1 -- 172.21.15.18:0/3476429121 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 488230544 0 0) 0x7fa658003530 con 0x7fa67006cd60 2024-04-17T19:53:11.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.821+0000 7fa66e59c640 1 -- 172.21.15.18:0/3476429121 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6701601f0 con 0x7fa6700b0120 2024-04-17T19:53:11.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.825+0000 7fa66e59c640 1 --2- 172.21.15.18:0/3476429121 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6700b0120 0x7fa67015f830 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa670070840 tx=0x7fa66001c2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3345f2821d515778 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:11.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.825+0000 7fa66d59a640 1 -- 172.21.15.18:0/3476429121 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6600b0070 con 0x7fa6700b0120 2024-04-17T19:53:11.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.825+0000 7fa66d59a640 1 -- 172.21.15.18:0/3476429121 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6600ab400 con 0x7fa6700b0120 2024-04-17T19:53:11.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.825+0000 7fa66d59a640 1 -- 172.21.15.18:0/3476429121 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa664001680 con 0x7fa6700b0120 2024-04-17T19:53:11.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.825+0000 7fa674e6e640 1 -- 172.21.15.18:0/3476429121 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6700b0120 msgr2=0x7fa67015f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:11.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.825+0000 7fa674e6e640 1 --2- 172.21.15.18:0/3476429121 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6700b0120 0x7fa67015f830 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa670070840 tx=0x7fa66001c2e0 comp rx=0 tx=0).stop 2024-04-17T19:53:11.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.825+0000 7fa674e6e640 1 -- 172.21.15.18:0/3476429121 shutdown_connections 2024-04-17T19:53:11.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.825+0000 7fa674e6e640 1 --2- 172.21.15.18:0/3476429121 >> v2:172.21.15.173:3300/0 conn(0x7fa6700b44b0 0x7fa6700b48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:11.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.825+0000 7fa674e6e640 1 --2- 172.21.15.18:0/3476429121 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6700b0120 0x7fa67015f830 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:11.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.825+0000 7fa674e6e640 1 -- 172.21.15.18:0/3476429121 >> 172.21.15.18:0/3476429121 conn(0x7fa670072bb0 msgr2=0x7fa670072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:11.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.829+0000 7fa674e6e640 1 -- 172.21.15.18:0/3476429121 shutdown_connections 2024-04-17T19:53:11.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.829+0000 7fa674e6e640 1 -- 172.21.15.18:0/3476429121 wait complete. 2024-04-17T19:53:11.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.829+0000 7fa674e6e640 1 Processor -- start 2024-04-17T19:53:11.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.829+0000 7fa674e6e640 1 -- start start 2024-04-17T19:53:11.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.829+0000 7fa674e6e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa67006cd60 0x7fa6701fbe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:11.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.829+0000 7fa674e6e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6700b0120 0x7fa67013a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:11.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.829+0000 7fa674e6e640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa6700b44b0 0x7fa6701610f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:11.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.829+0000 7fa674e6e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa67016c200 con 0x7fa67006cd60 2024-04-17T19:53:11.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.829+0000 7fa674e6e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa67016c080 con 0x7fa6700b0120 2024-04-17T19:53:11.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.829+0000 7fa674e6e640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fa67016c380 con 0x7fa6700b44b0 2024-04-17T19:53:11.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.829+0000 7fa66e59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa67006cd60 0x7fa6701fbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:11.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.829+0000 7fa66e59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa67006cd60 0x7fa6701fbe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44990/0 (socket says 172.21.15.18:44990) 2024-04-17T19:53:11.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.829+0000 7fa66e59c640 1 -- 172.21.15.18:0/2183042923 learned_addr learned my addr 172.21.15.18:0/2183042923 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:11.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.829+0000 7fa66dd9b640 1 --2- 172.21.15.18:0/2183042923 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6700b0120 0x7fa67013a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:11.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.829+0000 7fa66ed9d640 1 --2- 172.21.15.18:0/2183042923 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa6700b44b0 0x7fa6701610f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:11.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.829+0000 7fa66e59c640 1 -- 172.21.15.18:0/2183042923 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa6700b44b0 msgr2=0x7fa6701610f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:11.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.829+0000 7fa66e59c640 1 --2- 172.21.15.18:0/2183042923 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa6700b44b0 0x7fa6701610f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:11.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.829+0000 7fa66e59c640 1 -- 172.21.15.18:0/2183042923 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6700b0120 msgr2=0x7fa67013a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:11.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.829+0000 7fa66e59c640 1 --2- 172.21.15.18:0/2183042923 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6700b0120 0x7fa67013a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:11.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.829+0000 7fa66e59c640 1 -- 172.21.15.18:0/2183042923 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6701fc810 con 0x7fa67006cd60 2024-04-17T19:53:11.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.829+0000 7fa66ed9d640 1 --2- 172.21.15.18:0/2183042923 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa6700b44b0 0x7fa6701610f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:53:11.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.829+0000 7fa66e59c640 1 --2- 172.21.15.18:0/2183042923 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa67006cd60 0x7fa6701fbe30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa6600ae040 tx=0x7fa66001ab20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:11.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.833+0000 7fa65effd640 1 -- 172.21.15.18:0/2183042923 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6600b0050 con 0x7fa67006cd60 2024-04-17T19:53:11.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.833+0000 7fa65effd640 1 -- 172.21.15.18:0/2183042923 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6600bc070 con 0x7fa67006cd60 2024-04-17T19:53:11.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.833+0000 7fa674e6e640 1 -- 172.21.15.18:0/2183042923 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6701fcaf0 con 0x7fa67006cd60 2024-04-17T19:53:11.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.833+0000 7fa65effd640 1 -- 172.21.15.18:0/2183042923 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6600b78b0 con 0x7fa67006cd60 2024-04-17T19:53:11.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.833+0000 7fa674e6e640 1 -- 172.21.15.18:0/2183042923 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa67014bb30 con 0x7fa67006cd60 2024-04-17T19:53:11.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.833+0000 7fa674e6e640 1 -- 172.21.15.18:0/2183042923 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa670069950 con 0x7fa67006cd60 2024-04-17T19:53:11.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.833+0000 7fa65effd640 1 -- 172.21.15.18:0/2183042923 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa6600b7a50 con 0x7fa67006cd60 2024-04-17T19:53:11.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.833+0000 7fa65effd640 1 --2- 172.21.15.18:0/2183042923 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fa650068380 0x7fa65006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:11.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.833+0000 7fa65effd640 1 -- 172.21.15.18:0/2183042923 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fa660121350 con 0x7fa67006cd60 2024-04-17T19:53:11.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.833+0000 7fa66dd9b640 1 --2- 172.21.15.18:0/2183042923 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fa650068380 0x7fa65006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:11.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.833+0000 7fa66dd9b640 1 --2- 172.21.15.18:0/2183042923 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fa650068380 0x7fa65006a890 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa670161c90 tx=0x7fa664009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:11.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:11.837+0000 7fa65effd640 1 -- 172.21.15.18:0/2183042923 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa660015f90 con 0x7fa67006cd60 2024-04-17T19:53:12.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.033+0000 7fa674e6e640 1 -- 172.21.15.18:0/2183042923 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa67015f910 con 0x7fa67006cd60 2024-04-17T19:53:12.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.037+0000 7fa65effd640 1 -- 172.21.15.18:0/2183042923 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5177 (secure 0 0 0) 0x7fa6600f1540 con 0x7fa67006cd60 2024-04-17T19:53:12.033 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:53:12.033 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/729504609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":729504609},{"type":"v1","addr":"172.21.15.173:6833","nonce":729504609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4261,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/3797017174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3797017174},{"type":"v1","addr":"172.21.15.173:6835","nonce":3797017174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/995848920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":995848920},{"type":"v1","addr":"172.21.15.18:6835","nonce":995848920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-17T19:53:04.851226+0000","modified":"2024-04-17T19:53:09.904317+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6837/1926349198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1926349198},{"type":"v1","addr":"172.21.15.18:6837","nonce":1926349198}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1}]} 2024-04-17T19:53:12.033 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 7 2024-04-17T19:53:12.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.037+0000 7fa674e6e640 1 -- 172.21.15.18:0/2183042923 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fa650068380 msgr2=0x7fa65006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:12.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.037+0000 7fa674e6e640 1 --2- 172.21.15.18:0/2183042923 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fa650068380 0x7fa65006a890 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa670161c90 tx=0x7fa664009040 comp rx=0 tx=0).stop 2024-04-17T19:53:12.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.037+0000 7fa674e6e640 1 -- 172.21.15.18:0/2183042923 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa67006cd60 msgr2=0x7fa6701fbe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:12.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.037+0000 7fa674e6e640 1 --2- 172.21.15.18:0/2183042923 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa67006cd60 0x7fa6701fbe30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa6600ae040 tx=0x7fa66001ab20 comp rx=0 tx=0).stop 2024-04-17T19:53:12.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.037+0000 7fa674e6e640 1 -- 172.21.15.18:0/2183042923 shutdown_connections 2024-04-17T19:53:12.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.037+0000 7fa674e6e640 1 --2- 172.21.15.18:0/2183042923 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fa650068380 0x7fa65006a890 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:12.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.037+0000 7fa674e6e640 1 --2- 172.21.15.18:0/2183042923 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa6700b44b0 0x7fa6701610f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:12.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.037+0000 7fa674e6e640 1 --2- 172.21.15.18:0/2183042923 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6700b0120 0x7fa67013a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:12.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.037+0000 7fa674e6e640 1 --2- 172.21.15.18:0/2183042923 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa67006cd60 0x7fa6701fbe30 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:12.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.037+0000 7fa674e6e640 1 -- 172.21.15.18:0/2183042923 >> 172.21.15.18:0/2183042923 conn(0x7fa670072bb0 msgr2=0x7fa67006e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:12.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.037+0000 7fa674e6e640 1 -- 172.21.15.18:0/2183042923 shutdown_connections 2024-04-17T19:53:12.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.037+0000 7fa674e6e640 1 -- 172.21.15.18:0/2183042923 wait complete. 2024-04-17T19:53:12.055 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T19:53:12.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.213+0000 7f3d02111640 1 Processor -- start 2024-04-17T19:53:12.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.213+0000 7f3d02111640 1 -- start start 2024-04-17T19:53:12.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.213+0000 7f3d02111640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3cfc15e1a0 0x7f3cfc0ce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:12.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.213+0000 7f3d02111640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cfc0d0020 con 0x7f3cfc06cd60 2024-04-17T19:53:12.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.213+0000 7f3d02111640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cfc0cd930 con 0x7f3cfc0cef10 2024-04-17T19:53:12.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.213+0000 7f3d02111640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f3cfc0cdc10 con 0x7f3cfc15e1a0 2024-04-17T19:53:12.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.213+0000 7f3cfbfff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f3cfc06cd60 0x7f3cfc06d170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:38544/0 (socket says 172.21.15.18:38544) 2024-04-17T19:53:12.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.213+0000 7f3cfbfff640 1 -- 172.21.15.18:0/995593591 learned_addr learned my addr 172.21.15.18:0/995593591 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:12.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.213+0000 7f3cfb7fe640 1 --2- 172.21.15.18:0/995593591 >> v2:172.21.15.173:3300/0 conn(0x7f3cfc15e1a0 0x7f3cfc0ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:12.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.213+0000 7f3cfa7fc640 1 -- 172.21.15.18:0/995593591 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2087236073 0 0) 0x7f3cfc0d0020 con 0x7f3cfc06cd60 2024-04-17T19:53:12.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.213+0000 7f3cfa7fc640 1 -- 172.21.15.18:0/995593591 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ce4003530 con 0x7f3cfc06cd60 2024-04-17T19:53:12.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.213+0000 7f3cfa7fc640 1 -- 172.21.15.18:0/995593591 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1413493951 0 0) 0x7f3ce4003530 con 0x7f3cfc06cd60 2024-04-17T19:53:12.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.213+0000 7f3cfa7fc640 1 -- 172.21.15.18:0/995593591 >> v2:172.21.15.173:3300/0 conn(0x7f3cfc15e1a0 msgr2=0x7f3cfc0ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:12.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.213+0000 7f3cfa7fc640 1 --2- 172.21.15.18:0/995593591 >> v2:172.21.15.173:3300/0 conn(0x7f3cfc15e1a0 0x7f3cfc0ce9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:12.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.213+0000 7f3cfa7fc640 1 -- 172.21.15.18:0/995593591 >> v1:172.21.15.173:6789/0 conn(0x7f3cfc0cef10 legacy=0x7f3cfc15e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:12.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.213+0000 7f3cfa7fc640 1 -- 172.21.15.18:0/995593591 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cfc0cdef0 con 0x7f3cfc06cd60 2024-04-17T19:53:12.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.213+0000 7f3cfa7fc640 1 -- 172.21.15.18:0/995593591 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3208559991 0 0) 0x7f3cf4001a20 con 0x7f3cfc06cd60 2024-04-17T19:53:12.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.213+0000 7f3cfa7fc640 1 -- 172.21.15.18:0/995593591 >> v1:172.21.15.18:6789/0 conn(0x7f3cfc06cd60 legacy=0x7f3cfc06d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:12.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.213+0000 7f3cfa7fc640 1 --2- 172.21.15.18:0/995593591 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ce40039c0 0x7f3ce4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:12.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.213+0000 7f3cfa7fc640 1 --2- 172.21.15.18:0/995593591 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ce4004810 0x7f3ce4004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:12.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.213+0000 7f3cfa7fc640 1 --2- 172.21.15.18:0/995593591 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ce4005260 0x7f3ce400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:12.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.213+0000 7f3cfa7fc640 1 -- 172.21.15.18:0/995593591 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3cfc0cdc10 con 0x7f3ce4005260 2024-04-17T19:53:12.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.213+0000 7f3cfa7fc640 1 -- 172.21.15.18:0/995593591 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce400c1f0 con 0x7f3ce40039c0 2024-04-17T19:53:12.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.213+0000 7f3cfa7fc640 1 -- 172.21.15.18:0/995593591 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f3ce400c3f0 con 0x7f3ce4004810 2024-04-17T19:53:12.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.213+0000 7f3cfbfff640 1 --2- 172.21.15.18:0/995593591 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ce4005260 0x7f3ce400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:12.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.213+0000 7f3cfaffd640 1 --2- 172.21.15.18:0/995593591 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ce4004810 0x7f3ce4004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:12.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.217+0000 7f3cfbfff640 1 -- 172.21.15.18:0/995593591 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ce4004810 msgr2=0x7f3ce4004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:12.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.217+0000 7f3cfbfff640 1 --2- 172.21.15.18:0/995593591 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ce4004810 0x7f3ce4004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:12.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.217+0000 7f3cfbfff640 1 -- 172.21.15.18:0/995593591 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ce40039c0 msgr2=0x7f3ce4003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:12.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.217+0000 7f3cfbfff640 1 --2- 172.21.15.18:0/995593591 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ce40039c0 0x7f3ce4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:12.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.217+0000 7f3cfbfff640 1 -- 172.21.15.18:0/995593591 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ce4003530 con 0x7f3ce4005260 2024-04-17T19:53:12.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.217+0000 7f3cfbfff640 1 -- 172.21.15.18:0/995593591 reap_dead start 2024-04-17T19:53:12.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.217+0000 7f3cfbfff640 1 --2- 172.21.15.18:0/995593591 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ce4005260 0x7f3ce400b9d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3cf400a8f0 tx=0x7f3cf401fb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b124cbb10903940 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:12.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.217+0000 7f3cfa7fc640 1 -- 172.21.15.18:0/995593591 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf400a4c0 con 0x7f3ce4005260 2024-04-17T19:53:12.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.217+0000 7f3cfa7fc640 1 -- 172.21.15.18:0/995593591 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cf40aa700 con 0x7f3ce4005260 2024-04-17T19:53:12.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.217+0000 7f3cfa7fc640 1 -- 172.21.15.18:0/995593591 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf40aaad0 con 0x7f3ce4005260 2024-04-17T19:53:12.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.217+0000 7f3d02111640 1 -- 172.21.15.18:0/995593591 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ce4005260 msgr2=0x7f3ce400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:12.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.217+0000 7f3d02111640 1 --2- 172.21.15.18:0/995593591 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ce4005260 0x7f3ce400b9d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3cf400a8f0 tx=0x7f3cf401fb60 comp rx=0 tx=0).stop 2024-04-17T19:53:12.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.217+0000 7f3d02111640 1 -- 172.21.15.18:0/995593591 shutdown_connections 2024-04-17T19:53:12.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.217+0000 7f3d02111640 1 --2- 172.21.15.18:0/995593591 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ce4005260 0x7f3ce400b9d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:12.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.217+0000 7f3d02111640 1 -- 172.21.15.18:0/995593591 >> 172.21.15.18:0/995593591 conn(0x7f3cfc072bb0 msgr2=0x7f3cfc072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:12.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.217+0000 7f3d02111640 1 -- 172.21.15.18:0/995593591 shutdown_connections 2024-04-17T19:53:12.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.217+0000 7f3d02111640 1 -- 172.21.15.18:0/995593591 wait complete. 2024-04-17T19:53:12.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.221+0000 7f3d02111640 1 Processor -- start 2024-04-17T19:53:12.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.221+0000 7f3d02111640 1 -- start start 2024-04-17T19:53:12.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.221+0000 7f3d02111640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ce4005260 0x7f3cfc13c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:12.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.221+0000 7f3d02111640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3cfc13d100 0x7f3cfc13f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:12.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.221+0000 7f3d02111640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3cfc13d510 0x7f3cfc13f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:12.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.221+0000 7f3d02111640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3cfc15e5b0 con 0x7f3cfc13d100 2024-04-17T19:53:12.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.221+0000 7f3d02111640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3cfc0ce4b0 con 0x7f3cfc13d510 2024-04-17T19:53:12.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.221+0000 7f3d02111640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f3cfc15e730 con 0x7f3ce4005260 2024-04-17T19:53:12.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.221+0000 7f3cfaffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3cfc13d100 0x7f3cfc13f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:12.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.221+0000 7f3cfaffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3cfc13d100 0x7f3cfc13f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45018/0 (socket says 172.21.15.18:45018) 2024-04-17T19:53:12.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.221+0000 7f3cfaffd640 1 -- 172.21.15.18:0/1222418995 learned_addr learned my addr 172.21.15.18:0/1222418995 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:12.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.221+0000 7f3cfbfff640 1 --2- 172.21.15.18:0/1222418995 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3cfc13d510 0x7f3cfc13f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:12.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.221+0000 7f3cfb7fe640 1 --2- 172.21.15.18:0/1222418995 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ce4005260 0x7f3cfc13c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:12.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.221+0000 7f3cfaffd640 1 -- 172.21.15.18:0/1222418995 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ce4005260 msgr2=0x7f3cfc13c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:12.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.221+0000 7f3cfaffd640 1 --2- 172.21.15.18:0/1222418995 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ce4005260 0x7f3cfc13c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:12.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.221+0000 7f3cfaffd640 1 -- 172.21.15.18:0/1222418995 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3cfc13d510 msgr2=0x7f3cfc13f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:12.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.221+0000 7f3cfaffd640 1 --2- 172.21.15.18:0/1222418995 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3cfc13d510 0x7f3cfc13f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:12.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.221+0000 7f3cfaffd640 1 -- 172.21.15.18:0/1222418995 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cfc14f9f0 con 0x7f3cfc13d100 2024-04-17T19:53:12.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.221+0000 7f3cfaffd640 1 --2- 172.21.15.18:0/1222418995 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3cfc13d100 0x7f3cfc13f130 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3cf000e440 tx=0x7f3cf000e900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:12.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.221+0000 7f3ce3fff640 1 -- 172.21.15.18:0/1222418995 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf00052e0 con 0x7f3cfc13d100 2024-04-17T19:53:12.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.221+0000 7f3ce3fff640 1 -- 172.21.15.18:0/1222418995 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cf0018070 con 0x7f3cfc13d100 2024-04-17T19:53:12.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.221+0000 7f3d02111640 1 -- 172.21.15.18:0/1222418995 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cfc13dc70 con 0x7f3cfc13d100 2024-04-17T19:53:12.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.221+0000 7f3ce3fff640 1 -- 172.21.15.18:0/1222418995 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf0005480 con 0x7f3cfc13d100 2024-04-17T19:53:12.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.221+0000 7f3d02111640 1 -- 172.21.15.18:0/1222418995 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cfc13e230 con 0x7f3cfc13d100 2024-04-17T19:53:12.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.225+0000 7f3d02111640 1 -- 172.21.15.18:0/1222418995 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cfc13d9e0 con 0x7f3cfc13d100 2024-04-17T19:53:12.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.225+0000 7f3ce3fff640 1 -- 172.21.15.18:0/1222418995 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3cf0003840 con 0x7f3cfc13d100 2024-04-17T19:53:12.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.225+0000 7f3ce3fff640 1 --2- 172.21.15.18:0/1222418995 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f3ce8068380 0x7f3ce806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:12.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.225+0000 7f3ce3fff640 1 -- 172.21.15.18:0/1222418995 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f3cf0086930 con 0x7f3cfc13d100 2024-04-17T19:53:12.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.225+0000 7f3cfb7fe640 1 --2- 172.21.15.18:0/1222418995 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f3ce8068380 0x7f3ce806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:12.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.225+0000 7f3cfb7fe640 1 --2- 172.21.15.18:0/1222418995 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f3ce8068380 0x7f3ce806a890 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3cec0047c0 tx=0x7f3cec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:12.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.229+0000 7f3ce3fff640 1 -- 172.21.15.18:0/1222418995 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3cf0056bb0 con 0x7f3cfc13d100 2024-04-17T19:53:12.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.393+0000 7f3d02111640 1 -- 172.21.15.18:0/1222418995 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3cfc069950 con 0x7f3cfc13d100 2024-04-17T19:53:12.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.397+0000 7f3ce3fff640 1 -- 172.21.15.18:0/1222418995 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18506 (secure 0 0 0) 0x7f3cf00564b0 con 0x7f3cfc13d100 2024-04-17T19:53:12.392 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:53:12.392 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":27,"fsid":"dd480169-5a81-4623-be5f-0499aa244b28","created":"2024-04-17T19:52:39.533760+0000","modified":"2024-04-17T19:53:09.903922+0000","last_up_change":"2024-04-17T19:52:51.229698+0000","last_in_change":"2024-04-17T19:52:42.144259+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T19:52:52.391648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T19:53:02.734240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T19:53:03.813028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T19:53:07.478812+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e232d577-2508-4ea4-b355-29fbae1ff025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6801","nonce":2323038417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6803","nonce":2323038417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6807","nonce":2323038417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6805","nonce":2323038417}]},"public_addr":"172.21.15.18:6801/2323038417","cluster_addr":"172.21.15.18:6803/2323038417","heartbeat_back_addr":"172.21.15.18:6807/2323038417","heartbeat_front_addr":"172.21.15.18:6805/2323038417","state":["exists","up"]},{"osd":1,"uuid":"31810ef3-2c71-48d6-8748-b74a2968d23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6817","nonce":1283678238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6819","nonce":1283678238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6823","nonce":1283678238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6821","nonce":1283678238}]},"public_addr":"172.21.15.18:6817/1283678238","cluster_addr":"172.21.15.18:6819/1283678238","heartbeat_back_addr":"172.21.15.18:6823/1283678238","heartbeat_front_addr":"172.21.15.18:6821/1283678238","state":["exists","up"]},{"osd":2,"uuid":"5a783cc5-a41c-4967-9e11-6b8330f97d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6809","nonce":1212875862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6811","nonce":1212875862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6815","nonce":1212875862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6813","nonce":1212875862}]},"public_addr":"172.21.15.18:6809/1212875862","cluster_addr":"172.21.15.18:6811/1212875862","heartbeat_back_addr":"172.21.15.18:6815/1212875862","heartbeat_front_addr":"172.21.15.18:6813/1212875862","state":["exists","up"]},{"osd":3,"uuid":"b7e056d9-9da5-46e1-810d-0c3e242fe5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6825","nonce":2428878428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6827","nonce":2428878428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6831","nonce":2428878428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6829","nonce":2428878428}]},"public_addr":"172.21.15.18:6825/2428878428","cluster_addr":"172.21.15.18:6827/2428878428","heartbeat_back_addr":"172.21.15.18:6831/2428878428","heartbeat_front_addr":"172.21.15.18:6829/2428878428","state":["exists","up"]},{"osd":4,"uuid":"21df023f-bc8b-4abb-93e5-0ecc91acda0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6825","nonce":1421511819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6827","nonce":1421511819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6831","nonce":1421511819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6829","nonce":1421511819}]},"public_addr":"172.21.15.173:6825/1421511819","cluster_addr":"172.21.15.173:6827/1421511819","heartbeat_back_addr":"172.21.15.173:6831/1421511819","heartbeat_front_addr":"172.21.15.173:6829/1421511819","state":["exists","up"]},{"osd":5,"uuid":"e270098a-6d33-49f8-84ed-94e09a880cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6801","nonce":4221907702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6803","nonce":4221907702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6807","nonce":4221907702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6805","nonce":4221907702}]},"public_addr":"172.21.15.173:6801/4221907702","cluster_addr":"172.21.15.173:6803/4221907702","heartbeat_back_addr":"172.21.15.173:6807/4221907702","heartbeat_front_addr":"172.21.15.173:6805/4221907702","state":["exists","up"]},{"osd":6,"uuid":"93c67c8c-268d-4e32-877c-043cd3acd87c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6809","nonce":761678552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6811","nonce":761678552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6815","nonce":761678552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6813","nonce":761678552}]},"public_addr":"172.21.15.173:6809/761678552","cluster_addr":"172.21.15.173:6811/761678552","heartbeat_back_addr":"172.21.15.173:6815/761678552","heartbeat_front_addr":"172.21.15.173:6813/761678552","state":["exists","up"]},{"osd":7,"uuid":"faf10eea-80de-40f6-abbb-34d07d3f59ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6817","nonce":383724537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6819","nonce":383724537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6823","nonce":383724537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6821","nonce":383724537}]},"public_addr":"172.21.15.173:6817/383724537","cluster_addr":"172.21.15.173:6819/383724537","heartbeat_back_addr":"172.21.15.173:6823/383724537","heartbeat_front_addr":"172.21.15.173:6821/383724537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.668924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.761747+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.768128+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.632252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.742608+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.734327+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.477107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.818292+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T19:53:12.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.397+0000 7f3d02111640 1 -- 172.21.15.18:0/1222418995 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f3ce8068380 msgr2=0x7f3ce806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:12.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.397+0000 7f3d02111640 1 --2- 172.21.15.18:0/1222418995 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f3ce8068380 0x7f3ce806a890 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3cec0047c0 tx=0x7f3cec008040 comp rx=0 tx=0).stop 2024-04-17T19:53:12.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.397+0000 7f3d02111640 1 -- 172.21.15.18:0/1222418995 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3cfc13d100 msgr2=0x7f3cfc13f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:12.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.397+0000 7f3d02111640 1 --2- 172.21.15.18:0/1222418995 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3cfc13d100 0x7f3cfc13f130 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3cf000e440 tx=0x7f3cf000e900 comp rx=0 tx=0).stop 2024-04-17T19:53:12.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.397+0000 7f3d02111640 1 -- 172.21.15.18:0/1222418995 shutdown_connections 2024-04-17T19:53:12.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.397+0000 7f3d02111640 1 --2- 172.21.15.18:0/1222418995 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f3ce8068380 0x7f3ce806a890 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:12.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.397+0000 7f3d02111640 1 --2- 172.21.15.18:0/1222418995 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3cfc13d510 0x7f3cfc13f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:12.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.397+0000 7f3d02111640 1 --2- 172.21.15.18:0/1222418995 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3cfc13d100 0x7f3cfc13f130 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:12.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.397+0000 7f3d02111640 1 --2- 172.21.15.18:0/1222418995 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3ce4005260 0x7f3cfc13c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:12.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.397+0000 7f3d02111640 1 -- 172.21.15.18:0/1222418995 >> 172.21.15.18:0/1222418995 conn(0x7f3cfc072bb0 msgr2=0x7f3cfc157da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:12.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.397+0000 7f3d02111640 1 -- 172.21.15.18:0/1222418995 shutdown_connections 2024-04-17T19:53:12.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.397+0000 7f3d02111640 1 -- 172.21.15.18:0/1222418995 wait complete. 2024-04-17T19:53:12.816 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-17T19:53:04.851226+0000', 'modified': '2024-04-17T19:53:09.904317+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4278}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4278': {'gid': 4278, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.18:6837/1926349198', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6836', 'nonce': 1926349198}, {'type': 'v1', 'addr': '172.21.15.18:6837', 'nonce': 1926349198}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4278, 'qdb_cluster': [4278]} 2024-04-17T19:53:12.817 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-17T19:53:12.817 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-17T19:53:12.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.985+0000 7f100b999640 1 Processor -- start 2024-04-17T19:53:12.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.985+0000 7f100b999640 1 -- start start 2024-04-17T19:53:12.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.989+0000 7f100b999640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f10041429f0 0x7f1004073080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:12.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.989+0000 7f100b999640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f10040735c0 0x7f1004159380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:12.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.989+0000 7f100b999640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10040739d0 con 0x7f10041598c0 2024-04-17T19:53:12.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.989+0000 7f100b999640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f100415fdd0 con 0x7f10041429f0 2024-04-17T19:53:12.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.989+0000 7f100b999640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f10041600b0 con 0x7f10040735c0 2024-04-17T19:53:12.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.989+0000 7f1008f34640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f10040735c0 0x7f1004159380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:12.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.989+0000 7f1008f34640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f10040735c0 0x7f1004159380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.18:49802/0 (socket says 172.21.15.18:49802) 2024-04-17T19:53:12.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.989+0000 7f1008f34640 1 -- 172.21.15.18:0/3441663269 learned_addr learned my addr 172.21.15.18:0/3441663269 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:12.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.989+0000 7f1009735640 1 --2- 172.21.15.18:0/3441663269 >> v2:172.21.15.173:3300/0 conn(0x7f10041429f0 0x7f1004073080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:12.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.989+0000 7f1009735640 1 -- 172.21.15.18:0/3441663269 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f10040735c0 msgr2=0x7f1004159380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:12.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.989+0000 7f1009735640 1 --2- 172.21.15.18:0/3441663269 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f10040735c0 0x7f1004159380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:12.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.989+0000 7f1009735640 1 -- 172.21.15.18:0/3441663269 >> v1:172.21.15.173:6789/0 conn(0x7f10041598c0 legacy=0x7f10040b47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:12.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.989+0000 7f1009735640 1 -- 172.21.15.18:0/3441663269 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1004160390 con 0x7f10041429f0 2024-04-17T19:53:12.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.989+0000 7f1008f34640 1 --2- 172.21.15.18:0/3441663269 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f10040735c0 0x7f1004159380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T19:53:12.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.993+0000 7f1009735640 1 --2- 172.21.15.18:0/3441663269 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10041429f0 0x7f1004073080 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f10000097c0 tx=0x7f100001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea74811263bd897a server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:12.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.993+0000 7f0ffbfff640 1 -- 172.21.15.18:0/3441663269 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10000b0070 con 0x7f10041429f0 2024-04-17T19:53:12.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.993+0000 7f0ffbfff640 1 -- 172.21.15.18:0/3441663269 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10000ab600 con 0x7f10041429f0 2024-04-17T19:53:12.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.993+0000 7f0ffbfff640 1 -- 172.21.15.18:0/3441663269 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10000ab9d0 con 0x7f10041429f0 2024-04-17T19:53:12.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.993+0000 7f100b999640 1 -- 172.21.15.18:0/3441663269 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10041429f0 msgr2=0x7f1004073080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:12.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.993+0000 7f100b999640 1 --2- 172.21.15.18:0/3441663269 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10041429f0 0x7f1004073080 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f10000097c0 tx=0x7f100001c4a0 comp rx=0 tx=0).stop 2024-04-17T19:53:12.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.993+0000 7f100b999640 1 -- 172.21.15.18:0/3441663269 shutdown_connections 2024-04-17T19:53:12.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.993+0000 7f100b999640 1 --2- 172.21.15.18:0/3441663269 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f10040735c0 0x7f1004159380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:12.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.993+0000 7f100b999640 1 --2- 172.21.15.18:0/3441663269 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10041429f0 0x7f1004073080 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:12.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.993+0000 7f100b999640 1 -- 172.21.15.18:0/3441663269 >> 172.21.15.18:0/3441663269 conn(0x7f10040b38c0 msgr2=0x7f10040d12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:12.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.993+0000 7f100b999640 1 -- 172.21.15.18:0/3441663269 shutdown_connections 2024-04-17T19:53:12.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.993+0000 7f100b999640 1 -- 172.21.15.18:0/3441663269 wait complete. 2024-04-17T19:53:12.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.993+0000 7f100b999640 1 Processor -- start 2024-04-17T19:53:12.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.993+0000 7f100b999640 1 -- start start 2024-04-17T19:53:12.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.997+0000 7f100b999640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10040735c0 0x7f10040ae930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:12.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.997+0000 7f100b999640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f10041429f0 0x7f10041fc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:12.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.997+0000 7f100b999640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10041598c0 0x7f10041fcb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:12.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.997+0000 7f100b999640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1004163660 con 0x7f10041598c0 2024-04-17T19:53:12.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.997+0000 7f100b999640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1004142e00 con 0x7f10040735c0 2024-04-17T19:53:12.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.997+0000 7f100b999640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f10041637e0 con 0x7f10041429f0 2024-04-17T19:53:12.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.997+0000 7f1009f36640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10041598c0 0x7f10041fcb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:12.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.997+0000 7f1009f36640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10041598c0 0x7f10041fcb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45030/0 (socket says 172.21.15.18:45030) 2024-04-17T19:53:12.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.997+0000 7f1009f36640 1 -- 172.21.15.18:0/3610095685 learned_addr learned my addr 172.21.15.18:0/3610095685 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:12.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.997+0000 7f1009735640 1 --2- 172.21.15.18:0/3610095685 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10040735c0 0x7f10040ae930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:12.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.997+0000 7f1008f34640 1 --2- 172.21.15.18:0/3610095685 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f10041429f0 0x7f10041fc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:12.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.997+0000 7f1009f36640 1 -- 172.21.15.18:0/3610095685 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f10041429f0 msgr2=0x7f10041fc5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:12.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.997+0000 7f1009f36640 1 --2- 172.21.15.18:0/3610095685 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f10041429f0 0x7f10041fc5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:12.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.997+0000 7f1009f36640 1 -- 172.21.15.18:0/3610095685 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10040735c0 msgr2=0x7f10040ae930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:12.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.997+0000 7f1009f36640 1 --2- 172.21.15.18:0/3610095685 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10040735c0 0x7f10040ae930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:12.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.997+0000 7f1009f36640 1 -- 172.21.15.18:0/3610095685 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10040af1a0 con 0x7f10041598c0 2024-04-17T19:53:12.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.997+0000 7f1009f36640 1 --2- 172.21.15.18:0/3610095685 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10041598c0 0x7f10041fcb30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc00c730 tx=0x7f0ffc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:12.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.997+0000 7f0ff9ffb640 1 -- 172.21.15.18:0/3610095685 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc003b80 con 0x7f10041598c0 2024-04-17T19:53:12.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.997+0000 7f0ff9ffb640 1 -- 172.21.15.18:0/3610095685 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ffc003d20 con 0x7f10041598c0 2024-04-17T19:53:12.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.997+0000 7f0ff9ffb640 1 -- 172.21.15.18:0/3610095685 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc005310 con 0x7f10041598c0 2024-04-17T19:53:12.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.997+0000 7f100b999640 1 -- 172.21.15.18:0/3610095685 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10040af480 con 0x7f10041598c0 2024-04-17T19:53:12.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.997+0000 7f100b999640 1 -- 172.21.15.18:0/3610095685 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10040afa40 con 0x7f10041598c0 2024-04-17T19:53:12.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.997+0000 7f0ff9ffb640 1 -- 172.21.15.18:0/3610095685 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0ffc0056c0 con 0x7f10041598c0 2024-04-17T19:53:12.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.997+0000 7f0ff9ffb640 1 --2- 172.21.15.18:0/3610095685 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0fe8068380 0x7f0fe806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:12.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:12.997+0000 7f0ff9ffb640 1 -- 172.21.15.18:0/3610095685 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f0ffc086d70 con 0x7f10041598c0 2024-04-17T19:53:12.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.001+0000 7f1009735640 1 --2- 172.21.15.18:0/3610095685 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0fe8068380 0x7f0fe806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:12.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.001+0000 7f1009735640 1 --2- 172.21.15.18:0/3610095685 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0fe8068380 0x7f0fe806a890 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f10000ad000 tx=0x7f10000a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:12.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.001+0000 7f1012cef000 1 Processor -- start 2024-04-17T19:53:12.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.001+0000 7f1012cef000 1 -- start start 2024-04-17T19:53:12.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.001+0000 7f1012cef000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559feacddc10 0x559feae50030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:12.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.001+0000 7f1012cef000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559feacd6930 0x559feae50570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:12.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.001+0000 7f1012cef000 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x559fea8d6280 0x559feae50ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:12.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.001+0000 7f1012cef000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559feac544f0 con 0x559feacd6930 2024-04-17T19:53:12.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.001+0000 7f1012cef000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x559feabeec10 con 0x559feacddc10 2024-04-17T19:53:12.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.001+0000 7f1012cef000 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x559feac504b0 con 0x559fea8d6280 2024-04-17T19:53:12.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.001+0000 7f1008f34640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559feacd6930 0x559feae50570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:12.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.001+0000 7f1008f34640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559feacd6930 0x559feae50570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45036/0 (socket says 172.21.15.18:45036) 2024-04-17T19:53:12.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.001+0000 7f1008f34640 1 -- 172.21.15.18:0/523591233 learned_addr learned my addr 172.21.15.18:0/523591233 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:12.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.001+0000 7f1008f34640 1 -- 172.21.15.18:0/523591233 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x559fea8d6280 msgr2=0x559feae50ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:13.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.001+0000 7f1008f34640 1 --2- 172.21.15.18:0/523591233 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x559fea8d6280 0x559feae50ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:13.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.001+0000 7f1008f34640 1 -- 172.21.15.18:0/523591233 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559feacddc10 msgr2=0x559feae50030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:13.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.001+0000 7f1008f34640 1 --2- 172.21.15.18:0/523591233 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559feacddc10 0x559feae50030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:13.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.001+0000 7f1008f34640 1 -- 172.21.15.18:0/523591233 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559feabeee60 con 0x559feacd6930 2024-04-17T19:53:13.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.001+0000 7f1008f34640 1 --2- 172.21.15.18:0/523591233 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559feacd6930 0x559feae50570 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0ff4009ac0 tx=0x7f0ff4009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa85a89a4fed9f45 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:13.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.001+0000 7f0fe6ffd640 1 -- 172.21.15.18:0/523591233 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff4019070 con 0x559feacd6930 2024-04-17T19:53:13.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.001+0000 7f0fe6ffd640 1 -- 172.21.15.18:0/523591233 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ff4011ba0 con 0x559feacd6930 2024-04-17T19:53:13.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.001+0000 7f0fe6ffd640 1 -- 172.21.15.18:0/523591233 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff4015460 con 0x559feacd6930 2024-04-17T19:53:13.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.001+0000 7f1012cef000 1 -- 172.21.15.18:0/523591233 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559feacd6930 msgr2=0x559feae50570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:13.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.001+0000 7f1012cef000 1 --2- 172.21.15.18:0/523591233 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559feacd6930 0x559feae50570 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0ff4009ac0 tx=0x7f0ff4009240 comp rx=0 tx=0).stop 2024-04-17T19:53:13.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.001+0000 7f1012cef000 1 -- 172.21.15.18:0/523591233 shutdown_connections 2024-04-17T19:53:13.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.001+0000 7f1012cef000 1 --2- 172.21.15.18:0/523591233 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x559fea8d6280 0x559feae50ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:13.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.001+0000 7f1012cef000 1 --2- 172.21.15.18:0/523591233 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559feacd6930 0x559feae50570 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:13.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.001+0000 7f1012cef000 1 --2- 172.21.15.18:0/523591233 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559feacddc10 0x559feae50030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:13.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.001+0000 7f1012cef000 1 -- 172.21.15.18:0/523591233 >> 172.21.15.18:0/523591233 conn(0x559fead1f670 msgr2=0x559feae049a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:13.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.001+0000 7f1012cef000 1 -- 172.21.15.18:0/523591233 shutdown_connections 2024-04-17T19:53:13.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.001+0000 7f1012cef000 1 -- 172.21.15.18:0/523591233 wait complete. 2024-04-17T19:53:13.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.005+0000 7f1012cef000 1 -- start start 2024-04-17T19:53:13.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.005+0000 7f1012cef000 1 Processor -- start 2024-04-17T19:53:13.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.005+0000 7f1012cef000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559fea8d6280 0x559feae56e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:13.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.005+0000 7f1012cef000 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x559feacd6930 0x559feae573a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:13.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.005+0000 7f1012cef000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559feacddc10 0x559feae0a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:13.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.005+0000 7f1012cef000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559feac959e0 con 0x559feacddc10 2024-04-17T19:53:13.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.005+0000 7f1012cef000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x559feac11a80 con 0x559fea8d6280 2024-04-17T19:53:13.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.005+0000 7f1012cef000 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x559feac0fd10 con 0x559feacd6930 2024-04-17T19:53:13.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.005+0000 7f1012cef000 10 client.0 _ll_register_callbacks cb 0x559feadf1b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-17T19:53:13.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.005+0000 7f1009f36640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559feacddc10 0x559feae0a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:13.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.005+0000 7f1009f36640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559feacddc10 0x559feae0a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45050/0 (socket says 172.21.15.18:45050) 2024-04-17T19:53:13.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.005+0000 7f1009f36640 1 -- 172.21.15.18:0/1141243904 learned_addr learned my addr 172.21.15.18:0/1141243904 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:13.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.005+0000 7f1009f36640 1 -- 172.21.15.18:0/1141243904 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x559feacd6930 msgr2=0x559feae573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:13.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.005+0000 7f1009f36640 1 --2- 172.21.15.18:0/1141243904 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x559feacd6930 0x559feae573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:13.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.005+0000 7f1009f36640 1 -- 172.21.15.18:0/1141243904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559fea8d6280 msgr2=0x559feae56e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:13.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.005+0000 7f1009735640 1 --2- 172.21.15.18:0/1141243904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559fea8d6280 0x559feae56e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:13.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.005+0000 7f1009f36640 1 --2- 172.21.15.18:0/1141243904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559fea8d6280 0x559feae56e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:13.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.005+0000 7f1009f36640 1 -- 172.21.15.18:0/1141243904 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559feac1fe20 con 0x559feacddc10 2024-04-17T19:53:13.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.005+0000 7f1009735640 1 --2- 172.21.15.18:0/1141243904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559fea8d6280 0x559feae56e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:53:13.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.005+0000 7f1009f36640 1 --2- 172.21.15.18:0/1141243904 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559feacddc10 0x559feae0a2e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc05efa0 tx=0x7f0ffc057160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ccd4eb842a23e90 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:13.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.005+0000 7f0fdffff640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-17T19:53:13.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.005+0000 7f0fdffff640 1 -- 172.21.15.18:0/1141243904 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc054bf0 con 0x559feacddc10 2024-04-17T19:53:13.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.005+0000 7f0fdffff640 1 -- 172.21.15.18:0/1141243904 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f0ffc05d0c0 con 0x559feacddc10 2024-04-17T19:53:13.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.005+0000 7f1012cef000 1 -- 172.21.15.18:0/1141243904 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ff4011ba0 con 0x559feacddc10 2024-04-17T19:53:13.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.005+0000 7f0fdffff640 1 -- 172.21.15.18:0/1141243904 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f0ffc052f60 con 0x559feacddc10 2024-04-17T19:53:13.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.005+0000 7f1012cef000 10 client.4434 fetch_fsmap learned FSMap version 7 2024-04-17T19:53:13.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.005+0000 7f1012cef000 1 -- 172.21.15.18:0/1141243904 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x559fead1fa80 con 0x559feacddc10 2024-04-17T19:53:13.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.005+0000 7f0fdffff640 1 -- 172.21.15.18:0/1141243904 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ff4011ba0 con 0x559feacddc10 2024-04-17T19:53:13.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.005+0000 7f0fdffff640 1 -- 172.21.15.18:0/1141243904 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 7) ==== 3502+0+0 (secure 0 0 0) 0x7f0ffc055d40 con 0x559feacddc10 2024-04-17T19:53:13.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.005+0000 7f1012cef000 10 client.4434 fetch_fsmap finished waiting for FSMap version 7 2024-04-17T19:53:13.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.005+0000 7f1012cef000 10 client.4434 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-17T19:53:13.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.005+0000 7f1012cef000 20 client.4434 populate_metadata read hostname 'smithi018' 2024-04-17T19:53:13.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.005+0000 7f1012cef000 1 --2- 172.21.15.18:0/1141243904 >> [v2:172.21.15.18:6836/1926349198,v1:172.21.15.18:6837/1926349198] conn(0x559fea8fa7d0 0x559feae0b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:13.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.005+0000 7f1012cef000 4 client.4434 mds_command: new command op to 4278 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-17T19:53:13.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.005+0000 7f1012cef000 1 -- 172.21.15.18:0/1141243904 --> [v2:172.21.15.18:6836/1926349198,v1:172.21.15.18:6837/1926349198] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559feabedbe0 con 0x559fea8fa7d0 2024-04-17T19:53:13.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.005+0000 7f1009735640 1 --2- 172.21.15.18:0/1141243904 >> [v2:172.21.15.18:6836/1926349198,v1:172.21.15.18:6837/1926349198] conn(0x559fea8fa7d0 0x559feae0b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:13.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.009+0000 7f0fdffff640 10 client.4434 ms_handle_connect on v2:172.21.15.18:6836/1926349198 2024-04-17T19:53:13.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.009+0000 7f1009735640 1 --2- 172.21.15.18:0/1141243904 >> [v2:172.21.15.18:6836/1926349198,v1:172.21.15.18:6837/1926349198] conn(0x559fea8fa7d0 0x559feae0b020 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bccd5d502a1ff9a0 server_cookie=5b7f8a01b67e4f08 in_seq=0 out_seq=0 2024-04-17T19:53:13.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.009+0000 7f0fdffff640 1 -- 172.21.15.18:0/1141243904 <== mds.0 v2:172.21.15.18:6836/1926349198 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x559feabedbe0 con 0x559fea8fa7d0 2024-04-17T19:53:13.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.009+0000 7f0fdffff640 10 client.4434 handle_command_reply: tid=0 2024-04-17T19:53:13.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.009+0000 7f1012cef000 1 client.4434 shutdown 2024-04-17T19:53:13.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.009+0000 7f1012cef000 1 -- 172.21.15.18:0/1141243904 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559feacddc10 msgr2=0x559feae0a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:13.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.009+0000 7f1012cef000 1 --2- 172.21.15.18:0/1141243904 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559feacddc10 0x559feae0a2e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc05efa0 tx=0x7f0ffc057160 comp rx=0 tx=0).stop 2024-04-17T19:53:13.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.009+0000 7f1012cef000 1 -- 172.21.15.18:0/1141243904 shutdown_connections 2024-04-17T19:53:13.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.009+0000 7f1012cef000 1 --2- 172.21.15.18:0/1141243904 >> [v2:172.21.15.18:6836/1926349198,v1:172.21.15.18:6837/1926349198] conn(0x559fea8fa7d0 0x559feae0b020 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:13.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.009+0000 7f1012cef000 1 --2- 172.21.15.18:0/1141243904 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559feacddc10 0x559feae0a2e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:13.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.009+0000 7f1012cef000 1 --2- 172.21.15.18:0/1141243904 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x559feacd6930 0x559feae573a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:13.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.009+0000 7f0fdffff640 0 client.4434 ms_handle_reset on v2:172.21.15.18:6836/1926349198 2024-04-17T19:53:13.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.009+0000 7f1012cef000 1 --2- 172.21.15.18:0/1141243904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559fea8d6280 0x559feae56e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:13.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.009+0000 7f1012cef000 1 -- 172.21.15.18:0/1141243904 >> 172.21.15.18:0/1141243904 conn(0x559fead1f670 msgr2=0x559feae33630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:13.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.009+0000 7f1012cef000 1 -- 172.21.15.18:0/1141243904 shutdown_connections 2024-04-17T19:53:13.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.009+0000 7f1012cef000 1 -- 172.21.15.18:0/1141243904 wait complete. 2024-04-17T19:53:13.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.009+0000 7f1012cef000 20 client.4434 trim_cache size 0 max 16384 2024-04-17T19:53:13.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.025+0000 7f1012cef000 1 Processor -- start 2024-04-17T19:53:13.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.025+0000 7f1012cef000 1 -- start start 2024-04-17T19:53:13.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.029+0000 7f1012cef000 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x559fea8d6280 0x559feae0b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:13.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.029+0000 7f1012cef000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559feacd6930 0x559feae0b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:13.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.029+0000 7f1012cef000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559feacddc10 0x559feae0baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:13.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.029+0000 7f1012cef000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1004205b70 con 0x559feacd6930 2024-04-17T19:53:13.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.029+0000 7f1012cef000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1004145620 con 0x559feacddc10 2024-04-17T19:53:13.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.029+0000 7f1012cef000 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f1004205500 con 0x559fea8d6280 2024-04-17T19:53:13.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.029+0000 7f1008f34640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559feacd6930 0x559feae0b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:13.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.029+0000 7f1008f34640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559feacd6930 0x559feae0b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45058/0 (socket says 172.21.15.18:45058) 2024-04-17T19:53:13.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.029+0000 7f1008f34640 1 -- 172.21.15.18:0/2687373152 learned_addr learned my addr 172.21.15.18:0/2687373152 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:13.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.029+0000 7f1008f34640 1 -- 172.21.15.18:0/2687373152 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x559fea8d6280 msgr2=0x559feae0b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:13.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.029+0000 7f1008f34640 1 --2- 172.21.15.18:0/2687373152 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x559fea8d6280 0x559feae0b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:13.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.029+0000 7f1008f34640 1 -- 172.21.15.18:0/2687373152 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559feacddc10 msgr2=0x559feae0baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:13.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.029+0000 7f1008f34640 1 --2- 172.21.15.18:0/2687373152 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559feacddc10 0x559feae0baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:13.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.029+0000 7f1008f34640 1 -- 172.21.15.18:0/2687373152 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559feacade30 con 0x559feacd6930 2024-04-17T19:53:13.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.029+0000 7f1008f34640 1 --2- 172.21.15.18:0/2687373152 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559feacd6930 0x559feae0b560 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x559feac09410 tx=0x7f0ff4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84bd02b697087ff4 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:13.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.029+0000 7f0fe67fc640 1 -- 172.21.15.18:0/2687373152 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff4019040 con 0x559feacd6930 2024-04-17T19:53:13.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.029+0000 7f0fe67fc640 1 -- 172.21.15.18:0/2687373152 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ff4009530 con 0x559feacd6930 2024-04-17T19:53:13.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.029+0000 7f0fe67fc640 1 -- 172.21.15.18:0/2687373152 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff40156a0 con 0x559feacd6930 2024-04-17T19:53:13.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.029+0000 7f1012cef000 1 -- 172.21.15.18:0/2687373152 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559feacd6930 msgr2=0x559feae0b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:13.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.029+0000 7f1012cef000 1 --2- 172.21.15.18:0/2687373152 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559feacd6930 0x559feae0b560 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x559feac09410 tx=0x7f0ff4016000 comp rx=0 tx=0).stop 2024-04-17T19:53:13.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.029+0000 7f1012cef000 1 -- 172.21.15.18:0/2687373152 shutdown_connections 2024-04-17T19:53:13.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.029+0000 7f1012cef000 1 --2- 172.21.15.18:0/2687373152 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559feacddc10 0x559feae0baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:13.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.029+0000 7f1012cef000 1 --2- 172.21.15.18:0/2687373152 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559feacd6930 0x559feae0b560 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:13.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.029+0000 7f1012cef000 1 --2- 172.21.15.18:0/2687373152 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x559fea8d6280 0x559feae0b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:13.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.029+0000 7f1012cef000 1 -- 172.21.15.18:0/2687373152 >> 172.21.15.18:0/2687373152 conn(0x559fead1f670 msgr2=0x559feae65ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:13.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.029+0000 7f1012cef000 1 -- 172.21.15.18:0/2687373152 shutdown_connections 2024-04-17T19:53:13.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.029+0000 7f1012cef000 1 -- 172.21.15.18:0/2687373152 wait complete. 2024-04-17T19:53:13.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.029+0000 7f1012cef000 1 -- start start 2024-04-17T19:53:13.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.029+0000 7f1012cef000 1 Processor -- start 2024-04-17T19:53:13.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.033+0000 7f1012cef000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559fea8d6280 0x559feaec2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:13.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.033+0000 7f1012cef000 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x559feacd6930 0x559feaec3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:13.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.033+0000 7f1012cef000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559feacddc10 0x559feae5ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:13.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.033+0000 7f1012cef000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559feac58b20 con 0x559fea8d6280 2024-04-17T19:53:13.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.033+0000 7f1012cef000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x559feac53800 con 0x559feacddc10 2024-04-17T19:53:13.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.033+0000 7f1012cef000 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x559feac61700 con 0x559feacd6930 2024-04-17T19:53:13.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.033+0000 7f1012cef000 10 client.0 _ll_register_callbacks cb 0x7f0ffc001830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-17T19:53:13.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.033+0000 7f1009735640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559fea8d6280 0x559feaec2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:13.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.033+0000 7f1009735640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559fea8d6280 0x559feaec2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45064/0 (socket says 172.21.15.18:45064) 2024-04-17T19:53:13.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.033+0000 7f1009735640 1 -- 172.21.15.18:0/2808861669 learned_addr learned my addr 172.21.15.18:0/2808861669 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:13.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.033+0000 7f1009f36640 1 --2- 172.21.15.18:0/2808861669 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559feacddc10 0x559feae5ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:13.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.033+0000 7f1008f34640 1 --2- 172.21.15.18:0/2808861669 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x559feacd6930 0x559feaec3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:13.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.033+0000 7f1009735640 1 -- 172.21.15.18:0/2808861669 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x559feacd6930 msgr2=0x559feaec3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:13.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.033+0000 7f1009735640 1 --2- 172.21.15.18:0/2808861669 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x559feacd6930 0x559feaec3310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:13.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.033+0000 7f1009735640 1 -- 172.21.15.18:0/2808861669 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559feacddc10 msgr2=0x559feae5ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:13.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.033+0000 7f1009735640 1 --2- 172.21.15.18:0/2808861669 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559feacddc10 0x559feae5ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:13.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.033+0000 7f1009735640 1 -- 172.21.15.18:0/2808861669 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559feabe67e0 con 0x559fea8d6280 2024-04-17T19:53:13.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.033+0000 7f1009f36640 1 --2- 172.21.15.18:0/2808861669 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559feacddc10 0x559feae5ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:53:13.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.033+0000 7f1009735640 1 --2- 172.21.15.18:0/2808861669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559fea8d6280 0x559feaec2dd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f10000097c0 tx=0x7f1000019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b93ce7be363443c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:13.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.033+0000 7f0fdffff640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-17T19:53:13.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.033+0000 7f0fdffff640 1 -- 172.21.15.18:0/2808861669 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10000b0040 con 0x559fea8d6280 2024-04-17T19:53:13.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.033+0000 7f0fdffff640 1 -- 172.21.15.18:0/2808861669 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f10000c6160 con 0x559fea8d6280 2024-04-17T19:53:13.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.033+0000 7f1012cef000 1 -- 172.21.15.18:0/2808861669 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ff4009530 con 0x559fea8d6280 2024-04-17T19:53:13.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.033+0000 7f0fdffff640 1 -- 172.21.15.18:0/2808861669 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f10000d6050 con 0x559fea8d6280 2024-04-17T19:53:13.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.033+0000 7f1012cef000 10 client.4440 fetch_fsmap learned FSMap version 7 2024-04-17T19:53:13.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.033+0000 7f1012cef000 1 -- 172.21.15.18:0/2808861669 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x559feabf9670 con 0x559fea8d6280 2024-04-17T19:53:13.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.033+0000 7f0fdffff640 1 -- 172.21.15.18:0/2808861669 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ff4009530 con 0x559fea8d6280 2024-04-17T19:53:13.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.033+0000 7f0fdffff640 1 -- 172.21.15.18:0/2808861669 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 7) ==== 3502+0+0 (secure 0 0 0) 0x7f10000d9020 con 0x559fea8d6280 2024-04-17T19:53:13.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.033+0000 7f1012cef000 10 client.4440 fetch_fsmap finished waiting for FSMap version 7 2024-04-17T19:53:13.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.033+0000 7f1012cef000 10 client.4440 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-17T19:53:13.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.033+0000 7f1012cef000 20 client.4440 populate_metadata read hostname 'smithi018' 2024-04-17T19:53:13.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.033+0000 7f1012cef000 1 --2- 172.21.15.18:0/2808861669 >> [v2:172.21.15.18:6836/1926349198,v1:172.21.15.18:6837/1926349198] conn(0x559fea8e8830 0x559feaecbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:13.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.033+0000 7f1012cef000 4 client.4440 mds_command: new command op to 4278 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-17T19:53:13.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.033+0000 7f1012cef000 1 -- 172.21.15.18:0/2808861669 --> [v2:172.21.15.18:6836/1926349198,v1:172.21.15.18:6837/1926349198] -- command(tid 0: {"prefix": "status"}) -- 0x559feac61f10 con 0x559fea8e8830 2024-04-17T19:53:13.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.033+0000 7f1008f34640 1 --2- 172.21.15.18:0/2808861669 >> [v2:172.21.15.18:6836/1926349198,v1:172.21.15.18:6837/1926349198] conn(0x559fea8e8830 0x559feaecbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:13.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.033+0000 7f0fdffff640 10 client.4440 ms_handle_connect on v2:172.21.15.18:6836/1926349198 2024-04-17T19:53:13.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.033+0000 7f1008f34640 1 --2- 172.21.15.18:0/2808861669 >> [v2:172.21.15.18:6836/1926349198,v1:172.21.15.18:6837/1926349198] conn(0x559fea8e8830 0x559feaecbc40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=194e832e7dd3128d server_cookie=8df03d55f6d719ff in_seq=0 out_seq=0 2024-04-17T19:53:13.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.033+0000 7f0fdffff640 1 -- 172.21.15.18:0/2808861669 <== mds.0 v2:172.21.15.18:6836/1926349198 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x559feac61f10 con 0x559fea8e8830 2024-04-17T19:53:13.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.033+0000 7f0fdffff640 10 client.4440 handle_command_reply: tid=0 2024-04-17T19:53:13.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.033+0000 7f1012cef000 1 client.4440 shutdown 2024-04-17T19:53:13.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.033+0000 7f1012cef000 1 -- 172.21.15.18:0/2808861669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559fea8d6280 msgr2=0x559feaec2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:13.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.033+0000 7f1012cef000 1 --2- 172.21.15.18:0/2808861669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559fea8d6280 0x559feaec2dd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f10000097c0 tx=0x7f1000019240 comp rx=0 tx=0).stop 2024-04-17T19:53:13.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.033+0000 7f1012cef000 1 -- 172.21.15.18:0/2808861669 shutdown_connections 2024-04-17T19:53:13.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.033+0000 7f1012cef000 1 --2- 172.21.15.18:0/2808861669 >> [v2:172.21.15.18:6836/1926349198,v1:172.21.15.18:6837/1926349198] conn(0x559fea8e8830 0x559feaecbc40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:13.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.033+0000 7f1012cef000 1 --2- 172.21.15.18:0/2808861669 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x559feacddc10 0x559feae5ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:13.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.033+0000 7f1012cef000 1 --2- 172.21.15.18:0/2808861669 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x559feacd6930 0x559feaec3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:13.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.033+0000 7f0fdffff640 0 client.4440 ms_handle_reset on v2:172.21.15.18:6836/1926349198 2024-04-17T19:53:13.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.033+0000 7f1012cef000 1 --2- 172.21.15.18:0/2808861669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559fea8d6280 0x559feaec2dd0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:13.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.033+0000 7f1012cef000 1 -- 172.21.15.18:0/2808861669 >> 172.21.15.18:0/2808861669 conn(0x559fead1f670 msgr2=0x559feae0a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:13.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.033+0000 7f1012cef000 1 -- 172.21.15.18:0/2808861669 shutdown_connections 2024-04-17T19:53:13.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.033+0000 7f1012cef000 1 -- 172.21.15.18:0/2808861669 wait complete. 2024-04-17T19:53:13.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.033+0000 7f1012cef000 20 client.4440 trim_cache size 0 max 16384 2024-04-17T19:53:13.035 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-17T19:53:13.036 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "dd480169-5a81-4623-be5f-0499aa244b28", 2024-04-17T19:53:13.036 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 0, 2024-04-17T19:53:13.036 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 4278, 2024-04-17T19:53:13.036 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-04-17T19:53:13.036 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-04-17T19:53:13.036 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-04-17T19:53:13.036 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 7.5873433539999997, 2024-04-17T19:53:13.036 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 7, 2024-04-17T19:53:13.036 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 27, 2024-04-17T19:53:13.036 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 27, 2024-04-17T19:53:13.036 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 15.105029679999999 2024-04-17T19:53:13.036 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-17T19:53:13.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.037+0000 7f100b999640 1 -- 172.21.15.18:0/3610095685 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0fe8068380 msgr2=0x7f0fe806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:13.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.037+0000 7f100b999640 1 --2- 172.21.15.18:0/3610095685 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0fe8068380 0x7f0fe806a890 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f10000ad000 tx=0x7f10000a6000 comp rx=0 tx=0).stop 2024-04-17T19:53:13.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.037+0000 7f100b999640 1 -- 172.21.15.18:0/3610095685 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10041598c0 msgr2=0x7f10041fcb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:13.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.037+0000 7f100b999640 1 --2- 172.21.15.18:0/3610095685 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10041598c0 0x7f10041fcb30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc00c730 tx=0x7f0ffc00cbf0 comp rx=0 tx=0).stop 2024-04-17T19:53:13.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.037+0000 7f100b999640 1 -- 172.21.15.18:0/3610095685 shutdown_connections 2024-04-17T19:53:13.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.037+0000 7f100b999640 1 --2- 172.21.15.18:0/3610095685 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0fe8068380 0x7f0fe806a890 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:13.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.037+0000 7f100b999640 1 --2- 172.21.15.18:0/3610095685 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10041598c0 0x7f10041fcb30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:13.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.037+0000 7f100b999640 1 --2- 172.21.15.18:0/3610095685 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f10041429f0 0x7f10041fc5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:13.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.037+0000 7f100b999640 1 --2- 172.21.15.18:0/3610095685 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10040735c0 0x7f10040ae930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:13.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.037+0000 7f100b999640 1 -- 172.21.15.18:0/3610095685 >> 172.21.15.18:0/3610095685 conn(0x7f10040b38c0 msgr2=0x7f1004142f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:13.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.037+0000 7f100b999640 1 -- 172.21.15.18:0/3610095685 shutdown_connections 2024-04-17T19:53:13.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.037+0000 7f100b999640 1 -- 172.21.15.18:0/3610095685 wait complete. 2024-04-17T19:53:13.049 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-17T19:53:13.049 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-17T19:53:13.049 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-17T19:53:13.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.197+0000 7fcd35bb0640 1 Processor -- start 2024-04-17T19:53:13.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.197+0000 7fcd35bb0640 1 -- start start 2024-04-17T19:53:13.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.197+0000 7fcd35bb0640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fcd3009ecc0 0x7fcd301617b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:13.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.197+0000 7fcd35bb0640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcd3015de80 0x7fcd3015e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:13.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.197+0000 7fcd35bb0640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd300af140 con 0x7fcd300aeb90 2024-04-17T19:53:13.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.197+0000 7fcd35bb0640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fcd300af420 con 0x7fcd3009ecc0 2024-04-17T19:53:13.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.197+0000 7fcd35bb0640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fcd300af700 con 0x7fcd3015de80 2024-04-17T19:53:13.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.197+0000 7fcd2f7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fcd3009ecc0 0x7fcd301617b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:13.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.197+0000 7fcd26ffd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fcd300aeb90 0x7fcd3006bd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:38554/0 (socket says 172.21.15.18:38554) 2024-04-17T19:53:13.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.197+0000 7fcd26ffd640 1 -- 172.21.15.18:0/1317563162 learned_addr learned my addr 172.21.15.18:0/1317563162 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:13.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.197+0000 7fcd2ffff640 1 --2- 172.21.15.18:0/1317563162 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcd3015de80 0x7fcd3015e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:13.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.197+0000 7fcd2f7fe640 1 -- 172.21.15.18:0/1317563162 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcd3015de80 msgr2=0x7fcd3015e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:13.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.197+0000 7fcd2f7fe640 1 --2- 172.21.15.18:0/1317563162 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcd3015de80 0x7fcd3015e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:13.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.197+0000 7fcd2f7fe640 1 -- 172.21.15.18:0/1317563162 >> v1:172.21.15.18:6789/0 conn(0x7fcd300aeb90 legacy=0x7fcd3006bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:13.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.197+0000 7fcd2f7fe640 1 -- 172.21.15.18:0/1317563162 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd3006c460 con 0x7fcd3009ecc0 2024-04-17T19:53:13.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.201+0000 7fcd2f7fe640 1 --2- 172.21.15.18:0/1317563162 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd3009ecc0 0x7fcd301617b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcd200097c0 tx=0x7fcd2001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c745c9125035087 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:13.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.201+0000 7fcd2effd640 1 -- 172.21.15.18:0/1317563162 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd200b0070 con 0x7fcd3009ecc0 2024-04-17T19:53:13.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.201+0000 7fcd2effd640 1 -- 172.21.15.18:0/1317563162 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd200ab600 con 0x7fcd3009ecc0 2024-04-17T19:53:13.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.201+0000 7fcd2effd640 1 -- 172.21.15.18:0/1317563162 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd200ab9d0 con 0x7fcd3009ecc0 2024-04-17T19:53:13.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.201+0000 7fcd35bb0640 1 -- 172.21.15.18:0/1317563162 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd3009ecc0 msgr2=0x7fcd301617b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:13.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.201+0000 7fcd35bb0640 1 --2- 172.21.15.18:0/1317563162 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd3009ecc0 0x7fcd301617b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcd200097c0 tx=0x7fcd2001c4a0 comp rx=0 tx=0).stop 2024-04-17T19:53:13.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.201+0000 7fcd35bb0640 1 -- 172.21.15.18:0/1317563162 shutdown_connections 2024-04-17T19:53:13.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.201+0000 7fcd35bb0640 1 --2- 172.21.15.18:0/1317563162 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcd3015de80 0x7fcd3015e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:13.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.201+0000 7fcd35bb0640 1 --2- 172.21.15.18:0/1317563162 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd3009ecc0 0x7fcd301617b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:13.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.201+0000 7fcd35bb0640 1 -- 172.21.15.18:0/1317563162 >> 172.21.15.18:0/1317563162 conn(0x7fcd300d1230 msgr2=0x7fcd300d1640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:13.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.201+0000 7fcd35bb0640 1 -- 172.21.15.18:0/1317563162 shutdown_connections 2024-04-17T19:53:13.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.201+0000 7fcd35bb0640 1 -- 172.21.15.18:0/1317563162 wait complete. 2024-04-17T19:53:13.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.201+0000 7fcd35bb0640 1 Processor -- start 2024-04-17T19:53:13.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.201+0000 7fcd35bb0640 1 -- start start 2024-04-17T19:53:13.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.205+0000 7fcd35bb0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd3009ecc0 0x7fcd30151920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:13.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.205+0000 7fcd35bb0640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd300aeb90 0x7fcd300b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:13.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.205+0000 7fcd35bb0640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcd3015de80 0x7fcd300b5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:13.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.205+0000 7fcd35bb0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcd3016ad30 con 0x7fcd3009ecc0 2024-04-17T19:53:13.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.205+0000 7fcd35bb0640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fcd3016abb0 con 0x7fcd300aeb90 2024-04-17T19:53:13.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.205+0000 7fcd35bb0640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fcd3016aeb0 con 0x7fcd3015de80 2024-04-17T19:53:13.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.205+0000 7fcd2f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd3009ecc0 0x7fcd30151920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:13.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.205+0000 7fcd2f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd3009ecc0 0x7fcd30151920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45088/0 (socket says 172.21.15.18:45088) 2024-04-17T19:53:13.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.205+0000 7fcd2f7fe640 1 -- 172.21.15.18:0/480302370 learned_addr learned my addr 172.21.15.18:0/480302370 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:13.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.205+0000 7fcd26ffd640 1 --2- 172.21.15.18:0/480302370 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd300aeb90 0x7fcd300b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:13.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.205+0000 7fcd2ffff640 1 --2- 172.21.15.18:0/480302370 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcd3015de80 0x7fcd300b5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:13.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.205+0000 7fcd2f7fe640 1 -- 172.21.15.18:0/480302370 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcd3015de80 msgr2=0x7fcd300b5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:13.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.205+0000 7fcd2f7fe640 1 --2- 172.21.15.18:0/480302370 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcd3015de80 0x7fcd300b5370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:13.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.205+0000 7fcd2f7fe640 1 -- 172.21.15.18:0/480302370 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd300aeb90 msgr2=0x7fcd300b4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:13.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.205+0000 7fcd2f7fe640 1 --2- 172.21.15.18:0/480302370 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd300aeb90 0x7fcd300b4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:13.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.205+0000 7fcd2f7fe640 1 -- 172.21.15.18:0/480302370 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd30151e60 con 0x7fcd3009ecc0 2024-04-17T19:53:13.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.205+0000 7fcd26ffd640 1 --2- 172.21.15.18:0/480302370 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd300aeb90 0x7fcd300b4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:53:13.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.205+0000 7fcd2f7fe640 1 --2- 172.21.15.18:0/480302370 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd3009ecc0 0x7fcd30151920 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcd2001a0d0 tx=0x7fcd20019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:13.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.205+0000 7fcd2cff9640 1 -- 172.21.15.18:0/480302370 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd200b0040 con 0x7fcd3009ecc0 2024-04-17T19:53:13.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.205+0000 7fcd2cff9640 1 -- 172.21.15.18:0/480302370 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd200ba070 con 0x7fcd3009ecc0 2024-04-17T19:53:13.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.205+0000 7fcd35bb0640 1 -- 172.21.15.18:0/480302370 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd30155770 con 0x7fcd3009ecc0 2024-04-17T19:53:13.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.205+0000 7fcd2cff9640 1 -- 172.21.15.18:0/480302370 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd200aaa10 con 0x7fcd3009ecc0 2024-04-17T19:53:13.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.205+0000 7fcd35bb0640 1 -- 172.21.15.18:0/480302370 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd30155cf0 con 0x7fcd3009ecc0 2024-04-17T19:53:13.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.205+0000 7fcd35bb0640 1 -- 172.21.15.18:0/480302370 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd30069950 con 0x7fcd3009ecc0 2024-04-17T19:53:13.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.205+0000 7fcd2cff9640 1 -- 172.21.15.18:0/480302370 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcd200aabb0 con 0x7fcd3009ecc0 2024-04-17T19:53:13.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.209+0000 7fcd2cff9640 1 --2- 172.21.15.18:0/480302370 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fcd10068380 0x7fcd1006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:13.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.209+0000 7fcd2cff9640 1 -- 172.21.15.18:0/480302370 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fcd20121940 con 0x7fcd3009ecc0 2024-04-17T19:53:13.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.209+0000 7fcd26ffd640 1 --2- 172.21.15.18:0/480302370 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fcd10068380 0x7fcd1006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:13.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.209+0000 7fcd26ffd640 1 --2- 172.21.15.18:0/480302370 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fcd10068380 0x7fcd1006a890 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcd30156e30 tx=0x7fcd18009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:13.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.213+0000 7fcd2cff9640 1 -- 172.21.15.18:0/480302370 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcd20016090 con 0x7fcd3009ecc0 2024-04-17T19:53:13.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.405+0000 7fcd35bb0640 1 -- 172.21.15.18:0/480302370 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fcd300b4c10 con 0x7fcd3009ecc0 2024-04-17T19:53:13.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.409+0000 7fcd2cff9640 1 -- 172.21.15.18:0/480302370 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+88 (secure 0 0 0) 0x7fcd200f1ca0 con 0x7fcd3009ecc0 2024-04-17T19:53:13.403 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-17T19:53:13.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.409+0000 7fcd35bb0640 1 -- 172.21.15.18:0/480302370 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fcd10068380 msgr2=0x7fcd1006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:13.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.409+0000 7fcd35bb0640 1 --2- 172.21.15.18:0/480302370 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fcd10068380 0x7fcd1006a890 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcd30156e30 tx=0x7fcd18009040 comp rx=0 tx=0).stop 2024-04-17T19:53:13.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.409+0000 7fcd35bb0640 1 -- 172.21.15.18:0/480302370 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd3009ecc0 msgr2=0x7fcd30151920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:13.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.409+0000 7fcd35bb0640 1 --2- 172.21.15.18:0/480302370 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd3009ecc0 0x7fcd30151920 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcd2001a0d0 tx=0x7fcd20019240 comp rx=0 tx=0).stop 2024-04-17T19:53:13.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.409+0000 7fcd35bb0640 1 -- 172.21.15.18:0/480302370 shutdown_connections 2024-04-17T19:53:13.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.409+0000 7fcd35bb0640 1 --2- 172.21.15.18:0/480302370 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fcd10068380 0x7fcd1006a890 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:13.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.409+0000 7fcd35bb0640 1 --2- 172.21.15.18:0/480302370 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcd3015de80 0x7fcd300b5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:13.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.409+0000 7fcd35bb0640 1 --2- 172.21.15.18:0/480302370 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcd300aeb90 0x7fcd300b4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:13.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.409+0000 7fcd35bb0640 1 --2- 172.21.15.18:0/480302370 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd3009ecc0 0x7fcd30151920 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:13.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.409+0000 7fcd35bb0640 1 -- 172.21.15.18:0/480302370 >> 172.21.15.18:0/480302370 conn(0x7fcd300d1230 msgr2=0x7fcd3006bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:13.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.409+0000 7fcd35bb0640 1 -- 172.21.15.18:0/480302370 shutdown_connections 2024-04-17T19:53:13.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13.409+0000 7fcd35bb0640 1 -- 172.21.15.18:0/480302370 wait complete. 2024-04-17T19:53:13.423 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-17T19:53:13.423 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-17T19:53:13.423 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi018.front.sepia.ceph.com 2024-04-17T19:53:13.423 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-04-17T19:53:13.423 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-17T19:53:13.423 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-17T19:53:13.423 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-17T19:53:13.423 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-17T19:53:13.423 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-04-17T19:53:13.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:13.424 DEBUG:teuthology.orchestra.run.smithi018:> ip addr 2024-04-17T19:53:13.430 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-17T19:53:13.430 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-17T19:53:13.430 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2024-04-17T19:53:13.430 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-17T19:53:13.430 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2024-04-17T19:53:13.430 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-17T19:53:13.430 INFO:teuthology.orchestra.run.smithi018.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-17T19:53:13.430 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:98 brd ff:ff:ff:ff:ff:ff 2024-04-17T19:53:13.430 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f0 2024-04-17T19:53:13.430 INFO:teuthology.orchestra.run.smithi018.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-17T19:53:13.430 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:99 brd ff:ff:ff:ff:ff:ff 2024-04-17T19:53:13.430 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f1 2024-04-17T19:53:13.430 INFO:teuthology.orchestra.run.smithi018.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-17T19:53:13.431 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:62 brd ff:ff:ff:ff:ff:ff 2024-04-17T19:53:13.431 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f0 2024-04-17T19:53:13.431 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.21.15.18/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-17T19:53:13.431 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft 42466sec preferred_lft 42466sec 2024-04-17T19:53:13.431 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::ec4:7aff:febd:1362/64 scope link 2024-04-17T19:53:13.431 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-17T19:53:13.431 INFO:teuthology.orchestra.run.smithi018.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-17T19:53:13.431 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:63 brd ff:ff:ff:ff:ff:ff 2024-04-17T19:53:13.431 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f1 2024-04-17T19:53:13.431 INFO:teuthology.orchestra.run.smithi018.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-17T19:53:13.431 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 02:42:a8:c7:c7:ae brd ff:ff:ff:ff:ff:ff 2024-04-17T19:53:13.431 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-17T19:53:13.431 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-17T19:53:13.432 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-17T19:53:13.432 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T19:53:13.432 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-17T19:53:13.432 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link add name ceph-brx type bridge 2024-04-17T19:53:13.432 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip addr flush dev ceph-brx 2024-04-17T19:53:13.432 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set ceph-brx up 2024-04-17T19:53:13.432 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-17T19:53:13.432 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-17T19:53:13.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T19:53:13.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T19:53:13.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:13.552 DEBUG:teuthology.orchestra.run.smithi018:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-17T19:53:13.603 INFO:teuthology.orchestra.run.smithi018.stdout:1 2024-04-17T19:53:13.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:13.604 DEBUG:teuthology.orchestra.run.smithi018:> route 2024-04-17T19:53:13.670 INFO:teuthology.orchestra.run.smithi018.stdout:Kernel IP routing table 2024-04-17T19:53:13.670 INFO:teuthology.orchestra.run.smithi018.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-17T19:53:13.670 INFO:teuthology.orchestra.run.smithi018.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-17T19:53:13.670 INFO:teuthology.orchestra.run.smithi018.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-17T19:53:13.670 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-17T19:53:13.670 INFO:teuthology.orchestra.run.smithi018.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-17T19:53:13.671 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T19:53:13.671 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-17T19:53:13.671 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-17T19:53:13.671 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-17T19:53:13.671 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-17T19:53:13.671 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-17T19:53:13.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T19:53:13.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T19:53:13.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:13.793 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-04-17T19:53:13.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:13.799 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list-id 2024-04-17T19:53:13.843 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T19:53:13.843 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-17T19:53:13.843 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-17T19:53:13.844 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-04-17T19:53:13.844 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-17T19:53:13.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T19:53:13.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T19:53:13.968 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-04-17T19:53:13.968 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T19:53:13.968 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-17T19:53:13.968 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-04-17T19:53:13.968 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-17T19:53:13.968 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-04-17T19:53:13.968 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-04-17T19:53:13.968 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-04-17T19:53:13.968 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-17T19:53:14.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T19:53:14.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T19:53:14.071 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T19:53:14.071 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-17T19:53:14.071 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set brx.0 up 2024-04-17T19:53:14.071 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set dev brx.0 master ceph-brx 2024-04-17T19:53:14.071 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-17T19:53:14.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T19:53:14.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T19:53:14.175 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-04-17T19:53:14.175 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-17T19:53:14.175 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-04-17T19:53:14.223 INFO:teuthology.orchestra.run.smithi018.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-04-17T19:53:14.223 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-17T19:53:14.223 DEBUG:teuthology.orchestra.run.smithi018:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-04-17T19:53:14.271 DEBUG:teuthology.orchestra.run.smithi018:> sudo modprobe fuse 2024-04-17T19:53:14.327 DEBUG:teuthology.orchestra.run.smithi018:> cat /proc/self/mounts | awk '{print $2}' 2024-04-17T19:53:14.378 INFO:teuthology.orchestra.run.smithi018.stdout:/sys 2024-04-17T19:53:14.378 INFO:teuthology.orchestra.run.smithi018.stdout:/proc 2024-04-17T19:53:14.378 INFO:teuthology.orchestra.run.smithi018.stdout:/dev 2024-04-17T19:53:14.379 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/pts 2024-04-17T19:53:14.379 INFO:teuthology.orchestra.run.smithi018.stdout:/run 2024-04-17T19:53:14.379 INFO:teuthology.orchestra.run.smithi018.stdout:/ 2024-04-17T19:53:14.379 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/security 2024-04-17T19:53:14.379 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/shm 2024-04-17T19:53:14.379 INFO:teuthology.orchestra.run.smithi018.stdout:/run/lock 2024-04-17T19:53:14.379 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/cgroup 2024-04-17T19:53:14.379 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/pstore 2024-04-17T19:53:14.379 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/bpf 2024-04-17T19:53:14.379 INFO:teuthology.orchestra.run.smithi018.stdout:/proc/sys/fs/binfmt_misc 2024-04-17T19:53:14.379 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/hugepages 2024-04-17T19:53:14.379 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/mqueue 2024-04-17T19:53:14.379 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/debug 2024-04-17T19:53:14.379 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/tracing 2024-04-17T19:53:14.379 INFO:teuthology.orchestra.run.smithi018.stdout:/proc/fs/nfsd 2024-04-17T19:53:14.380 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/fuse/connections 2024-04-17T19:53:14.380 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/config 2024-04-17T19:53:14.380 INFO:teuthology.orchestra.run.smithi018.stdout:/run/credentials/systemd-sysusers.service 2024-04-17T19:53:14.380 INFO:teuthology.orchestra.run.smithi018.stdout:/run/rpc_pipefs 2024-04-17T19:53:14.380 INFO:teuthology.orchestra.run.smithi018.stdout:/run/user/1000 2024-04-17T19:53:14.380 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph 2024-04-17T19:53:14.380 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph/osd/ceph-0 2024-04-17T19:53:14.380 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph/osd/ceph-1 2024-04-17T19:53:14.380 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph/osd/ceph-2 2024-04-17T19:53:14.380 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph/osd/ceph-3 2024-04-17T19:53:14.380 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns 2024-04-17T19:53:14.380 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-17T19:53:14.380 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-17T19:53:14.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:14.381 DEBUG:teuthology.orchestra.run.smithi018:> ls /sys/fs/fuse/connections 2024-04-17T19:53:14.428 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-17T19:53:14.428 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-04-17T19:53:14.472 DEBUG:teuthology.orchestra.run.smithi018:> sudo modprobe fuse 2024-04-17T19:53:14.487 DEBUG:teuthology.orchestra.run.smithi018:> cat /proc/self/mounts | awk '{print $2}' 2024-04-17T19:53:14.536 INFO:teuthology.orchestra.run.smithi018.stdout:/sys 2024-04-17T19:53:14.537 INFO:teuthology.orchestra.run.smithi018.stdout:/proc 2024-04-17T19:53:14.537 INFO:teuthology.orchestra.run.smithi018.stdout:/dev 2024-04-17T19:53:14.537 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/pts 2024-04-17T19:53:14.537 INFO:teuthology.orchestra.run.smithi018.stdout:/run 2024-04-17T19:53:14.537 INFO:teuthology.orchestra.run.smithi018.stdout:/ 2024-04-17T19:53:14.537 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/security 2024-04-17T19:53:14.537 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/shm 2024-04-17T19:53:14.537 INFO:teuthology.orchestra.run.smithi018.stdout:/run/lock 2024-04-17T19:53:14.537 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/cgroup 2024-04-17T19:53:14.537 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/pstore 2024-04-17T19:53:14.537 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/bpf 2024-04-17T19:53:14.537 INFO:teuthology.orchestra.run.smithi018.stdout:/proc/sys/fs/binfmt_misc 2024-04-17T19:53:14.537 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/hugepages 2024-04-17T19:53:14.538 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/mqueue 2024-04-17T19:53:14.538 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/debug 2024-04-17T19:53:14.538 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/tracing 2024-04-17T19:53:14.538 INFO:teuthology.orchestra.run.smithi018.stdout:/proc/fs/nfsd 2024-04-17T19:53:14.538 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/fuse/connections 2024-04-17T19:53:14.538 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/config 2024-04-17T19:53:14.538 INFO:teuthology.orchestra.run.smithi018.stdout:/run/credentials/systemd-sysusers.service 2024-04-17T19:53:14.538 INFO:teuthology.orchestra.run.smithi018.stdout:/run/rpc_pipefs 2024-04-17T19:53:14.538 INFO:teuthology.orchestra.run.smithi018.stdout:/run/user/1000 2024-04-17T19:53:14.538 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph 2024-04-17T19:53:14.538 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph/osd/ceph-0 2024-04-17T19:53:14.538 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph/osd/ceph-1 2024-04-17T19:53:14.538 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph/osd/ceph-2 2024-04-17T19:53:14.538 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph/osd/ceph-3 2024-04-17T19:53:14.538 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns 2024-04-17T19:53:14.539 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-17T19:53:14.539 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-17T19:53:14.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:14.539 DEBUG:teuthology.orchestra.run.smithi018:> ls /sys/fs/fuse/connections 2024-04-17T19:53:14.587 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi018.stderr:2024-04-17T19:53:14.589+0000 7fb65758d580 -1 init, newargv = 0x56290f3bc150 newargc=15 2024-04-17T19:53:14.587 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi018.stderr:ceph-fuse[33605]: starting ceph client 2024-04-17T19:53:14.596 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi018.stderr:ceph-fuse[33605]: starting fuse 2024-04-17T19:53:15.688 DEBUG:teuthology.orchestra.run.smithi018:> sudo modprobe fuse 2024-04-17T19:53:15.705 DEBUG:teuthology.orchestra.run.smithi018:> cat /proc/self/mounts | awk '{print $2}' 2024-04-17T19:53:15.754 INFO:teuthology.orchestra.run.smithi018.stdout:/sys 2024-04-17T19:53:15.754 INFO:teuthology.orchestra.run.smithi018.stdout:/proc 2024-04-17T19:53:15.754 INFO:teuthology.orchestra.run.smithi018.stdout:/dev 2024-04-17T19:53:15.754 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/pts 2024-04-17T19:53:15.754 INFO:teuthology.orchestra.run.smithi018.stdout:/run 2024-04-17T19:53:15.754 INFO:teuthology.orchestra.run.smithi018.stdout:/ 2024-04-17T19:53:15.754 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/security 2024-04-17T19:53:15.755 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/shm 2024-04-17T19:53:15.755 INFO:teuthology.orchestra.run.smithi018.stdout:/run/lock 2024-04-17T19:53:15.755 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/cgroup 2024-04-17T19:53:15.755 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/pstore 2024-04-17T19:53:15.755 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/bpf 2024-04-17T19:53:15.755 INFO:teuthology.orchestra.run.smithi018.stdout:/proc/sys/fs/binfmt_misc 2024-04-17T19:53:15.755 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/hugepages 2024-04-17T19:53:15.755 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/mqueue 2024-04-17T19:53:15.755 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/debug 2024-04-17T19:53:15.755 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/tracing 2024-04-17T19:53:15.755 INFO:teuthology.orchestra.run.smithi018.stdout:/proc/fs/nfsd 2024-04-17T19:53:15.756 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/fuse/connections 2024-04-17T19:53:15.756 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/config 2024-04-17T19:53:15.756 INFO:teuthology.orchestra.run.smithi018.stdout:/run/credentials/systemd-sysusers.service 2024-04-17T19:53:15.756 INFO:teuthology.orchestra.run.smithi018.stdout:/run/rpc_pipefs 2024-04-17T19:53:15.756 INFO:teuthology.orchestra.run.smithi018.stdout:/run/user/1000 2024-04-17T19:53:15.756 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph 2024-04-17T19:53:15.756 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph/osd/ceph-0 2024-04-17T19:53:15.756 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph/osd/ceph-1 2024-04-17T19:53:15.756 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph/osd/ceph-2 2024-04-17T19:53:15.756 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph/osd/ceph-3 2024-04-17T19:53:15.756 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns 2024-04-17T19:53:15.756 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-17T19:53:15.757 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-17T19:53:15.757 INFO:teuthology.orchestra.run.smithi018.stdout:/home/ubuntu/cephtest/mnt.admin 2024-04-17T19:53:15.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:15.757 DEBUG:teuthology.orchestra.run.smithi018:> ls /sys/fs/fuse/connections 2024-04-17T19:53:15.801 INFO:teuthology.orchestra.run.smithi018.stdout:45 2024-04-17T19:53:15.801 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-04-17T19:53:15.801 DEBUG:teuthology.orchestra.run.smithi018:> sudo stdin-killer -- python3 -c ' 2024-04-17T19:53:15.802 DEBUG:teuthology.orchestra.run.smithi018:> import glob 2024-04-17T19:53:15.802 DEBUG:teuthology.orchestra.run.smithi018:> import re 2024-04-17T19:53:15.802 DEBUG:teuthology.orchestra.run.smithi018:> import os 2024-04-17T19:53:15.802 DEBUG:teuthology.orchestra.run.smithi018:> import subprocess 2024-04-17T19:53:15.802 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-17T19:53:15.802 DEBUG:teuthology.orchestra.run.smithi018:> def _find_admin_socket(client_name): 2024-04-17T19:53:15.802 DEBUG:teuthology.orchestra.run.smithi018:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-04-17T19:53:15.802 DEBUG:teuthology.orchestra.run.smithi018:> files = glob.glob(asok_path) 2024-04-17T19:53:15.802 DEBUG:teuthology.orchestra.run.smithi018:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-04-17T19:53:15.802 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-17T19:53:15.803 DEBUG:teuthology.orchestra.run.smithi018:> # Given a non-glob path, it better be there 2024-04-17T19:53:15.803 DEBUG:teuthology.orchestra.run.smithi018:> if "*" not in asok_path: 2024-04-17T19:53:15.803 DEBUG:teuthology.orchestra.run.smithi018:> assert(len(files) == 1) 2024-04-17T19:53:15.803 DEBUG:teuthology.orchestra.run.smithi018:> return files[0] 2024-04-17T19:53:15.803 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-17T19:53:15.803 DEBUG:teuthology.orchestra.run.smithi018:> for f in files: 2024-04-17T19:53:15.803 DEBUG:teuthology.orchestra.run.smithi018:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-17T19:53:15.803 DEBUG:teuthology.orchestra.run.smithi018:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-17T19:53:15.803 DEBUG:teuthology.orchestra.run.smithi018:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-17T19:53:15.803 DEBUG:teuthology.orchestra.run.smithi018:> contents = proc_f.read() 2024-04-17T19:53:15.803 DEBUG:teuthology.orchestra.run.smithi018:> if mountpoint in contents: 2024-04-17T19:53:15.804 DEBUG:teuthology.orchestra.run.smithi018:> return f 2024-04-17T19:53:15.804 DEBUG:teuthology.orchestra.run.smithi018:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-17T19:53:15.804 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-17T19:53:15.804 DEBUG:teuthology.orchestra.run.smithi018:> print(_find_admin_socket("client.admin")) 2024-04-17T19:53:15.804 DEBUG:teuthology.orchestra.run.smithi018:> ' 2024-04-17T19:53:15.928 INFO:teuthology.orchestra.run.smithi018.stdout:/var/run/ceph/ceph-client.admin.33605.asok 2024-04-17T19:53:15.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T19:53:15.940 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.33605.asok 2024-04-17T19:53:15.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:15.940 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.33605.asok status 2024-04-17T19:53:16.121 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-17T19:53:16.121 INFO:teuthology.orchestra.run.smithi018.stdout: "metadata": { 2024-04-17T19:53:16.121 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_sha1": "f3a98d3f110319c567ec86bf70955c141495ccf6", 2024-04-17T19:53:16.121 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_version": "ceph version 19.0.0-3146-gf3a98d3f (f3a98d3f110319c567ec86bf70955c141495ccf6) squid (dev)", 2024-04-17T19:53:16.121 INFO:teuthology.orchestra.run.smithi018.stdout: "entity_id": "admin", 2024-04-17T19:53:16.121 INFO:teuthology.orchestra.run.smithi018.stdout: "hostname": "smithi018", 2024-04-17T19:53:16.122 INFO:teuthology.orchestra.run.smithi018.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-04-17T19:53:16.122 INFO:teuthology.orchestra.run.smithi018.stdout: "pid": "33605", 2024-04-17T19:53:16.122 INFO:teuthology.orchestra.run.smithi018.stdout: "root": "/" 2024-04-17T19:53:16.122 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-17T19:53:16.122 INFO:teuthology.orchestra.run.smithi018.stdout: "dentry_count": 0, 2024-04-17T19:53:16.122 INFO:teuthology.orchestra.run.smithi018.stdout: "dentry_pinned_count": 0, 2024-04-17T19:53:16.122 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 4452, 2024-04-17T19:53:16.122 INFO:teuthology.orchestra.run.smithi018.stdout: "inst": { 2024-04-17T19:53:16.122 INFO:teuthology.orchestra.run.smithi018.stdout: "name": { 2024-04-17T19:53:16.122 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "client", 2024-04-17T19:53:16.122 INFO:teuthology.orchestra.run.smithi018.stdout: "num": 4452 2024-04-17T19:53:16.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-17T19:53:16.123 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": { 2024-04-17T19:53:16.123 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-04-17T19:53:16.123 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "192.168.0.1:0", 2024-04-17T19:53:16.123 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2334212810 2024-04-17T19:53:16.123 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-17T19:53:16.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-17T19:53:16.123 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": { 2024-04-17T19:53:16.123 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-04-17T19:53:16.123 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "192.168.0.1:0", 2024-04-17T19:53:16.123 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2334212810 2024-04-17T19:53:16.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-17T19:53:16.124 INFO:teuthology.orchestra.run.smithi018.stdout: "inst_str": "client.4452 192.168.0.1:0/2334212810", 2024-04-17T19:53:16.124 INFO:teuthology.orchestra.run.smithi018.stdout: "addr_str": "192.168.0.1:0/2334212810", 2024-04-17T19:53:16.124 INFO:teuthology.orchestra.run.smithi018.stdout: "inode_count": 1, 2024-04-17T19:53:16.124 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_epoch": 7, 2024-04-17T19:53:16.124 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_epoch": 27, 2024-04-17T19:53:16.124 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_epoch_barrier": 0, 2024-04-17T19:53:16.124 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklisted": false, 2024-04-17T19:53:16.124 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs" 2024-04-17T19:53:16.124 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-17T19:53:16.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:16.137 DEBUG:teuthology.orchestra.run.smithi018:> stat --file-system '--printf=%T 2024-04-17T19:53:16.138 DEBUG:teuthology.orchestra.run.smithi018:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-04-17T19:53:16.144 INFO:teuthology.orchestra.run.smithi018.stdout:fuseblk 2024-04-17T19:53:16.145 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-04-17T19:53:16.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:16.145 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-04-17T19:53:16.204 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-04-17T19:53:16.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-17T19:53:16.328 INFO:teuthology.orchestra.run.smithi018.stdout:# file: . 2024-04-17T19:53:16.328 INFO:teuthology.orchestra.run.smithi018.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-04-17T19:53:16.328 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:53:16.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T19:53:16.336 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-17T19:53:16.336 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-17T19:53:16.342 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T19:53:16.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.549+0000 7f32bc65a640 1 Processor -- start 2024-04-17T19:53:16.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.549+0000 7f32bc65a640 1 -- start start 2024-04-17T19:53:16.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.549+0000 7f32bc65a640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f32b40d37c0 0x7f32b40d4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:16.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.549+0000 7f32bc65a640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f32b40d0230 0x7f32b40b82f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:16.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.549+0000 7f32bc65a640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32b406c1e0 con 0x7f32b406d280 2024-04-17T19:53:16.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.549+0000 7f32bc65a640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f32b406c4c0 con 0x7f32b40d0230 2024-04-17T19:53:16.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.549+0000 7f32bc65a640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f32b406c7a0 con 0x7f32b40d37c0 2024-04-17T19:53:16.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.549+0000 7f32b9bf5640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f32b406d280 0x7f32b40cfb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:49070/0 (socket says 172.21.15.18:49070) 2024-04-17T19:53:16.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.549+0000 7f32b9bf5640 1 -- 172.21.15.18:0/3605062357 learned_addr learned my addr 172.21.15.18:0/3605062357 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:16.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.549+0000 7f32babf7640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f32b40d0230 0x7f32b40b82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:16.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.549+0000 7f32ba3f6640 1 --2- 172.21.15.18:0/3605062357 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f32b40d37c0 0x7f32b40d4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:16.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.549+0000 7f32b93f4640 1 -- 172.21.15.18:0/3605062357 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2815341315 0 0) 0x7f32b406c1e0 con 0x7f32b406d280 2024-04-17T19:53:16.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.549+0000 7f32b93f4640 1 -- 172.21.15.18:0/3605062357 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32a0003530 con 0x7f32b406d280 2024-04-17T19:53:16.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.549+0000 7f32babf7640 1 -- 172.21.15.18:0/3605062357 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f32b40d37c0 msgr2=0x7f32b40d4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:16.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.549+0000 7f32babf7640 1 --2- 172.21.15.18:0/3605062357 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f32b40d37c0 0x7f32b40d4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:16.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.549+0000 7f32babf7640 1 -- 172.21.15.18:0/3605062357 >> v1:172.21.15.18:6789/0 conn(0x7f32b406d280 legacy=0x7f32b40cfb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:16.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.549+0000 7f32babf7640 1 -- 172.21.15.18:0/3605062357 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32b406ca80 con 0x7f32b40d0230 2024-04-17T19:53:16.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.553+0000 7f32babf7640 1 --2- 172.21.15.18:0/3605062357 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32b40d0230 0x7f32b40b82f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f32ac009d90 tx=0x7f32ac01c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6680793bdf2e2f15 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:16.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.553+0000 7f32b93f4640 1 -- 172.21.15.18:0/3605062357 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ac0b2070 con 0x7f32b40d0230 2024-04-17T19:53:16.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.553+0000 7f32b93f4640 1 -- 172.21.15.18:0/3605062357 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32ac0a5880 con 0x7f32b40d0230 2024-04-17T19:53:16.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.553+0000 7f32b93f4640 1 -- 172.21.15.18:0/3605062357 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ac0a5c50 con 0x7f32b40d0230 2024-04-17T19:53:16.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.553+0000 7f32bc65a640 1 -- 172.21.15.18:0/3605062357 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32b40d0230 msgr2=0x7f32b40b82f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:16.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.553+0000 7f32bc65a640 1 --2- 172.21.15.18:0/3605062357 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32b40d0230 0x7f32b40b82f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f32ac009d90 tx=0x7f32ac01c8b0 comp rx=0 tx=0).stop 2024-04-17T19:53:16.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.553+0000 7f32bc65a640 1 -- 172.21.15.18:0/3605062357 shutdown_connections 2024-04-17T19:53:16.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.553+0000 7f32bc65a640 1 --2- 172.21.15.18:0/3605062357 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32b40d0230 0x7f32b40b82f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:16.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.553+0000 7f32bc65a640 1 --2- 172.21.15.18:0/3605062357 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f32b40d37c0 0x7f32b40d4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:16.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.553+0000 7f32bc65a640 1 -- 172.21.15.18:0/3605062357 >> 172.21.15.18:0/3605062357 conn(0x7f32b40b6cd0 msgr2=0x7f32b40b70e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:16.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.553+0000 7f32bc65a640 1 -- 172.21.15.18:0/3605062357 shutdown_connections 2024-04-17T19:53:16.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.553+0000 7f32bc65a640 1 -- 172.21.15.18:0/3605062357 wait complete. 2024-04-17T19:53:16.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.557+0000 7f32bc65a640 1 Processor -- start 2024-04-17T19:53:16.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.557+0000 7f32bc65a640 1 -- start start 2024-04-17T19:53:16.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.557+0000 7f32bc65a640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f32b406d280 0x7f32b4161070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:16.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.557+0000 7f32bc65a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32b40d37c0 0x7f32b40cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:16.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.557+0000 7f32bc65a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32b4155600 0x7f32b4155a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:16.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.557+0000 7f32bc65a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f32b415ea30 con 0x7f32b4155600 2024-04-17T19:53:16.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.557+0000 7f32bc65a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f32b406bfa0 con 0x7f32b40d37c0 2024-04-17T19:53:16.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.557+0000 7f32bc65a640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f32b415ebb0 con 0x7f32b406d280 2024-04-17T19:53:16.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.557+0000 7f32babf7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32b4155600 0x7f32b4155a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:16.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.557+0000 7f32babf7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32b4155600 0x7f32b4155a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52604/0 (socket says 172.21.15.18:52604) 2024-04-17T19:53:16.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.557+0000 7f32babf7640 1 -- 172.21.15.18:0/988038047 learned_addr learned my addr 172.21.15.18:0/988038047 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:16.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.557+0000 7f32ba3f6640 1 --2- 172.21.15.18:0/988038047 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f32b406d280 0x7f32b4161070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:16.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.557+0000 7f32b9bf5640 1 --2- 172.21.15.18:0/988038047 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32b40d37c0 0x7f32b40cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:16.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.557+0000 7f32babf7640 1 -- 172.21.15.18:0/988038047 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f32b406d280 msgr2=0x7f32b4161070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:16.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.557+0000 7f32babf7640 1 --2- 172.21.15.18:0/988038047 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f32b406d280 0x7f32b4161070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:16.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.557+0000 7f32babf7640 1 -- 172.21.15.18:0/988038047 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32b40d37c0 msgr2=0x7f32b40cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:16.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.557+0000 7f32babf7640 1 --2- 172.21.15.18:0/988038047 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32b40d37c0 0x7f32b40cc9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:16.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.557+0000 7f32babf7640 1 -- 172.21.15.18:0/988038047 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32b4155f50 con 0x7f32b4155600 2024-04-17T19:53:16.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.557+0000 7f32babf7640 1 --2- 172.21.15.18:0/988038047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32b4155600 0x7f32b4155a10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f32ac009d90 tx=0x7f32ac019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:16.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.557+0000 7f32aaffd640 1 -- 172.21.15.18:0/988038047 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ac0b2050 con 0x7f32b4155600 2024-04-17T19:53:16.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.557+0000 7f32aaffd640 1 -- 172.21.15.18:0/988038047 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32ac0be070 con 0x7f32b4155600 2024-04-17T19:53:16.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.557+0000 7f32bc65a640 1 -- 172.21.15.18:0/988038047 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32b40ccf00 con 0x7f32b4155600 2024-04-17T19:53:16.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.557+0000 7f32aaffd640 1 -- 172.21.15.18:0/988038047 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ac0ad850 con 0x7f32b4155600 2024-04-17T19:53:16.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.557+0000 7f32bc65a640 1 -- 172.21.15.18:0/988038047 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32b4161cf0 con 0x7f32b4155600 2024-04-17T19:53:16.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.561+0000 7f32bc65a640 1 -- 172.21.15.18:0/988038047 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32b4069950 con 0x7f32b4155600 2024-04-17T19:53:16.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.561+0000 7f32aaffd640 1 -- 172.21.15.18:0/988038047 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f32ac0ad9f0 con 0x7f32b4155600 2024-04-17T19:53:16.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.561+0000 7f32aaffd640 1 --2- 172.21.15.18:0/988038047 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f32980683b0 0x7f329806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:16.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.561+0000 7f32ba3f6640 1 --2- 172.21.15.18:0/988038047 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f32980683b0 0x7f329806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:16.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.561+0000 7f32aaffd640 1 -- 172.21.15.18:0/988038047 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f32ac1217a0 con 0x7f32b4155600 2024-04-17T19:53:16.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.561+0000 7f32ba3f6640 1 --2- 172.21.15.18:0/988038047 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f32980683b0 0x7f329806a8c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f32b000b930 tx=0x7f32b0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:16.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.565+0000 7f32aaffd640 1 -- 172.21.15.18:0/988038047 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f32ac0c7020 con 0x7f32b4155600 2024-04-17T19:53:16.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.733+0000 7f32bc65a640 1 -- 172.21.15.18:0/988038047 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f32b40d3250 con 0x7f32b4155600 2024-04-17T19:53:16.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.733+0000 7f32aaffd640 1 -- 172.21.15.18:0/988038047 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18506 (secure 0 0 0) 0x7f32b4155f50 con 0x7f32b4155600 2024-04-17T19:53:16.731 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:53:16.731 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":27,"fsid":"dd480169-5a81-4623-be5f-0499aa244b28","created":"2024-04-17T19:52:39.533760+0000","modified":"2024-04-17T19:53:09.903922+0000","last_up_change":"2024-04-17T19:52:51.229698+0000","last_in_change":"2024-04-17T19:52:42.144259+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T19:52:52.391648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T19:53:02.734240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T19:53:03.813028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T19:53:07.478812+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e232d577-2508-4ea4-b355-29fbae1ff025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6801","nonce":2323038417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6803","nonce":2323038417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6807","nonce":2323038417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6805","nonce":2323038417}]},"public_addr":"172.21.15.18:6801/2323038417","cluster_addr":"172.21.15.18:6803/2323038417","heartbeat_back_addr":"172.21.15.18:6807/2323038417","heartbeat_front_addr":"172.21.15.18:6805/2323038417","state":["exists","up"]},{"osd":1,"uuid":"31810ef3-2c71-48d6-8748-b74a2968d23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6817","nonce":1283678238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6819","nonce":1283678238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6823","nonce":1283678238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6821","nonce":1283678238}]},"public_addr":"172.21.15.18:6817/1283678238","cluster_addr":"172.21.15.18:6819/1283678238","heartbeat_back_addr":"172.21.15.18:6823/1283678238","heartbeat_front_addr":"172.21.15.18:6821/1283678238","state":["exists","up"]},{"osd":2,"uuid":"5a783cc5-a41c-4967-9e11-6b8330f97d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6809","nonce":1212875862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6811","nonce":1212875862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6815","nonce":1212875862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6813","nonce":1212875862}]},"public_addr":"172.21.15.18:6809/1212875862","cluster_addr":"172.21.15.18:6811/1212875862","heartbeat_back_addr":"172.21.15.18:6815/1212875862","heartbeat_front_addr":"172.21.15.18:6813/1212875862","state":["exists","up"]},{"osd":3,"uuid":"b7e056d9-9da5-46e1-810d-0c3e242fe5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6825","nonce":2428878428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6827","nonce":2428878428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6831","nonce":2428878428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6829","nonce":2428878428}]},"public_addr":"172.21.15.18:6825/2428878428","cluster_addr":"172.21.15.18:6827/2428878428","heartbeat_back_addr":"172.21.15.18:6831/2428878428","heartbeat_front_addr":"172.21.15.18:6829/2428878428","state":["exists","up"]},{"osd":4,"uuid":"21df023f-bc8b-4abb-93e5-0ecc91acda0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6825","nonce":1421511819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6827","nonce":1421511819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6831","nonce":1421511819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6829","nonce":1421511819}]},"public_addr":"172.21.15.173:6825/1421511819","cluster_addr":"172.21.15.173:6827/1421511819","heartbeat_back_addr":"172.21.15.173:6831/1421511819","heartbeat_front_addr":"172.21.15.173:6829/1421511819","state":["exists","up"]},{"osd":5,"uuid":"e270098a-6d33-49f8-84ed-94e09a880cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6801","nonce":4221907702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6803","nonce":4221907702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6807","nonce":4221907702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6805","nonce":4221907702}]},"public_addr":"172.21.15.173:6801/4221907702","cluster_addr":"172.21.15.173:6803/4221907702","heartbeat_back_addr":"172.21.15.173:6807/4221907702","heartbeat_front_addr":"172.21.15.173:6805/4221907702","state":["exists","up"]},{"osd":6,"uuid":"93c67c8c-268d-4e32-877c-043cd3acd87c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6809","nonce":761678552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6811","nonce":761678552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6815","nonce":761678552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6813","nonce":761678552}]},"public_addr":"172.21.15.173:6809/761678552","cluster_addr":"172.21.15.173:6811/761678552","heartbeat_back_addr":"172.21.15.173:6815/761678552","heartbeat_front_addr":"172.21.15.173:6813/761678552","state":["exists","up"]},{"osd":7,"uuid":"faf10eea-80de-40f6-abbb-34d07d3f59ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6817","nonce":383724537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6819","nonce":383724537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6823","nonce":383724537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6821","nonce":383724537}]},"public_addr":"172.21.15.173:6817/383724537","cluster_addr":"172.21.15.173:6819/383724537","heartbeat_back_addr":"172.21.15.173:6823/383724537","heartbeat_front_addr":"172.21.15.173:6821/383724537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.668924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.761747+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.768128+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.632252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.742608+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.734327+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.477107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.818292+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T19:53:16.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.737+0000 7f32bc65a640 1 -- 172.21.15.18:0/988038047 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f32980683b0 msgr2=0x7f329806a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:16.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.737+0000 7f32bc65a640 1 --2- 172.21.15.18:0/988038047 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f32980683b0 0x7f329806a8c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f32b000b930 tx=0x7f32b0008040 comp rx=0 tx=0).stop 2024-04-17T19:53:16.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.737+0000 7f32bc65a640 1 -- 172.21.15.18:0/988038047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32b4155600 msgr2=0x7f32b4155a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:16.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.737+0000 7f32bc65a640 1 --2- 172.21.15.18:0/988038047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32b4155600 0x7f32b4155a10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f32ac009d90 tx=0x7f32ac019650 comp rx=0 tx=0).stop 2024-04-17T19:53:16.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.737+0000 7f32bc65a640 1 -- 172.21.15.18:0/988038047 shutdown_connections 2024-04-17T19:53:16.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.737+0000 7f32bc65a640 1 --2- 172.21.15.18:0/988038047 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f32980683b0 0x7f329806a8c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:16.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.737+0000 7f32bc65a640 1 --2- 172.21.15.18:0/988038047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32b4155600 0x7f32b4155a10 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:16.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.737+0000 7f32bc65a640 1 --2- 172.21.15.18:0/988038047 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32b40d37c0 0x7f32b40cc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:16.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.737+0000 7f32bc65a640 1 --2- 172.21.15.18:0/988038047 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f32b406d280 0x7f32b4161070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:16.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.737+0000 7f32bc65a640 1 -- 172.21.15.18:0/988038047 >> 172.21.15.18:0/988038047 conn(0x7f32b40b6cd0 msgr2=0x7f32b4156a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:16.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.737+0000 7f32bc65a640 1 -- 172.21.15.18:0/988038047 shutdown_connections 2024-04-17T19:53:16.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.737+0000 7f32bc65a640 1 -- 172.21.15.18:0/988038047 wait complete. 2024-04-17T19:53:16.753 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T19:52:52.391648+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-17T19:53:02.734240+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-17T19:53:03.813028+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-17T19:53:07.478812+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-17T19:53:16.753 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T19:53:16.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.917+0000 7f351855f640 1 Processor -- start 2024-04-17T19:53:16.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.917+0000 7f351855f640 1 -- start start 2024-04-17T19:53:16.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.921+0000 7f351855f640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f351006cd60 0x7f351006d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:16.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.921+0000 7f351855f640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f351015d7c0 0x7f351015dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:16.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.921+0000 7f351855f640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f351015fc90 con 0x7f351015c7c0 2024-04-17T19:53:16.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.921+0000 7f351855f640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f351006d6b0 con 0x7f351006cd60 2024-04-17T19:53:16.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.921+0000 7f351855f640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f3510142870 con 0x7f351015d7c0 2024-04-17T19:53:16.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.921+0000 7f35162fb640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f351006cd60 0x7f351006d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:16.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.921+0000 7f3515afa640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f351015c7c0 0x7f351015cbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:49076/0 (socket says 172.21.15.18:49076) 2024-04-17T19:53:16.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.921+0000 7f3515afa640 1 -- 172.21.15.18:0/4049324645 learned_addr learned my addr 172.21.15.18:0/4049324645 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:16.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.921+0000 7f3516afc640 1 --2- 172.21.15.18:0/4049324645 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f351015d7c0 0x7f351015dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:16.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.921+0000 7f35162fb640 1 -- 172.21.15.18:0/4049324645 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f351015d7c0 msgr2=0x7f351015dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:16.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.921+0000 7f35152f9640 1 -- 172.21.15.18:0/4049324645 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1441336871 0 0) 0x7f351015fc90 con 0x7f351015c7c0 2024-04-17T19:53:16.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.921+0000 7f35162fb640 1 --2- 172.21.15.18:0/4049324645 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f351015d7c0 0x7f351015dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:16.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.921+0000 7f35162fb640 1 -- 172.21.15.18:0/4049324645 >> v1:172.21.15.18:6789/0 conn(0x7f351015c7c0 legacy=0x7f351015cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:16.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.921+0000 7f35162fb640 1 -- 172.21.15.18:0/4049324645 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f351015ff00 con 0x7f351006cd60 2024-04-17T19:53:16.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.925+0000 7f35162fb640 1 --2- 172.21.15.18:0/4049324645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f351006cd60 0x7f351006d170 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f35040097f0 tx=0x7f350401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2610bd3d91ae9ba server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:16.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.925+0000 7f35152f9640 1 -- 172.21.15.18:0/4049324645 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35040b0070 con 0x7f351006cd60 2024-04-17T19:53:16.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.925+0000 7f35152f9640 1 -- 172.21.15.18:0/4049324645 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35040ab600 con 0x7f351006cd60 2024-04-17T19:53:16.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.925+0000 7f35152f9640 1 -- 172.21.15.18:0/4049324645 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35040ab9d0 con 0x7f351006cd60 2024-04-17T19:53:16.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.925+0000 7f351855f640 1 -- 172.21.15.18:0/4049324645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f351006cd60 msgr2=0x7f351006d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:16.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.925+0000 7f351855f640 1 --2- 172.21.15.18:0/4049324645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f351006cd60 0x7f351006d170 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f35040097f0 tx=0x7f350401c440 comp rx=0 tx=0).stop 2024-04-17T19:53:16.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.925+0000 7f351855f640 1 -- 172.21.15.18:0/4049324645 shutdown_connections 2024-04-17T19:53:16.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.925+0000 7f351855f640 1 --2- 172.21.15.18:0/4049324645 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f351015d7c0 0x7f351015dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:16.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.925+0000 7f351855f640 1 --2- 172.21.15.18:0/4049324645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f351006cd60 0x7f351006d170 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:16.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.925+0000 7f351855f640 1 -- 172.21.15.18:0/4049324645 >> 172.21.15.18:0/4049324645 conn(0x7f3510072bb0 msgr2=0x7f3510072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:16.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.925+0000 7f351855f640 1 -- 172.21.15.18:0/4049324645 shutdown_connections 2024-04-17T19:53:16.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.925+0000 7f351855f640 1 -- 172.21.15.18:0/4049324645 wait complete. 2024-04-17T19:53:16.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.925+0000 7f351855f640 1 Processor -- start 2024-04-17T19:53:16.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.925+0000 7f351855f640 1 -- start start 2024-04-17T19:53:16.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.929+0000 7f351855f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f351006cd60 0x7f3510134b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:16.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.929+0000 7f351855f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f351015c7c0 0x7f3510154740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:16.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.929+0000 7f351855f640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f351015d7c0 0x7f3510154ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:16.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.929+0000 7f351855f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f35101609e0 con 0x7f351015c7c0 2024-04-17T19:53:16.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.929+0000 7f351855f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3510168f90 con 0x7f351006cd60 2024-04-17T19:53:16.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.929+0000 7f351855f640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f351014b210 con 0x7f351015d7c0 2024-04-17T19:53:16.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.929+0000 7f3515afa640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f351015c7c0 0x7f3510154740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:16.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.929+0000 7f3515afa640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f351015c7c0 0x7f3510154740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52614/0 (socket says 172.21.15.18:52614) 2024-04-17T19:53:16.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.929+0000 7f3515afa640 1 -- 172.21.15.18:0/27210706 learned_addr learned my addr 172.21.15.18:0/27210706 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:16.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.929+0000 7f35162fb640 1 --2- 172.21.15.18:0/27210706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f351006cd60 0x7f3510134b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:16.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.929+0000 7f3516afc640 1 --2- 172.21.15.18:0/27210706 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f351015d7c0 0x7f3510154ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:16.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.929+0000 7f3515afa640 1 -- 172.21.15.18:0/27210706 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f351015d7c0 msgr2=0x7f3510154ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:16.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.929+0000 7f3515afa640 1 --2- 172.21.15.18:0/27210706 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f351015d7c0 0x7f3510154ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:16.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.929+0000 7f3515afa640 1 -- 172.21.15.18:0/27210706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f351006cd60 msgr2=0x7f3510134b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:16.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.929+0000 7f3515afa640 1 --2- 172.21.15.18:0/27210706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f351006cd60 0x7f3510134b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:16.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.929+0000 7f3515afa640 1 -- 172.21.15.18:0/27210706 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f351013dc60 con 0x7f351015c7c0 2024-04-17T19:53:16.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.929+0000 7f3515afa640 1 --2- 172.21.15.18:0/27210706 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f351015c7c0 0x7f3510154740 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f350c00c480 tx=0x7f350c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:16.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.929+0000 7f3502ffd640 1 -- 172.21.15.18:0/27210706 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f350c018070 con 0x7f351015c7c0 2024-04-17T19:53:16.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.929+0000 7f3502ffd640 1 -- 172.21.15.18:0/27210706 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f350c0074e0 con 0x7f351015c7c0 2024-04-17T19:53:16.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.929+0000 7f351855f640 1 -- 172.21.15.18:0/27210706 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3510154c80 con 0x7f351015c7c0 2024-04-17T19:53:16.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.929+0000 7f3502ffd640 1 -- 172.21.15.18:0/27210706 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f350c0049f0 con 0x7f351015c7c0 2024-04-17T19:53:16.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.929+0000 7f351855f640 1 -- 172.21.15.18:0/27210706 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f351013d3c0 con 0x7f351015c7c0 2024-04-17T19:53:16.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.929+0000 7f351855f640 1 -- 172.21.15.18:0/27210706 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3510069950 con 0x7f351015c7c0 2024-04-17T19:53:16.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.929+0000 7f3502ffd640 1 -- 172.21.15.18:0/27210706 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f350c01b070 con 0x7f351015c7c0 2024-04-17T19:53:16.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.933+0000 7f3502ffd640 1 --2- 172.21.15.18:0/27210706 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f34f4068380 0x7f34f406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:16.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.933+0000 7f35162fb640 1 --2- 172.21.15.18:0/27210706 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f34f4068380 0x7f34f406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:16.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.933+0000 7f3502ffd640 1 -- 172.21.15.18:0/27210706 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f350c0860c0 con 0x7f351015c7c0 2024-04-17T19:53:16.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.933+0000 7f35162fb640 1 --2- 172.21.15.18:0/27210706 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f34f4068380 0x7f34f406a890 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f35040ad000 tx=0x7f35040a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:16.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:16.937+0000 7f3502ffd640 1 -- 172.21.15.18:0/27210706 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f351013dc60 con 0x7f351015c7c0 2024-04-17T19:53:17.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.101+0000 7f351855f640 1 -- 172.21.15.18:0/27210706 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f35100b4b80 con 0x7f351015c7c0 2024-04-17T19:53:17.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.101+0000 7f3502ffd640 1 -- 172.21.15.18:0/27210706 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f350c056340 con 0x7f351015c7c0 2024-04-17T19:53:17.097 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-17T19:53:17.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.105+0000 7f351855f640 1 -- 172.21.15.18:0/27210706 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f34f4068380 msgr2=0x7f34f406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:17.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.105+0000 7f351855f640 1 --2- 172.21.15.18:0/27210706 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f34f4068380 0x7f34f406a890 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f35040ad000 tx=0x7f35040a6000 comp rx=0 tx=0).stop 2024-04-17T19:53:17.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.105+0000 7f351855f640 1 -- 172.21.15.18:0/27210706 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f351015c7c0 msgr2=0x7f3510154740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:17.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.105+0000 7f351855f640 1 --2- 172.21.15.18:0/27210706 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f351015c7c0 0x7f3510154740 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f350c00c480 tx=0x7f350c00c940 comp rx=0 tx=0).stop 2024-04-17T19:53:17.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.105+0000 7f351855f640 1 -- 172.21.15.18:0/27210706 shutdown_connections 2024-04-17T19:53:17.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.105+0000 7f351855f640 1 --2- 172.21.15.18:0/27210706 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f34f4068380 0x7f34f406a890 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:17.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.105+0000 7f351855f640 1 --2- 172.21.15.18:0/27210706 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f351015d7c0 0x7f3510154ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:17.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.105+0000 7f351855f640 1 --2- 172.21.15.18:0/27210706 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f351015c7c0 0x7f3510154740 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:17.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.105+0000 7f351855f640 1 --2- 172.21.15.18:0/27210706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f351006cd60 0x7f3510134b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:17.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.105+0000 7f351855f640 1 -- 172.21.15.18:0/27210706 >> 172.21.15.18:0/27210706 conn(0x7f3510072bb0 msgr2=0x7f3510072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:17.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.105+0000 7f351855f640 1 -- 172.21.15.18:0/27210706 shutdown_connections 2024-04-17T19:53:17.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.105+0000 7f351855f640 1 -- 172.21.15.18:0/27210706 wait complete. 2024-04-17T19:53:17.119 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-17T19:53:17.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.277+0000 7f5006f6c640 1 Processor -- start 2024-04-17T19:53:17.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.277+0000 7f5006f6c640 1 -- start start 2024-04-17T19:53:17.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.277+0000 7f5006f6c640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f50000b86b0 0x7f500006d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:17.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.277+0000 7f5006f6c640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f500006be80 con 0x7f50000b82a0 2024-04-17T19:53:17.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.277+0000 7f5006f6c640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f500006c160 con 0x7f50000d3420 2024-04-17T19:53:17.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.277+0000 7f5006f6c640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f50000cfd90 con 0x7f50000b86b0 2024-04-17T19:53:17.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.277+0000 7f5004d08640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f50000b82a0 0x7f500006cc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:49080/0 (socket says 172.21.15.18:49080) 2024-04-17T19:53:17.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.277+0000 7f5004d08640 1 -- 172.21.15.18:0/3552181023 learned_addr learned my addr 172.21.15.18:0/3552181023 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:17.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.277+0000 7f4fff7fe640 1 -- 172.21.15.18:0/3552181023 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 800445264 0 0) 0x7f500006be80 con 0x7f50000b82a0 2024-04-17T19:53:17.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.277+0000 7f4ffffff640 1 --2- 172.21.15.18:0/3552181023 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f50000b86b0 0x7f500006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:17.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.277+0000 7f4fff7fe640 1 -- 172.21.15.18:0/3552181023 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fe8003530 con 0x7f50000b82a0 2024-04-17T19:53:17.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.277+0000 7f4fff7fe640 1 -- 172.21.15.18:0/3552181023 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3370214708 0 0) 0x7f4fe8003530 con 0x7f50000b82a0 2024-04-17T19:53:17.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.277+0000 7f4fff7fe640 1 -- 172.21.15.18:0/3552181023 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f50000b86b0 msgr2=0x7f500006d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:17.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.277+0000 7f4fff7fe640 1 --2- 172.21.15.18:0/3552181023 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f50000b86b0 0x7f500006d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:17.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.277+0000 7f4fff7fe640 1 -- 172.21.15.18:0/3552181023 >> v1:172.21.15.173:6789/0 conn(0x7f50000d3420 legacy=0x7f50000d3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:17.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.277+0000 7f4fff7fe640 1 -- 172.21.15.18:0/3552181023 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f500006c440 con 0x7f50000b82a0 2024-04-17T19:53:17.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.277+0000 7f4fff7fe640 1 -- 172.21.15.18:0/3552181023 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3208559991 0 0) 0x7f4ff0001a00 con 0x7f50000b82a0 2024-04-17T19:53:17.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.277+0000 7f4fff7fe640 1 -- 172.21.15.18:0/3552181023 >> v1:172.21.15.18:6789/0 conn(0x7f50000b82a0 legacy=0x7f500006cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:17.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.277+0000 7f4fff7fe640 1 --2- 172.21.15.18:0/3552181023 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f50000b86b0 0x7f4fe8003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:17.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.277+0000 7f4fff7fe640 1 --2- 172.21.15.18:0/3552181023 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fe8003f90 0x7f4fe8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:17.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.277+0000 7f4fff7fe640 1 --2- 172.21.15.18:0/3552181023 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fe8004d50 0x7f4fe8005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:17.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.277+0000 7f4fff7fe640 1 -- 172.21.15.18:0/3552181023 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f50000cfd90 con 0x7f4fe8003f90 2024-04-17T19:53:17.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.277+0000 7f4fff7fe640 1 -- 172.21.15.18:0/3552181023 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe800bcb0 con 0x7f4fe8004d50 2024-04-17T19:53:17.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.277+0000 7f4fff7fe640 1 -- 172.21.15.18:0/3552181023 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f4fe800beb0 con 0x7f50000b86b0 2024-04-17T19:53:17.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.277+0000 7f4ffffff640 1 --2- 172.21.15.18:0/3552181023 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fe8003f90 0x7f4fe8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:17.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.281+0000 7f5004d08640 1 --2- 172.21.15.18:0/3552181023 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f50000b86b0 0x7f4fe8003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:17.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.281+0000 7f5005509640 1 --2- 172.21.15.18:0/3552181023 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fe8004d50 0x7f4fe8005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:17.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.281+0000 7f4ffffff640 1 -- 172.21.15.18:0/3552181023 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f50000b86b0 msgr2=0x7f4fe8003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:17.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.281+0000 7f4ffffff640 1 --2- 172.21.15.18:0/3552181023 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f50000b86b0 0x7f4fe8003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:17.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.281+0000 7f4ffffff640 1 -- 172.21.15.18:0/3552181023 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fe8004d50 msgr2=0x7f4fe8005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:17.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.281+0000 7f4ffffff640 1 --2- 172.21.15.18:0/3552181023 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fe8004d50 0x7f4fe8005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:17.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.281+0000 7f4ffffff640 1 -- 172.21.15.18:0/3552181023 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fe8003530 con 0x7f4fe8003f90 2024-04-17T19:53:17.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.281+0000 7f4ffffff640 1 --2- 172.21.15.18:0/3552181023 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fe8003f90 0x7f4fe8004810 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4009ae0 tx=0x7f4ff401ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4790d52c4cf472b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:17.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.281+0000 7f4fff7fe640 1 -- 172.21.15.18:0/3552181023 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff40096b0 con 0x7f4fe8003f90 2024-04-17T19:53:17.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.281+0000 7f4fff7fe640 1 -- 172.21.15.18:0/3552181023 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ff40a6440 con 0x7f4fe8003f90 2024-04-17T19:53:17.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.281+0000 7f4fff7fe640 1 -- 172.21.15.18:0/3552181023 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff40a6830 con 0x7f4fe8003f90 2024-04-17T19:53:17.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.281+0000 7f5006f6c640 1 -- 172.21.15.18:0/3552181023 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fe8003f90 msgr2=0x7f4fe8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:17.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.281+0000 7f5006f6c640 1 --2- 172.21.15.18:0/3552181023 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fe8003f90 0x7f4fe8004810 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4009ae0 tx=0x7f4ff401ca60 comp rx=0 tx=0).stop 2024-04-17T19:53:17.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.281+0000 7f5005509640 1 -- 172.21.15.18:0/3552181023 reap_dead start 2024-04-17T19:53:17.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.281+0000 7f5006f6c640 1 -- 172.21.15.18:0/3552181023 shutdown_connections 2024-04-17T19:53:17.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.281+0000 7f5006f6c640 1 -- 172.21.15.18:0/3552181023 >> 172.21.15.18:0/3552181023 conn(0x7f50000b6cf0 msgr2=0x7f50000b7100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:17.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.281+0000 7f5006f6c640 1 -- 172.21.15.18:0/3552181023 shutdown_connections 2024-04-17T19:53:17.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.281+0000 7f5006f6c640 1 -- 172.21.15.18:0/3552181023 wait complete. 2024-04-17T19:53:17.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.285+0000 7f5006f6c640 1 Processor -- start 2024-04-17T19:53:17.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.285+0000 7f5006f6c640 1 -- start start 2024-04-17T19:53:17.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.285+0000 7f5006f6c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fe8003f90 0x7f5000155fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:17.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.285+0000 7f5006f6c640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5000156e30 0x7f5000157af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:17.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.285+0000 7f5006f6c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f500015a080 0x7f500015a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:17.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.285+0000 7f5006f6c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f500016b6b0 con 0x7f4fe8003f90 2024-04-17T19:53:17.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.285+0000 7f5006f6c640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f500016b530 con 0x7f500015a080 2024-04-17T19:53:17.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.285+0000 7f5006f6c640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f500016b830 con 0x7f5000156e30 2024-04-17T19:53:17.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.285+0000 7f5004d08640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fe8003f90 0x7f5000155fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:17.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.285+0000 7f5004d08640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fe8003f90 0x7f5000155fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52636/0 (socket says 172.21.15.18:52636) 2024-04-17T19:53:17.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.285+0000 7f5004d08640 1 -- 172.21.15.18:0/3612652641 learned_addr learned my addr 172.21.15.18:0/3612652641 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:17.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.285+0000 7f4ffffff640 1 --2- 172.21.15.18:0/3612652641 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5000156e30 0x7f5000157af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:17.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.285+0000 7f5005509640 1 --2- 172.21.15.18:0/3612652641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f500015a080 0x7f500015a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:17.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.285+0000 7f5004d08640 1 -- 172.21.15.18:0/3612652641 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5000156e30 msgr2=0x7f5000157af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:17.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.285+0000 7f5004d08640 1 --2- 172.21.15.18:0/3612652641 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5000156e30 0x7f5000157af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:17.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.285+0000 7f5004d08640 1 -- 172.21.15.18:0/3612652641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f500015a080 msgr2=0x7f500015a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:17.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.285+0000 7f5004d08640 1 --2- 172.21.15.18:0/3612652641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f500015a080 0x7f500015a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:17.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.285+0000 7f5004d08640 1 -- 172.21.15.18:0/3612652641 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f500015a9d0 con 0x7f4fe8003f90 2024-04-17T19:53:17.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.285+0000 7f5004d08640 1 --2- 172.21.15.18:0/3612652641 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fe8003f90 0x7f5000155fa0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4ff00079e0 tx=0x7f4ff000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:17.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.285+0000 7f4ffd7fa640 1 -- 172.21.15.18:0/3612652641 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff000edf0 con 0x7f4fe8003f90 2024-04-17T19:53:17.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.289+0000 7f4ffd7fa640 1 -- 172.21.15.18:0/3612652641 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ff0018070 con 0x7f4fe8003f90 2024-04-17T19:53:17.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.289+0000 7f4ffd7fa640 1 -- 172.21.15.18:0/3612652641 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff0013660 con 0x7f4fe8003f90 2024-04-17T19:53:17.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.289+0000 7f5006f6c640 1 -- 172.21.15.18:0/3612652641 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5000164470 con 0x7f4fe8003f90 2024-04-17T19:53:17.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.289+0000 7f5006f6c640 1 -- 172.21.15.18:0/3612652641 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5000164a30 con 0x7f4fe8003f90 2024-04-17T19:53:17.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.289+0000 7f5006f6c640 1 -- 172.21.15.18:0/3612652641 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5000156530 con 0x7f4fe8003f90 2024-04-17T19:53:17.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.289+0000 7f4ffd7fa640 1 -- 172.21.15.18:0/3612652641 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4ff0013800 con 0x7f4fe8003f90 2024-04-17T19:53:17.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.289+0000 7f4ffd7fa640 1 --2- 172.21.15.18:0/3612652641 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f4fec068380 0x7f4fec06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:17.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.289+0000 7f4ffd7fa640 1 -- 172.21.15.18:0/3612652641 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f4ff0087330 con 0x7f4fe8003f90 2024-04-17T19:53:17.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.289+0000 7f4ffffff640 1 --2- 172.21.15.18:0/3612652641 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f4fec068380 0x7f4fec06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:17.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.289+0000 7f4ffffff640 1 --2- 172.21.15.18:0/3612652641 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f4fec068380 0x7f4fec06a890 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4ff40ad000 tx=0x7f4ff40046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:17.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.293+0000 7f4ffd7fa640 1 -- 172.21.15.18:0/3612652641 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f500015a9d0 con 0x7f4fe8003f90 2024-04-17T19:53:17.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.457+0000 7f5006f6c640 1 -- 172.21.15.18:0/3612652641 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f50001fc390 con 0x7f4fe8003f90 2024-04-17T19:53:17.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.457+0000 7f4ffd7fa640 1 -- 172.21.15.18:0/3612652641 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f4ff0057560 con 0x7f4fe8003f90 2024-04-17T19:53:17.454 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-17T19:53:17.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.461+0000 7f5006f6c640 1 -- 172.21.15.18:0/3612652641 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f4fec068380 msgr2=0x7f4fec06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:17.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.461+0000 7f5006f6c640 1 --2- 172.21.15.18:0/3612652641 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f4fec068380 0x7f4fec06a890 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4ff40ad000 tx=0x7f4ff40046d0 comp rx=0 tx=0).stop 2024-04-17T19:53:17.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.461+0000 7f5006f6c640 1 -- 172.21.15.18:0/3612652641 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fe8003f90 msgr2=0x7f5000155fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:17.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.461+0000 7f5006f6c640 1 --2- 172.21.15.18:0/3612652641 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fe8003f90 0x7f5000155fa0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4ff00079e0 tx=0x7f4ff000e530 comp rx=0 tx=0).stop 2024-04-17T19:53:17.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.461+0000 7f5006f6c640 1 -- 172.21.15.18:0/3612652641 shutdown_connections 2024-04-17T19:53:17.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.461+0000 7f5006f6c640 1 --2- 172.21.15.18:0/3612652641 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f4fec068380 0x7f4fec06a890 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:17.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.461+0000 7f5006f6c640 1 --2- 172.21.15.18:0/3612652641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f500015a080 0x7f500015a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:17.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.461+0000 7f5006f6c640 1 --2- 172.21.15.18:0/3612652641 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5000156e30 0x7f5000157af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:17.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.461+0000 7f5006f6c640 1 --2- 172.21.15.18:0/3612652641 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fe8003f90 0x7f5000155fa0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:17.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.461+0000 7f5006f6c640 1 -- 172.21.15.18:0/3612652641 >> 172.21.15.18:0/3612652641 conn(0x7f50000b6cf0 msgr2=0x7f500015ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:17.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.461+0000 7f5006f6c640 1 -- 172.21.15.18:0/3612652641 shutdown_connections 2024-04-17T19:53:17.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.461+0000 7f5006f6c640 1 -- 172.21.15.18:0/3612652641 wait complete. 2024-04-17T19:53:17.476 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-17T19:53:17.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.633+0000 7f80e956e640 1 Processor -- start 2024-04-17T19:53:17.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.633+0000 7f80e956e640 1 -- start start 2024-04-17T19:53:17.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.633+0000 7f80e956e640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f80e415e1a0 0x7f80e40ce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:17.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.633+0000 7f80e956e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f80e406cd60 0x7f80e406d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:17.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.633+0000 7f80e956e640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80e406d6b0 con 0x7f80e40cef10 2024-04-17T19:53:17.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.633+0000 7f80e956e640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f80e40d0020 con 0x7f80e406cd60 2024-04-17T19:53:17.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.633+0000 7f80e956e640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f80e40cd930 con 0x7f80e415e1a0 2024-04-17T19:53:17.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.633+0000 7f80e37fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f80e406cd60 0x7f80e406d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:17.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.633+0000 7f80e37fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f80e406cd60 0x7f80e406d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52644/0 (socket says 172.21.15.18:52644) 2024-04-17T19:53:17.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.633+0000 7f80e37fe640 1 -- 172.21.15.18:0/1784407834 learned_addr learned my addr 172.21.15.18:0/1784407834 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:17.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.633+0000 7f80e2ffd640 1 --2- 172.21.15.18:0/1784407834 >> v2:172.21.15.173:3300/0 conn(0x7f80e415e1a0 0x7f80e40ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:17.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.633+0000 7f80e37fe640 1 -- 172.21.15.18:0/1784407834 >> v2:172.21.15.173:3300/0 conn(0x7f80e415e1a0 msgr2=0x7f80e40ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:17.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.633+0000 7f80e37fe640 1 --2- 172.21.15.18:0/1784407834 >> v2:172.21.15.173:3300/0 conn(0x7f80e415e1a0 0x7f80e40ce9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:17.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.633+0000 7f80e37fe640 1 -- 172.21.15.18:0/1784407834 >> v1:172.21.15.173:6789/0 conn(0x7f80e40cef10 legacy=0x7f80e415e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:17.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.633+0000 7f80e37fe640 1 -- 172.21.15.18:0/1784407834 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80e40cdc10 con 0x7f80e406cd60 2024-04-17T19:53:17.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.637+0000 7f80e37fe640 1 --2- 172.21.15.18:0/1784407834 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80e406cd60 0x7f80e406d170 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f80e406fdc0 tx=0x7f80dc01c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3119371d987ebcb0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:17.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.637+0000 7f80e1ffb640 1 -- 172.21.15.18:0/1784407834 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80dc0a55d0 con 0x7f80e406cd60 2024-04-17T19:53:17.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.637+0000 7f80e1ffb640 1 -- 172.21.15.18:0/1784407834 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80dc0a5770 con 0x7f80e406cd60 2024-04-17T19:53:17.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.637+0000 7f80e1ffb640 1 -- 172.21.15.18:0/1784407834 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80dc0a5b40 con 0x7f80e406cd60 2024-04-17T19:53:17.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.637+0000 7f80e956e640 1 -- 172.21.15.18:0/1784407834 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80e406cd60 msgr2=0x7f80e406d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:17.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.637+0000 7f80e956e640 1 --2- 172.21.15.18:0/1784407834 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80e406cd60 0x7f80e406d170 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f80e406fdc0 tx=0x7f80dc01c710 comp rx=0 tx=0).stop 2024-04-17T19:53:17.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.637+0000 7f80e956e640 1 -- 172.21.15.18:0/1784407834 shutdown_connections 2024-04-17T19:53:17.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.637+0000 7f80e956e640 1 --2- 172.21.15.18:0/1784407834 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80e406cd60 0x7f80e406d170 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:17.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.637+0000 7f80e956e640 1 --2- 172.21.15.18:0/1784407834 >> v2:172.21.15.173:3300/0 conn(0x7f80e415e1a0 0x7f80e40ce9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:17.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.637+0000 7f80e956e640 1 -- 172.21.15.18:0/1784407834 >> 172.21.15.18:0/1784407834 conn(0x7f80e4072bb0 msgr2=0x7f80e4072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:17.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.637+0000 7f80e956e640 1 -- 172.21.15.18:0/1784407834 shutdown_connections 2024-04-17T19:53:17.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.637+0000 7f80e956e640 1 -- 172.21.15.18:0/1784407834 wait complete. 2024-04-17T19:53:17.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.637+0000 7f80e956e640 1 Processor -- start 2024-04-17T19:53:17.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.637+0000 7f80e956e640 1 -- start start 2024-04-17T19:53:17.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.641+0000 7f80e956e640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f80e406cd60 0x7f80e4152390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:17.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.641+0000 7f80e956e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80e40cef10 0x7f80e41528d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:17.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.641+0000 7f80e956e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80e415e1a0 0x7f80e41557a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:17.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.641+0000 7f80e956e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f80e415e730 con 0x7f80e40cef10 2024-04-17T19:53:17.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.641+0000 7f80e956e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f80e415e5b0 con 0x7f80e415e1a0 2024-04-17T19:53:17.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.641+0000 7f80e956e640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f80e415f020 con 0x7f80e406cd60 2024-04-17T19:53:17.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.641+0000 7f80e27fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80e40cef10 0x7f80e41528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:17.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.641+0000 7f80e27fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80e40cef10 0x7f80e41528d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52648/0 (socket says 172.21.15.18:52648) 2024-04-17T19:53:17.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.641+0000 7f80e27fc640 1 -- 172.21.15.18:0/2153564333 learned_addr learned my addr 172.21.15.18:0/2153564333 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:17.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.641+0000 7f80e37fe640 1 --2- 172.21.15.18:0/2153564333 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80e415e1a0 0x7f80e41557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:17.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.641+0000 7f80e2ffd640 1 --2- 172.21.15.18:0/2153564333 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f80e406cd60 0x7f80e4152390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:17.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.641+0000 7f80e27fc640 1 -- 172.21.15.18:0/2153564333 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f80e406cd60 msgr2=0x7f80e4152390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:17.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.641+0000 7f80e27fc640 1 --2- 172.21.15.18:0/2153564333 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f80e406cd60 0x7f80e4152390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:17.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.641+0000 7f80e27fc640 1 -- 172.21.15.18:0/2153564333 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80e415e1a0 msgr2=0x7f80e41557a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:17.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.641+0000 7f80e27fc640 1 --2- 172.21.15.18:0/2153564333 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80e415e1a0 0x7f80e41557a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:17.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.641+0000 7f80e27fc640 1 -- 172.21.15.18:0/2153564333 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80e414c3f0 con 0x7f80e40cef10 2024-04-17T19:53:17.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.641+0000 7f80e2ffd640 1 --2- 172.21.15.18:0/2153564333 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f80e406cd60 0x7f80e4152390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:53:17.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.641+0000 7f80e27fc640 1 --2- 172.21.15.18:0/2153564333 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80e40cef10 0x7f80e41528d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f80d800b410 tx=0x7f80d800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:17.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.641+0000 7f80cb7fe640 1 -- 172.21.15.18:0/2153564333 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d8015030 con 0x7f80e40cef10 2024-04-17T19:53:17.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.641+0000 7f80cb7fe640 1 -- 172.21.15.18:0/2153564333 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80d8004020 con 0x7f80e40cef10 2024-04-17T19:53:17.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.641+0000 7f80e956e640 1 -- 172.21.15.18:0/2153564333 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80e414c8f0 con 0x7f80e40cef10 2024-04-17T19:53:17.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.641+0000 7f80cb7fe640 1 -- 172.21.15.18:0/2153564333 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d8004410 con 0x7f80e40cef10 2024-04-17T19:53:17.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.641+0000 7f80e956e640 1 -- 172.21.15.18:0/2153564333 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80e414ceb0 con 0x7f80e40cef10 2024-04-17T19:53:17.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.641+0000 7f80e956e640 1 -- 172.21.15.18:0/2153564333 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80e414c660 con 0x7f80e40cef10 2024-04-17T19:53:17.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.641+0000 7f80cb7fe640 1 -- 172.21.15.18:0/2153564333 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f80d8018070 con 0x7f80e40cef10 2024-04-17T19:53:17.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.645+0000 7f80cb7fe640 1 --2- 172.21.15.18:0/2153564333 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f80d0068380 0x7f80d006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:17.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.645+0000 7f80cb7fe640 1 -- 172.21.15.18:0/2153564333 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f80d8086f00 con 0x7f80e40cef10 2024-04-17T19:53:17.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.645+0000 7f80e2ffd640 1 --2- 172.21.15.18:0/2153564333 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f80d0068380 0x7f80d006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:17.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.645+0000 7f80e2ffd640 1 --2- 172.21.15.18:0/2153564333 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f80d0068380 0x7f80d006a890 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f80e40b5f30 tx=0x7f80d4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:17.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.649+0000 7f80cb7fe640 1 -- 172.21.15.18:0/2153564333 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f80d80572f0 con 0x7f80e40cef10 2024-04-17T19:53:17.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.805+0000 7f80e956e640 1 -- 172.21.15.18:0/2153564333 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f80e4069950 con 0x7f80e40cef10 2024-04-17T19:53:17.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.805+0000 7f80cb7fe640 1 -- 172.21.15.18:0/2153564333 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f80d8056bf0 con 0x7f80e40cef10 2024-04-17T19:53:17.802 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-17T19:53:17.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.809+0000 7f80e956e640 1 -- 172.21.15.18:0/2153564333 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f80d0068380 msgr2=0x7f80d006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:17.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.809+0000 7f80e956e640 1 --2- 172.21.15.18:0/2153564333 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f80d0068380 0x7f80d006a890 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f80e40b5f30 tx=0x7f80d4008040 comp rx=0 tx=0).stop 2024-04-17T19:53:17.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.809+0000 7f80e956e640 1 -- 172.21.15.18:0/2153564333 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80e40cef10 msgr2=0x7f80e41528d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:17.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.809+0000 7f80e956e640 1 --2- 172.21.15.18:0/2153564333 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80e40cef10 0x7f80e41528d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f80d800b410 tx=0x7f80d800b8d0 comp rx=0 tx=0).stop 2024-04-17T19:53:17.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.809+0000 7f80e956e640 1 -- 172.21.15.18:0/2153564333 shutdown_connections 2024-04-17T19:53:17.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.809+0000 7f80e956e640 1 --2- 172.21.15.18:0/2153564333 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f80d0068380 0x7f80d006a890 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:17.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.809+0000 7f80e956e640 1 --2- 172.21.15.18:0/2153564333 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80e415e1a0 0x7f80e41557a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:17.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.809+0000 7f80e956e640 1 --2- 172.21.15.18:0/2153564333 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80e40cef10 0x7f80e41528d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:17.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.809+0000 7f80e956e640 1 --2- 172.21.15.18:0/2153564333 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f80e406cd60 0x7f80e4152390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:17.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.809+0000 7f80e956e640 1 -- 172.21.15.18:0/2153564333 >> 172.21.15.18:0/2153564333 conn(0x7f80e4072bb0 msgr2=0x7f80e406e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:17.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.809+0000 7f80e956e640 1 -- 172.21.15.18:0/2153564333 shutdown_connections 2024-04-17T19:53:17.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.809+0000 7f80e956e640 1 -- 172.21.15.18:0/2153564333 wait complete. 2024-04-17T19:53:17.822 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-17T19:53:17.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.981+0000 7f01e2f44640 1 Processor -- start 2024-04-17T19:53:17.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.981+0000 7f01e2f44640 1 -- start start 2024-04-17T19:53:17.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.981+0000 7f01e2f44640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f01dc0ced70 0x7f01dc0b6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:17.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.981+0000 7f01e2f44640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f01dc0b6d90 0x7f01dc0ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:17.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.981+0000 7f01e2f44640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01dc0cf180 con 0x7f01dc0cd090 2024-04-17T19:53:17.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.981+0000 7f01e2f44640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f01dc0b2c70 con 0x7f01dc0b6d90 2024-04-17T19:53:17.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.981+0000 7f01e2f44640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f01dc0ce4d0 con 0x7f01dc0ced70 2024-04-17T19:53:17.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.981+0000 7f01dbfff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f01dc0b6d90 0x7f01dc0ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:17.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.981+0000 7f01e14e1640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f01dc0cd090 0x7f01dc0b1470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:49094/0 (socket says 172.21.15.18:49094) 2024-04-17T19:53:17.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.981+0000 7f01e14e1640 1 -- 172.21.15.18:0/1690962311 learned_addr learned my addr 172.21.15.18:0/1690962311 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:17.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.981+0000 7f01e0ce0640 1 --2- 172.21.15.18:0/1690962311 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f01dc0ced70 0x7f01dc0b6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:17.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.981+0000 7f01dbfff640 1 -- 172.21.15.18:0/1690962311 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f01dc0ced70 msgr2=0x7f01dc0b6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:17.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.981+0000 7f01dbfff640 1 --2- 172.21.15.18:0/1690962311 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f01dc0ced70 0x7f01dc0b6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:17.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.981+0000 7f01dbfff640 1 -- 172.21.15.18:0/1690962311 >> v1:172.21.15.18:6789/0 conn(0x7f01dc0cd090 legacy=0x7f01dc0b1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:17.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.981+0000 7f01dbfff640 1 -- 172.21.15.18:0/1690962311 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01dc0b71a0 con 0x7f01dc0b6d90 2024-04-17T19:53:17.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.985+0000 7f01dbfff640 1 --2- 172.21.15.18:0/1690962311 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01dc0b6d90 0x7f01dc0ccb50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f01d00097c0 tx=0x7f01d001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=359544b45f4ef3f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:17.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.985+0000 7f01db7fe640 1 -- 172.21.15.18:0/1690962311 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d00b0070 con 0x7f01dc0b6d90 2024-04-17T19:53:17.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.985+0000 7f01db7fe640 1 -- 172.21.15.18:0/1690962311 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01d00ab600 con 0x7f01dc0b6d90 2024-04-17T19:53:17.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.985+0000 7f01db7fe640 1 -- 172.21.15.18:0/1690962311 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d00ab9d0 con 0x7f01dc0b6d90 2024-04-17T19:53:17.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.985+0000 7f01e2f44640 1 -- 172.21.15.18:0/1690962311 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01dc0b6d90 msgr2=0x7f01dc0ccb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:17.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.985+0000 7f01e2f44640 1 --2- 172.21.15.18:0/1690962311 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01dc0b6d90 0x7f01dc0ccb50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f01d00097c0 tx=0x7f01d001c4a0 comp rx=0 tx=0).stop 2024-04-17T19:53:17.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.985+0000 7f01e2f44640 1 -- 172.21.15.18:0/1690962311 shutdown_connections 2024-04-17T19:53:17.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.985+0000 7f01e2f44640 1 --2- 172.21.15.18:0/1690962311 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01dc0b6d90 0x7f01dc0ccb50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:17.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.985+0000 7f01e2f44640 1 --2- 172.21.15.18:0/1690962311 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f01dc0ced70 0x7f01dc0b6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:17.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.985+0000 7f01e2f44640 1 -- 172.21.15.18:0/1690962311 >> 172.21.15.18:0/1690962311 conn(0x7f01dc09aa70 msgr2=0x7f01dc09ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:17.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.985+0000 7f01e2f44640 1 -- 172.21.15.18:0/1690962311 shutdown_connections 2024-04-17T19:53:17.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.985+0000 7f01e2f44640 1 -- 172.21.15.18:0/1690962311 wait complete. 2024-04-17T19:53:17.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.989+0000 7f01e2f44640 1 Processor -- start 2024-04-17T19:53:17.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.989+0000 7f01e2f44640 1 -- start start 2024-04-17T19:53:17.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.989+0000 7f01e2f44640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01dc0b6d90 0x7f01dc167ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:17.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.989+0000 7f01e2f44640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f01dc0cd090 0x7f01dc149f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:17.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.989+0000 7f01e2f44640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01dc0ced70 0x7f01dc15a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:17.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.989+0000 7f01e2f44640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f01dc0cd8b0 con 0x7f01dc0b6d90 2024-04-17T19:53:17.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.989+0000 7f01e2f44640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f01dc0b33e0 con 0x7f01dc0ced70 2024-04-17T19:53:17.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.989+0000 7f01e2f44640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f01dc0d0c30 con 0x7f01dc0cd090 2024-04-17T19:53:17.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.989+0000 7f01e0ce0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01dc0b6d90 0x7f01dc167ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:17.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.989+0000 7f01e0ce0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01dc0b6d90 0x7f01dc167ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52678/0 (socket says 172.21.15.18:52678) 2024-04-17T19:53:17.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.989+0000 7f01e0ce0640 1 -- 172.21.15.18:0/1145845147 learned_addr learned my addr 172.21.15.18:0/1145845147 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:17.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.989+0000 7f01e14e1640 1 --2- 172.21.15.18:0/1145845147 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01dc0ced70 0x7f01dc15a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:17.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.989+0000 7f01dbfff640 1 --2- 172.21.15.18:0/1145845147 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f01dc0cd090 0x7f01dc149f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:17.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.989+0000 7f01e0ce0640 1 -- 172.21.15.18:0/1145845147 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f01dc0cd090 msgr2=0x7f01dc149f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:17.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.989+0000 7f01e0ce0640 1 --2- 172.21.15.18:0/1145845147 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f01dc0cd090 0x7f01dc149f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:17.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.989+0000 7f01e0ce0640 1 -- 172.21.15.18:0/1145845147 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01dc0ced70 msgr2=0x7f01dc15a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:17.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.989+0000 7f01e0ce0640 1 --2- 172.21.15.18:0/1145845147 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01dc0ced70 0x7f01dc15a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:17.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.989+0000 7f01e0ce0640 1 -- 172.21.15.18:0/1145845147 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01dc0b46c0 con 0x7f01dc0b6d90 2024-04-17T19:53:17.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.989+0000 7f01e0ce0640 1 --2- 172.21.15.18:0/1145845147 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01dc0b6d90 0x7f01dc167ff0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f01cc007e70 tx=0x7f01cc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:17.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.989+0000 7f01d97fa640 1 -- 172.21.15.18:0/1145845147 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01cc014620 con 0x7f01dc0b6d90 2024-04-17T19:53:17.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.989+0000 7f01d97fa640 1 -- 172.21.15.18:0/1145845147 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01cc019070 con 0x7f01dc0b6d90 2024-04-17T19:53:17.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.989+0000 7f01e2f44640 1 -- 172.21.15.18:0/1145845147 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01dc168530 con 0x7f01dc0b6d90 2024-04-17T19:53:17.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.989+0000 7f01d97fa640 1 -- 172.21.15.18:0/1145845147 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01cc014a00 con 0x7f01dc0b6d90 2024-04-17T19:53:17.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.989+0000 7f01e2f44640 1 -- 172.21.15.18:0/1145845147 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01dc06c6f0 con 0x7f01dc0b6d90 2024-04-17T19:53:17.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.993+0000 7f01e2f44640 1 -- 172.21.15.18:0/1145845147 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01dc069950 con 0x7f01dc0b6d90 2024-04-17T19:53:17.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.993+0000 7f01d97fa640 1 -- 172.21.15.18:0/1145845147 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f01cc014ba0 con 0x7f01dc0b6d90 2024-04-17T19:53:17.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.993+0000 7f01d97fa640 1 --2- 172.21.15.18:0/1145845147 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f01c8068380 0x7f01c806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:17.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.993+0000 7f01d97fa640 1 -- 172.21.15.18:0/1145845147 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f01cc087640 con 0x7f01dc0b6d90 2024-04-17T19:53:17.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.993+0000 7f01dbfff640 1 --2- 172.21.15.18:0/1145845147 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f01c8068380 0x7f01c806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:17.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.993+0000 7f01dbfff640 1 --2- 172.21.15.18:0/1145845147 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f01c8068380 0x7f01c806a890 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f01d00ad000 tx=0x7f01d0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:17.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:17.997+0000 7f01d97fa640 1 -- 172.21.15.18:0/1145845147 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f01cc011260 con 0x7f01dc0b6d90 2024-04-17T19:53:18.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.153+0000 7f01e2f44640 1 -- 172.21.15.18:0/1145845147 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f01dc0cdd00 con 0x7f01dc0b6d90 2024-04-17T19:53:18.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.153+0000 7f01d97fa640 1 -- 172.21.15.18:0/1145845147 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f01cc057830 con 0x7f01dc0b6d90 2024-04-17T19:53:18.149 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-17T19:53:18.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.153+0000 7f01e2f44640 1 -- 172.21.15.18:0/1145845147 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f01c8068380 msgr2=0x7f01c806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:18.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.153+0000 7f01e2f44640 1 --2- 172.21.15.18:0/1145845147 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f01c8068380 0x7f01c806a890 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f01d00ad000 tx=0x7f01d0008040 comp rx=0 tx=0).stop 2024-04-17T19:53:18.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.153+0000 7f01e2f44640 1 -- 172.21.15.18:0/1145845147 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01dc0b6d90 msgr2=0x7f01dc167ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:18.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.153+0000 7f01e2f44640 1 --2- 172.21.15.18:0/1145845147 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01dc0b6d90 0x7f01dc167ff0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f01cc007e70 tx=0x7f01cc00e4b0 comp rx=0 tx=0).stop 2024-04-17T19:53:18.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.157+0000 7f01e2f44640 1 -- 172.21.15.18:0/1145845147 shutdown_connections 2024-04-17T19:53:18.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.157+0000 7f01e2f44640 1 --2- 172.21.15.18:0/1145845147 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f01c8068380 0x7f01c806a890 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:18.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.157+0000 7f01e2f44640 1 --2- 172.21.15.18:0/1145845147 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01dc0ced70 0x7f01dc15a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:18.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.157+0000 7f01e2f44640 1 --2- 172.21.15.18:0/1145845147 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f01dc0cd090 0x7f01dc149f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:18.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.157+0000 7f01e2f44640 1 --2- 172.21.15.18:0/1145845147 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01dc0b6d90 0x7f01dc167ff0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:18.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.157+0000 7f01e2f44640 1 -- 172.21.15.18:0/1145845147 >> 172.21.15.18:0/1145845147 conn(0x7f01dc09aa70 msgr2=0x7f01dc0b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:18.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.157+0000 7f01e2f44640 1 -- 172.21.15.18:0/1145845147 shutdown_connections 2024-04-17T19:53:18.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.157+0000 7f01e2f44640 1 -- 172.21.15.18:0/1145845147 wait complete. 2024-04-17T19:53:18.171 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-17T19:53:18.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.313+0000 7f6df9a10640 1 Processor -- start 2024-04-17T19:53:18.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.313+0000 7f6df9a10640 1 -- start start 2024-04-17T19:53:18.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.313+0000 7f6df9a10640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6df406bd50 0x7f6df4073080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:18.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.317+0000 7f6df9a10640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6df40735c0 0x7f6df40b4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:18.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.317+0000 7f6df9a10640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6df40739d0 con 0x7f6df4162900 2024-04-17T19:53:18.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.317+0000 7f6df9a10640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f6df406c4a0 con 0x7f6df40735c0 2024-04-17T19:53:18.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.317+0000 7f6df9a10640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f6df406c780 con 0x7f6df406bd50 2024-04-17T19:53:18.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.317+0000 7f6df37fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6df40735c0 0x7f6df40b4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:18.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.317+0000 7f6df37fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6df40735c0 0x7f6df40b4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52682/0 (socket says 172.21.15.18:52682) 2024-04-17T19:53:18.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.317+0000 7f6df37fe640 1 -- 172.21.15.18:0/1392468283 learned_addr learned my addr 172.21.15.18:0/1392468283 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:18.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.317+0000 7f6df27fc640 1 --2- 172.21.15.18:0/1392468283 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6df406bd50 0x7f6df4073080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:18.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.317+0000 7f6df37fe640 1 -- 172.21.15.18:0/1392468283 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6df406bd50 msgr2=0x7f6df4073080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:18.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.317+0000 7f6df37fe640 1 --2- 172.21.15.18:0/1392468283 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6df406bd50 0x7f6df4073080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:18.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.317+0000 7f6df37fe640 1 -- 172.21.15.18:0/1392468283 >> v1:172.21.15.173:6789/0 conn(0x7f6df4162900 legacy=0x7f6df40ce9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:18.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.317+0000 7f6df37fe640 1 -- 172.21.15.18:0/1392468283 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6df406ca60 con 0x7f6df40735c0 2024-04-17T19:53:18.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.317+0000 7f6df37fe640 1 --2- 172.21.15.18:0/1392468283 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6df40735c0 0x7f6df40b4a20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6dec009e50 tx=0x7f6dec01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46fc1c0187362c58 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:18.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.317+0000 7f6df1ffb640 1 -- 172.21.15.18:0/1392468283 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dec0a5700 con 0x7f6df40735c0 2024-04-17T19:53:18.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.317+0000 7f6df1ffb640 1 -- 172.21.15.18:0/1392468283 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dec0a58a0 con 0x7f6df40735c0 2024-04-17T19:53:18.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.317+0000 7f6df1ffb640 1 -- 172.21.15.18:0/1392468283 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dec0a5c70 con 0x7f6df40735c0 2024-04-17T19:53:18.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.317+0000 7f6df9a10640 1 -- 172.21.15.18:0/1392468283 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6df40735c0 msgr2=0x7f6df40b4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:18.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.317+0000 7f6df9a10640 1 --2- 172.21.15.18:0/1392468283 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6df40735c0 0x7f6df40b4a20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6dec009e50 tx=0x7f6dec01ca30 comp rx=0 tx=0).stop 2024-04-17T19:53:18.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.317+0000 7f6df9a10640 1 -- 172.21.15.18:0/1392468283 shutdown_connections 2024-04-17T19:53:18.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.317+0000 7f6df9a10640 1 --2- 172.21.15.18:0/1392468283 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6df40735c0 0x7f6df40b4a20 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:18.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.317+0000 7f6df9a10640 1 --2- 172.21.15.18:0/1392468283 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6df406bd50 0x7f6df4073080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:18.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.317+0000 7f6df9a10640 1 -- 172.21.15.18:0/1392468283 >> 172.21.15.18:0/1392468283 conn(0x7f6df40b38c0 msgr2=0x7f6df40d12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:18.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.317+0000 7f6df9a10640 1 -- 172.21.15.18:0/1392468283 shutdown_connections 2024-04-17T19:53:18.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.317+0000 7f6df9a10640 1 -- 172.21.15.18:0/1392468283 wait complete. 2024-04-17T19:53:18.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.321+0000 7f6df9a10640 1 Processor -- start 2024-04-17T19:53:18.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.321+0000 7f6df9a10640 1 -- start start 2024-04-17T19:53:18.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.321+0000 7f6df9a10640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6df406bd50 0x7f6df40b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:18.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.321+0000 7f6df9a10640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6df40735c0 0x7f6df4149660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:18.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.321+0000 7f6df9a10640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6df4162900 0x7f6df415b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:18.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.321+0000 7f6df9a10640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6df416c370 con 0x7f6df406bd50 2024-04-17T19:53:18.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.321+0000 7f6df9a10640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6df416c1f0 con 0x7f6df4162900 2024-04-17T19:53:18.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.321+0000 7f6df9a10640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f6df416c4f0 con 0x7f6df40735c0 2024-04-17T19:53:18.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.321+0000 7f6df2ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6df406bd50 0x7f6df40b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:18.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.321+0000 7f6df2ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6df406bd50 0x7f6df40b02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52694/0 (socket says 172.21.15.18:52694) 2024-04-17T19:53:18.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.321+0000 7f6df2ffd640 1 -- 172.21.15.18:0/619548779 learned_addr learned my addr 172.21.15.18:0/619548779 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:18.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.321+0000 7f6df37fe640 1 --2- 172.21.15.18:0/619548779 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6df4162900 0x7f6df415b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:18.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.321+0000 7f6df27fc640 1 --2- 172.21.15.18:0/619548779 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6df40735c0 0x7f6df4149660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:18.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.321+0000 7f6df2ffd640 1 -- 172.21.15.18:0/619548779 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6df40735c0 msgr2=0x7f6df4149660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:18.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.321+0000 7f6df2ffd640 1 --2- 172.21.15.18:0/619548779 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6df40735c0 0x7f6df4149660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:18.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.321+0000 7f6df2ffd640 1 -- 172.21.15.18:0/619548779 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6df4162900 msgr2=0x7f6df415b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:18.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.321+0000 7f6df2ffd640 1 --2- 172.21.15.18:0/619548779 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6df4162900 0x7f6df415b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:18.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.321+0000 7f6df2ffd640 1 -- 172.21.15.18:0/619548779 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6df40af6d0 con 0x7f6df406bd50 2024-04-17T19:53:18.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.321+0000 7f6df37fe640 1 --2- 172.21.15.18:0/619548779 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6df4162900 0x7f6df415b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:53:18.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.321+0000 7f6df2ffd640 1 --2- 172.21.15.18:0/619548779 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6df406bd50 0x7f6df40b02c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6de400c3c0 tx=0x7f6de400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:18.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.321+0000 7f6ddbfff640 1 -- 172.21.15.18:0/619548779 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de4017070 con 0x7f6df406bd50 2024-04-17T19:53:18.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.321+0000 7f6ddbfff640 1 -- 172.21.15.18:0/619548779 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6de40052d0 con 0x7f6df406bd50 2024-04-17T19:53:18.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.321+0000 7f6ddbfff640 1 -- 172.21.15.18:0/619548779 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de4003820 con 0x7f6df406bd50 2024-04-17T19:53:18.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.321+0000 7f6df9a10640 1 -- 172.21.15.18:0/619548779 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6df414a3f0 con 0x7f6df406bd50 2024-04-17T19:53:18.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.321+0000 7f6df9a10640 1 -- 172.21.15.18:0/619548779 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6df414a9b0 con 0x7f6df406bd50 2024-04-17T19:53:18.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.325+0000 7f6df9a10640 1 -- 172.21.15.18:0/619548779 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6df4069950 con 0x7f6df406bd50 2024-04-17T19:53:18.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.325+0000 7f6ddbfff640 1 -- 172.21.15.18:0/619548779 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6de401a070 con 0x7f6df406bd50 2024-04-17T19:53:18.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.325+0000 7f6ddbfff640 1 --2- 172.21.15.18:0/619548779 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f6de0068380 0x7f6de006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:18.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.325+0000 7f6ddbfff640 1 -- 172.21.15.18:0/619548779 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f6de4085f60 con 0x7f6df406bd50 2024-04-17T19:53:18.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.325+0000 7f6df27fc640 1 --2- 172.21.15.18:0/619548779 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f6de0068380 0x7f6de006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:18.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.325+0000 7f6df27fc640 1 --2- 172.21.15.18:0/619548779 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f6de0068380 0x7f6de006a890 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6df415c390 tx=0x7f6de8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:18.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.329+0000 7f6ddbfff640 1 -- 172.21.15.18:0/619548779 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6df40af6d0 con 0x7f6df406bd50 2024-04-17T19:53:18.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.501+0000 7f6df9a10640 1 -- 172.21.15.18:0/619548779 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6df40b5f40 con 0x7f6df406bd50 2024-04-17T19:53:18.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.501+0000 7f6ddbfff640 1 -- 172.21.15.18:0/619548779 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f6df40739d0 con 0x7f6df406bd50 2024-04-17T19:53:18.498 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-04-17T19:53:18.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.505+0000 7f6df9a10640 1 -- 172.21.15.18:0/619548779 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f6de0068380 msgr2=0x7f6de006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:18.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.505+0000 7f6df9a10640 1 --2- 172.21.15.18:0/619548779 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f6de0068380 0x7f6de006a890 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6df415c390 tx=0x7f6de8008040 comp rx=0 tx=0).stop 2024-04-17T19:53:18.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.505+0000 7f6df9a10640 1 -- 172.21.15.18:0/619548779 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6df406bd50 msgr2=0x7f6df40b02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:18.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.505+0000 7f6df9a10640 1 --2- 172.21.15.18:0/619548779 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6df406bd50 0x7f6df40b02c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6de400c3c0 tx=0x7f6de400c880 comp rx=0 tx=0).stop 2024-04-17T19:53:18.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.505+0000 7f6df9a10640 1 -- 172.21.15.18:0/619548779 shutdown_connections 2024-04-17T19:53:18.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.505+0000 7f6df9a10640 1 --2- 172.21.15.18:0/619548779 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f6de0068380 0x7f6de006a890 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:18.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.505+0000 7f6df9a10640 1 --2- 172.21.15.18:0/619548779 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6df4162900 0x7f6df415b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:18.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.505+0000 7f6df9a10640 1 --2- 172.21.15.18:0/619548779 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6df40735c0 0x7f6df4149660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:18.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.505+0000 7f6df9a10640 1 --2- 172.21.15.18:0/619548779 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6df406bd50 0x7f6df40b02c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:18.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.505+0000 7f6df9a10640 1 -- 172.21.15.18:0/619548779 >> 172.21.15.18:0/619548779 conn(0x7f6df40b38c0 msgr2=0x7f6df4155710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:18.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.505+0000 7f6df9a10640 1 -- 172.21.15.18:0/619548779 shutdown_connections 2024-04-17T19:53:18.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.505+0000 7f6df9a10640 1 -- 172.21.15.18:0/619548779 wait complete. 2024-04-17T19:53:18.519 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-17T19:53:18.519 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-17T19:53:18.525 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T19:53:18.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.717+0000 7feb3855b640 1 Processor -- start 2024-04-17T19:53:18.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.717+0000 7feb3855b640 1 -- start start 2024-04-17T19:53:18.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.717+0000 7feb3855b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7feb3006d470 0x7feb3015ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:18.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.717+0000 7feb3855b640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb300d0020 con 0x7feb3015e1a0 2024-04-17T19:53:18.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.717+0000 7feb3855b640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb300cd930 con 0x7feb3015e910 2024-04-17T19:53:18.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.717+0000 7feb3855b640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7feb300cdc10 con 0x7feb3006d470 2024-04-17T19:53:18.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.717+0000 7feb36af8640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7feb3006d470 0x7feb3015ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:18.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.717+0000 7feb362f7640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7feb3015e1a0 0x7feb300ce9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:49096/0 (socket says 172.21.15.18:49096) 2024-04-17T19:53:18.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.717+0000 7feb36af8640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7feb3006d470 0x7feb3015ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52702/0 (socket says 172.21.15.18:52702) 2024-04-17T19:53:18.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.717+0000 7feb362f7640 1 -- 172.21.15.18:0/2212199795 learned_addr learned my addr 172.21.15.18:0/2212199795 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:18.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.717+0000 7feb36af8640 1 -- 172.21.15.18:0/2212199795 >> v1:172.21.15.173:6789/0 conn(0x7feb3015e910 legacy=0x7feb3006cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:18.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.717+0000 7feb352f5640 1 -- 172.21.15.18:0/2212199795 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2731664032 0 0) 0x7feb300d0020 con 0x7feb3015e1a0 2024-04-17T19:53:18.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.717+0000 7feb36af8640 1 -- 172.21.15.18:0/2212199795 >> v1:172.21.15.18:6789/0 conn(0x7feb3015e1a0 legacy=0x7feb300ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:18.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.717+0000 7feb36af8640 1 -- 172.21.15.18:0/2212199795 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb300cdef0 con 0x7feb3006d470 2024-04-17T19:53:18.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.721+0000 7feb36af8640 1 --2- 172.21.15.18:0/2212199795 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb3006d470 0x7feb3015ed20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7feb2c0097c0 tx=0x7feb2c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b7b734a9daf1286 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:18.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.721+0000 7feb352f5640 1 -- 172.21.15.18:0/2212199795 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb2c0b0070 con 0x7feb3006d470 2024-04-17T19:53:18.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.721+0000 7feb352f5640 1 -- 172.21.15.18:0/2212199795 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb2c0ab600 con 0x7feb3006d470 2024-04-17T19:53:18.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.721+0000 7feb352f5640 1 -- 172.21.15.18:0/2212199795 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb2c0ab9d0 con 0x7feb3006d470 2024-04-17T19:53:18.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.721+0000 7feb3855b640 1 -- 172.21.15.18:0/2212199795 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb3006d470 msgr2=0x7feb3015ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:18.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.721+0000 7feb3855b640 1 --2- 172.21.15.18:0/2212199795 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb3006d470 0x7feb3015ed20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7feb2c0097c0 tx=0x7feb2c01c410 comp rx=0 tx=0).stop 2024-04-17T19:53:18.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.721+0000 7feb3855b640 1 -- 172.21.15.18:0/2212199795 shutdown_connections 2024-04-17T19:53:18.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.721+0000 7feb3855b640 1 --2- 172.21.15.18:0/2212199795 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb3006d470 0x7feb3015ed20 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:18.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.721+0000 7feb3855b640 1 -- 172.21.15.18:0/2212199795 >> 172.21.15.18:0/2212199795 conn(0x7feb30072bb0 msgr2=0x7feb30072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:18.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.721+0000 7feb3855b640 1 -- 172.21.15.18:0/2212199795 shutdown_connections 2024-04-17T19:53:18.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.721+0000 7feb3855b640 1 -- 172.21.15.18:0/2212199795 wait complete. 2024-04-17T19:53:18.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.725+0000 7feb3855b640 1 Processor -- start 2024-04-17T19:53:18.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.725+0000 7feb3855b640 1 -- start start 2024-04-17T19:53:18.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.725+0000 7feb3855b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb3015e1a0 0x7feb30141630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:18.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.725+0000 7feb3855b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb3015e910 0x7feb3013fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:18.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.725+0000 7feb3855b640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feb30143050 0x7feb30143460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:18.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.725+0000 7feb3855b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7feb300cf260 con 0x7feb3015e910 2024-04-17T19:53:18.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.725+0000 7feb3855b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7feb300cf0e0 con 0x7feb3015e1a0 2024-04-17T19:53:18.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.725+0000 7feb3855b640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7feb30157a10 con 0x7feb30143050 2024-04-17T19:53:18.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.725+0000 7feb35af6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb3015e910 0x7feb3013fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:18.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.725+0000 7feb35af6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb3015e910 0x7feb3013fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52710/0 (socket says 172.21.15.18:52710) 2024-04-17T19:53:18.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.725+0000 7feb35af6640 1 -- 172.21.15.18:0/1275488234 learned_addr learned my addr 172.21.15.18:0/1275488234 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:18.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.725+0000 7feb362f7640 1 --2- 172.21.15.18:0/1275488234 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb3015e1a0 0x7feb30141630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:18.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.725+0000 7feb36af8640 1 --2- 172.21.15.18:0/1275488234 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feb30143050 0x7feb30143460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:18.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.725+0000 7feb35af6640 1 -- 172.21.15.18:0/1275488234 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feb30143050 msgr2=0x7feb30143460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:18.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.725+0000 7feb35af6640 1 --2- 172.21.15.18:0/1275488234 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feb30143050 0x7feb30143460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:18.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.725+0000 7feb35af6640 1 -- 172.21.15.18:0/1275488234 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb3015e1a0 msgr2=0x7feb30141630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:18.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.725+0000 7feb35af6640 1 --2- 172.21.15.18:0/1275488234 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb3015e1a0 0x7feb30141630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:18.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.725+0000 7feb35af6640 1 -- 172.21.15.18:0/1275488234 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb30140dc0 con 0x7feb3015e910 2024-04-17T19:53:18.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.725+0000 7feb362f7640 1 --2- 172.21.15.18:0/1275488234 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb3015e1a0 0x7feb30141630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:53:18.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.725+0000 7feb36af8640 1 --2- 172.21.15.18:0/1275488234 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feb30143050 0x7feb30143460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:53:18.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.725+0000 7feb35af6640 1 --2- 172.21.15.18:0/1275488234 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb3015e910 0x7feb3013fc00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7feb2000c3c0 tx=0x7feb2000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:18.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.725+0000 7feb26ffd640 1 -- 172.21.15.18:0/1275488234 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb20017070 con 0x7feb3015e910 2024-04-17T19:53:18.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.725+0000 7feb26ffd640 1 -- 172.21.15.18:0/1275488234 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb200052d0 con 0x7feb3015e910 2024-04-17T19:53:18.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.725+0000 7feb3855b640 1 -- 172.21.15.18:0/1275488234 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb301410a0 con 0x7feb3015e910 2024-04-17T19:53:18.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.725+0000 7feb26ffd640 1 -- 172.21.15.18:0/1275488234 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb20003820 con 0x7feb3015e910 2024-04-17T19:53:18.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.725+0000 7feb3855b640 1 -- 172.21.15.18:0/1275488234 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb30140140 con 0x7feb3015e910 2024-04-17T19:53:18.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.729+0000 7feb3855b640 1 -- 172.21.15.18:0/1275488234 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb30143d90 con 0x7feb3015e910 2024-04-17T19:53:18.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.729+0000 7feb26ffd640 1 -- 172.21.15.18:0/1275488234 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7feb2001a070 con 0x7feb3015e910 2024-04-17T19:53:18.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.729+0000 7feb26ffd640 1 --2- 172.21.15.18:0/1275488234 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7feb140683b0 0x7feb1406a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:18.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.729+0000 7feb26ffd640 1 -- 172.21.15.18:0/1275488234 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7feb200860b0 con 0x7feb3015e910 2024-04-17T19:53:18.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.729+0000 7feb362f7640 1 --2- 172.21.15.18:0/1275488234 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7feb140683b0 0x7feb1406a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:18.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.729+0000 7feb362f7640 1 --2- 172.21.15.18:0/1275488234 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7feb140683b0 0x7feb1406a8c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7feb280012f0 tx=0x7feb28009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:18.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.733+0000 7feb26ffd640 1 -- 172.21.15.18:0/1275488234 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7feb20005480 con 0x7feb3015e910 2024-04-17T19:53:18.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.897+0000 7feb3855b640 1 -- 172.21.15.18:0/1275488234 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feb30069950 con 0x7feb3015e910 2024-04-17T19:53:18.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.901+0000 7feb26ffd640 1 -- 172.21.15.18:0/1275488234 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18506 (secure 0 0 0) 0x7feb200562a0 con 0x7feb3015e910 2024-04-17T19:53:18.896 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:53:18.896 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":27,"fsid":"dd480169-5a81-4623-be5f-0499aa244b28","created":"2024-04-17T19:52:39.533760+0000","modified":"2024-04-17T19:53:09.903922+0000","last_up_change":"2024-04-17T19:52:51.229698+0000","last_in_change":"2024-04-17T19:52:42.144259+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T19:52:52.391648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T19:53:02.734240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T19:53:03.813028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T19:53:07.478812+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e232d577-2508-4ea4-b355-29fbae1ff025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6801","nonce":2323038417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6803","nonce":2323038417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6807","nonce":2323038417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6805","nonce":2323038417}]},"public_addr":"172.21.15.18:6801/2323038417","cluster_addr":"172.21.15.18:6803/2323038417","heartbeat_back_addr":"172.21.15.18:6807/2323038417","heartbeat_front_addr":"172.21.15.18:6805/2323038417","state":["exists","up"]},{"osd":1,"uuid":"31810ef3-2c71-48d6-8748-b74a2968d23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6817","nonce":1283678238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6819","nonce":1283678238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6823","nonce":1283678238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6821","nonce":1283678238}]},"public_addr":"172.21.15.18:6817/1283678238","cluster_addr":"172.21.15.18:6819/1283678238","heartbeat_back_addr":"172.21.15.18:6823/1283678238","heartbeat_front_addr":"172.21.15.18:6821/1283678238","state":["exists","up"]},{"osd":2,"uuid":"5a783cc5-a41c-4967-9e11-6b8330f97d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6809","nonce":1212875862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6811","nonce":1212875862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6815","nonce":1212875862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6813","nonce":1212875862}]},"public_addr":"172.21.15.18:6809/1212875862","cluster_addr":"172.21.15.18:6811/1212875862","heartbeat_back_addr":"172.21.15.18:6815/1212875862","heartbeat_front_addr":"172.21.15.18:6813/1212875862","state":["exists","up"]},{"osd":3,"uuid":"b7e056d9-9da5-46e1-810d-0c3e242fe5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6825","nonce":2428878428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6827","nonce":2428878428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6831","nonce":2428878428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6829","nonce":2428878428}]},"public_addr":"172.21.15.18:6825/2428878428","cluster_addr":"172.21.15.18:6827/2428878428","heartbeat_back_addr":"172.21.15.18:6831/2428878428","heartbeat_front_addr":"172.21.15.18:6829/2428878428","state":["exists","up"]},{"osd":4,"uuid":"21df023f-bc8b-4abb-93e5-0ecc91acda0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6825","nonce":1421511819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6827","nonce":1421511819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6831","nonce":1421511819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6829","nonce":1421511819}]},"public_addr":"172.21.15.173:6825/1421511819","cluster_addr":"172.21.15.173:6827/1421511819","heartbeat_back_addr":"172.21.15.173:6831/1421511819","heartbeat_front_addr":"172.21.15.173:6829/1421511819","state":["exists","up"]},{"osd":5,"uuid":"e270098a-6d33-49f8-84ed-94e09a880cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6801","nonce":4221907702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6803","nonce":4221907702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6807","nonce":4221907702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6805","nonce":4221907702}]},"public_addr":"172.21.15.173:6801/4221907702","cluster_addr":"172.21.15.173:6803/4221907702","heartbeat_back_addr":"172.21.15.173:6807/4221907702","heartbeat_front_addr":"172.21.15.173:6805/4221907702","state":["exists","up"]},{"osd":6,"uuid":"93c67c8c-268d-4e32-877c-043cd3acd87c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6809","nonce":761678552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6811","nonce":761678552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6815","nonce":761678552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6813","nonce":761678552}]},"public_addr":"172.21.15.173:6809/761678552","cluster_addr":"172.21.15.173:6811/761678552","heartbeat_back_addr":"172.21.15.173:6815/761678552","heartbeat_front_addr":"172.21.15.173:6813/761678552","state":["exists","up"]},{"osd":7,"uuid":"faf10eea-80de-40f6-abbb-34d07d3f59ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6817","nonce":383724537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6819","nonce":383724537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6823","nonce":383724537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6821","nonce":383724537}]},"public_addr":"172.21.15.173:6817/383724537","cluster_addr":"172.21.15.173:6819/383724537","heartbeat_back_addr":"172.21.15.173:6823/383724537","heartbeat_front_addr":"172.21.15.173:6821/383724537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.668924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.761747+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.768128+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.632252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.742608+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.734327+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.477107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.818292+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T19:53:18.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.901+0000 7feb3855b640 1 -- 172.21.15.18:0/1275488234 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7feb140683b0 msgr2=0x7feb1406a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:18.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.901+0000 7feb3855b640 1 --2- 172.21.15.18:0/1275488234 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7feb140683b0 0x7feb1406a8c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7feb280012f0 tx=0x7feb28009040 comp rx=0 tx=0).stop 2024-04-17T19:53:18.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.901+0000 7feb3855b640 1 -- 172.21.15.18:0/1275488234 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb3015e910 msgr2=0x7feb3013fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:18.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.901+0000 7feb3855b640 1 --2- 172.21.15.18:0/1275488234 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb3015e910 0x7feb3013fc00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7feb2000c3c0 tx=0x7feb2000c880 comp rx=0 tx=0).stop 2024-04-17T19:53:18.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.901+0000 7feb3855b640 1 -- 172.21.15.18:0/1275488234 shutdown_connections 2024-04-17T19:53:18.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.901+0000 7feb3855b640 1 --2- 172.21.15.18:0/1275488234 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7feb140683b0 0x7feb1406a8c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:18.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.901+0000 7feb3855b640 1 --2- 172.21.15.18:0/1275488234 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feb30143050 0x7feb30143460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:18.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.901+0000 7feb3855b640 1 --2- 172.21.15.18:0/1275488234 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb3015e910 0x7feb3013fc00 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:18.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.901+0000 7feb3855b640 1 --2- 172.21.15.18:0/1275488234 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb3015e1a0 0x7feb30141630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:18.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.901+0000 7feb3855b640 1 -- 172.21.15.18:0/1275488234 >> 172.21.15.18:0/1275488234 conn(0x7feb30072bb0 msgr2=0x7feb3015c890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:18.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.901+0000 7feb3855b640 1 -- 172.21.15.18:0/1275488234 shutdown_connections 2024-04-17T19:53:18.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:18.901+0000 7feb3855b640 1 -- 172.21.15.18:0/1275488234 wait complete. 2024-04-17T19:53:18.917 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T19:52:52.391648+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-17T19:53:02.734240+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-17T19:53:03.813028+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-17T19:53:07.478812+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-17T19:53:18.918 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T19:53:19.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.077+0000 7fc59573b640 1 Processor -- start 2024-04-17T19:53:19.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.077+0000 7fc59573b640 1 -- start start 2024-04-17T19:53:19.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.077+0000 7fc59573b640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc5900b86b0 0x7fc59006d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:19.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.077+0000 7fc59573b640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc5900d3420 0x7fc5900d3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:19.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.077+0000 7fc59573b640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc59006be80 con 0x7fc5900b82a0 2024-04-17T19:53:19.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.077+0000 7fc59573b640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7fc5900cfd90 con 0x7fc5900b86b0 2024-04-17T19:53:19.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.077+0000 7fc59573b640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fc59006c160 con 0x7fc5900d3420 2024-04-17T19:53:19.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.077+0000 7fc58effd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fc5900b82a0 0x7fc59006cc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:49098/0 (socket says 172.21.15.18:49098) 2024-04-17T19:53:19.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.077+0000 7fc58effd640 1 -- 172.21.15.18:0/1525188907 learned_addr learned my addr 172.21.15.18:0/1525188907 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:19.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.077+0000 7fc58e7fc640 1 --2- 172.21.15.18:0/1525188907 >> v2:172.21.15.173:3300/0 conn(0x7fc5900b86b0 0x7fc59006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:19.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.077+0000 7fc58dffb640 1 -- 172.21.15.18:0/1525188907 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3724337234 0 0) 0x7fc59006be80 con 0x7fc5900b82a0 2024-04-17T19:53:19.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.077+0000 7fc58f7fe640 1 --2- 172.21.15.18:0/1525188907 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc5900d3420 0x7fc5900d3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:19.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.077+0000 7fc58dffb640 1 -- 172.21.15.18:0/1525188907 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc578003530 con 0x7fc5900b82a0 2024-04-17T19:53:19.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.077+0000 7fc58dffb640 1 -- 172.21.15.18:0/1525188907 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 322758864 0 0) 0x7fc578003530 con 0x7fc5900b82a0 2024-04-17T19:53:19.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.081+0000 7fc58dffb640 1 -- 172.21.15.18:0/1525188907 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc5900d3420 msgr2=0x7fc5900d3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:19.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.081+0000 7fc58dffb640 1 --2- 172.21.15.18:0/1525188907 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc5900d3420 0x7fc5900d3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:19.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.081+0000 7fc58dffb640 1 -- 172.21.15.18:0/1525188907 >> v2:172.21.15.173:3300/0 conn(0x7fc5900b86b0 msgr2=0x7fc59006d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:19.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.081+0000 7fc58dffb640 1 --2- 172.21.15.18:0/1525188907 >> v2:172.21.15.173:3300/0 conn(0x7fc5900b86b0 0x7fc59006d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:19.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.081+0000 7fc58dffb640 1 -- 172.21.15.18:0/1525188907 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc59006c440 con 0x7fc5900b82a0 2024-04-17T19:53:19.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.081+0000 7fc58dffb640 1 -- 172.21.15.18:0/1525188907 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3208559991 0 0) 0x7fc588001a00 con 0x7fc5900b82a0 2024-04-17T19:53:19.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.081+0000 7fc58dffb640 1 -- 172.21.15.18:0/1525188907 >> v1:172.21.15.18:6789/0 conn(0x7fc5900b82a0 legacy=0x7fc59006cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:19.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.081+0000 7fc58dffb640 1 --2- 172.21.15.18:0/1525188907 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5780039c0 0x7fc578003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:19.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.081+0000 7fc58dffb640 1 --2- 172.21.15.18:0/1525188907 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc5900d3420 0x7fc578004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:19.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.081+0000 7fc58dffb640 1 --2- 172.21.15.18:0/1525188907 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc578004d50 0x7fc578005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:19.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.081+0000 7fc58dffb640 1 -- 172.21.15.18:0/1525188907 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc5900cfd90 con 0x7fc578004d50 2024-04-17T19:53:19.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.081+0000 7fc58dffb640 1 -- 172.21.15.18:0/1525188907 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc59006c160 con 0x7fc5780039c0 2024-04-17T19:53:19.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.081+0000 7fc58dffb640 1 -- 172.21.15.18:0/1525188907 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fc57800bb30 con 0x7fc5900d3420 2024-04-17T19:53:19.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.081+0000 7fc58f7fe640 1 --2- 172.21.15.18:0/1525188907 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc578004d50 0x7fc578005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:19.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.081+0000 7fc58e7fc640 1 --2- 172.21.15.18:0/1525188907 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc5900d3420 0x7fc578004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:19.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.081+0000 7fc58f7fe640 1 -- 172.21.15.18:0/1525188907 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc5900d3420 msgr2=0x7fc578004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:19.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.081+0000 7fc58f7fe640 1 --2- 172.21.15.18:0/1525188907 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc5900d3420 0x7fc578004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:19.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.081+0000 7fc58f7fe640 1 -- 172.21.15.18:0/1525188907 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5780039c0 msgr2=0x7fc578003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:19.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.081+0000 7fc58f7fe640 1 --2- 172.21.15.18:0/1525188907 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5780039c0 0x7fc578003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:19.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.081+0000 7fc58f7fe640 1 -- 172.21.15.18:0/1525188907 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc578003530 con 0x7fc578004d50 2024-04-17T19:53:19.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.081+0000 7fc58e7fc640 1 --2- 172.21.15.18:0/1525188907 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc5900d3420 0x7fc578004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:53:19.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.081+0000 7fc58f7fe640 1 --2- 172.21.15.18:0/1525188907 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc578004d50 0x7fc578005160 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc580009ab0 tx=0x7fc58001ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8a9699c3206b969 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:19.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.081+0000 7fc58dffb640 1 -- 172.21.15.18:0/1525188907 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5800b2070 con 0x7fc578004d50 2024-04-17T19:53:19.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.081+0000 7fc58dffb640 1 -- 172.21.15.18:0/1525188907 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5800a5550 con 0x7fc578004d50 2024-04-17T19:53:19.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.081+0000 7fc58dffb640 1 -- 172.21.15.18:0/1525188907 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5800096b0 con 0x7fc578004d50 2024-04-17T19:53:19.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.081+0000 7fc59573b640 1 -- 172.21.15.18:0/1525188907 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc578004d50 msgr2=0x7fc578005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:19.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.081+0000 7fc59573b640 1 --2- 172.21.15.18:0/1525188907 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc578004d50 0x7fc578005160 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc580009ab0 tx=0x7fc58001ca20 comp rx=0 tx=0).stop 2024-04-17T19:53:19.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.081+0000 7fc58f7fe640 1 -- 172.21.15.18:0/1525188907 reap_dead start 2024-04-17T19:53:19.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.081+0000 7fc59573b640 1 -- 172.21.15.18:0/1525188907 shutdown_connections 2024-04-17T19:53:19.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.081+0000 7fc59573b640 1 -- 172.21.15.18:0/1525188907 >> 172.21.15.18:0/1525188907 conn(0x7fc5900b6cf0 msgr2=0x7fc5900b7100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:19.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.081+0000 7fc59573b640 1 -- 172.21.15.18:0/1525188907 shutdown_connections 2024-04-17T19:53:19.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.081+0000 7fc59573b640 1 -- 172.21.15.18:0/1525188907 wait complete. 2024-04-17T19:53:19.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.085+0000 7fc59573b640 1 Processor -- start 2024-04-17T19:53:19.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.085+0000 7fc59573b640 1 -- start start 2024-04-17T19:53:19.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.085+0000 7fc59573b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc578004d50 0x7fc5900cdca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:19.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.085+0000 7fc59573b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc590158a20 0x7fc590158e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:19.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.085+0000 7fc59573b640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc5900ae4e0 0x7fc5900ae8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:19.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.085+0000 7fc59573b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc5900d43d0 con 0x7fc590158a20 2024-04-17T19:53:19.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.085+0000 7fc59573b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc5900d4250 con 0x7fc578004d50 2024-04-17T19:53:19.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.085+0000 7fc59573b640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fc5900d4550 con 0x7fc5900ae4e0 2024-04-17T19:53:19.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.085+0000 7fc58e7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc590158a20 0x7fc590158e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:19.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.085+0000 7fc58e7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc590158a20 0x7fc590158e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52728/0 (socket says 172.21.15.18:52728) 2024-04-17T19:53:19.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.085+0000 7fc58e7fc640 1 -- 172.21.15.18:0/317711055 learned_addr learned my addr 172.21.15.18:0/317711055 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:19.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.085+0000 7fc58effd640 1 --2- 172.21.15.18:0/317711055 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc578004d50 0x7fc5900cdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:19.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.085+0000 7fc58f7fe640 1 --2- 172.21.15.18:0/317711055 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc5900ae4e0 0x7fc5900ae8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:19.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.085+0000 7fc58e7fc640 1 -- 172.21.15.18:0/317711055 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc5900ae4e0 msgr2=0x7fc5900ae8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:19.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.085+0000 7fc58e7fc640 1 --2- 172.21.15.18:0/317711055 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc5900ae4e0 0x7fc5900ae8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:19.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.085+0000 7fc58e7fc640 1 -- 172.21.15.18:0/317711055 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc578004d50 msgr2=0x7fc5900cdca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:19.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.085+0000 7fc58e7fc640 1 --2- 172.21.15.18:0/317711055 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc578004d50 0x7fc5900cdca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:19.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.085+0000 7fc58e7fc640 1 -- 172.21.15.18:0/317711055 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5900aee30 con 0x7fc590158a20 2024-04-17T19:53:19.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.085+0000 7fc58f7fe640 1 --2- 172.21.15.18:0/317711055 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc5900ae4e0 0x7fc5900ae8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:53:19.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.085+0000 7fc58e7fc640 1 --2- 172.21.15.18:0/317711055 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc590158a20 0x7fc590158e30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc584010980 tx=0x7fc584010e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:19.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.085+0000 7fc5777fe640 1 -- 172.21.15.18:0/317711055 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc58400f040 con 0x7fc590158a20 2024-04-17T19:53:19.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.085+0000 7fc5777fe640 1 -- 172.21.15.18:0/317711055 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc58400ec20 con 0x7fc590158a20 2024-04-17T19:53:19.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.085+0000 7fc59573b640 1 -- 172.21.15.18:0/317711055 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5900abd40 con 0x7fc590158a20 2024-04-17T19:53:19.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.085+0000 7fc5777fe640 1 -- 172.21.15.18:0/317711055 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc584004020 con 0x7fc590158a20 2024-04-17T19:53:19.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.085+0000 7fc59573b640 1 -- 172.21.15.18:0/317711055 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5900ac300 con 0x7fc590158a20 2024-04-17T19:53:19.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.089+0000 7fc59573b640 1 -- 172.21.15.18:0/317711055 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5901597e0 con 0x7fc590158a20 2024-04-17T19:53:19.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.089+0000 7fc5777fe640 1 -- 172.21.15.18:0/317711055 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc5840041c0 con 0x7fc590158a20 2024-04-17T19:53:19.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.089+0000 7fc5777fe640 1 --2- 172.21.15.18:0/317711055 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fc57c0683b0 0x7fc57c06a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:19.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.089+0000 7fc5777fe640 1 -- 172.21.15.18:0/317711055 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fc584087200 con 0x7fc590158a20 2024-04-17T19:53:19.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.089+0000 7fc58effd640 1 --2- 172.21.15.18:0/317711055 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fc57c0683b0 0x7fc57c06a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:19.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.089+0000 7fc58effd640 1 --2- 172.21.15.18:0/317711055 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fc57c0683b0 0x7fc57c06a8c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc588001b70 tx=0x7fc588001960 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:19.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.093+0000 7fc5777fe640 1 -- 172.21.15.18:0/317711055 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc5900aee30 con 0x7fc590158a20 2024-04-17T19:53:19.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.257+0000 7fc59573b640 1 -- 172.21.15.18:0/317711055 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc590069950 con 0x7fc590158a20 2024-04-17T19:53:19.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.257+0000 7fc5777fe640 1 -- 172.21.15.18:0/317711055 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7fc584018030 con 0x7fc590158a20 2024-04-17T19:53:19.253 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-17T19:53:19.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.257+0000 7fc59573b640 1 -- 172.21.15.18:0/317711055 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fc57c0683b0 msgr2=0x7fc57c06a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:19.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.257+0000 7fc59573b640 1 --2- 172.21.15.18:0/317711055 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fc57c0683b0 0x7fc57c06a8c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc588001b70 tx=0x7fc588001960 comp rx=0 tx=0).stop 2024-04-17T19:53:19.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.257+0000 7fc59573b640 1 -- 172.21.15.18:0/317711055 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc590158a20 msgr2=0x7fc590158e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:19.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.257+0000 7fc59573b640 1 --2- 172.21.15.18:0/317711055 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc590158a20 0x7fc590158e30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc584010980 tx=0x7fc584010e40 comp rx=0 tx=0).stop 2024-04-17T19:53:19.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.257+0000 7fc59573b640 1 -- 172.21.15.18:0/317711055 shutdown_connections 2024-04-17T19:53:19.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.257+0000 7fc59573b640 1 --2- 172.21.15.18:0/317711055 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fc57c0683b0 0x7fc57c06a8c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:19.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.257+0000 7fc59573b640 1 --2- 172.21.15.18:0/317711055 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc5900ae4e0 0x7fc5900ae8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:19.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.257+0000 7fc59573b640 1 --2- 172.21.15.18:0/317711055 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc590158a20 0x7fc590158e30 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:19.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.257+0000 7fc59573b640 1 --2- 172.21.15.18:0/317711055 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc578004d50 0x7fc5900cdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:19.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.257+0000 7fc59573b640 1 -- 172.21.15.18:0/317711055 >> 172.21.15.18:0/317711055 conn(0x7fc5900b6cf0 msgr2=0x7fc59015a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:19.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.257+0000 7fc59573b640 1 -- 172.21.15.18:0/317711055 shutdown_connections 2024-04-17T19:53:19.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.257+0000 7fc59573b640 1 -- 172.21.15.18:0/317711055 wait complete. 2024-04-17T19:53:19.274 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-17T19:53:19.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.429+0000 7f49c9e6b640 1 Processor -- start 2024-04-17T19:53:19.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.429+0000 7f49c9e6b640 1 -- start start 2024-04-17T19:53:19.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.433+0000 7f49c9e6b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f49c40b6850 0x7f49c40b6c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:19.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.433+0000 7f49c9e6b640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49c40b71a0 con 0x7f49c40cece0 2024-04-17T19:53:19.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.433+0000 7f49c9e6b640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49c40cdc10 con 0x7f49c40cf0f0 2024-04-17T19:53:19.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.433+0000 7f49c9e6b640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f49c40ce4b0 con 0x7f49c40b6850 2024-04-17T19:53:19.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.433+0000 7f49c37fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f49c40cece0 0x7f49c4161500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:49114/0 (socket says 172.21.15.18:49114) 2024-04-17T19:53:19.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.433+0000 7f49c37fe640 1 -- 172.21.15.18:0/3107831956 learned_addr learned my addr 172.21.15.18:0/3107831956 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:19.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.433+0000 7f49c3fff640 1 --2- 172.21.15.18:0/3107831956 >> v2:172.21.15.18:3300/0 conn(0x7f49c40b6850 0x7f49c40b6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:19.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.433+0000 7f49c2ffd640 1 -- 172.21.15.18:0/3107831956 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3340744162 0 0) 0x7f49b4001120 con 0x7f49c40cece0 2024-04-17T19:53:19.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.433+0000 7f49c2ffd640 1 -- 172.21.15.18:0/3107831956 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f49b0003530 con 0x7f49c40cece0 2024-04-17T19:53:19.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.433+0000 7f49c3fff640 1 -- 172.21.15.18:0/3107831956 >> v1:172.21.15.173:6789/0 conn(0x7f49c40cf0f0 legacy=0x7f49c40b1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:19.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.433+0000 7f49c3fff640 1 -- 172.21.15.18:0/3107831956 >> v1:172.21.15.18:6789/0 conn(0x7f49c40cece0 legacy=0x7f49c4161500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:19.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.433+0000 7f49c3fff640 1 -- 172.21.15.18:0/3107831956 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49c40cdef0 con 0x7f49c40b6850 2024-04-17T19:53:19.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.437+0000 7f49c3fff640 1 --2- 172.21.15.18:0/3107831956 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49c40b6850 0x7f49c40b6c60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f49bc009d90 tx=0x7f49bc01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d08cd7e75b3545d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:19.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.437+0000 7f49c2ffd640 1 -- 172.21.15.18:0/3107831956 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49bc0b2070 con 0x7f49c40b6850 2024-04-17T19:53:19.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.437+0000 7f49c2ffd640 1 -- 172.21.15.18:0/3107831956 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49bc0a5830 con 0x7f49c40b6850 2024-04-17T19:53:19.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.437+0000 7f49c2ffd640 1 -- 172.21.15.18:0/3107831956 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49bc0a5be0 con 0x7f49c40b6850 2024-04-17T19:53:19.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.437+0000 7f49c9e6b640 1 -- 172.21.15.18:0/3107831956 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49c40b6850 msgr2=0x7f49c40b6c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:19.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.437+0000 7f49c9e6b640 1 --2- 172.21.15.18:0/3107831956 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49c40b6850 0x7f49c40b6c60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f49bc009d90 tx=0x7f49bc01c970 comp rx=0 tx=0).stop 2024-04-17T19:53:19.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.437+0000 7f49c9e6b640 1 -- 172.21.15.18:0/3107831956 shutdown_connections 2024-04-17T19:53:19.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.437+0000 7f49c9e6b640 1 --2- 172.21.15.18:0/3107831956 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49c40b6850 0x7f49c40b6c60 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:19.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.437+0000 7f49c9e6b640 1 -- 172.21.15.18:0/3107831956 >> 172.21.15.18:0/3107831956 conn(0x7f49c409aa70 msgr2=0x7f49c409ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:19.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.437+0000 7f49c9e6b640 1 -- 172.21.15.18:0/3107831956 shutdown_connections 2024-04-17T19:53:19.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.437+0000 7f49c9e6b640 1 -- 172.21.15.18:0/3107831956 wait complete. 2024-04-17T19:53:19.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.437+0000 7f49c9e6b640 1 Processor -- start 2024-04-17T19:53:19.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.437+0000 7f49c9e6b640 1 -- start start 2024-04-17T19:53:19.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.441+0000 7f49c9e6b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f49c40b6850 0x7f49c41518d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:19.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.441+0000 7f49c9e6b640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f49c40cece0 0x7f49c406d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:19.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.441+0000 7f49c9e6b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49c40cf0f0 0x7f49c406db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:19.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.441+0000 7f49c9e6b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f49c40b1a50 con 0x7f49c40cf0f0 2024-04-17T19:53:19.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.441+0000 7f49c9e6b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f49c40b2850 con 0x7f49c40b6850 2024-04-17T19:53:19.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.441+0000 7f49c9e6b640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f49c40b1bd0 con 0x7f49c40cece0 2024-04-17T19:53:19.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.441+0000 7f49c3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49c40cf0f0 0x7f49c406db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:19.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.441+0000 7f49c3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49c40cf0f0 0x7f49c406db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52742/0 (socket says 172.21.15.18:52742) 2024-04-17T19:53:19.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.441+0000 7f49c3fff640 1 -- 172.21.15.18:0/1901268434 learned_addr learned my addr 172.21.15.18:0/1901268434 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:19.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.441+0000 7f49c37fe640 1 --2- 172.21.15.18:0/1901268434 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f49c40b6850 0x7f49c41518d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:19.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.441+0000 7f49bbfff640 1 --2- 172.21.15.18:0/1901268434 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f49c40cece0 0x7f49c406d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:19.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.441+0000 7f49c3fff640 1 -- 172.21.15.18:0/1901268434 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f49c40cece0 msgr2=0x7f49c406d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:19.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.441+0000 7f49c3fff640 1 --2- 172.21.15.18:0/1901268434 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f49c40cece0 0x7f49c406d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:19.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.441+0000 7f49c3fff640 1 -- 172.21.15.18:0/1901268434 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f49c40b6850 msgr2=0x7f49c41518d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:19.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.441+0000 7f49c3fff640 1 --2- 172.21.15.18:0/1901268434 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f49c40b6850 0x7f49c41518d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:19.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.441+0000 7f49c3fff640 1 -- 172.21.15.18:0/1901268434 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49c4152220 con 0x7f49c40cf0f0 2024-04-17T19:53:19.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.441+0000 7f49c37fe640 1 --2- 172.21.15.18:0/1901268434 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f49c40b6850 0x7f49c41518d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:53:19.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.441+0000 7f49c3fff640 1 --2- 172.21.15.18:0/1901268434 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49c40cf0f0 0x7f49c406db70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f49bc009d90 tx=0x7f49bc019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:19.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.441+0000 7f49c0ff9640 1 -- 172.21.15.18:0/1901268434 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49bc0b2050 con 0x7f49c40cf0f0 2024-04-17T19:53:19.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.441+0000 7f49c0ff9640 1 -- 172.21.15.18:0/1901268434 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49bc0b3040 con 0x7f49c40cf0f0 2024-04-17T19:53:19.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.441+0000 7f49c0ff9640 1 -- 172.21.15.18:0/1901268434 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49bc0ad650 con 0x7f49c40cf0f0 2024-04-17T19:53:19.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.441+0000 7f49c9e6b640 1 -- 172.21.15.18:0/1901268434 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49c4152500 con 0x7f49c40cf0f0 2024-04-17T19:53:19.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.441+0000 7f49c9e6b640 1 -- 172.21.15.18:0/1901268434 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49c4152ac0 con 0x7f49c40cf0f0 2024-04-17T19:53:19.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.441+0000 7f49c9e6b640 1 -- 172.21.15.18:0/1901268434 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49c4069950 con 0x7f49c40cf0f0 2024-04-17T19:53:19.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.441+0000 7f49c0ff9640 1 -- 172.21.15.18:0/1901268434 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f49bc0c0020 con 0x7f49c40cf0f0 2024-04-17T19:53:19.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.441+0000 7f49c0ff9640 1 --2- 172.21.15.18:0/1901268434 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f49a4068380 0x7f49a406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:19.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.445+0000 7f49c0ff9640 1 -- 172.21.15.18:0/1901268434 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f49bc121710 con 0x7f49c40cf0f0 2024-04-17T19:53:19.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.445+0000 7f49c37fe640 1 --2- 172.21.15.18:0/1901268434 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f49a4068380 0x7f49a406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:19.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.445+0000 7f49c37fe640 1 --2- 172.21.15.18:0/1901268434 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f49a4068380 0x7f49a406a890 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f49b40012c0 tx=0x7f49b4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:19.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.449+0000 7f49c0ff9640 1 -- 172.21.15.18:0/1901268434 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f49bc016560 con 0x7f49c40cf0f0 2024-04-17T19:53:19.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.605+0000 7f49c9e6b640 1 -- 172.21.15.18:0/1901268434 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f49c406f020 con 0x7f49c40cf0f0 2024-04-17T19:53:19.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.605+0000 7f49c0ff9640 1 -- 172.21.15.18:0/1901268434 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f49bc0f1b40 con 0x7f49c40cf0f0 2024-04-17T19:53:19.602 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-17T19:53:19.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.609+0000 7f49c9e6b640 1 -- 172.21.15.18:0/1901268434 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f49a4068380 msgr2=0x7f49a406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:19.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.609+0000 7f49c9e6b640 1 --2- 172.21.15.18:0/1901268434 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f49a4068380 0x7f49a406a890 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f49b40012c0 tx=0x7f49b4009040 comp rx=0 tx=0).stop 2024-04-17T19:53:19.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.609+0000 7f49c9e6b640 1 -- 172.21.15.18:0/1901268434 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49c40cf0f0 msgr2=0x7f49c406db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:19.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.609+0000 7f49c9e6b640 1 --2- 172.21.15.18:0/1901268434 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49c40cf0f0 0x7f49c406db70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f49bc009d90 tx=0x7f49bc019710 comp rx=0 tx=0).stop 2024-04-17T19:53:19.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.609+0000 7f49c9e6b640 1 -- 172.21.15.18:0/1901268434 shutdown_connections 2024-04-17T19:53:19.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.609+0000 7f49c9e6b640 1 --2- 172.21.15.18:0/1901268434 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f49a4068380 0x7f49a406a890 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:19.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.609+0000 7f49c9e6b640 1 --2- 172.21.15.18:0/1901268434 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49c40cf0f0 0x7f49c406db70 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:19.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.609+0000 7f49c9e6b640 1 --2- 172.21.15.18:0/1901268434 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f49c40cece0 0x7f49c406d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:19.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.609+0000 7f49c9e6b640 1 --2- 172.21.15.18:0/1901268434 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f49c40b6850 0x7f49c41518d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:19.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.609+0000 7f49c9e6b640 1 -- 172.21.15.18:0/1901268434 >> 172.21.15.18:0/1901268434 conn(0x7f49c409aa70 msgr2=0x7f49c40b1340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:19.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.609+0000 7f49c9e6b640 1 -- 172.21.15.18:0/1901268434 shutdown_connections 2024-04-17T19:53:19.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.609+0000 7f49c9e6b640 1 -- 172.21.15.18:0/1901268434 wait complete. 2024-04-17T19:53:19.623 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-17T19:53:19.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.785+0000 7ff76b388640 1 Processor -- start 2024-04-17T19:53:19.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.785+0000 7ff76b388640 1 -- start start 2024-04-17T19:53:19.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.785+0000 7ff76b388640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff76415e910 0x7ff76415ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:19.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.785+0000 7ff76b388640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7640d0020 con 0x7ff76415e1a0 2024-04-17T19:53:19.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.785+0000 7ff76b388640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7640cd930 con 0x7ff76406cd60 2024-04-17T19:53:19.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.785+0000 7ff76b388640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7ff7640cdc10 con 0x7ff76415e910 2024-04-17T19:53:19.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.785+0000 7ff769124640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7ff76415e1a0 0x7ff7640ce9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:49124/0 (socket says 172.21.15.18:49124) 2024-04-17T19:53:19.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.785+0000 7ff769124640 1 -- 172.21.15.18:0/2307529792 learned_addr learned my addr 172.21.15.18:0/2307529792 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:19.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.785+0000 7ff768923640 1 --2- 172.21.15.18:0/2307529792 >> v2:172.21.15.173:3300/0 conn(0x7ff76415e910 0x7ff76415ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:19.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.785+0000 7ff75bfff640 1 -- 172.21.15.18:0/2307529792 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3034111422 0 0) 0x7ff7640d0020 con 0x7ff76415e1a0 2024-04-17T19:53:19.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.785+0000 7ff75bfff640 1 -- 172.21.15.18:0/2307529792 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff750003530 con 0x7ff76415e1a0 2024-04-17T19:53:19.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.785+0000 7ff75bfff640 1 -- 172.21.15.18:0/2307529792 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3292036197 0 0) 0x7ff750003530 con 0x7ff76415e1a0 2024-04-17T19:53:19.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.785+0000 7ff75bfff640 1 -- 172.21.15.18:0/2307529792 >> v2:172.21.15.173:3300/0 conn(0x7ff76415e910 msgr2=0x7ff76415ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:19.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.785+0000 7ff75bfff640 1 --2- 172.21.15.18:0/2307529792 >> v2:172.21.15.173:3300/0 conn(0x7ff76415e910 0x7ff76415ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:19.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.785+0000 7ff75bfff640 1 -- 172.21.15.18:0/2307529792 >> v1:172.21.15.173:6789/0 conn(0x7ff76406cd60 legacy=0x7ff76406d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:19.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.785+0000 7ff75bfff640 1 -- 172.21.15.18:0/2307529792 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7640cdef0 con 0x7ff76415e1a0 2024-04-17T19:53:19.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.785+0000 7ff75bfff640 1 -- 172.21.15.18:0/2307529792 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3208559991 0 0) 0x7ff7600016a0 con 0x7ff76415e1a0 2024-04-17T19:53:19.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.785+0000 7ff75bfff640 1 -- 172.21.15.18:0/2307529792 >> v1:172.21.15.18:6789/0 conn(0x7ff76415e1a0 legacy=0x7ff7640ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:19.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.785+0000 7ff75bfff640 1 --2- 172.21.15.18:0/2307529792 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff7500039c0 0x7ff750003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:19.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.785+0000 7ff75bfff640 1 --2- 172.21.15.18:0/2307529792 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff750004810 0x7ff750004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:19.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.785+0000 7ff75bfff640 1 --2- 172.21.15.18:0/2307529792 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff750005260 0x7ff75000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:19.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.785+0000 7ff75bfff640 1 -- 172.21.15.18:0/2307529792 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff7640cdc10 con 0x7ff750004810 2024-04-17T19:53:19.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.785+0000 7ff75bfff640 1 -- 172.21.15.18:0/2307529792 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff75000c1f0 con 0x7ff750005260 2024-04-17T19:53:19.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.785+0000 7ff768923640 1 --2- 172.21.15.18:0/2307529792 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff750004810 0x7ff750004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:19.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.785+0000 7ff75bfff640 1 -- 172.21.15.18:0/2307529792 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7ff75000c3f0 con 0x7ff7500039c0 2024-04-17T19:53:19.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.785+0000 7ff769925640 1 --2- 172.21.15.18:0/2307529792 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff750005260 0x7ff75000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:19.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.789+0000 7ff769124640 1 --2- 172.21.15.18:0/2307529792 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff7500039c0 0x7ff750003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:19.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.789+0000 7ff768923640 1 -- 172.21.15.18:0/2307529792 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff7500039c0 msgr2=0x7ff750003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:19.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.789+0000 7ff768923640 1 --2- 172.21.15.18:0/2307529792 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff7500039c0 0x7ff750003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:19.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.789+0000 7ff768923640 1 -- 172.21.15.18:0/2307529792 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff750005260 msgr2=0x7ff75000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:19.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.789+0000 7ff768923640 1 --2- 172.21.15.18:0/2307529792 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff750005260 0x7ff75000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:19.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.789+0000 7ff768923640 1 -- 172.21.15.18:0/2307529792 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff750003530 con 0x7ff750004810 2024-04-17T19:53:19.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.789+0000 7ff769124640 1 --2- 172.21.15.18:0/2307529792 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff7500039c0 0x7ff750003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:53:19.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.789+0000 7ff769925640 1 --2- 172.21.15.18:0/2307529792 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff750005260 0x7ff75000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:53:19.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.789+0000 7ff769925640 1 -- 172.21.15.18:0/2307529792 reap_dead start 2024-04-17T19:53:19.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.789+0000 7ff768923640 1 --2- 172.21.15.18:0/2307529792 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff750004810 0x7ff750004c20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff754009ab0 tx=0x7ff75401ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ac423229aae74d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:19.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.789+0000 7ff75bfff640 1 -- 172.21.15.18:0/2307529792 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7540b2070 con 0x7ff750004810 2024-04-17T19:53:19.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.789+0000 7ff75bfff640 1 -- 172.21.15.18:0/2307529792 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7540a55f0 con 0x7ff750004810 2024-04-17T19:53:19.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.789+0000 7ff75bfff640 1 -- 172.21.15.18:0/2307529792 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7540096b0 con 0x7ff750004810 2024-04-17T19:53:19.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.793+0000 7ff76b388640 1 -- 172.21.15.18:0/2307529792 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff750004810 msgr2=0x7ff750004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:19.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.793+0000 7ff76b388640 1 --2- 172.21.15.18:0/2307529792 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff750004810 0x7ff750004c20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff754009ab0 tx=0x7ff75401ca20 comp rx=0 tx=0).stop 2024-04-17T19:53:19.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.793+0000 7ff76b388640 1 -- 172.21.15.18:0/2307529792 shutdown_connections 2024-04-17T19:53:19.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.793+0000 7ff76b388640 1 --2- 172.21.15.18:0/2307529792 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff750004810 0x7ff750004c20 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:19.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.793+0000 7ff76b388640 1 -- 172.21.15.18:0/2307529792 >> 172.21.15.18:0/2307529792 conn(0x7ff764072bb0 msgr2=0x7ff764072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:19.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.793+0000 7ff76b388640 1 -- 172.21.15.18:0/2307529792 shutdown_connections 2024-04-17T19:53:19.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.793+0000 7ff76b388640 1 -- 172.21.15.18:0/2307529792 wait complete. 2024-04-17T19:53:19.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.793+0000 7ff76b388640 1 Processor -- start 2024-04-17T19:53:19.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.793+0000 7ff76b388640 1 -- start start 2024-04-17T19:53:19.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.793+0000 7ff76b388640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff750004810 0x7ff76414b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:19.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.793+0000 7ff76b388640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff7640b45f0 0x7ff764152dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:19.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.793+0000 7ff76b388640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7640b50f0 0x7ff76414fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:19.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.793+0000 7ff76b388640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff76406d580 con 0x7ff7640b50f0 2024-04-17T19:53:19.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.793+0000 7ff76b388640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff76415f130 con 0x7ff750004810 2024-04-17T19:53:19.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.793+0000 7ff76b388640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7ff764153850 con 0x7ff7640b45f0 2024-04-17T19:53:19.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.793+0000 7ff769925640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7640b50f0 0x7ff76414fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:19.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.793+0000 7ff769925640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7640b50f0 0x7ff76414fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52756/0 (socket says 172.21.15.18:52756) 2024-04-17T19:53:19.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.797+0000 7ff769925640 1 -- 172.21.15.18:0/4148542742 learned_addr learned my addr 172.21.15.18:0/4148542742 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:19.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.797+0000 7ff769124640 1 --2- 172.21.15.18:0/4148542742 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff750004810 0x7ff76414b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:19.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.797+0000 7ff768923640 1 --2- 172.21.15.18:0/4148542742 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff7640b45f0 0x7ff764152dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:19.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.797+0000 7ff769925640 1 -- 172.21.15.18:0/4148542742 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff7640b45f0 msgr2=0x7ff764152dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:19.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.797+0000 7ff769925640 1 --2- 172.21.15.18:0/4148542742 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff7640b45f0 0x7ff764152dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:19.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.797+0000 7ff769925640 1 -- 172.21.15.18:0/4148542742 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff750004810 msgr2=0x7ff76414b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:19.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.797+0000 7ff769925640 1 --2- 172.21.15.18:0/4148542742 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff750004810 0x7ff76414b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:19.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.797+0000 7ff769925640 1 -- 172.21.15.18:0/4148542742 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7641513f0 con 0x7ff7640b50f0 2024-04-17T19:53:19.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.797+0000 7ff769124640 1 --2- 172.21.15.18:0/4148542742 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff750004810 0x7ff76414b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:53:19.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.797+0000 7ff769925640 1 --2- 172.21.15.18:0/4148542742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7640b50f0 0x7ff76414fb30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff7640a9840 tx=0x7ff75c00d960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:19.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.797+0000 7ff759ffb640 1 -- 172.21.15.18:0/4148542742 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75c018070 con 0x7ff7640b50f0 2024-04-17T19:53:19.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.797+0000 7ff759ffb640 1 -- 172.21.15.18:0/4148542742 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff75c003d90 con 0x7ff7640b50f0 2024-04-17T19:53:19.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.797+0000 7ff76b388640 1 -- 172.21.15.18:0/4148542742 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff764151830 con 0x7ff7640b50f0 2024-04-17T19:53:19.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.797+0000 7ff759ffb640 1 -- 172.21.15.18:0/4148542742 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75c0052b0 con 0x7ff7640b50f0 2024-04-17T19:53:19.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.797+0000 7ff76b388640 1 -- 172.21.15.18:0/4148542742 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff764151110 con 0x7ff7640b50f0 2024-04-17T19:53:19.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.797+0000 7ff76b388640 1 -- 172.21.15.18:0/4148542742 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff764069950 con 0x7ff7640b50f0 2024-04-17T19:53:19.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.797+0000 7ff759ffb640 1 -- 172.21.15.18:0/4148542742 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff75c01b070 con 0x7ff7640b50f0 2024-04-17T19:53:19.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.797+0000 7ff759ffb640 1 --2- 172.21.15.18:0/4148542742 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7ff748068380 0x7ff74806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:19.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.797+0000 7ff759ffb640 1 -- 172.21.15.18:0/4148542742 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7ff75c086290 con 0x7ff7640b50f0 2024-04-17T19:53:19.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.797+0000 7ff769124640 1 --2- 172.21.15.18:0/4148542742 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7ff748068380 0x7ff74806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:19.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.797+0000 7ff769124640 1 --2- 172.21.15.18:0/4148542742 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7ff748068380 0x7ff74806a890 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff760000f70 tx=0x7ff760009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:19.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.801+0000 7ff759ffb640 1 -- 172.21.15.18:0/4148542742 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff75c0565a0 con 0x7ff7640b50f0 2024-04-17T19:53:19.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.957+0000 7ff76b388640 1 -- 172.21.15.18:0/4148542742 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff7640b4b20 con 0x7ff7640b50f0 2024-04-17T19:53:19.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.961+0000 7ff759ffb640 1 -- 172.21.15.18:0/4148542742 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7ff75c055ea0 con 0x7ff7640b50f0 2024-04-17T19:53:19.955 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-17T19:53:19.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.961+0000 7ff76b388640 1 -- 172.21.15.18:0/4148542742 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7ff748068380 msgr2=0x7ff74806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:19.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.961+0000 7ff76b388640 1 --2- 172.21.15.18:0/4148542742 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7ff748068380 0x7ff74806a890 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff760000f70 tx=0x7ff760009040 comp rx=0 tx=0).stop 2024-04-17T19:53:19.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.961+0000 7ff76b388640 1 -- 172.21.15.18:0/4148542742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7640b50f0 msgr2=0x7ff76414fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:19.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.961+0000 7ff76b388640 1 --2- 172.21.15.18:0/4148542742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7640b50f0 0x7ff76414fb30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff7640a9840 tx=0x7ff75c00d960 comp rx=0 tx=0).stop 2024-04-17T19:53:19.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.961+0000 7ff76b388640 1 -- 172.21.15.18:0/4148542742 shutdown_connections 2024-04-17T19:53:19.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.961+0000 7ff76b388640 1 --2- 172.21.15.18:0/4148542742 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7ff748068380 0x7ff74806a890 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:19.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.961+0000 7ff76b388640 1 --2- 172.21.15.18:0/4148542742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7640b50f0 0x7ff76414fb30 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:19.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.961+0000 7ff76b388640 1 --2- 172.21.15.18:0/4148542742 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff7640b45f0 0x7ff764152dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:19.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.961+0000 7ff76b388640 1 --2- 172.21.15.18:0/4148542742 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff750004810 0x7ff76414b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:19.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.961+0000 7ff76b388640 1 -- 172.21.15.18:0/4148542742 >> 172.21.15.18:0/4148542742 conn(0x7ff764072bb0 msgr2=0x7ff76414d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:19.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.961+0000 7ff76b388640 1 -- 172.21.15.18:0/4148542742 shutdown_connections 2024-04-17T19:53:19.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:19.961+0000 7ff76b388640 1 -- 172.21.15.18:0/4148542742 wait complete. 2024-04-17T19:53:19.976 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-17T19:53:20.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.121+0000 7f963daba640 1 Processor -- start 2024-04-17T19:53:20.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.121+0000 7f963daba640 1 -- start start 2024-04-17T19:53:20.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.121+0000 7f963daba640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f96380cfb20 0x7f96380cff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:20.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.121+0000 7f963daba640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f963806ef30 0x7f963806f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:20.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.121+0000 7f963daba640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96380b53d0 con 0x7f963815b810 2024-04-17T19:53:20.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.121+0000 7f963daba640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f96380b5990 con 0x7f963806ef30 2024-04-17T19:53:20.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.121+0000 7f963daba640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f96380b56b0 con 0x7f96380cfb20 2024-04-17T19:53:20.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.121+0000 7f9637fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f963806ef30 0x7f963806f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:20.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.121+0000 7f9637fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f963806ef30 0x7f963806f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52766/0 (socket says 172.21.15.18:52766) 2024-04-17T19:53:20.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.121+0000 7f9637fff640 1 -- 172.21.15.18:0/2037778660 learned_addr learned my addr 172.21.15.18:0/2037778660 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:20.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.121+0000 7f9636ffd640 1 --2- 172.21.15.18:0/2037778660 >> v2:172.21.15.173:3300/0 conn(0x7f96380cfb20 0x7f96380cff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:20.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.121+0000 7f9637fff640 1 -- 172.21.15.18:0/2037778660 >> v2:172.21.15.173:3300/0 conn(0x7f96380cfb20 msgr2=0x7f96380cff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:20.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.121+0000 7f9637fff640 1 --2- 172.21.15.18:0/2037778660 >> v2:172.21.15.173:3300/0 conn(0x7f96380cfb20 0x7f96380cff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:20.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.121+0000 7f9637fff640 1 -- 172.21.15.18:0/2037778660 >> v1:172.21.15.173:6789/0 conn(0x7f963815b810 legacy=0x7f96380cde90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:20.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.121+0000 7f9637fff640 1 -- 172.21.15.18:0/2037778660 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f963806ea10 con 0x7f963806ef30 2024-04-17T19:53:20.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.125+0000 7f9637fff640 1 --2- 172.21.15.18:0/2037778660 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f963806ef30 0x7f963806f340 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f96380707f0 tx=0x7f963001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b05b372ba7c22cd server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:20.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.125+0000 7f96367fc640 1 -- 172.21.15.18:0/2037778660 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96300a56b0 con 0x7f963806ef30 2024-04-17T19:53:20.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.125+0000 7f96367fc640 1 -- 172.21.15.18:0/2037778660 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96300a5850 con 0x7f963806ef30 2024-04-17T19:53:20.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.125+0000 7f96367fc640 1 -- 172.21.15.18:0/2037778660 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96300a5c20 con 0x7f963806ef30 2024-04-17T19:53:20.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.125+0000 7f963daba640 1 -- 172.21.15.18:0/2037778660 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f963806ef30 msgr2=0x7f963806f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:20.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.125+0000 7f963daba640 1 --2- 172.21.15.18:0/2037778660 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f963806ef30 0x7f963806f340 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f96380707f0 tx=0x7f963001c960 comp rx=0 tx=0).stop 2024-04-17T19:53:20.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.125+0000 7f963daba640 1 -- 172.21.15.18:0/2037778660 shutdown_connections 2024-04-17T19:53:20.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.125+0000 7f963daba640 1 --2- 172.21.15.18:0/2037778660 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f963806ef30 0x7f963806f340 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:20.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.125+0000 7f963daba640 1 --2- 172.21.15.18:0/2037778660 >> v2:172.21.15.173:3300/0 conn(0x7f96380cfb20 0x7f96380cff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:20.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.125+0000 7f963daba640 1 -- 172.21.15.18:0/2037778660 >> 172.21.15.18:0/2037778660 conn(0x7f9638072bb0 msgr2=0x7f9638072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:20.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.125+0000 7f963daba640 1 -- 172.21.15.18:0/2037778660 shutdown_connections 2024-04-17T19:53:20.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.125+0000 7f963daba640 1 -- 172.21.15.18:0/2037778660 wait complete. 2024-04-17T19:53:20.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.125+0000 7f963daba640 1 Processor -- start 2024-04-17T19:53:20.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.125+0000 7f963daba640 1 -- start start 2024-04-17T19:53:20.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.129+0000 7f963daba640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f963806ef30 0x7f9638143770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:20.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.129+0000 7f963daba640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96380cfb20 0x7f963814dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:20.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.129+0000 7f963daba640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f963815b810 0x7f963814e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:20.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.129+0000 7f963daba640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f96381667d0 con 0x7f963815b810 2024-04-17T19:53:20.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.129+0000 7f963daba640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9638166650 con 0x7f96380cfb20 2024-04-17T19:53:20.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.129+0000 7f963daba640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f9638166950 con 0x7f963806ef30 2024-04-17T19:53:20.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.129+0000 7f9637fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f963815b810 0x7f963814e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:20.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.129+0000 7f9637fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f963815b810 0x7f963814e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52768/0 (socket says 172.21.15.18:52768) 2024-04-17T19:53:20.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.129+0000 7f9637fff640 1 -- 172.21.15.18:0/3041484104 learned_addr learned my addr 172.21.15.18:0/3041484104 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:20.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.129+0000 7f9636ffd640 1 --2- 172.21.15.18:0/3041484104 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96380cfb20 0x7f963814dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:20.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.129+0000 7f9637fff640 1 -- 172.21.15.18:0/3041484104 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f963806ef30 msgr2=0x7f9638143770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:20.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.129+0000 7f96377fe640 1 --2- 172.21.15.18:0/3041484104 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f963806ef30 0x7f9638143770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:20.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.129+0000 7f9637fff640 1 --2- 172.21.15.18:0/3041484104 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f963806ef30 0x7f9638143770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:20.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.129+0000 7f9637fff640 1 -- 172.21.15.18:0/3041484104 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96380cfb20 msgr2=0x7f963814dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:20.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.129+0000 7f9637fff640 1 --2- 172.21.15.18:0/3041484104 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96380cfb20 0x7f963814dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:20.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.129+0000 7f9637fff640 1 -- 172.21.15.18:0/3041484104 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9638158bf0 con 0x7f963815b810 2024-04-17T19:53:20.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.129+0000 7f9636ffd640 1 --2- 172.21.15.18:0/3041484104 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96380cfb20 0x7f963814dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:53:20.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.129+0000 7f9637fff640 1 --2- 172.21.15.18:0/3041484104 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f963815b810 0x7f963814e530 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f96300af040 tx=0x7f9630019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:20.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.129+0000 7f961ffff640 1 -- 172.21.15.18:0/3041484104 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9630009510 con 0x7f963815b810 2024-04-17T19:53:20.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.129+0000 7f961ffff640 1 -- 172.21.15.18:0/3041484104 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96300be070 con 0x7f963815b810 2024-04-17T19:53:20.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.129+0000 7f963daba640 1 -- 172.21.15.18:0/3041484104 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9638147cd0 con 0x7f963815b810 2024-04-17T19:53:20.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.129+0000 7f961ffff640 1 -- 172.21.15.18:0/3041484104 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96300b8ae0 con 0x7f963815b810 2024-04-17T19:53:20.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.129+0000 7f963daba640 1 -- 172.21.15.18:0/3041484104 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9638148290 con 0x7f963815b810 2024-04-17T19:53:20.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.129+0000 7f963daba640 1 -- 172.21.15.18:0/3041484104 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9638069950 con 0x7f963815b810 2024-04-17T19:53:20.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.129+0000 7f961ffff640 1 -- 172.21.15.18:0/3041484104 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f96300b8c80 con 0x7f963815b810 2024-04-17T19:53:20.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.129+0000 7f961ffff640 1 --2- 172.21.15.18:0/3041484104 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f9624068380 0x7f962406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:20.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.129+0000 7f96377fe640 1 --2- 172.21.15.18:0/3041484104 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f9624068380 0x7f962406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:20.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.129+0000 7f961ffff640 1 -- 172.21.15.18:0/3041484104 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f9630121f70 con 0x7f963815b810 2024-04-17T19:53:20.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.133+0000 7f96377fe640 1 --2- 172.21.15.18:0/3041484104 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f9624068380 0x7f962406a890 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9628007fd0 tx=0x7f9628009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:20.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.137+0000 7f961ffff640 1 -- 172.21.15.18:0/3041484104 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f96300165e0 con 0x7f963815b810 2024-04-17T19:53:20.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.289+0000 7f963daba640 1 -- 172.21.15.18:0/3041484104 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f963815d560 con 0x7f963815b810 2024-04-17T19:53:20.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.289+0000 7f961ffff640 1 -- 172.21.15.18:0/3041484104 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f96300f2200 con 0x7f963815b810 2024-04-17T19:53:20.285 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-17T19:53:20.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.293+0000 7f963daba640 1 -- 172.21.15.18:0/3041484104 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f9624068380 msgr2=0x7f962406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:20.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.293+0000 7f963daba640 1 --2- 172.21.15.18:0/3041484104 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f9624068380 0x7f962406a890 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9628007fd0 tx=0x7f9628009040 comp rx=0 tx=0).stop 2024-04-17T19:53:20.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.293+0000 7f963daba640 1 -- 172.21.15.18:0/3041484104 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f963815b810 msgr2=0x7f963814e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:20.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.293+0000 7f963daba640 1 --2- 172.21.15.18:0/3041484104 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f963815b810 0x7f963814e530 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f96300af040 tx=0x7f9630019700 comp rx=0 tx=0).stop 2024-04-17T19:53:20.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.293+0000 7f963daba640 1 -- 172.21.15.18:0/3041484104 shutdown_connections 2024-04-17T19:53:20.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.293+0000 7f963daba640 1 --2- 172.21.15.18:0/3041484104 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f9624068380 0x7f962406a890 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:20.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.293+0000 7f963daba640 1 --2- 172.21.15.18:0/3041484104 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f963815b810 0x7f963814e530 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:20.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.293+0000 7f963daba640 1 --2- 172.21.15.18:0/3041484104 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96380cfb20 0x7f963814dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:20.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.293+0000 7f963daba640 1 --2- 172.21.15.18:0/3041484104 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f963806ef30 0x7f9638143770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:20.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.293+0000 7f963daba640 1 -- 172.21.15.18:0/3041484104 >> 172.21.15.18:0/3041484104 conn(0x7f9638072bb0 msgr2=0x7f9638072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:20.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.293+0000 7f963daba640 1 -- 172.21.15.18:0/3041484104 shutdown_connections 2024-04-17T19:53:20.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.293+0000 7f963daba640 1 -- 172.21.15.18:0/3041484104 wait complete. 2024-04-17T19:53:20.306 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-17T19:53:20.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.457+0000 7fd0d9028640 1 Processor -- start 2024-04-17T19:53:20.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.457+0000 7fd0d9028640 1 -- start start 2024-04-17T19:53:20.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.457+0000 7fd0d9028640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd0d415d2f0 0x7fd0d406f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:20.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.457+0000 7fd0d9028640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0d4070250 con 0x7fd0d40cd860 2024-04-17T19:53:20.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.457+0000 7fd0d9028640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0d40d1480 con 0x7fd0d406fe40 2024-04-17T19:53:20.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.457+0000 7fd0d9028640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fd0d41616b0 con 0x7fd0d415d2f0 2024-04-17T19:53:20.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.461+0000 7fd0d2d9d640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fd0d40cd860 0x7fd0d4160e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:49128/0 (socket says 172.21.15.18:49128) 2024-04-17T19:53:20.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.461+0000 7fd0d2d9d640 1 -- 172.21.15.18:0/3834451761 learned_addr learned my addr 172.21.15.18:0/3834451761 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:20.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.461+0000 7fd0d259c640 1 --2- 172.21.15.18:0/3834451761 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd0d415d2f0 0x7fd0d406f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:20.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.461+0000 7fd0d1d9b640 1 -- 172.21.15.18:0/3834451761 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2138215741 0 0) 0x7fd0c4001120 con 0x7fd0d40cd860 2024-04-17T19:53:20.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.461+0000 7fd0d1d9b640 1 -- 172.21.15.18:0/3834451761 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0bc003530 con 0x7fd0d40cd860 2024-04-17T19:53:20.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.461+0000 7fd0d1d9b640 1 -- 172.21.15.18:0/3834451761 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 40263132 0 0) 0x7fd0bc003530 con 0x7fd0d40cd860 2024-04-17T19:53:20.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.461+0000 7fd0d1d9b640 1 -- 172.21.15.18:0/3834451761 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd0d415d2f0 msgr2=0x7fd0d406f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:20.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.461+0000 7fd0d1d9b640 1 --2- 172.21.15.18:0/3834451761 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd0d415d2f0 0x7fd0d406f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:20.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.461+0000 7fd0d1d9b640 1 -- 172.21.15.18:0/3834451761 >> v1:172.21.15.173:6789/0 conn(0x7fd0d406fe40 legacy=0x7fd0d40d1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:20.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.461+0000 7fd0d1d9b640 1 -- 172.21.15.18:0/3834451761 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0d4161990 con 0x7fd0d40cd860 2024-04-17T19:53:20.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.461+0000 7fd0d1d9b640 1 -- 172.21.15.18:0/3834451761 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3208559991 0 0) 0x7fd0c4001850 con 0x7fd0d40cd860 2024-04-17T19:53:20.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.461+0000 7fd0d1d9b640 1 -- 172.21.15.18:0/3834451761 >> v1:172.21.15.18:6789/0 conn(0x7fd0d40cd860 legacy=0x7fd0d4160e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:20.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.461+0000 7fd0d1d9b640 1 --2- 172.21.15.18:0/3834451761 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd0d415d2f0 0x7fd0bc0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:20.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.461+0000 7fd0d1d9b640 1 --2- 172.21.15.18:0/3834451761 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0bc003f70 0x7fd0bc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:20.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.461+0000 7fd0d1d9b640 1 --2- 172.21.15.18:0/3834451761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0bc004d50 0x7fd0bc005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:20.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.461+0000 7fd0d1d9b640 1 -- 172.21.15.18:0/3834451761 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd0d41616b0 con 0x7fd0bc004d50 2024-04-17T19:53:20.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.461+0000 7fd0d1d9b640 1 -- 172.21.15.18:0/3834451761 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd0bc00bc10 con 0x7fd0bc003f70 2024-04-17T19:53:20.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.461+0000 7fd0d1d9b640 1 -- 172.21.15.18:0/3834451761 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fd0bc00be10 con 0x7fd0d415d2f0 2024-04-17T19:53:20.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.461+0000 7fd0d359e640 1 --2- 172.21.15.18:0/3834451761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0bc004d50 0x7fd0bc005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:20.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.461+0000 7fd0d2d9d640 1 --2- 172.21.15.18:0/3834451761 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd0d415d2f0 0x7fd0bc0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:20.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.461+0000 7fd0d259c640 1 --2- 172.21.15.18:0/3834451761 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0bc003f70 0x7fd0bc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:20.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.461+0000 7fd0d359e640 1 -- 172.21.15.18:0/3834451761 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd0d415d2f0 msgr2=0x7fd0bc0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:20.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.461+0000 7fd0d359e640 1 --2- 172.21.15.18:0/3834451761 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd0d415d2f0 0x7fd0bc0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:20.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.461+0000 7fd0d359e640 1 -- 172.21.15.18:0/3834451761 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0bc003f70 msgr2=0x7fd0bc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:20.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.461+0000 7fd0d359e640 1 --2- 172.21.15.18:0/3834451761 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0bc003f70 0x7fd0bc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:20.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.461+0000 7fd0d359e640 1 -- 172.21.15.18:0/3834451761 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0bc003530 con 0x7fd0bc004d50 2024-04-17T19:53:20.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.461+0000 7fd0d359e640 1 --2- 172.21.15.18:0/3834451761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0bc004d50 0x7fd0bc005160 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc001e70 tx=0x7fd0cc01c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d740c3b8dce3abc3 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:20.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.465+0000 7fd0d1d9b640 1 -- 172.21.15.18:0/3834451761 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0cc001a90 con 0x7fd0bc004d50 2024-04-17T19:53:20.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.465+0000 7fd0d1d9b640 1 -- 172.21.15.18:0/3834451761 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0cc003b80 con 0x7fd0bc004d50 2024-04-17T19:53:20.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.465+0000 7fd0d1d9b640 1 -- 172.21.15.18:0/3834451761 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0cc005080 con 0x7fd0bc004d50 2024-04-17T19:53:20.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.465+0000 7fd0d9028640 1 -- 172.21.15.18:0/3834451761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0bc004d50 msgr2=0x7fd0bc005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:20.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.465+0000 7fd0d9028640 1 --2- 172.21.15.18:0/3834451761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0bc004d50 0x7fd0bc005160 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc001e70 tx=0x7fd0cc01c780 comp rx=0 tx=0).stop 2024-04-17T19:53:20.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.465+0000 7fd0d359e640 1 -- 172.21.15.18:0/3834451761 reap_dead start 2024-04-17T19:53:20.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.465+0000 7fd0d9028640 1 -- 172.21.15.18:0/3834451761 shutdown_connections 2024-04-17T19:53:20.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.465+0000 7fd0d9028640 1 -- 172.21.15.18:0/3834451761 >> 172.21.15.18:0/3834451761 conn(0x7fd0d40cf7d0 msgr2=0x7fd0d40cfbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:20.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.465+0000 7fd0d9028640 1 -- 172.21.15.18:0/3834451761 shutdown_connections 2024-04-17T19:53:20.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.465+0000 7fd0d9028640 1 -- 172.21.15.18:0/3834451761 wait complete. 2024-04-17T19:53:20.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.465+0000 7fd0d9028640 1 Processor -- start 2024-04-17T19:53:20.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.465+0000 7fd0d9028640 1 -- start start 2024-04-17T19:53:20.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.469+0000 7fd0d9028640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd0bc004d50 0x7fd0d41f5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:20.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.469+0000 7fd0d9028640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0d41e6eb0 0x7fd0d41e72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:20.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.469+0000 7fd0d9028640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0d406e6c0 0x7fd0d406ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:20.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.469+0000 7fd0d9028640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd0d415d700 con 0x7fd0d41e6eb0 2024-04-17T19:53:20.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.469+0000 7fd0d9028640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd0d40d1740 con 0x7fd0d406e6c0 2024-04-17T19:53:20.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.469+0000 7fd0d9028640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fd0d406f900 con 0x7fd0bc004d50 2024-04-17T19:53:20.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.469+0000 7fd0d259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0d41e6eb0 0x7fd0d41e72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:20.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.469+0000 7fd0d259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0d41e6eb0 0x7fd0d41e72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52774/0 (socket says 172.21.15.18:52774) 2024-04-17T19:53:20.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.469+0000 7fd0d259c640 1 -- 172.21.15.18:0/96425403 learned_addr learned my addr 172.21.15.18:0/96425403 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:20.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.469+0000 7fd0d2d9d640 1 --2- 172.21.15.18:0/96425403 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd0bc004d50 0x7fd0d41f5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:20.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.469+0000 7fd0d359e640 1 --2- 172.21.15.18:0/96425403 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0d406e6c0 0x7fd0d406ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:20.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.469+0000 7fd0d259c640 1 -- 172.21.15.18:0/96425403 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd0bc004d50 msgr2=0x7fd0d41f5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:20.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.469+0000 7fd0d259c640 1 --2- 172.21.15.18:0/96425403 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd0bc004d50 0x7fd0d41f5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:20.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.469+0000 7fd0d259c640 1 -- 172.21.15.18:0/96425403 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0d406e6c0 msgr2=0x7fd0d406ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:20.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.469+0000 7fd0d259c640 1 --2- 172.21.15.18:0/96425403 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0d406e6c0 0x7fd0d406ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:20.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.469+0000 7fd0d259c640 1 -- 172.21.15.18:0/96425403 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0d406f010 con 0x7fd0d41e6eb0 2024-04-17T19:53:20.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.469+0000 7fd0d259c640 1 --2- 172.21.15.18:0/96425403 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0d41e6eb0 0x7fd0d41e72c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd0c8011610 tx=0x7fd0c8011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:20.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.469+0000 7fd0bb7fe640 1 -- 172.21.15.18:0/96425403 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c800f8f0 con 0x7fd0d41e6eb0 2024-04-17T19:53:20.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.469+0000 7fd0bb7fe640 1 -- 172.21.15.18:0/96425403 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0c800fa90 con 0x7fd0d41e6eb0 2024-04-17T19:53:20.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.469+0000 7fd0d9028640 1 -- 172.21.15.18:0/96425403 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0d415dd30 con 0x7fd0d41e6eb0 2024-04-17T19:53:20.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.469+0000 7fd0bb7fe640 1 -- 172.21.15.18:0/96425403 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c800fe40 con 0x7fd0d41e6eb0 2024-04-17T19:53:20.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.469+0000 7fd0d9028640 1 -- 172.21.15.18:0/96425403 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0d41e7c00 con 0x7fd0d41e6eb0 2024-04-17T19:53:20.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.469+0000 7fd0d9028640 1 -- 172.21.15.18:0/96425403 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0d4069950 con 0x7fd0d41e6eb0 2024-04-17T19:53:20.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.469+0000 7fd0bb7fe640 1 -- 172.21.15.18:0/96425403 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd0c8015460 con 0x7fd0d41e6eb0 2024-04-17T19:53:20.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.469+0000 7fd0bb7fe640 1 --2- 172.21.15.18:0/96425403 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fd0c0068380 0x7fd0c006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:20.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.469+0000 7fd0d2d9d640 1 --2- 172.21.15.18:0/96425403 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fd0c0068380 0x7fd0c006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:20.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.469+0000 7fd0bb7fe640 1 -- 172.21.15.18:0/96425403 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fd0c80875d0 con 0x7fd0d41e6eb0 2024-04-17T19:53:20.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.473+0000 7fd0d2d9d640 1 --2- 172.21.15.18:0/96425403 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fd0c0068380 0x7fd0c006a890 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4001060 tx=0x7fd0c4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:20.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.477+0000 7fd0bb7fe640 1 -- 172.21.15.18:0/96425403 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd0d406f010 con 0x7fd0d41e6eb0 2024-04-17T19:53:20.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.641+0000 7fd0d9028640 1 -- 172.21.15.18:0/96425403 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd0d40d1030 con 0x7fd0d41e6eb0 2024-04-17T19:53:20.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.645+0000 7fd0bb7fe640 1 -- 172.21.15.18:0/96425403 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7fd0c8019030 con 0x7fd0d41e6eb0 2024-04-17T19:53:20.640 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-04-17T19:53:20.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.645+0000 7fd0d9028640 1 -- 172.21.15.18:0/96425403 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fd0c0068380 msgr2=0x7fd0c006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:20.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.645+0000 7fd0d9028640 1 --2- 172.21.15.18:0/96425403 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fd0c0068380 0x7fd0c006a890 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4001060 tx=0x7fd0c4009040 comp rx=0 tx=0).stop 2024-04-17T19:53:20.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.645+0000 7fd0d9028640 1 -- 172.21.15.18:0/96425403 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0d41e6eb0 msgr2=0x7fd0d41e72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:20.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.645+0000 7fd0d9028640 1 --2- 172.21.15.18:0/96425403 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0d41e6eb0 0x7fd0d41e72c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd0c8011610 tx=0x7fd0c8011ad0 comp rx=0 tx=0).stop 2024-04-17T19:53:20.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.645+0000 7fd0d9028640 1 -- 172.21.15.18:0/96425403 shutdown_connections 2024-04-17T19:53:20.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.645+0000 7fd0d9028640 1 --2- 172.21.15.18:0/96425403 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fd0c0068380 0x7fd0c006a890 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:20.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.645+0000 7fd0d9028640 1 --2- 172.21.15.18:0/96425403 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0d406e6c0 0x7fd0d406ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:20.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.645+0000 7fd0d9028640 1 --2- 172.21.15.18:0/96425403 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0d41e6eb0 0x7fd0d41e72c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:20.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.645+0000 7fd0d9028640 1 --2- 172.21.15.18:0/96425403 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd0bc004d50 0x7fd0d41f5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:20.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.645+0000 7fd0d9028640 1 -- 172.21.15.18:0/96425403 >> 172.21.15.18:0/96425403 conn(0x7fd0d40cf7d0 msgr2=0x7fd0d40b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:20.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.645+0000 7fd0d9028640 1 -- 172.21.15.18:0/96425403 shutdown_connections 2024-04-17T19:53:20.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.645+0000 7fd0d9028640 1 -- 172.21.15.18:0/96425403 wait complete. 2024-04-17T19:53:20.660 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi018.front.sepia.ceph.com... 2024-04-17T19:53:20.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:20.660 DEBUG:teuthology.orchestra.run.smithi018:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-04-17T19:53:20.677 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi018.stderr:ceph-fuse[33605]: fuse finished with error 0 and tester_r 0 2024-04-17T19:53:20.679 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T19:53:20.747 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi018.front.sepia.ceph.com 2024-04-17T19:53:20.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:20.747 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-04-17T19:53:20.762 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T19:53:20.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.965+0000 7fd2613d5640 1 Processor -- start 2024-04-17T19:53:20.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.965+0000 7fd2613d5640 1 -- start start 2024-04-17T19:53:20.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.965+0000 7fd2613d5640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd25c15d2d0 0x7fd25c0b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:20.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.965+0000 7fd2613d5640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd25c0cd5f0 con 0x7fd25c073080 2024-04-17T19:53:20.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.965+0000 7fd2613d5640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd25c0cd8d0 con 0x7fd25c0ce690 2024-04-17T19:53:20.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.965+0000 7fd2613d5640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fd25c0cdbb0 con 0x7fd25c15d2d0 2024-04-17T19:53:20.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.965+0000 7fd25a7fc640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fd25c073080 0x7fd25c073490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:49132/0 (socket says 172.21.15.18:49132) 2024-04-17T19:53:20.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.965+0000 7fd25a7fc640 1 -- 172.21.15.18:0/3538131134 learned_addr learned my addr 172.21.15.18:0/3538131134 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:20.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.965+0000 7fd25affd640 1 --2- 172.21.15.18:0/3538131134 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd25c15d2d0 0x7fd25c0b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:20.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.965+0000 7fd259ffb640 1 -- 172.21.15.18:0/3538131134 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2283780967 0 0) 0x7fd25c0cd5f0 con 0x7fd25c073080 2024-04-17T19:53:20.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.965+0000 7fd259ffb640 1 -- 172.21.15.18:0/3538131134 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd244003530 con 0x7fd25c073080 2024-04-17T19:53:20.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.965+0000 7fd259ffb640 1 -- 172.21.15.18:0/3538131134 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 697891232 0 0) 0x7fd25c0cd8d0 con 0x7fd25c0ce690 2024-04-17T19:53:20.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.965+0000 7fd259ffb640 1 -- 172.21.15.18:0/3538131134 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd25c0cd5f0 con 0x7fd25c0ce690 2024-04-17T19:53:20.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.965+0000 7fd25affd640 1 -- 172.21.15.18:0/3538131134 >> v1:172.21.15.173:6789/0 conn(0x7fd25c0ce690 legacy=0x7fd25c0ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:20.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.965+0000 7fd25affd640 1 -- 172.21.15.18:0/3538131134 >> v1:172.21.15.18:6789/0 conn(0x7fd25c073080 legacy=0x7fd25c073490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:20.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.965+0000 7fd25affd640 1 -- 172.21.15.18:0/3538131134 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd25c0cde90 con 0x7fd25c15d2d0 2024-04-17T19:53:20.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.969+0000 7fd25affd640 1 --2- 172.21.15.18:0/3538131134 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd25c15d2d0 0x7fd25c0b4d30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd24c009dc0 tx=0x7fd24c01c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d31b605288377861 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:20.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.969+0000 7fd259ffb640 1 -- 172.21.15.18:0/3538131134 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd24c0b2070 con 0x7fd25c15d2d0 2024-04-17T19:53:20.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.969+0000 7fd259ffb640 1 -- 172.21.15.18:0/3538131134 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd24c0a5850 con 0x7fd25c15d2d0 2024-04-17T19:53:20.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.969+0000 7fd259ffb640 1 -- 172.21.15.18:0/3538131134 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd24c0a5c20 con 0x7fd25c15d2d0 2024-04-17T19:53:20.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.969+0000 7fd2613d5640 1 -- 172.21.15.18:0/3538131134 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd25c15d2d0 msgr2=0x7fd25c0b4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:20.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.969+0000 7fd2613d5640 1 --2- 172.21.15.18:0/3538131134 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd25c15d2d0 0x7fd25c0b4d30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd24c009dc0 tx=0x7fd24c01c990 comp rx=0 tx=0).stop 2024-04-17T19:53:20.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.969+0000 7fd2613d5640 1 -- 172.21.15.18:0/3538131134 shutdown_connections 2024-04-17T19:53:20.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.969+0000 7fd2613d5640 1 --2- 172.21.15.18:0/3538131134 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd25c15d2d0 0x7fd25c0b4d30 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:20.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.969+0000 7fd2613d5640 1 -- 172.21.15.18:0/3538131134 >> 172.21.15.18:0/3538131134 conn(0x7fd25c0b3910 msgr2=0x7fd25c0d12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:20.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.969+0000 7fd2613d5640 1 -- 172.21.15.18:0/3538131134 shutdown_connections 2024-04-17T19:53:20.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.969+0000 7fd2613d5640 1 -- 172.21.15.18:0/3538131134 wait complete. 2024-04-17T19:53:20.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.973+0000 7fd2613d5640 1 Processor -- start 2024-04-17T19:53:20.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.973+0000 7fd2613d5640 1 -- start start 2024-04-17T19:53:20.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.973+0000 7fd2613d5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd25c073080 0x7fd25c1514f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:20.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.973+0000 7fd2613d5640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd25c0ce690 0x7fd25c13cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:20.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.973+0000 7fd2613d5640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd25c15d2d0 0x7fd25c153110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:20.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.973+0000 7fd2613d5640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd25c0b5480 con 0x7fd25c073080 2024-04-17T19:53:20.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.973+0000 7fd2613d5640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd25c0cf7d0 con 0x7fd25c15d2d0 2024-04-17T19:53:20.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.973+0000 7fd2613d5640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fd25c16b690 con 0x7fd25c0ce690 2024-04-17T19:53:20.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.973+0000 7fd25affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd25c073080 0x7fd25c1514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:20.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.973+0000 7fd25affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd25c073080 0x7fd25c1514f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52780/0 (socket says 172.21.15.18:52780) 2024-04-17T19:53:20.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.973+0000 7fd25affd640 1 -- 172.21.15.18:0/2545006554 learned_addr learned my addr 172.21.15.18:0/2545006554 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:20.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.973+0000 7fd25b7fe640 1 --2- 172.21.15.18:0/2545006554 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd25c15d2d0 0x7fd25c153110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:20.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.973+0000 7fd25a7fc640 1 --2- 172.21.15.18:0/2545006554 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd25c0ce690 0x7fd25c13cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:20.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.973+0000 7fd25affd640 1 -- 172.21.15.18:0/2545006554 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd25c0ce690 msgr2=0x7fd25c13cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:20.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.973+0000 7fd25affd640 1 --2- 172.21.15.18:0/2545006554 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd25c0ce690 0x7fd25c13cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:20.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.973+0000 7fd25affd640 1 -- 172.21.15.18:0/2545006554 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd25c15d2d0 msgr2=0x7fd25c153110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:20.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.973+0000 7fd25affd640 1 --2- 172.21.15.18:0/2545006554 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd25c15d2d0 0x7fd25c153110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:20.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.973+0000 7fd25affd640 1 -- 172.21.15.18:0/2545006554 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd25c154660 con 0x7fd25c073080 2024-04-17T19:53:20.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.973+0000 7fd25affd640 1 --2- 172.21.15.18:0/2545006554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd25c073080 0x7fd25c1514f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd24c0195a0 tx=0x7fd24c019730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:20.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.973+0000 7fd2437fe640 1 -- 172.21.15.18:0/2545006554 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd24c0b2050 con 0x7fd25c073080 2024-04-17T19:53:20.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.973+0000 7fd2437fe640 1 -- 172.21.15.18:0/2545006554 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd24c0b3040 con 0x7fd25c073080 2024-04-17T19:53:20.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.973+0000 7fd2437fe640 1 -- 172.21.15.18:0/2545006554 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd24c0ad650 con 0x7fd25c073080 2024-04-17T19:53:20.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.977+0000 7fd2613d5640 1 -- 172.21.15.18:0/2545006554 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd25c154940 con 0x7fd25c073080 2024-04-17T19:53:20.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.977+0000 7fd2613d5640 1 -- 172.21.15.18:0/2545006554 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd25c154f00 con 0x7fd25c073080 2024-04-17T19:53:20.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.977+0000 7fd2613d5640 1 -- 172.21.15.18:0/2545006554 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd25c155340 con 0x7fd25c073080 2024-04-17T19:53:20.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.977+0000 7fd2437fe640 1 -- 172.21.15.18:0/2545006554 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd24c0c0020 con 0x7fd25c073080 2024-04-17T19:53:20.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.977+0000 7fd2437fe640 1 --2- 172.21.15.18:0/2545006554 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fd248068380 0x7fd24806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:20.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.977+0000 7fd2437fe640 1 -- 172.21.15.18:0/2545006554 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fd24c121420 con 0x7fd25c073080 2024-04-17T19:53:20.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.977+0000 7fd25a7fc640 1 --2- 172.21.15.18:0/2545006554 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fd248068380 0x7fd24806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:20.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.977+0000 7fd25a7fc640 1 --2- 172.21.15.18:0/2545006554 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fd248068380 0x7fd24806a890 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd25c14d3e0 tx=0x7fd250009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:20.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:20.981+0000 7fd2437fe640 1 -- 172.21.15.18:0/2545006554 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd24c0c7020 con 0x7fd25c073080 2024-04-17T19:53:21.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.141+0000 7fd2613d5640 1 -- 172.21.15.18:0/2545006554 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd25c069950 con 0x7fd25c073080 2024-04-17T19:53:21.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.141+0000 7fd2437fe640 1 -- 172.21.15.18:0/2545006554 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18506 (secure 0 0 0) 0x7fd24c016580 con 0x7fd25c073080 2024-04-17T19:53:21.139 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:53:21.139 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":27,"fsid":"dd480169-5a81-4623-be5f-0499aa244b28","created":"2024-04-17T19:52:39.533760+0000","modified":"2024-04-17T19:53:09.903922+0000","last_up_change":"2024-04-17T19:52:51.229698+0000","last_in_change":"2024-04-17T19:52:42.144259+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T19:52:52.391648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T19:53:02.734240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T19:53:03.813028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T19:53:07.478812+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e232d577-2508-4ea4-b355-29fbae1ff025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6801","nonce":2323038417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6803","nonce":2323038417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6807","nonce":2323038417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6805","nonce":2323038417}]},"public_addr":"172.21.15.18:6801/2323038417","cluster_addr":"172.21.15.18:6803/2323038417","heartbeat_back_addr":"172.21.15.18:6807/2323038417","heartbeat_front_addr":"172.21.15.18:6805/2323038417","state":["exists","up"]},{"osd":1,"uuid":"31810ef3-2c71-48d6-8748-b74a2968d23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6817","nonce":1283678238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6819","nonce":1283678238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6823","nonce":1283678238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6821","nonce":1283678238}]},"public_addr":"172.21.15.18:6817/1283678238","cluster_addr":"172.21.15.18:6819/1283678238","heartbeat_back_addr":"172.21.15.18:6823/1283678238","heartbeat_front_addr":"172.21.15.18:6821/1283678238","state":["exists","up"]},{"osd":2,"uuid":"5a783cc5-a41c-4967-9e11-6b8330f97d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6809","nonce":1212875862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6811","nonce":1212875862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6815","nonce":1212875862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6813","nonce":1212875862}]},"public_addr":"172.21.15.18:6809/1212875862","cluster_addr":"172.21.15.18:6811/1212875862","heartbeat_back_addr":"172.21.15.18:6815/1212875862","heartbeat_front_addr":"172.21.15.18:6813/1212875862","state":["exists","up"]},{"osd":3,"uuid":"b7e056d9-9da5-46e1-810d-0c3e242fe5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6825","nonce":2428878428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6827","nonce":2428878428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6831","nonce":2428878428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6829","nonce":2428878428}]},"public_addr":"172.21.15.18:6825/2428878428","cluster_addr":"172.21.15.18:6827/2428878428","heartbeat_back_addr":"172.21.15.18:6831/2428878428","heartbeat_front_addr":"172.21.15.18:6829/2428878428","state":["exists","up"]},{"osd":4,"uuid":"21df023f-bc8b-4abb-93e5-0ecc91acda0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6825","nonce":1421511819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6827","nonce":1421511819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6831","nonce":1421511819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6829","nonce":1421511819}]},"public_addr":"172.21.15.173:6825/1421511819","cluster_addr":"172.21.15.173:6827/1421511819","heartbeat_back_addr":"172.21.15.173:6831/1421511819","heartbeat_front_addr":"172.21.15.173:6829/1421511819","state":["exists","up"]},{"osd":5,"uuid":"e270098a-6d33-49f8-84ed-94e09a880cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6801","nonce":4221907702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6803","nonce":4221907702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6807","nonce":4221907702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6805","nonce":4221907702}]},"public_addr":"172.21.15.173:6801/4221907702","cluster_addr":"172.21.15.173:6803/4221907702","heartbeat_back_addr":"172.21.15.173:6807/4221907702","heartbeat_front_addr":"172.21.15.173:6805/4221907702","state":["exists","up"]},{"osd":6,"uuid":"93c67c8c-268d-4e32-877c-043cd3acd87c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6809","nonce":761678552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6811","nonce":761678552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6815","nonce":761678552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6813","nonce":761678552}]},"public_addr":"172.21.15.173:6809/761678552","cluster_addr":"172.21.15.173:6811/761678552","heartbeat_back_addr":"172.21.15.173:6815/761678552","heartbeat_front_addr":"172.21.15.173:6813/761678552","state":["exists","up"]},{"osd":7,"uuid":"faf10eea-80de-40f6-abbb-34d07d3f59ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6817","nonce":383724537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6819","nonce":383724537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6823","nonce":383724537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6821","nonce":383724537}]},"public_addr":"172.21.15.173:6817/383724537","cluster_addr":"172.21.15.173:6819/383724537","heartbeat_back_addr":"172.21.15.173:6823/383724537","heartbeat_front_addr":"172.21.15.173:6821/383724537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.668924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.761747+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.768128+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.632252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.742608+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.734327+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.477107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.818292+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T19:53:21.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.145+0000 7fd2613d5640 1 -- 172.21.15.18:0/2545006554 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fd248068380 msgr2=0x7fd24806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:21.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.145+0000 7fd2613d5640 1 --2- 172.21.15.18:0/2545006554 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fd248068380 0x7fd24806a890 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd25c14d3e0 tx=0x7fd250009040 comp rx=0 tx=0).stop 2024-04-17T19:53:21.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.145+0000 7fd2613d5640 1 -- 172.21.15.18:0/2545006554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd25c073080 msgr2=0x7fd25c1514f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:21.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.145+0000 7fd2613d5640 1 --2- 172.21.15.18:0/2545006554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd25c073080 0x7fd25c1514f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd24c0195a0 tx=0x7fd24c019730 comp rx=0 tx=0).stop 2024-04-17T19:53:21.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.145+0000 7fd2613d5640 1 -- 172.21.15.18:0/2545006554 shutdown_connections 2024-04-17T19:53:21.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.145+0000 7fd2613d5640 1 --2- 172.21.15.18:0/2545006554 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fd248068380 0x7fd24806a890 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:21.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.145+0000 7fd2613d5640 1 --2- 172.21.15.18:0/2545006554 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd25c15d2d0 0x7fd25c153110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:21.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.145+0000 7fd2613d5640 1 --2- 172.21.15.18:0/2545006554 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd25c0ce690 0x7fd25c13cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:21.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.145+0000 7fd2613d5640 1 --2- 172.21.15.18:0/2545006554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd25c073080 0x7fd25c1514f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:21.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.145+0000 7fd2613d5640 1 -- 172.21.15.18:0/2545006554 >> 172.21.15.18:0/2545006554 conn(0x7fd25c0b3910 msgr2=0x7fd25c15dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:21.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.145+0000 7fd2613d5640 1 -- 172.21.15.18:0/2545006554 shutdown_connections 2024-04-17T19:53:21.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.145+0000 7fd2613d5640 1 -- 172.21.15.18:0/2545006554 wait complete. 2024-04-17T19:53:21.159 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T19:53:21.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.301+0000 7fc059e20640 1 Processor -- start 2024-04-17T19:53:21.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.301+0000 7fc059e20640 1 -- start start 2024-04-17T19:53:21.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.305+0000 7fc059e20640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc05406cd60 0x7fc05406d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:21.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.305+0000 7fc059e20640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc05415c7c0 0x7fc05415cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:21.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.305+0000 7fc059e20640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc05406f9f0 0x7fc05406fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:21.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.305+0000 7fc059e20640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fc05415fc90 con 0x7fc05415c7c0 2024-04-17T19:53:21.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.305+0000 7fc059e20640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7fc05406d6b0 con 0x7fc05406f9f0 2024-04-17T19:53:21.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.305+0000 7fc059e20640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fc054142870 con 0x7fc05406cd60 2024-04-17T19:53:21.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.305+0000 7fc052ffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc05415c7c0 0x7fc05415cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:21.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.305+0000 7fc052ffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc05415c7c0 0x7fc05415cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52792/0 (socket says 172.21.15.18:52792) 2024-04-17T19:53:21.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.305+0000 7fc052ffd640 1 -- 172.21.15.18:0/3137654052 learned_addr learned my addr 172.21.15.18:0/3137654052 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:21.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.305+0000 7fc053fff640 1 --2- 172.21.15.18:0/3137654052 >> v2:172.21.15.173:3300/0 conn(0x7fc05406f9f0 0x7fc05406fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:21.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.305+0000 7fc0537fe640 1 --2- 172.21.15.18:0/3137654052 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc05406cd60 0x7fc05406d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:21.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.305+0000 7fc052ffd640 1 -- 172.21.15.18:0/3137654052 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc05406cd60 msgr2=0x7fc05406d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:21.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.305+0000 7fc052ffd640 1 --2- 172.21.15.18:0/3137654052 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc05406cd60 0x7fc05406d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:21.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.305+0000 7fc052ffd640 1 -- 172.21.15.18:0/3137654052 >> v2:172.21.15.173:3300/0 conn(0x7fc05406f9f0 msgr2=0x7fc05406fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:21.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.305+0000 7fc052ffd640 1 --2- 172.21.15.18:0/3137654052 >> v2:172.21.15.173:3300/0 conn(0x7fc05406f9f0 0x7fc05406fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:21.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.305+0000 7fc052ffd640 1 -- 172.21.15.18:0/3137654052 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc05415ff00 con 0x7fc05415c7c0 2024-04-17T19:53:21.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.305+0000 7fc0537fe640 1 --2- 172.21.15.18:0/3137654052 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc05406cd60 0x7fc05406d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:53:21.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.309+0000 7fc052ffd640 1 --2- 172.21.15.18:0/3137654052 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc05415c7c0 0x7fc05415cbd0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc0540b4b50 tx=0x7fc04801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea1ce898776507dc server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:21.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.309+0000 7fc0527fc640 1 -- 172.21.15.18:0/3137654052 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0480aa610 con 0x7fc05415c7c0 2024-04-17T19:53:21.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.309+0000 7fc0527fc640 1 -- 172.21.15.18:0/3137654052 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0480af070 con 0x7fc05415c7c0 2024-04-17T19:53:21.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.309+0000 7fc0527fc640 1 -- 172.21.15.18:0/3137654052 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0480aa9d0 con 0x7fc05415c7c0 2024-04-17T19:53:21.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.309+0000 7fc059e20640 1 -- 172.21.15.18:0/3137654052 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc05415c7c0 msgr2=0x7fc05415cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:21.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.309+0000 7fc059e20640 1 --2- 172.21.15.18:0/3137654052 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc05415c7c0 0x7fc05415cbd0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc0540b4b50 tx=0x7fc04801c4f0 comp rx=0 tx=0).stop 2024-04-17T19:53:21.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.309+0000 7fc059e20640 1 -- 172.21.15.18:0/3137654052 shutdown_connections 2024-04-17T19:53:21.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.309+0000 7fc059e20640 1 --2- 172.21.15.18:0/3137654052 >> v2:172.21.15.173:3300/0 conn(0x7fc05406f9f0 0x7fc05406fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:21.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.309+0000 7fc059e20640 1 --2- 172.21.15.18:0/3137654052 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc05415c7c0 0x7fc05415cbd0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:21.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.309+0000 7fc059e20640 1 --2- 172.21.15.18:0/3137654052 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc05406cd60 0x7fc05406d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:21.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.309+0000 7fc059e20640 1 -- 172.21.15.18:0/3137654052 >> 172.21.15.18:0/3137654052 conn(0x7fc054072bb0 msgr2=0x7fc054072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:21.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.309+0000 7fc059e20640 1 -- 172.21.15.18:0/3137654052 shutdown_connections 2024-04-17T19:53:21.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.309+0000 7fc059e20640 1 -- 172.21.15.18:0/3137654052 wait complete. 2024-04-17T19:53:21.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.313+0000 7fc059e20640 1 Processor -- start 2024-04-17T19:53:21.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.313+0000 7fc059e20640 1 -- start start 2024-04-17T19:53:21.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.313+0000 7fc059e20640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc05406cd60 0x7fc054152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:21.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.313+0000 7fc059e20640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc05406f9f0 0x7fc054154ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:21.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.313+0000 7fc059e20640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc05415c7c0 0x7fc054159b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:21.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.313+0000 7fc059e20640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc0541609e0 con 0x7fc05406cd60 2024-04-17T19:53:21.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.313+0000 7fc059e20640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc054070750 con 0x7fc05415c7c0 2024-04-17T19:53:21.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.313+0000 7fc059e20640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fc054153820 con 0x7fc05406f9f0 2024-04-17T19:53:21.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.313+0000 7fc0537fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc05406cd60 0x7fc054152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:21.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.313+0000 7fc0537fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc05406cd60 0x7fc054152f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52806/0 (socket says 172.21.15.18:52806) 2024-04-17T19:53:21.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.313+0000 7fc0537fe640 1 -- 172.21.15.18:0/686200553 learned_addr learned my addr 172.21.15.18:0/686200553 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:21.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.313+0000 7fc053fff640 1 --2- 172.21.15.18:0/686200553 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc05415c7c0 0x7fc054159b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:21.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.313+0000 7fc052ffd640 1 --2- 172.21.15.18:0/686200553 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc05406f9f0 0x7fc054154ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:21.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.313+0000 7fc0537fe640 1 -- 172.21.15.18:0/686200553 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc05406f9f0 msgr2=0x7fc054154ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:21.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.313+0000 7fc0537fe640 1 --2- 172.21.15.18:0/686200553 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc05406f9f0 0x7fc054154ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:21.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.313+0000 7fc0537fe640 1 -- 172.21.15.18:0/686200553 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc05415c7c0 msgr2=0x7fc054159b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:21.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.313+0000 7fc0537fe640 1 --2- 172.21.15.18:0/686200553 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc05415c7c0 0x7fc054159b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:21.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.313+0000 7fc0537fe640 1 -- 172.21.15.18:0/686200553 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0541576d0 con 0x7fc05406cd60 2024-04-17T19:53:21.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.313+0000 7fc0537fe640 1 --2- 172.21.15.18:0/686200553 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc05406cd60 0x7fc054152f60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc04400c820 tx=0x7fc04400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:21.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.313+0000 7fc03bfff640 1 -- 172.21.15.18:0/686200553 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc044015070 con 0x7fc05406cd60 2024-04-17T19:53:21.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.313+0000 7fc03bfff640 1 -- 172.21.15.18:0/686200553 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc044007a30 con 0x7fc05406cd60 2024-04-17T19:53:21.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.313+0000 7fc059e20640 1 -- 172.21.15.18:0/686200553 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0541579b0 con 0x7fc05406cd60 2024-04-17T19:53:21.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.313+0000 7fc03bfff640 1 -- 172.21.15.18:0/686200553 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc044007e20 con 0x7fc05406cd60 2024-04-17T19:53:21.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.313+0000 7fc059e20640 1 -- 172.21.15.18:0/686200553 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc054157f70 con 0x7fc05406cd60 2024-04-17T19:53:21.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.313+0000 7fc059e20640 1 -- 172.21.15.18:0/686200553 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc054069950 con 0x7fc05406cd60 2024-04-17T19:53:21.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.317+0000 7fc03bfff640 1 -- 172.21.15.18:0/686200553 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc044018070 con 0x7fc05406cd60 2024-04-17T19:53:21.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.317+0000 7fc03bfff640 1 --2- 172.21.15.18:0/686200553 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fc0400683b0 0x7fc04006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:21.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.317+0000 7fc03bfff640 1 -- 172.21.15.18:0/686200553 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fc044086c30 con 0x7fc05406cd60 2024-04-17T19:53:21.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.317+0000 7fc052ffd640 1 --2- 172.21.15.18:0/686200553 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fc0400683b0 0x7fc04006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:21.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.317+0000 7fc052ffd640 1 --2- 172.21.15.18:0/686200553 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fc0400683b0 0x7fc04006a8c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc0480ae000 tx=0x7fc048008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:21.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.321+0000 7fc03bfff640 1 -- 172.21.15.18:0/686200553 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc044056e20 con 0x7fc05406cd60 2024-04-17T19:53:21.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.481+0000 7fc059e20640 1 -- 172.21.15.18:0/686200553 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc054160b60 con 0x7fc05406cd60 2024-04-17T19:53:21.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.485+0000 7fc03bfff640 1 -- 172.21.15.18:0/686200553 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18506 (secure 0 0 0) 0x7fc054160b60 con 0x7fc05406cd60 2024-04-17T19:53:21.483 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:53:21.483 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":27,"fsid":"dd480169-5a81-4623-be5f-0499aa244b28","created":"2024-04-17T19:52:39.533760+0000","modified":"2024-04-17T19:53:09.903922+0000","last_up_change":"2024-04-17T19:52:51.229698+0000","last_in_change":"2024-04-17T19:52:42.144259+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T19:52:52.391648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T19:53:02.734240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T19:53:03.813028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T19:53:07.478812+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e232d577-2508-4ea4-b355-29fbae1ff025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6801","nonce":2323038417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6803","nonce":2323038417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6807","nonce":2323038417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6805","nonce":2323038417}]},"public_addr":"172.21.15.18:6801/2323038417","cluster_addr":"172.21.15.18:6803/2323038417","heartbeat_back_addr":"172.21.15.18:6807/2323038417","heartbeat_front_addr":"172.21.15.18:6805/2323038417","state":["exists","up"]},{"osd":1,"uuid":"31810ef3-2c71-48d6-8748-b74a2968d23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6817","nonce":1283678238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6819","nonce":1283678238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6823","nonce":1283678238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6821","nonce":1283678238}]},"public_addr":"172.21.15.18:6817/1283678238","cluster_addr":"172.21.15.18:6819/1283678238","heartbeat_back_addr":"172.21.15.18:6823/1283678238","heartbeat_front_addr":"172.21.15.18:6821/1283678238","state":["exists","up"]},{"osd":2,"uuid":"5a783cc5-a41c-4967-9e11-6b8330f97d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6809","nonce":1212875862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6811","nonce":1212875862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6815","nonce":1212875862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6813","nonce":1212875862}]},"public_addr":"172.21.15.18:6809/1212875862","cluster_addr":"172.21.15.18:6811/1212875862","heartbeat_back_addr":"172.21.15.18:6815/1212875862","heartbeat_front_addr":"172.21.15.18:6813/1212875862","state":["exists","up"]},{"osd":3,"uuid":"b7e056d9-9da5-46e1-810d-0c3e242fe5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6825","nonce":2428878428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6827","nonce":2428878428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6831","nonce":2428878428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6829","nonce":2428878428}]},"public_addr":"172.21.15.18:6825/2428878428","cluster_addr":"172.21.15.18:6827/2428878428","heartbeat_back_addr":"172.21.15.18:6831/2428878428","heartbeat_front_addr":"172.21.15.18:6829/2428878428","state":["exists","up"]},{"osd":4,"uuid":"21df023f-bc8b-4abb-93e5-0ecc91acda0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6825","nonce":1421511819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6827","nonce":1421511819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6831","nonce":1421511819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6829","nonce":1421511819}]},"public_addr":"172.21.15.173:6825/1421511819","cluster_addr":"172.21.15.173:6827/1421511819","heartbeat_back_addr":"172.21.15.173:6831/1421511819","heartbeat_front_addr":"172.21.15.173:6829/1421511819","state":["exists","up"]},{"osd":5,"uuid":"e270098a-6d33-49f8-84ed-94e09a880cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6801","nonce":4221907702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6803","nonce":4221907702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6807","nonce":4221907702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6805","nonce":4221907702}]},"public_addr":"172.21.15.173:6801/4221907702","cluster_addr":"172.21.15.173:6803/4221907702","heartbeat_back_addr":"172.21.15.173:6807/4221907702","heartbeat_front_addr":"172.21.15.173:6805/4221907702","state":["exists","up"]},{"osd":6,"uuid":"93c67c8c-268d-4e32-877c-043cd3acd87c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6809","nonce":761678552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6811","nonce":761678552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6815","nonce":761678552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6813","nonce":761678552}]},"public_addr":"172.21.15.173:6809/761678552","cluster_addr":"172.21.15.173:6811/761678552","heartbeat_back_addr":"172.21.15.173:6815/761678552","heartbeat_front_addr":"172.21.15.173:6813/761678552","state":["exists","up"]},{"osd":7,"uuid":"faf10eea-80de-40f6-abbb-34d07d3f59ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6817","nonce":383724537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6819","nonce":383724537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6823","nonce":383724537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6821","nonce":383724537}]},"public_addr":"172.21.15.173:6817/383724537","cluster_addr":"172.21.15.173:6819/383724537","heartbeat_back_addr":"172.21.15.173:6823/383724537","heartbeat_front_addr":"172.21.15.173:6821/383724537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.668924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.761747+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.768128+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.632252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.742608+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.734327+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.477107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.818292+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T19:53:21.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.489+0000 7fc059e20640 1 -- 172.21.15.18:0/686200553 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fc0400683b0 msgr2=0x7fc04006a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:21.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.489+0000 7fc059e20640 1 --2- 172.21.15.18:0/686200553 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fc0400683b0 0x7fc04006a8c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc0480ae000 tx=0x7fc048008040 comp rx=0 tx=0).stop 2024-04-17T19:53:21.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.489+0000 7fc059e20640 1 -- 172.21.15.18:0/686200553 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc05406cd60 msgr2=0x7fc054152f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:21.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.489+0000 7fc059e20640 1 --2- 172.21.15.18:0/686200553 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc05406cd60 0x7fc054152f60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc04400c820 tx=0x7fc04400cce0 comp rx=0 tx=0).stop 2024-04-17T19:53:21.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.489+0000 7fc059e20640 1 -- 172.21.15.18:0/686200553 shutdown_connections 2024-04-17T19:53:21.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.489+0000 7fc059e20640 1 --2- 172.21.15.18:0/686200553 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fc0400683b0 0x7fc04006a8c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:21.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.489+0000 7fc059e20640 1 --2- 172.21.15.18:0/686200553 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc05415c7c0 0x7fc054159b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:21.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.489+0000 7fc059e20640 1 --2- 172.21.15.18:0/686200553 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc05406f9f0 0x7fc054154ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:21.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.489+0000 7fc059e20640 1 --2- 172.21.15.18:0/686200553 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc05406cd60 0x7fc054152f60 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:21.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.489+0000 7fc059e20640 1 -- 172.21.15.18:0/686200553 >> 172.21.15.18:0/686200553 conn(0x7fc054072bb0 msgr2=0x7fc05415f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:21.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.489+0000 7fc059e20640 1 -- 172.21.15.18:0/686200553 shutdown_connections 2024-04-17T19:53:21.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.489+0000 7fc059e20640 1 -- 172.21.15.18:0/686200553 wait complete. 2024-04-17T19:53:21.503 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-17T19:53:21.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.653+0000 7f39e753f640 1 Processor -- start 2024-04-17T19:53:21.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.653+0000 7f39e753f640 1 -- start start 2024-04-17T19:53:21.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.653+0000 7f39e753f640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f39e00d37c0 0x7f39e00d4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:21.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.653+0000 7f39e753f640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f39e00d0230 0x7f39e00b82f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:21.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.653+0000 7f39e753f640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39e006c1e0 con 0x7f39e006d280 2024-04-17T19:53:21.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.653+0000 7f39e753f640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f39e006c4c0 con 0x7f39e00d0230 2024-04-17T19:53:21.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.653+0000 7f39e753f640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f39e006c7a0 con 0x7f39e00d37c0 2024-04-17T19:53:21.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.653+0000 7f39e5adc640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f39e00d0230 0x7f39e00b82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:21.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.653+0000 7f39e5adc640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f39e00d0230 0x7f39e00b82f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52818/0 (socket says 172.21.15.18:52818) 2024-04-17T19:53:21.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.653+0000 7f39e5adc640 1 -- 172.21.15.18:0/2404201047 learned_addr learned my addr 172.21.15.18:0/2404201047 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:21.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.653+0000 7f39e52db640 1 --2- 172.21.15.18:0/2404201047 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f39e00d37c0 0x7f39e00d4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:21.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.653+0000 7f39e5adc640 1 -- 172.21.15.18:0/2404201047 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f39e00d37c0 msgr2=0x7f39e00d4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:21.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.653+0000 7f39e5adc640 1 --2- 172.21.15.18:0/2404201047 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f39e00d37c0 0x7f39e00d4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:21.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.653+0000 7f39e5adc640 1 -- 172.21.15.18:0/2404201047 >> v1:172.21.15.173:6789/0 conn(0x7f39e006d280 legacy=0x7f39e00cfb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:21.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.653+0000 7f39e5adc640 1 -- 172.21.15.18:0/2404201047 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39e006ca80 con 0x7f39e00d0230 2024-04-17T19:53:21.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.653+0000 7f39e52db640 1 --2- 172.21.15.18:0/2404201047 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f39e00d37c0 0x7f39e00d4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:53:21.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.657+0000 7f39e5adc640 1 --2- 172.21.15.18:0/2404201047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39e00d0230 0x7f39e00b82f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f39d8009870 tx=0x7f39d801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76f0ef222c0589b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:21.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.657+0000 7f39dffff640 1 -- 172.21.15.18:0/2404201047 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d80b0070 con 0x7f39e00d0230 2024-04-17T19:53:21.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.657+0000 7f39dffff640 1 -- 172.21.15.18:0/2404201047 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39d80ab600 con 0x7f39e00d0230 2024-04-17T19:53:21.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.657+0000 7f39dffff640 1 -- 172.21.15.18:0/2404201047 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d80ab9d0 con 0x7f39e00d0230 2024-04-17T19:53:21.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.657+0000 7f39e753f640 1 -- 172.21.15.18:0/2404201047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39e00d0230 msgr2=0x7f39e00b82f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:21.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.657+0000 7f39e753f640 1 --2- 172.21.15.18:0/2404201047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39e00d0230 0x7f39e00b82f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f39d8009870 tx=0x7f39d801c460 comp rx=0 tx=0).stop 2024-04-17T19:53:21.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.657+0000 7f39e753f640 1 -- 172.21.15.18:0/2404201047 shutdown_connections 2024-04-17T19:53:21.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.657+0000 7f39e753f640 1 --2- 172.21.15.18:0/2404201047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39e00d0230 0x7f39e00b82f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:21.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.657+0000 7f39e753f640 1 --2- 172.21.15.18:0/2404201047 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f39e00d37c0 0x7f39e00d4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:21.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.657+0000 7f39e753f640 1 -- 172.21.15.18:0/2404201047 >> 172.21.15.18:0/2404201047 conn(0x7f39e00b6cd0 msgr2=0x7f39e00b70e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:21.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.657+0000 7f39e753f640 1 -- 172.21.15.18:0/2404201047 shutdown_connections 2024-04-17T19:53:21.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.657+0000 7f39e753f640 1 -- 172.21.15.18:0/2404201047 wait complete. 2024-04-17T19:53:21.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.661+0000 7f39e753f640 1 Processor -- start 2024-04-17T19:53:21.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.661+0000 7f39e753f640 1 -- start start 2024-04-17T19:53:21.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.661+0000 7f39e753f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39e006d280 0x7f39e00c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:21.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.661+0000 7f39e753f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39e00d37c0 0x7f39e01fbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:21.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.661+0000 7f39e753f640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f39e01fc3f0 0x7f39e0156070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:21.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.661+0000 7f39e753f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f39e015ebb0 con 0x7f39e00d37c0 2024-04-17T19:53:21.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.661+0000 7f39e753f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f39e015ea30 con 0x7f39e006d280 2024-04-17T19:53:21.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.661+0000 7f39e753f640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f39e015ed30 con 0x7f39e01fc3f0 2024-04-17T19:53:21.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.661+0000 7f39e4ada640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39e00d37c0 0x7f39e01fbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:21.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.661+0000 7f39e4ada640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39e00d37c0 0x7f39e01fbeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52822/0 (socket says 172.21.15.18:52822) 2024-04-17T19:53:21.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.661+0000 7f39e4ada640 1 -- 172.21.15.18:0/1016307937 learned_addr learned my addr 172.21.15.18:0/1016307937 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:21.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.661+0000 7f39e5adc640 1 --2- 172.21.15.18:0/1016307937 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f39e01fc3f0 0x7f39e0156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:21.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.661+0000 7f39e52db640 1 --2- 172.21.15.18:0/1016307937 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39e006d280 0x7f39e00c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:21.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.661+0000 7f39e4ada640 1 -- 172.21.15.18:0/1016307937 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f39e01fc3f0 msgr2=0x7f39e0156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:21.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.661+0000 7f39e4ada640 1 --2- 172.21.15.18:0/1016307937 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f39e01fc3f0 0x7f39e0156070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:21.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.661+0000 7f39e4ada640 1 -- 172.21.15.18:0/1016307937 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39e006d280 msgr2=0x7f39e00c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:21.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.661+0000 7f39e4ada640 1 --2- 172.21.15.18:0/1016307937 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39e006d280 0x7f39e00c8f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:21.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.661+0000 7f39e4ada640 1 -- 172.21.15.18:0/1016307937 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39e01fc800 con 0x7f39e00d37c0 2024-04-17T19:53:21.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.661+0000 7f39e4ada640 1 --2- 172.21.15.18:0/1016307937 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39e00d37c0 0x7f39e01fbeb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f39d400b3e0 tx=0x7f39d400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:21.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.661+0000 7f39ddffb640 1 -- 172.21.15.18:0/1016307937 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d4015020 con 0x7f39e00d37c0 2024-04-17T19:53:21.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.661+0000 7f39ddffb640 1 -- 172.21.15.18:0/1016307937 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39d4011830 con 0x7f39e00d37c0 2024-04-17T19:53:21.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.661+0000 7f39e753f640 1 -- 172.21.15.18:0/1016307937 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39e00cbb00 con 0x7f39e00d37c0 2024-04-17T19:53:21.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.661+0000 7f39ddffb640 1 -- 172.21.15.18:0/1016307937 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d4011c60 con 0x7f39e00d37c0 2024-04-17T19:53:21.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.661+0000 7f39e753f640 1 -- 172.21.15.18:0/1016307937 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39e00c9d80 con 0x7f39e00d37c0 2024-04-17T19:53:21.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.665+0000 7f39e753f640 1 -- 172.21.15.18:0/1016307937 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39e00c9810 con 0x7f39e00d37c0 2024-04-17T19:53:21.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.665+0000 7f39ddffb640 1 -- 172.21.15.18:0/1016307937 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f39d4018020 con 0x7f39e00d37c0 2024-04-17T19:53:21.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.665+0000 7f39ddffb640 1 --2- 172.21.15.18:0/1016307937 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f39cc0683b0 0x7f39cc06a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:21.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.665+0000 7f39ddffb640 1 -- 172.21.15.18:0/1016307937 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f39d40868c0 con 0x7f39e00d37c0 2024-04-17T19:53:21.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.665+0000 7f39e52db640 1 --2- 172.21.15.18:0/1016307937 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f39cc0683b0 0x7f39cc06a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:21.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.665+0000 7f39e52db640 1 --2- 172.21.15.18:0/1016307937 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f39cc0683b0 0x7f39cc06a8c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f39d0008ee0 tx=0x7f39d0008430 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:21.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.669+0000 7f39ddffb640 1 -- 172.21.15.18:0/1016307937 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f39d401f030 con 0x7f39e00d37c0 2024-04-17T19:53:21.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:21.861+0000 7f39e753f640 1 -- 172.21.15.18:0/1016307937 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f39e0069950 con 0x7f39e00d37c0 2024-04-17T19:53:22.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.541+0000 7f39ddffb640 1 -- 172.21.15.18:0/1016307937 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) ==== 118+0+0 (secure 0 0 0) 0x7f39e01fc800 con 0x7f39e00d37c0 2024-04-17T19:53:22.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.545+0000 7f39e753f640 1 -- 172.21.15.18:0/1016307937 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f39cc0683b0 msgr2=0x7f39cc06a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:22.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.545+0000 7f39e753f640 1 --2- 172.21.15.18:0/1016307937 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f39cc0683b0 0x7f39cc06a8c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f39d0008ee0 tx=0x7f39d0008430 comp rx=0 tx=0).stop 2024-04-17T19:53:22.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.545+0000 7f39e753f640 1 -- 172.21.15.18:0/1016307937 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39e00d37c0 msgr2=0x7f39e01fbeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:22.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.545+0000 7f39e753f640 1 --2- 172.21.15.18:0/1016307937 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39e00d37c0 0x7f39e01fbeb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f39d400b3e0 tx=0x7f39d400b8a0 comp rx=0 tx=0).stop 2024-04-17T19:53:22.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.549+0000 7f39e753f640 1 -- 172.21.15.18:0/1016307937 shutdown_connections 2024-04-17T19:53:22.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.549+0000 7f39e753f640 1 --2- 172.21.15.18:0/1016307937 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f39cc0683b0 0x7f39cc06a8c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:22.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.549+0000 7f39e753f640 1 --2- 172.21.15.18:0/1016307937 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f39e01fc3f0 0x7f39e0156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:22.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.549+0000 7f39e753f640 1 --2- 172.21.15.18:0/1016307937 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39e00d37c0 0x7f39e01fbeb0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:22.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.549+0000 7f39e753f640 1 --2- 172.21.15.18:0/1016307937 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39e006d280 0x7f39e00c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:22.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.549+0000 7f39e753f640 1 -- 172.21.15.18:0/1016307937 >> 172.21.15.18:0/1016307937 conn(0x7f39e00b6cd0 msgr2=0x7f39e015bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:22.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.549+0000 7f39e753f640 1 -- 172.21.15.18:0/1016307937 shutdown_connections 2024-04-17T19:53:22.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.549+0000 7f39e753f640 1 -- 172.21.15.18:0/1016307937 wait complete. 2024-04-17T19:53:22.570 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-04-17T19:53:22.570 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-17T19:53:22.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.733+0000 7f5fd4e52640 1 Processor -- start 2024-04-17T19:53:22.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.733+0000 7f5fd4e52640 1 -- start start 2024-04-17T19:53:22.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.737+0000 7f5fd4e52640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f5fd015d1f0 0x7f5fd0160640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:22.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.737+0000 7f5fd4e52640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5fd00b7250 0x7f5fd00b7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:22.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.737+0000 7f5fd4e52640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fd015d600 con 0x7f5fd0070de0 2024-04-17T19:53:22.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.737+0000 7f5fd4e52640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f5fd0160b80 con 0x7f5fd015d1f0 2024-04-17T19:53:22.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.737+0000 7f5fd4e52640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f5fd00b2580 con 0x7f5fd00b7250 2024-04-17T19:53:22.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.737+0000 7f5fce59c640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f5fd015d1f0 0x7f5fd0160640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:22.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.737+0000 7f5fced9d640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5fd00b7250 0x7f5fd00b7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:22.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.737+0000 7f5fc7fff640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f5fd0070de0 0x7f5fd00711f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.18:45302/0 (socket says 172.21.15.18:45302) 2024-04-17T19:53:22.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.737+0000 7f5fce59c640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f5fd015d1f0 0x7f5fd0160640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.18:35582/0 (socket says 172.21.15.18:35582) 2024-04-17T19:53:22.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.737+0000 7f5fc7fff640 1 -- 172.21.15.18:0/2086509264 learned_addr learned my addr 172.21.15.18:0/2086509264 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:22.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.737+0000 7f5fce59c640 1 -- 172.21.15.18:0/2086509264 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5fd00b7250 msgr2=0x7f5fd00b7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:22.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.737+0000 7f5fce59c640 1 --2- 172.21.15.18:0/2086509264 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5fd00b7250 0x7f5fd00b7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:22.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.737+0000 7f5fce59c640 1 -- 172.21.15.18:0/2086509264 >> v1:172.21.15.173:6789/0 conn(0x7f5fd0070de0 legacy=0x7f5fd00711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:22.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.737+0000 7f5fce59c640 1 -- 172.21.15.18:0/2086509264 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fd0163250 con 0x7f5fd015d1f0 2024-04-17T19:53:22.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.741+0000 7f5fce59c640 1 --2- 172.21.15.18:0/2086509264 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5fd015d1f0 0x7f5fd0160640 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5fc00097c0 tx=0x7f5fc001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e4c9dd8b6ed7586 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:22.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.741+0000 7f5fcdd9b640 1 -- 172.21.15.18:0/2086509264 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc00aa600 con 0x7f5fd015d1f0 2024-04-17T19:53:22.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.741+0000 7f5fcdd9b640 1 -- 172.21.15.18:0/2086509264 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fc00af070 con 0x7f5fd015d1f0 2024-04-17T19:53:22.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.741+0000 7f5fcdd9b640 1 -- 172.21.15.18:0/2086509264 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc00aa9c0 con 0x7f5fd015d1f0 2024-04-17T19:53:22.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.741+0000 7f5fd4e52640 1 -- 172.21.15.18:0/2086509264 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5fd015d1f0 msgr2=0x7f5fd0160640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:22.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.741+0000 7f5fd4e52640 1 --2- 172.21.15.18:0/2086509264 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5fd015d1f0 0x7f5fd0160640 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5fc00097c0 tx=0x7f5fc001c4a0 comp rx=0 tx=0).stop 2024-04-17T19:53:22.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.741+0000 7f5fd4e52640 1 -- 172.21.15.18:0/2086509264 shutdown_connections 2024-04-17T19:53:22.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.741+0000 7f5fd4e52640 1 --2- 172.21.15.18:0/2086509264 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5fd00b7250 0x7f5fd00b7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:22.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.741+0000 7f5fd4e52640 1 --2- 172.21.15.18:0/2086509264 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5fd015d1f0 0x7f5fd0160640 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:22.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.741+0000 7f5fd4e52640 1 -- 172.21.15.18:0/2086509264 >> 172.21.15.18:0/2086509264 conn(0x7f5fd00cf7d0 msgr2=0x7f5fd00cfbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:22.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.741+0000 7f5fd4e52640 1 -- 172.21.15.18:0/2086509264 shutdown_connections 2024-04-17T19:53:22.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.741+0000 7f5fd4e52640 1 -- 172.21.15.18:0/2086509264 wait complete. 2024-04-17T19:53:22.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.745+0000 7f5fd4e52640 1 Processor -- start 2024-04-17T19:53:22.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.745+0000 7f5fd4e52640 1 -- start start 2024-04-17T19:53:22.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.745+0000 7f5fd4e52640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5fd0070de0 0x7f5fd006e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:22.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.745+0000 7f5fd4e52640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fd00b7250 0x7f5fd00c7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:22.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.745+0000 7f5fd4e52640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5fd015d1f0 0x7f5fd00c77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:22.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.745+0000 7f5fd4e52640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd016c550 con 0x7f5fd00b7250 2024-04-17T19:53:22.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.745+0000 7f5fd4e52640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd0164010 con 0x7f5fd0070de0 2024-04-17T19:53:22.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.745+0000 7f5fd4e52640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f5fd016c6d0 con 0x7f5fd015d1f0 2024-04-17T19:53:22.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.745+0000 7f5fc7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fd00b7250 0x7f5fd00c7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:22.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.745+0000 7f5fc7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fd00b7250 0x7f5fd00c7290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52838/0 (socket says 172.21.15.18:52838) 2024-04-17T19:53:22.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.745+0000 7f5fc7fff640 1 -- 172.21.15.18:0/234434642 learned_addr learned my addr 172.21.15.18:0/234434642 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:22.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.745+0000 7f5fce59c640 1 --2- 172.21.15.18:0/234434642 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5fd0070de0 0x7f5fd006e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:22.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.745+0000 7f5fced9d640 1 --2- 172.21.15.18:0/234434642 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5fd015d1f0 0x7f5fd00c77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:22.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.745+0000 7f5fc7fff640 1 -- 172.21.15.18:0/234434642 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5fd015d1f0 msgr2=0x7f5fd00c77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:22.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.745+0000 7f5fc7fff640 1 --2- 172.21.15.18:0/234434642 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5fd015d1f0 0x7f5fd00c77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:22.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.745+0000 7f5fc7fff640 1 -- 172.21.15.18:0/234434642 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5fd0070de0 msgr2=0x7f5fd006e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:22.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.745+0000 7f5fc7fff640 1 --2- 172.21.15.18:0/234434642 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5fd0070de0 0x7f5fd006e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:22.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.745+0000 7f5fc7fff640 1 -- 172.21.15.18:0/234434642 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fd006ed10 con 0x7f5fd00b7250 2024-04-17T19:53:22.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.745+0000 7f5fce59c640 1 --2- 172.21.15.18:0/234434642 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5fd0070de0 0x7f5fd006e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:53:22.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.745+0000 7f5fc7fff640 1 --2- 172.21.15.18:0/234434642 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fd00b7250 0x7f5fd00c7290 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5fb800c3a0 tx=0x7f5fb800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:22.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.745+0000 7f5fc6ffd640 1 -- 172.21.15.18:0/234434642 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb8017070 con 0x7f5fd00b7250 2024-04-17T19:53:22.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.745+0000 7f5fc6ffd640 1 -- 172.21.15.18:0/234434642 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fb8005cf0 con 0x7f5fd00b7250 2024-04-17T19:53:22.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.745+0000 7f5fd4e52640 1 -- 172.21.15.18:0/234434642 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fd006eff0 con 0x7f5fd00b7250 2024-04-17T19:53:22.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.745+0000 7f5fc6ffd640 1 -- 172.21.15.18:0/234434642 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb80072f0 con 0x7f5fd00b7250 2024-04-17T19:53:22.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.745+0000 7f5fd4e52640 1 -- 172.21.15.18:0/234434642 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fd00c6d70 con 0x7f5fd00b7250 2024-04-17T19:53:22.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.749+0000 7f5fd4e52640 1 -- 172.21.15.18:0/234434642 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fd0069950 con 0x7f5fd00b7250 2024-04-17T19:53:22.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.749+0000 7f5fc6ffd640 1 -- 172.21.15.18:0/234434642 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5fb801a070 con 0x7f5fd00b7250 2024-04-17T19:53:22.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.749+0000 7f5fc6ffd640 1 --2- 172.21.15.18:0/234434642 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f5fb00683b0 0x7f5fb006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:22.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.749+0000 7f5fc6ffd640 1 -- 172.21.15.18:0/234434642 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f5fb80861c0 con 0x7f5fd00b7250 2024-04-17T19:53:22.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.749+0000 7f5fce59c640 1 --2- 172.21.15.18:0/234434642 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f5fb00683b0 0x7f5fb006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:22.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.749+0000 7f5fce59c640 1 --2- 172.21.15.18:0/234434642 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f5fb00683b0 0x7f5fb006a8c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5fc00ae000 tx=0x7f5fc00a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:22.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.753+0000 7f5fc6ffd640 1 -- 172.21.15.18:0/234434642 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5fd015d600 con 0x7f5fd00b7250 2024-04-17T19:53:22.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:22.945+0000 7f5fd4e52640 1 -- 172.21.15.18:0/234434642 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f5fd00d2110 con 0x7f5fd00b7250 2024-04-17T19:53:23.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.553+0000 7f5fc6ffd640 1 -- 172.21.15.18:0/234434642 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) ==== 122+0+0 (secure 0 0 0) 0x7f5fb8056310 con 0x7f5fd00b7250 2024-04-17T19:53:23.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.557+0000 7f5fd4e52640 1 -- 172.21.15.18:0/234434642 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f5fb00683b0 msgr2=0x7f5fb006a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:23.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.557+0000 7f5fd4e52640 1 --2- 172.21.15.18:0/234434642 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f5fb00683b0 0x7f5fb006a8c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5fc00ae000 tx=0x7f5fc00a7000 comp rx=0 tx=0).stop 2024-04-17T19:53:23.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.557+0000 7f5fd4e52640 1 -- 172.21.15.18:0/234434642 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fd00b7250 msgr2=0x7f5fd00c7290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:23.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.557+0000 7f5fd4e52640 1 --2- 172.21.15.18:0/234434642 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fd00b7250 0x7f5fd00c7290 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5fb800c3a0 tx=0x7f5fb800c860 comp rx=0 tx=0).stop 2024-04-17T19:53:23.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.557+0000 7f5fd4e52640 1 -- 172.21.15.18:0/234434642 shutdown_connections 2024-04-17T19:53:23.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.557+0000 7f5fd4e52640 1 --2- 172.21.15.18:0/234434642 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f5fb00683b0 0x7f5fb006a8c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:23.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.557+0000 7f5fd4e52640 1 --2- 172.21.15.18:0/234434642 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5fd015d1f0 0x7f5fd00c77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:23.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.557+0000 7f5fd4e52640 1 --2- 172.21.15.18:0/234434642 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fd00b7250 0x7f5fd00c7290 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:23.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.557+0000 7f5fd4e52640 1 --2- 172.21.15.18:0/234434642 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5fd0070de0 0x7f5fd006e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:23.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.557+0000 7f5fd4e52640 1 -- 172.21.15.18:0/234434642 >> 172.21.15.18:0/234434642 conn(0x7f5fd00cf7d0 msgr2=0x7f5fd00711f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:23.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.557+0000 7f5fd4e52640 1 -- 172.21.15.18:0/234434642 shutdown_connections 2024-04-17T19:53:23.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.557+0000 7f5fd4e52640 1 -- 172.21.15.18:0/234434642 wait complete. 2024-04-17T19:53:23.581 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-17T19:53:23.581 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T19:53:23.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.741+0000 7fb6e61af640 1 Processor -- start 2024-04-17T19:53:23.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.741+0000 7fb6e61af640 1 -- start start 2024-04-17T19:53:23.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.741+0000 7fb6e61af640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb6e015e1a0 0x7fb6e00ce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:23.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.741+0000 7fb6e61af640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6e00d0020 con 0x7fb6e006cd60 2024-04-17T19:53:23.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.741+0000 7fb6e61af640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6e00cd930 con 0x7fb6e00cef10 2024-04-17T19:53:23.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.741+0000 7fb6e61af640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fb6e00cdc10 con 0x7fb6e015e1a0 2024-04-17T19:53:23.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.741+0000 7fb6df7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb6e015e1a0 0x7fb6e00ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:23.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.741+0000 7fb6dffff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fb6e006cd60 0x7fb6e006d170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:49136/0 (socket says 172.21.15.18:49136) 2024-04-17T19:53:23.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.741+0000 7fb6dffff640 1 -- 172.21.15.18:0/3873158492 learned_addr learned my addr 172.21.15.18:0/3873158492 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:23.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.741+0000 7fb6de7fc640 1 -- 172.21.15.18:0/3873158492 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2143536756 0 0) 0x7fb6e00d0020 con 0x7fb6e006cd60 2024-04-17T19:53:23.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.741+0000 7fb6de7fc640 1 -- 172.21.15.18:0/3873158492 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6c8003530 con 0x7fb6e006cd60 2024-04-17T19:53:23.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.741+0000 7fb6df7fe640 1 -- 172.21.15.18:0/3873158492 >> v1:172.21.15.173:6789/0 conn(0x7fb6e00cef10 legacy=0x7fb6e015e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:23.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.741+0000 7fb6df7fe640 1 -- 172.21.15.18:0/3873158492 >> v1:172.21.15.18:6789/0 conn(0x7fb6e006cd60 legacy=0x7fb6e006d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:23.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.741+0000 7fb6df7fe640 1 -- 172.21.15.18:0/3873158492 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6e00cdef0 con 0x7fb6e015e1a0 2024-04-17T19:53:23.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.745+0000 7fb6df7fe640 1 --2- 172.21.15.18:0/3873158492 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6e015e1a0 0x7fb6e00ce9d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb6d00097c0 tx=0x7fb6d001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c7bae4365ee3f10 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:23.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.745+0000 7fb6de7fc640 1 -- 172.21.15.18:0/3873158492 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d00b1070 con 0x7fb6e015e1a0 2024-04-17T19:53:23.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.745+0000 7fb6de7fc640 1 -- 172.21.15.18:0/3873158492 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6d00a8050 con 0x7fb6e015e1a0 2024-04-17T19:53:23.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.745+0000 7fb6de7fc640 1 -- 172.21.15.18:0/3873158492 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d00ac860 con 0x7fb6e015e1a0 2024-04-17T19:53:23.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.745+0000 7fb6e61af640 1 -- 172.21.15.18:0/3873158492 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6e015e1a0 msgr2=0x7fb6e00ce9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:23.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.745+0000 7fb6e61af640 1 --2- 172.21.15.18:0/3873158492 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6e015e1a0 0x7fb6e00ce9d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb6d00097c0 tx=0x7fb6d001c3e0 comp rx=0 tx=0).stop 2024-04-17T19:53:23.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.745+0000 7fb6e61af640 1 -- 172.21.15.18:0/3873158492 shutdown_connections 2024-04-17T19:53:23.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.745+0000 7fb6e61af640 1 --2- 172.21.15.18:0/3873158492 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6e015e1a0 0x7fb6e00ce9d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:23.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.745+0000 7fb6e61af640 1 -- 172.21.15.18:0/3873158492 >> 172.21.15.18:0/3873158492 conn(0x7fb6e0072bb0 msgr2=0x7fb6e0072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:23.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.745+0000 7fb6e61af640 1 -- 172.21.15.18:0/3873158492 shutdown_connections 2024-04-17T19:53:23.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.745+0000 7fb6e61af640 1 -- 172.21.15.18:0/3873158492 wait complete. 2024-04-17T19:53:23.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.749+0000 7fb6e61af640 1 Processor -- start 2024-04-17T19:53:23.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.749+0000 7fb6e61af640 1 -- start start 2024-04-17T19:53:23.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.749+0000 7fb6e61af640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb6e006cd60 0x7fb6e01f83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:23.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.749+0000 7fb6e61af640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6e00cef10 0x7fb6e014d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:23.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.749+0000 7fb6e61af640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6e015e1a0 0x7fb6e0153c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:23.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.749+0000 7fb6e61af640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e015f1a0 con 0x7fb6e00cef10 2024-04-17T19:53:23.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.749+0000 7fb6e61af640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e015f020 con 0x7fb6e015e1a0 2024-04-17T19:53:23.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.749+0000 7fb6e61af640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fb6e0157a10 con 0x7fb6e006cd60 2024-04-17T19:53:23.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.749+0000 7fb6deffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6e00cef10 0x7fb6e014d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:23.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.749+0000 7fb6deffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6e00cef10 0x7fb6e014d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52852/0 (socket says 172.21.15.18:52852) 2024-04-17T19:53:23.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.749+0000 7fb6deffd640 1 -- 172.21.15.18:0/2513423176 learned_addr learned my addr 172.21.15.18:0/2513423176 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:23.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.749+0000 7fb6dffff640 1 --2- 172.21.15.18:0/2513423176 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6e015e1a0 0x7fb6e0153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:23.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.749+0000 7fb6deffd640 1 -- 172.21.15.18:0/2513423176 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb6e006cd60 msgr2=0x7fb6e01f83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:23.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.749+0000 7fb6deffd640 1 --2- 172.21.15.18:0/2513423176 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb6e006cd60 0x7fb6e01f83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:23.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.749+0000 7fb6deffd640 1 -- 172.21.15.18:0/2513423176 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6e015e1a0 msgr2=0x7fb6e0153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:23.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.749+0000 7fb6deffd640 1 --2- 172.21.15.18:0/2513423176 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6e015e1a0 0x7fb6e0153c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:23.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.749+0000 7fb6deffd640 1 -- 172.21.15.18:0/2513423176 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6e00ab3e0 con 0x7fb6e00cef10 2024-04-17T19:53:23.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.749+0000 7fb6dffff640 1 --2- 172.21.15.18:0/2513423176 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6e015e1a0 0x7fb6e0153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:53:23.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.749+0000 7fb6deffd640 1 --2- 172.21.15.18:0/2513423176 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6e00cef10 0x7fb6e014d7c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb6d400c760 tx=0x7fb6d400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:23.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.749+0000 7fb6c7fff640 1 -- 172.21.15.18:0/2513423176 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d4016020 con 0x7fb6e00cef10 2024-04-17T19:53:23.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.749+0000 7fb6c7fff640 1 -- 172.21.15.18:0/2513423176 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6d4006d80 con 0x7fb6e00cef10 2024-04-17T19:53:23.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.749+0000 7fb6e61af640 1 -- 172.21.15.18:0/2513423176 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6e014dd00 con 0x7fb6e00cef10 2024-04-17T19:53:23.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.749+0000 7fb6c7fff640 1 -- 172.21.15.18:0/2513423176 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d4003bc0 con 0x7fb6e00cef10 2024-04-17T19:53:23.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.749+0000 7fb6e61af640 1 -- 172.21.15.18:0/2513423176 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6e00aae20 con 0x7fb6e00cef10 2024-04-17T19:53:23.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.749+0000 7fb6e61af640 1 -- 172.21.15.18:0/2513423176 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6e0069950 con 0x7fb6e00cef10 2024-04-17T19:53:23.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.753+0000 7fb6c7fff640 1 -- 172.21.15.18:0/2513423176 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb6d400a7f0 con 0x7fb6e00cef10 2024-04-17T19:53:23.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.753+0000 7fb6c7fff640 1 --2- 172.21.15.18:0/2513423176 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fb6cc068380 0x7fb6cc06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:23.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.753+0000 7fb6c7fff640 1 -- 172.21.15.18:0/2513423176 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fb6d40868b0 con 0x7fb6e00cef10 2024-04-17T19:53:23.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.753+0000 7fb6df7fe640 1 --2- 172.21.15.18:0/2513423176 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fb6cc068380 0x7fb6cc06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:23.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.753+0000 7fb6df7fe640 1 --2- 172.21.15.18:0/2513423176 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fb6cc068380 0x7fb6cc06a890 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb6d00ae000 tx=0x7fb6d0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:23.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.757+0000 7fb6c7fff640 1 -- 172.21.15.18:0/2513423176 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb6d4020020 con 0x7fb6e00cef10 2024-04-17T19:53:23.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.953+0000 7fb6e61af640 1 -- 172.21.15.18:0/2513423176 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb6e0073300 con 0x7fb6e00cef10 2024-04-17T19:53:23.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.953+0000 7fb6c7fff640 1 -- 172.21.15.18:0/2513423176 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5177 (secure 0 0 0) 0x7fb6e00ab3e0 con 0x7fb6e00cef10 2024-04-17T19:53:23.950 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:53:23.950 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/729504609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":729504609},{"type":"v1","addr":"172.21.15.173:6833","nonce":729504609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4261,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/3797017174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3797017174},{"type":"v1","addr":"172.21.15.173:6835","nonce":3797017174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/995848920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":995848920},{"type":"v1","addr":"172.21.15.18:6835","nonce":995848920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-17T19:53:04.851226+0000","modified":"2024-04-17T19:53:22.952315+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6837/1926349198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1926349198},{"type":"v1","addr":"172.21.15.18:6837","nonce":1926349198}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1}]} 2024-04-17T19:53:23.951 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 9 2024-04-17T19:53:23.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.957+0000 7fb6e61af640 1 -- 172.21.15.18:0/2513423176 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fb6cc068380 msgr2=0x7fb6cc06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:23.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.957+0000 7fb6e61af640 1 --2- 172.21.15.18:0/2513423176 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fb6cc068380 0x7fb6cc06a890 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb6d00ae000 tx=0x7fb6d0008040 comp rx=0 tx=0).stop 2024-04-17T19:53:23.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.957+0000 7fb6e61af640 1 -- 172.21.15.18:0/2513423176 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6e00cef10 msgr2=0x7fb6e014d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:23.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.957+0000 7fb6e61af640 1 --2- 172.21.15.18:0/2513423176 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6e00cef10 0x7fb6e014d7c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb6d400c760 tx=0x7fb6d400cc20 comp rx=0 tx=0).stop 2024-04-17T19:53:23.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.957+0000 7fb6e61af640 1 -- 172.21.15.18:0/2513423176 shutdown_connections 2024-04-17T19:53:23.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.957+0000 7fb6e61af640 1 --2- 172.21.15.18:0/2513423176 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fb6cc068380 0x7fb6cc06a890 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:23.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.957+0000 7fb6e61af640 1 --2- 172.21.15.18:0/2513423176 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6e015e1a0 0x7fb6e0153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:23.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.957+0000 7fb6e61af640 1 --2- 172.21.15.18:0/2513423176 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6e00cef10 0x7fb6e014d7c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:23.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.957+0000 7fb6e61af640 1 --2- 172.21.15.18:0/2513423176 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb6e006cd60 0x7fb6e01f83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:23.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.957+0000 7fb6e61af640 1 -- 172.21.15.18:0/2513423176 >> 172.21.15.18:0/2513423176 conn(0x7fb6e0072bb0 msgr2=0x7fb6e00b13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:23.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.957+0000 7fb6e61af640 1 -- 172.21.15.18:0/2513423176 shutdown_connections 2024-04-17T19:53:23.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:23.957+0000 7fb6e61af640 1 -- 172.21.15.18:0/2513423176 wait complete. 2024-04-17T19:53:23.970 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T19:53:24.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.125+0000 7f757412d640 1 Processor -- start 2024-04-17T19:53:24.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.125+0000 7f757412d640 1 -- start start 2024-04-17T19:53:24.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.125+0000 7f757412d640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f756c0713e0 0x7f756c0cdd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:24.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.125+0000 7f757412d640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f756c0ce6b0 con 0x7f756c06eee0 2024-04-17T19:53:24.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.125+0000 7f757412d640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f756c06de40 con 0x7f756c0ce2a0 2024-04-17T19:53:24.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.125+0000 7f757412d640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f756c06e120 con 0x7f756c0713e0 2024-04-17T19:53:24.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.125+0000 7f7571ec9640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f756c06eee0 0x7f756c070cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:49146/0 (socket says 172.21.15.18:49146) 2024-04-17T19:53:24.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.125+0000 7f7571ec9640 1 -- 172.21.15.18:0/1660566047 learned_addr learned my addr 172.21.15.18:0/1660566047 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:24.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.125+0000 7f75716c8640 1 --2- 172.21.15.18:0/1660566047 >> v2:172.21.15.173:3300/0 conn(0x7f756c0713e0 0x7f756c0cdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:24.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.125+0000 7f7570ec7640 1 -- 172.21.15.18:0/1660566047 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3292403884 0 0) 0x7f756c0ce6b0 con 0x7f756c06eee0 2024-04-17T19:53:24.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.125+0000 7f7570ec7640 1 -- 172.21.15.18:0/1660566047 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7558003530 con 0x7f756c06eee0 2024-04-17T19:53:24.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.125+0000 7f7570ec7640 1 -- 172.21.15.18:0/1660566047 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3321278697 0 0) 0x7f7558003530 con 0x7f756c06eee0 2024-04-17T19:53:24.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.125+0000 7f7570ec7640 1 -- 172.21.15.18:0/1660566047 >> v2:172.21.15.173:3300/0 conn(0x7f756c0713e0 msgr2=0x7f756c0cdd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:24.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.125+0000 7f7570ec7640 1 --2- 172.21.15.18:0/1660566047 >> v2:172.21.15.173:3300/0 conn(0x7f756c0713e0 0x7f756c0cdd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:24.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.125+0000 7f7570ec7640 1 -- 172.21.15.18:0/1660566047 >> v1:172.21.15.173:6789/0 conn(0x7f756c0ce2a0 legacy=0x7f756c0d07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:24.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.125+0000 7f7570ec7640 1 -- 172.21.15.18:0/1660566047 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f756c06e400 con 0x7f756c06eee0 2024-04-17T19:53:24.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.125+0000 7f7570ec7640 1 -- 172.21.15.18:0/1660566047 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3208559991 0 0) 0x7f7568001a00 con 0x7f756c06eee0 2024-04-17T19:53:24.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.125+0000 7f7570ec7640 1 -- 172.21.15.18:0/1660566047 >> v1:172.21.15.18:6789/0 conn(0x7f756c06eee0 legacy=0x7f756c070cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:24.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.125+0000 7f7570ec7640 1 --2- 172.21.15.18:0/1660566047 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f75580039c0 0x7f7558003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:24.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.125+0000 7f7570ec7640 1 --2- 172.21.15.18:0/1660566047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7558004810 0x7f7558004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:24.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.125+0000 7f7570ec7640 1 --2- 172.21.15.18:0/1660566047 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75580051d0 0x7f755800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:24.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.125+0000 7f7570ec7640 1 -- 172.21.15.18:0/1660566047 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f756c06e120 con 0x7f7558004810 2024-04-17T19:53:24.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.125+0000 7f7570ec7640 1 -- 172.21.15.18:0/1660566047 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f755800c160 con 0x7f75580051d0 2024-04-17T19:53:24.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.125+0000 7f7570ec7640 1 -- 172.21.15.18:0/1660566047 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f755800c360 con 0x7f75580039c0 2024-04-17T19:53:24.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.125+0000 7f75716c8640 1 --2- 172.21.15.18:0/1660566047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7558004810 0x7f7558004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:24.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.125+0000 7f75726ca640 1 --2- 172.21.15.18:0/1660566047 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75580051d0 0x7f755800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:24.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.125+0000 7f7571ec9640 1 --2- 172.21.15.18:0/1660566047 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f75580039c0 0x7f7558003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:24.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.125+0000 7f75716c8640 1 -- 172.21.15.18:0/1660566047 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f75580039c0 msgr2=0x7f7558003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:24.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.129+0000 7f75716c8640 1 --2- 172.21.15.18:0/1660566047 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f75580039c0 0x7f7558003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:24.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.129+0000 7f75716c8640 1 -- 172.21.15.18:0/1660566047 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75580051d0 msgr2=0x7f755800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:24.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.129+0000 7f75716c8640 1 --2- 172.21.15.18:0/1660566047 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75580051d0 0x7f755800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:24.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.129+0000 7f75716c8640 1 -- 172.21.15.18:0/1660566047 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7558003530 con 0x7f7558004810 2024-04-17T19:53:24.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.129+0000 7f75726ca640 1 -- 172.21.15.18:0/1660566047 reap_dead start 2024-04-17T19:53:24.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.129+0000 7f7571ec9640 1 --2- 172.21.15.18:0/1660566047 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f75580039c0 0x7f7558003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:53:24.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.129+0000 7f75716c8640 1 --2- 172.21.15.18:0/1660566047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7558004810 0x7f7558004c20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f756c068ae0 tx=0x7f755c01ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fe15c64896dcd25 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:24.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.129+0000 7f7570ec7640 1 -- 172.21.15.18:0/1660566047 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f755c0b2070 con 0x7f7558004810 2024-04-17T19:53:24.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.129+0000 7f7570ec7640 1 -- 172.21.15.18:0/1660566047 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f755c0a5600 con 0x7f7558004810 2024-04-17T19:53:24.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.129+0000 7f7570ec7640 1 -- 172.21.15.18:0/1660566047 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f755c0096b0 con 0x7f7558004810 2024-04-17T19:53:24.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.129+0000 7f757412d640 1 -- 172.21.15.18:0/1660566047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7558004810 msgr2=0x7f7558004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:24.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.129+0000 7f757412d640 1 --2- 172.21.15.18:0/1660566047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7558004810 0x7f7558004c20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f756c068ae0 tx=0x7f755c01ca10 comp rx=0 tx=0).stop 2024-04-17T19:53:24.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.129+0000 7f757412d640 1 -- 172.21.15.18:0/1660566047 shutdown_connections 2024-04-17T19:53:24.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.129+0000 7f757412d640 1 --2- 172.21.15.18:0/1660566047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7558004810 0x7f7558004c20 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:24.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.129+0000 7f757412d640 1 -- 172.21.15.18:0/1660566047 >> 172.21.15.18:0/1660566047 conn(0x7f756c0d2bf0 msgr2=0x7f756c0d3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:24.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.129+0000 7f757412d640 1 -- 172.21.15.18:0/1660566047 shutdown_connections 2024-04-17T19:53:24.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.129+0000 7f757412d640 1 -- 172.21.15.18:0/1660566047 wait complete. 2024-04-17T19:53:24.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.133+0000 7f757412d640 1 Processor -- start 2024-04-17T19:53:24.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.133+0000 7f757412d640 1 -- start start 2024-04-17T19:53:24.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.133+0000 7f757412d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7558004810 0x7f756c15ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:24.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.133+0000 7f757412d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f756c1f5840 0x7f756c1e9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:24.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.133+0000 7f757412d640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f756c1ea0d0 0x7f756c1e8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:24.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.133+0000 7f757412d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f756c15f8f0 con 0x7f756c1f5840 2024-04-17T19:53:24.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.133+0000 7f757412d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f756c06e9c0 con 0x7f7558004810 2024-04-17T19:53:24.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.133+0000 7f757412d640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f756c06daf0 con 0x7f756c1ea0d0 2024-04-17T19:53:24.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.133+0000 7f75716c8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f756c1f5840 0x7f756c1e9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:24.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.133+0000 7f75716c8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f756c1f5840 0x7f756c1e9b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52866/0 (socket says 172.21.15.18:52866) 2024-04-17T19:53:24.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.133+0000 7f75716c8640 1 -- 172.21.15.18:0/2987349860 learned_addr learned my addr 172.21.15.18:0/2987349860 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:24.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.133+0000 7f7571ec9640 1 --2- 172.21.15.18:0/2987349860 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7558004810 0x7f756c15ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:24.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.133+0000 7f75726ca640 1 --2- 172.21.15.18:0/2987349860 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f756c1ea0d0 0x7f756c1e8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:24.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.133+0000 7f75716c8640 1 -- 172.21.15.18:0/2987349860 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f756c1ea0d0 msgr2=0x7f756c1e8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:24.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.133+0000 7f75716c8640 1 --2- 172.21.15.18:0/2987349860 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f756c1ea0d0 0x7f756c1e8e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:24.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.133+0000 7f75716c8640 1 -- 172.21.15.18:0/2987349860 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7558004810 msgr2=0x7f756c15ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:24.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.133+0000 7f75716c8640 1 --2- 172.21.15.18:0/2987349860 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7558004810 0x7f756c15ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:24.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.133+0000 7f75716c8640 1 -- 172.21.15.18:0/2987349860 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f756c1f5c50 con 0x7f756c1f5840 2024-04-17T19:53:24.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.133+0000 7f7571ec9640 1 --2- 172.21.15.18:0/2987349860 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7558004810 0x7f756c15ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:53:24.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.133+0000 7f75716c8640 1 --2- 172.21.15.18:0/2987349860 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f756c1f5840 0x7f756c1e9b90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f755c0b0040 tx=0x7f755c0197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:24.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.133+0000 7f75627fc640 1 -- 172.21.15.18:0/2987349860 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f755c0bc020 con 0x7f756c1f5840 2024-04-17T19:53:24.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.133+0000 7f75627fc640 1 -- 172.21.15.18:0/2987349860 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f755c004020 con 0x7f756c1f5840 2024-04-17T19:53:24.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.133+0000 7f757412d640 1 -- 172.21.15.18:0/2987349860 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f756c0cb160 con 0x7f756c1f5840 2024-04-17T19:53:24.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.133+0000 7f75627fc640 1 -- 172.21.15.18:0/2987349860 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f755c0b2040 con 0x7f756c1f5840 2024-04-17T19:53:24.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.133+0000 7f757412d640 1 -- 172.21.15.18:0/2987349860 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f756c0cb720 con 0x7f756c1f5840 2024-04-17T19:53:24.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.137+0000 7f757412d640 1 -- 172.21.15.18:0/2987349860 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f756c163f00 con 0x7f756c1f5840 2024-04-17T19:53:24.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.137+0000 7f75627fc640 1 -- 172.21.15.18:0/2987349860 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f755c003620 con 0x7f756c1f5840 2024-04-17T19:53:24.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.137+0000 7f75627fc640 1 --2- 172.21.15.18:0/2987349860 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f7550068380 0x7f755006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:24.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.137+0000 7f75627fc640 1 -- 172.21.15.18:0/2987349860 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f755c120b10 con 0x7f756c1f5840 2024-04-17T19:53:24.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.137+0000 7f7571ec9640 1 --2- 172.21.15.18:0/2987349860 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f7550068380 0x7f755006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:24.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.137+0000 7f7571ec9640 1 --2- 172.21.15.18:0/2987349860 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f7550068380 0x7f755006a890 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7568007c50 tx=0x7f7568009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:24.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.141+0000 7f75627fc640 1 -- 172.21.15.18:0/2987349860 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f755c016720 con 0x7f756c1f5840 2024-04-17T19:53:24.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.297+0000 7f757412d640 1 -- 172.21.15.18:0/2987349860 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f756c069950 con 0x7f756c1f5840 2024-04-17T19:53:24.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.301+0000 7f75627fc640 1 -- 172.21.15.18:0/2987349860 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18506 (secure 0 0 0) 0x7f755c0f0c60 con 0x7f756c1f5840 2024-04-17T19:53:24.297 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:53:24.297 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":27,"fsid":"dd480169-5a81-4623-be5f-0499aa244b28","created":"2024-04-17T19:52:39.533760+0000","modified":"2024-04-17T19:53:09.903922+0000","last_up_change":"2024-04-17T19:52:51.229698+0000","last_in_change":"2024-04-17T19:52:42.144259+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T19:52:52.391648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T19:53:02.734240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T19:53:03.813028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T19:53:07.478812+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e232d577-2508-4ea4-b355-29fbae1ff025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6801","nonce":2323038417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6803","nonce":2323038417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6807","nonce":2323038417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6805","nonce":2323038417}]},"public_addr":"172.21.15.18:6801/2323038417","cluster_addr":"172.21.15.18:6803/2323038417","heartbeat_back_addr":"172.21.15.18:6807/2323038417","heartbeat_front_addr":"172.21.15.18:6805/2323038417","state":["exists","up"]},{"osd":1,"uuid":"31810ef3-2c71-48d6-8748-b74a2968d23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6817","nonce":1283678238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6819","nonce":1283678238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6823","nonce":1283678238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6821","nonce":1283678238}]},"public_addr":"172.21.15.18:6817/1283678238","cluster_addr":"172.21.15.18:6819/1283678238","heartbeat_back_addr":"172.21.15.18:6823/1283678238","heartbeat_front_addr":"172.21.15.18:6821/1283678238","state":["exists","up"]},{"osd":2,"uuid":"5a783cc5-a41c-4967-9e11-6b8330f97d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6809","nonce":1212875862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6811","nonce":1212875862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6815","nonce":1212875862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6813","nonce":1212875862}]},"public_addr":"172.21.15.18:6809/1212875862","cluster_addr":"172.21.15.18:6811/1212875862","heartbeat_back_addr":"172.21.15.18:6815/1212875862","heartbeat_front_addr":"172.21.15.18:6813/1212875862","state":["exists","up"]},{"osd":3,"uuid":"b7e056d9-9da5-46e1-810d-0c3e242fe5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6825","nonce":2428878428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6827","nonce":2428878428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6831","nonce":2428878428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6829","nonce":2428878428}]},"public_addr":"172.21.15.18:6825/2428878428","cluster_addr":"172.21.15.18:6827/2428878428","heartbeat_back_addr":"172.21.15.18:6831/2428878428","heartbeat_front_addr":"172.21.15.18:6829/2428878428","state":["exists","up"]},{"osd":4,"uuid":"21df023f-bc8b-4abb-93e5-0ecc91acda0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6825","nonce":1421511819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6827","nonce":1421511819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6831","nonce":1421511819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6829","nonce":1421511819}]},"public_addr":"172.21.15.173:6825/1421511819","cluster_addr":"172.21.15.173:6827/1421511819","heartbeat_back_addr":"172.21.15.173:6831/1421511819","heartbeat_front_addr":"172.21.15.173:6829/1421511819","state":["exists","up"]},{"osd":5,"uuid":"e270098a-6d33-49f8-84ed-94e09a880cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6801","nonce":4221907702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6803","nonce":4221907702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6807","nonce":4221907702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6805","nonce":4221907702}]},"public_addr":"172.21.15.173:6801/4221907702","cluster_addr":"172.21.15.173:6803/4221907702","heartbeat_back_addr":"172.21.15.173:6807/4221907702","heartbeat_front_addr":"172.21.15.173:6805/4221907702","state":["exists","up"]},{"osd":6,"uuid":"93c67c8c-268d-4e32-877c-043cd3acd87c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6809","nonce":761678552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6811","nonce":761678552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6815","nonce":761678552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6813","nonce":761678552}]},"public_addr":"172.21.15.173:6809/761678552","cluster_addr":"172.21.15.173:6811/761678552","heartbeat_back_addr":"172.21.15.173:6815/761678552","heartbeat_front_addr":"172.21.15.173:6813/761678552","state":["exists","up"]},{"osd":7,"uuid":"faf10eea-80de-40f6-abbb-34d07d3f59ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6817","nonce":383724537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6819","nonce":383724537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6823","nonce":383724537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6821","nonce":383724537}]},"public_addr":"172.21.15.173:6817/383724537","cluster_addr":"172.21.15.173:6819/383724537","heartbeat_back_addr":"172.21.15.173:6823/383724537","heartbeat_front_addr":"172.21.15.173:6821/383724537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.668924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.761747+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.768128+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.632252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.742608+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.734327+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.477107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.818292+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T19:53:24.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.301+0000 7f757412d640 1 -- 172.21.15.18:0/2987349860 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f7550068380 msgr2=0x7f755006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:24.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.301+0000 7f757412d640 1 --2- 172.21.15.18:0/2987349860 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f7550068380 0x7f755006a890 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7568007c50 tx=0x7f7568009040 comp rx=0 tx=0).stop 2024-04-17T19:53:24.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.301+0000 7f757412d640 1 -- 172.21.15.18:0/2987349860 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f756c1f5840 msgr2=0x7f756c1e9b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:24.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.301+0000 7f757412d640 1 --2- 172.21.15.18:0/2987349860 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f756c1f5840 0x7f756c1e9b90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f755c0b0040 tx=0x7f755c0197b0 comp rx=0 tx=0).stop 2024-04-17T19:53:24.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.301+0000 7f757412d640 1 -- 172.21.15.18:0/2987349860 shutdown_connections 2024-04-17T19:53:24.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.301+0000 7f757412d640 1 --2- 172.21.15.18:0/2987349860 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f7550068380 0x7f755006a890 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:24.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.301+0000 7f757412d640 1 --2- 172.21.15.18:0/2987349860 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f756c1ea0d0 0x7f756c1e8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:24.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.301+0000 7f757412d640 1 --2- 172.21.15.18:0/2987349860 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f756c1f5840 0x7f756c1e9b90 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:24.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.301+0000 7f757412d640 1 --2- 172.21.15.18:0/2987349860 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7558004810 0x7f756c15ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:24.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.301+0000 7f757412d640 1 -- 172.21.15.18:0/2987349860 >> 172.21.15.18:0/2987349860 conn(0x7f756c0d2bf0 msgr2=0x7f756c15e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:24.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.301+0000 7f757412d640 1 -- 172.21.15.18:0/2987349860 shutdown_connections 2024-04-17T19:53:24.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.301+0000 7f757412d640 1 -- 172.21.15.18:0/2987349860 wait complete. 2024-04-17T19:53:24.317 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-17T19:53:24.318 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T19:53:24.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.461+0000 7f60d19ae640 1 Processor -- start 2024-04-17T19:53:24.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.461+0000 7f60d19ae640 1 -- start start 2024-04-17T19:53:24.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.461+0000 7f60d19ae640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f60cc15e910 0x7f60cc15ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:24.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.461+0000 7f60d19ae640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60cc0d0020 con 0x7f60cc06cd60 2024-04-17T19:53:24.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.461+0000 7f60d19ae640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60cc0cd930 con 0x7f60cc15e1a0 2024-04-17T19:53:24.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.461+0000 7f60d19ae640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f60cc0cdc10 con 0x7f60cc15e910 2024-04-17T19:53:24.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.461+0000 7f60ca7fc640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f60cc15e910 0x7f60cc15ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:24.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.461+0000 7f60cb7fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f60cc06cd60 0x7f60cc06d170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:49160/0 (socket says 172.21.15.18:49160) 2024-04-17T19:53:24.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.461+0000 7f60cb7fe640 1 -- 172.21.15.18:0/1128427695 learned_addr learned my addr 172.21.15.18:0/1128427695 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:24.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.461+0000 7f60ca7fc640 1 -- 172.21.15.18:0/1128427695 >> v1:172.21.15.173:6789/0 conn(0x7f60cc15e1a0 legacy=0x7f60cc0ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:24.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.461+0000 7f60ca7fc640 1 -- 172.21.15.18:0/1128427695 >> v1:172.21.15.18:6789/0 conn(0x7f60cc06cd60 legacy=0x7f60cc06d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:24.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.461+0000 7f60ca7fc640 1 -- 172.21.15.18:0/1128427695 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60cc0cdef0 con 0x7f60cc15e910 2024-04-17T19:53:24.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.465+0000 7f60ca7fc640 1 --2- 172.21.15.18:0/1128427695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f60cc15e910 0x7f60cc15ed20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f60c00097c0 tx=0x7f60c001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90513289c4579978 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:24.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.465+0000 7f60c9ffb640 1 -- 172.21.15.18:0/1128427695 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60c00b0070 con 0x7f60cc15e910 2024-04-17T19:53:24.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.465+0000 7f60c9ffb640 1 -- 172.21.15.18:0/1128427695 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60c00ab600 con 0x7f60cc15e910 2024-04-17T19:53:24.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.465+0000 7f60c9ffb640 1 -- 172.21.15.18:0/1128427695 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60c00ab9d0 con 0x7f60cc15e910 2024-04-17T19:53:24.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.465+0000 7f60d19ae640 1 -- 172.21.15.18:0/1128427695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f60cc15e910 msgr2=0x7f60cc15ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:24.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.465+0000 7f60d19ae640 1 --2- 172.21.15.18:0/1128427695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f60cc15e910 0x7f60cc15ed20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f60c00097c0 tx=0x7f60c001c410 comp rx=0 tx=0).stop 2024-04-17T19:53:24.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.465+0000 7f60d19ae640 1 -- 172.21.15.18:0/1128427695 shutdown_connections 2024-04-17T19:53:24.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.465+0000 7f60d19ae640 1 --2- 172.21.15.18:0/1128427695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f60cc15e910 0x7f60cc15ed20 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:24.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.465+0000 7f60d19ae640 1 -- 172.21.15.18:0/1128427695 >> 172.21.15.18:0/1128427695 conn(0x7f60cc072bb0 msgr2=0x7f60cc072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:24.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.465+0000 7f60d19ae640 1 -- 172.21.15.18:0/1128427695 shutdown_connections 2024-04-17T19:53:24.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.465+0000 7f60d19ae640 1 -- 172.21.15.18:0/1128427695 wait complete. 2024-04-17T19:53:24.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.469+0000 7f60d19ae640 1 Processor -- start 2024-04-17T19:53:24.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.469+0000 7f60d19ae640 1 -- start start 2024-04-17T19:53:24.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.469+0000 7f60d19ae640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f60cc06cd60 0x7f60cc14c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:24.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.469+0000 7f60d19ae640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f60cc15e1a0 0x7f60cc15cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:24.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.469+0000 7f60d19ae640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f60cc15d470 0x7f60cc1567c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:24.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.469+0000 7f60d19ae640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f60cc0cf260 con 0x7f60cc15d470 2024-04-17T19:53:24.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.469+0000 7f60d19ae640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f60cc0cf0e0 con 0x7f60cc15e1a0 2024-04-17T19:53:24.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.469+0000 7f60d19ae640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f60cc157a10 con 0x7f60cc06cd60 2024-04-17T19:53:24.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.469+0000 7f60cb7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f60cc15d470 0x7f60cc1567c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:24.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.469+0000 7f60cb7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f60cc15d470 0x7f60cc1567c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52882/0 (socket says 172.21.15.18:52882) 2024-04-17T19:53:24.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.469+0000 7f60cb7fe640 1 -- 172.21.15.18:0/1594753881 learned_addr learned my addr 172.21.15.18:0/1594753881 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:24.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.469+0000 7f60ca7fc640 1 --2- 172.21.15.18:0/1594753881 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f60cc15e1a0 0x7f60cc15cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:24.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.469+0000 7f60caffd640 1 --2- 172.21.15.18:0/1594753881 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f60cc06cd60 0x7f60cc14c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:24.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.469+0000 7f60cb7fe640 1 -- 172.21.15.18:0/1594753881 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f60cc06cd60 msgr2=0x7f60cc14c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:24.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.469+0000 7f60cb7fe640 1 --2- 172.21.15.18:0/1594753881 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f60cc06cd60 0x7f60cc14c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:24.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.469+0000 7f60cb7fe640 1 -- 172.21.15.18:0/1594753881 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f60cc15e1a0 msgr2=0x7f60cc15cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:24.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.469+0000 7f60cb7fe640 1 --2- 172.21.15.18:0/1594753881 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f60cc15e1a0 0x7f60cc15cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:24.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.469+0000 7f60cb7fe640 1 -- 172.21.15.18:0/1594753881 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60cc14c9a0 con 0x7f60cc15d470 2024-04-17T19:53:24.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.469+0000 7f60cb7fe640 1 --2- 172.21.15.18:0/1594753881 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f60cc15d470 0x7f60cc1567c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f60bc00ca70 tx=0x7f60bc00cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:24.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.469+0000 7f60b3fff640 1 -- 172.21.15.18:0/1594753881 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60bc017070 con 0x7f60cc15d470 2024-04-17T19:53:24.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.469+0000 7f60b3fff640 1 -- 172.21.15.18:0/1594753881 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60bc00abd0 con 0x7f60cc15d470 2024-04-17T19:53:24.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.469+0000 7f60d19ae640 1 -- 172.21.15.18:0/1594753881 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60cc159600 con 0x7f60cc15d470 2024-04-17T19:53:24.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.469+0000 7f60b3fff640 1 -- 172.21.15.18:0/1594753881 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60bc012400 con 0x7f60cc15d470 2024-04-17T19:53:24.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.469+0000 7f60d19ae640 1 -- 172.21.15.18:0/1594753881 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60cc159bc0 con 0x7f60cc15d470 2024-04-17T19:53:24.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.469+0000 7f60d19ae640 1 -- 172.21.15.18:0/1594753881 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60cc069950 con 0x7f60cc15d470 2024-04-17T19:53:24.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.469+0000 7f60b3fff640 1 -- 172.21.15.18:0/1594753881 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f60bc01a070 con 0x7f60cc15d470 2024-04-17T19:53:24.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.473+0000 7f60b3fff640 1 --2- 172.21.15.18:0/1594753881 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f60b8068380 0x7f60b806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:24.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.473+0000 7f60b3fff640 1 -- 172.21.15.18:0/1594753881 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f60bc086a00 con 0x7f60cc15d470 2024-04-17T19:53:24.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.473+0000 7f60caffd640 1 --2- 172.21.15.18:0/1594753881 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f60b8068380 0x7f60b806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:24.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.473+0000 7f60caffd640 1 --2- 172.21.15.18:0/1594753881 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f60b8068380 0x7f60b806a890 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f60cc0b5f30 tx=0x7f60c4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:24.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.477+0000 7f60b3fff640 1 -- 172.21.15.18:0/1594753881 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f60bc056bf0 con 0x7f60cc15d470 2024-04-17T19:53:24.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.629+0000 7f60d19ae640 1 -- 172.21.15.18:0/1594753881 --> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f60cc0cee70 con 0x7f60b8068380 2024-04-17T19:53:24.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.653+0000 7f60b3fff640 1 -- 172.21.15.18:0/1594753881 <== mgr.4104 v2:172.21.15.18:6832/751466605 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332558 (secure 0 0 0) 0x7f60cc0cee70 con 0x7f60b8068380 2024-04-17T19:53:24.655 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:53:24.657 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-17T19:53:24.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.661+0000 7f60d19ae640 1 -- 172.21.15.18:0/1594753881 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f60b8068380 msgr2=0x7f60b806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:24.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.661+0000 7f60d19ae640 1 --2- 172.21.15.18:0/1594753881 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f60b8068380 0x7f60b806a890 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f60cc0b5f30 tx=0x7f60c4009040 comp rx=0 tx=0).stop 2024-04-17T19:53:24.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.661+0000 7f60d19ae640 1 -- 172.21.15.18:0/1594753881 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f60cc15d470 msgr2=0x7f60cc1567c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:24.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.661+0000 7f60d19ae640 1 --2- 172.21.15.18:0/1594753881 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f60cc15d470 0x7f60cc1567c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f60bc00ca70 tx=0x7f60bc00cf30 comp rx=0 tx=0).stop 2024-04-17T19:53:24.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.661+0000 7f60d19ae640 1 -- 172.21.15.18:0/1594753881 shutdown_connections 2024-04-17T19:53:24.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.661+0000 7f60d19ae640 1 --2- 172.21.15.18:0/1594753881 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f60b8068380 0x7f60b806a890 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:24.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.661+0000 7f60d19ae640 1 --2- 172.21.15.18:0/1594753881 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f60cc15d470 0x7f60cc1567c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:24.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.661+0000 7f60d19ae640 1 --2- 172.21.15.18:0/1594753881 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f60cc15e1a0 0x7f60cc15cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:24.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.661+0000 7f60d19ae640 1 --2- 172.21.15.18:0/1594753881 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f60cc06cd60 0x7f60cc14c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:24.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.661+0000 7f60d19ae640 1 -- 172.21.15.18:0/1594753881 >> 172.21.15.18:0/1594753881 conn(0x7f60cc072bb0 msgr2=0x7f60cc14f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:24.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.661+0000 7f60d19ae640 1 -- 172.21.15.18:0/1594753881 shutdown_connections 2024-04-17T19:53:24.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.661+0000 7f60d19ae640 1 -- 172.21.15.18:0/1594753881 wait complete. 2024-04-17T19:53:24.675 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-04-17T19:53:24.348831+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236256,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738464,"statfs":{"total":773094113280,"available":772852187136,"internally_reserved":0,"allocated":3514368,"data_stored":2072296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":238276148},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005008"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.867881+0000","last_change":"2024-04-17T19:53:04.461184+0000","last_active":"2024-04-17T19:53:11.867881+0000","last_peered":"2024-04-17T19:53:11.867881+0000","last_clean":"2024-04-17T19:53:11.867881+0000","last_became_active":"2024-04-17T19:53:04.460006+0000","last_became_peered":"2024-04-17T19:53:04.460006+0000","last_unstale":"2024-04-17T19:53:11.867881+0000","last_undegraded":"2024-04-17T19:53:11.867881+0000","last_fullsized":"2024-04-17T19:53:11.867881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:23:02.868468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.495714+0000","last_change":"2024-04-17T19:53:05.474006+0000","last_active":"2024-04-17T19:53:10.495714+0000","last_peered":"2024-04-17T19:53:10.495714+0000","last_clean":"2024-04-17T19:53:10.495714+0000","last_became_active":"2024-04-17T19:53:05.467848+0000","last_became_peered":"2024-04-17T19:53:05.467848+0000","last_unstale":"2024-04-17T19:53:10.495714+0000","last_undegraded":"2024-04-17T19:53:10.495714+0000","last_fullsized":"2024-04-17T19:53:10.495714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:05:21.173050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.779378+0000","last_change":"2024-04-17T19:53:09.559397+0000","last_active":"2024-04-17T19:53:10.779378+0000","last_peered":"2024-04-17T19:53:10.779378+0000","last_clean":"2024-04-17T19:53:10.779378+0000","last_became_active":"2024-04-17T19:53:09.558504+0000","last_became_peered":"2024-04-17T19:53:09.558504+0000","last_unstale":"2024-04-17T19:53:10.779378+0000","last_undegraded":"2024-04-17T19:53:10.779378+0000","last_fullsized":"2024-04-17T19:53:10.779378+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:06:18.745394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.496229+0000","last_change":"2024-04-17T19:53:04.484961+0000","last_active":"2024-04-17T19:53:10.496229+0000","last_peered":"2024-04-17T19:53:10.496229+0000","last_clean":"2024-04-17T19:53:10.496229+0000","last_became_active":"2024-04-17T19:53:04.468291+0000","last_became_peered":"2024-04-17T19:53:04.468291+0000","last_unstale":"2024-04-17T19:53:10.496229+0000","last_undegraded":"2024-04-17T19:53:10.496229+0000","last_fullsized":"2024-04-17T19:53:10.496229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:06:00.469757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.494707+0000","last_change":"2024-04-17T19:53:05.475578+0000","last_active":"2024-04-17T19:53:10.494707+0000","last_peered":"2024-04-17T19:53:10.494707+0000","last_clean":"2024-04-17T19:53:10.494707+0000","last_became_active":"2024-04-17T19:53:05.473678+0000","last_became_peered":"2024-04-17T19:53:05.473678+0000","last_unstale":"2024-04-17T19:53:10.494707+0000","last_undegraded":"2024-04-17T19:53:10.494707+0000","last_fullsized":"2024-04-17T19:53:10.494707+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:47:05.354826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.863354+0000","last_change":"2024-04-17T19:53:09.545180+0000","last_active":"2024-04-17T19:53:11.863354+0000","last_peered":"2024-04-17T19:53:11.863354+0000","last_clean":"2024-04-17T19:53:11.863354+0000","last_became_active":"2024-04-17T19:53:09.544580+0000","last_became_peered":"2024-04-17T19:53:09.544580+0000","last_unstale":"2024-04-17T19:53:11.863354+0000","last_undegraded":"2024-04-17T19:53:11.863354+0000","last_fullsized":"2024-04-17T19:53:11.863354+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:02:44.844970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.529583+0000","last_change":"2024-04-17T19:53:04.468009+0000","last_active":"2024-04-17T19:53:10.529583+0000","last_peered":"2024-04-17T19:53:10.529583+0000","last_clean":"2024-04-17T19:53:10.529583+0000","last_became_active":"2024-04-17T19:53:04.467568+0000","last_became_peered":"2024-04-17T19:53:04.467568+0000","last_unstale":"2024-04-17T19:53:10.529583+0000","last_undegraded":"2024-04-17T19:53:10.529583+0000","last_fullsized":"2024-04-17T19:53:10.529583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:18:11.256327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.528343+0000","last_change":"2024-04-17T19:53:05.464961+0000","last_active":"2024-04-17T19:53:11.528343+0000","last_peered":"2024-04-17T19:53:11.528343+0000","last_clean":"2024-04-17T19:53:11.528343+0000","last_became_active":"2024-04-17T19:53:05.464601+0000","last_became_peered":"2024-04-17T19:53:05.464601+0000","last_unstale":"2024-04-17T19:53:11.528343+0000","last_undegraded":"2024-04-17T19:53:11.528343+0000","last_fullsized":"2024-04-17T19:53:11.528343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:12:03.449509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.863767+0000","last_change":"2024-04-17T19:53:09.529447+0000","last_active":"2024-04-17T19:53:11.863767+0000","last_peered":"2024-04-17T19:53:11.863767+0000","last_clean":"2024-04-17T19:53:11.863767+0000","last_became_active":"2024-04-17T19:53:09.528285+0000","last_became_peered":"2024-04-17T19:53:09.528285+0000","last_unstale":"2024-04-17T19:53:11.863767+0000","last_undegraded":"2024-04-17T19:53:11.863767+0000","last_fullsized":"2024-04-17T19:53:11.863767+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:47:09.400433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.529734+0000","last_change":"2024-04-17T19:53:04.467639+0000","last_active":"2024-04-17T19:53:10.529734+0000","last_peered":"2024-04-17T19:53:10.529734+0000","last_clean":"2024-04-17T19:53:10.529734+0000","last_became_active":"2024-04-17T19:53:04.467004+0000","last_became_peered":"2024-04-17T19:53:04.467004+0000","last_unstale":"2024-04-17T19:53:10.529734+0000","last_undegraded":"2024-04-17T19:53:10.529734+0000","last_fullsized":"2024-04-17T19:53:10.529734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:38:40.499868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.492819+0000","last_change":"2024-04-17T19:53:05.468179+0000","last_active":"2024-04-17T19:53:10.492819+0000","last_peered":"2024-04-17T19:53:10.492819+0000","last_clean":"2024-04-17T19:53:10.492819+0000","last_became_active":"2024-04-17T19:53:05.467217+0000","last_became_peered":"2024-04-17T19:53:05.467217+0000","last_unstale":"2024-04-17T19:53:10.492819+0000","last_undegraded":"2024-04-17T19:53:10.492819+0000","last_fullsized":"2024-04-17T19:53:10.492819+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:29:50.290114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.863352+0000","last_change":"2024-04-17T19:53:09.549722+0000","last_active":"2024-04-17T19:53:11.863352+0000","last_peered":"2024-04-17T19:53:11.863352+0000","last_clean":"2024-04-17T19:53:11.863352+0000","last_became_active":"2024-04-17T19:53:09.548876+0000","last_became_peered":"2024-04-17T19:53:09.548876+0000","last_unstale":"2024-04-17T19:53:11.863352+0000","last_undegraded":"2024-04-17T19:53:11.863352+0000","last_fullsized":"2024-04-17T19:53:11.863352+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:15:49.773156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.491904+0000","last_change":"2024-04-17T19:53:05.475996+0000","last_active":"2024-04-17T19:53:10.491904+0000","last_peered":"2024-04-17T19:53:10.491904+0000","last_clean":"2024-04-17T19:53:10.491904+0000","last_became_active":"2024-04-17T19:53:05.475517+0000","last_became_peered":"2024-04-17T19:53:05.475517+0000","last_unstale":"2024-04-17T19:53:10.491904+0000","last_undegraded":"2024-04-17T19:53:10.491904+0000","last_fullsized":"2024-04-17T19:53:10.491904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:39:47.272961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.492869+0000","last_change":"2024-04-17T19:53:04.465884+0000","last_active":"2024-04-17T19:53:10.492869+0000","last_peered":"2024-04-17T19:53:10.492869+0000","last_clean":"2024-04-17T19:53:10.492869+0000","last_became_active":"2024-04-17T19:53:04.465108+0000","last_became_peered":"2024-04-17T19:53:04.465108+0000","last_unstale":"2024-04-17T19:53:10.492869+0000","last_undegraded":"2024-04-17T19:53:10.492869+0000","last_fullsized":"2024-04-17T19:53:10.492869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:23:02.868468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.492043+0000","last_change":"2024-04-17T19:53:09.545287+0000","last_active":"2024-04-17T19:53:10.492043+0000","last_peered":"2024-04-17T19:53:10.492043+0000","last_clean":"2024-04-17T19:53:10.492043+0000","last_became_active":"2024-04-17T19:53:09.544328+0000","last_became_peered":"2024-04-17T19:53:09.544328+0000","last_unstale":"2024-04-17T19:53:10.492043+0000","last_undegraded":"2024-04-17T19:53:10.492043+0000","last_fullsized":"2024-04-17T19:53:10.492043+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:47:26.887721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.779852+0000","last_change":"2024-04-17T19:53:05.496585+0000","last_active":"2024-04-17T19:53:10.779852+0000","last_peered":"2024-04-17T19:53:10.779852+0000","last_clean":"2024-04-17T19:53:10.779852+0000","last_became_active":"2024-04-17T19:53:05.495800+0000","last_became_peered":"2024-04-17T19:53:05.495800+0000","last_unstale":"2024-04-17T19:53:10.779852+0000","last_undegraded":"2024-04-17T19:53:10.779852+0000","last_fullsized":"2024-04-17T19:53:10.779852+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:18:12.267644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.496900+0000","last_change":"2024-04-17T19:53:04.479274+0000","last_active":"2024-04-17T19:53:10.496900+0000","last_peered":"2024-04-17T19:53:10.496900+0000","last_clean":"2024-04-17T19:53:10.496900+0000","last_became_active":"2024-04-17T19:53:04.478425+0000","last_became_peered":"2024-04-17T19:53:04.478425+0000","last_unstale":"2024-04-17T19:53:10.496900+0000","last_undegraded":"2024-04-17T19:53:10.496900+0000","last_fullsized":"2024-04-17T19:53:10.496900+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:16:15.623557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.529101+0000","last_change":"2024-04-17T19:53:09.526995+0000","last_active":"2024-04-17T19:53:10.529101+0000","last_peered":"2024-04-17T19:53:10.529101+0000","last_clean":"2024-04-17T19:53:10.529101+0000","last_became_active":"2024-04-17T19:53:09.525577+0000","last_became_peered":"2024-04-17T19:53:09.525577+0000","last_unstale":"2024-04-17T19:53:10.529101+0000","last_undegraded":"2024-04-17T19:53:10.529101+0000","last_fullsized":"2024-04-17T19:53:10.529101+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:52:59.924361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.866027+0000","last_change":"2024-04-17T19:53:05.463312+0000","last_active":"2024-04-17T19:53:11.866027+0000","last_peered":"2024-04-17T19:53:11.866027+0000","last_clean":"2024-04-17T19:53:11.866027+0000","last_became_active":"2024-04-17T19:53:05.462415+0000","last_became_peered":"2024-04-17T19:53:05.462415+0000","last_unstale":"2024-04-17T19:53:11.866027+0000","last_undegraded":"2024-04-17T19:53:11.866027+0000","last_fullsized":"2024-04-17T19:53:11.866027+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:27:51.520335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.867287+0000","last_change":"2024-04-17T19:53:04.471150+0000","last_active":"2024-04-17T19:53:11.867287+0000","last_peered":"2024-04-17T19:53:11.867287+0000","last_clean":"2024-04-17T19:53:11.867287+0000","last_became_active":"2024-04-17T19:53:04.470258+0000","last_became_peered":"2024-04-17T19:53:04.470258+0000","last_unstale":"2024-04-17T19:53:11.867287+0000","last_undegraded":"2024-04-17T19:53:11.867287+0000","last_fullsized":"2024-04-17T19:53:11.867287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:06:00.469757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.780980+0000","last_change":"2024-04-17T19:53:09.565387+0000","last_active":"2024-04-17T19:53:10.780980+0000","last_peered":"2024-04-17T19:53:10.780980+0000","last_clean":"2024-04-17T19:53:10.780980+0000","last_became_active":"2024-04-17T19:53:09.564134+0000","last_became_peered":"2024-04-17T19:53:09.564134+0000","last_unstale":"2024-04-17T19:53:10.780980+0000","last_undegraded":"2024-04-17T19:53:10.780980+0000","last_fullsized":"2024-04-17T19:53:10.780980+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:21:01.809464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.491285+0000","last_change":"2024-04-17T19:53:05.468962+0000","last_active":"2024-04-17T19:53:10.491285+0000","last_peered":"2024-04-17T19:53:10.491285+0000","last_clean":"2024-04-17T19:53:10.491285+0000","last_became_active":"2024-04-17T19:53:05.466996+0000","last_became_peered":"2024-04-17T19:53:05.466996+0000","last_unstale":"2024-04-17T19:53:10.491285+0000","last_undegraded":"2024-04-17T19:53:10.491285+0000","last_fullsized":"2024-04-17T19:53:10.491285+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:04:55.125411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.528304+0000","last_change":"2024-04-17T19:53:04.472916+0000","last_active":"2024-04-17T19:53:10.528304+0000","last_peered":"2024-04-17T19:53:10.528304+0000","last_clean":"2024-04-17T19:53:10.528304+0000","last_became_active":"2024-04-17T19:53:04.468136+0000","last_became_peered":"2024-04-17T19:53:04.468136+0000","last_unstale":"2024-04-17T19:53:10.528304+0000","last_undegraded":"2024-04-17T19:53:10.528304+0000","last_fullsized":"2024-04-17T19:53:10.528304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:23:02.868468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.864193+0000","last_change":"2024-04-17T19:53:09.558352+0000","last_active":"2024-04-17T19:53:11.864193+0000","last_peered":"2024-04-17T19:53:11.864193+0000","last_clean":"2024-04-17T19:53:11.864193+0000","last_became_active":"2024-04-17T19:53:09.557871+0000","last_became_peered":"2024-04-17T19:53:09.557871+0000","last_unstale":"2024-04-17T19:53:11.864193+0000","last_undegraded":"2024-04-17T19:53:11.864193+0000","last_fullsized":"2024-04-17T19:53:11.864193+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:34:07.690034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.867320+0000","last_change":"2024-04-17T19:53:05.467799+0000","last_active":"2024-04-17T19:53:11.867320+0000","last_peered":"2024-04-17T19:53:11.867320+0000","last_clean":"2024-04-17T19:53:11.867320+0000","last_became_active":"2024-04-17T19:53:05.465048+0000","last_became_peered":"2024-04-17T19:53:05.465048+0000","last_unstale":"2024-04-17T19:53:11.867320+0000","last_undegraded":"2024-04-17T19:53:11.867320+0000","last_fullsized":"2024-04-17T19:53:11.867320+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:19:09.456602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.494989+0000","last_change":"2024-04-17T19:53:04.469594+0000","last_active":"2024-04-17T19:53:10.494989+0000","last_peered":"2024-04-17T19:53:10.494989+0000","last_clean":"2024-04-17T19:53:10.494989+0000","last_became_active":"2024-04-17T19:53:04.469119+0000","last_became_peered":"2024-04-17T19:53:04.469119+0000","last_unstale":"2024-04-17T19:53:10.494989+0000","last_undegraded":"2024-04-17T19:53:10.494989+0000","last_fullsized":"2024-04-17T19:53:10.494989+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:40:30.547343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.863355+0000","last_change":"2024-04-17T19:53:09.527277+0000","last_active":"2024-04-17T19:53:11.863355+0000","last_peered":"2024-04-17T19:53:11.863355+0000","last_clean":"2024-04-17T19:53:11.863355+0000","last_became_active":"2024-04-17T19:53:09.526436+0000","last_became_peered":"2024-04-17T19:53:09.526436+0000","last_unstale":"2024-04-17T19:53:11.863355+0000","last_undegraded":"2024-04-17T19:53:11.863355+0000","last_fullsized":"2024-04-17T19:53:11.863355+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:54:31.569576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.867699+0000","last_change":"2024-04-17T19:53:05.443712+0000","last_active":"2024-04-17T19:53:11.867699+0000","last_peered":"2024-04-17T19:53:11.867699+0000","last_clean":"2024-04-17T19:53:11.867699+0000","last_became_active":"2024-04-17T19:53:05.442881+0000","last_became_peered":"2024-04-17T19:53:05.442881+0000","last_unstale":"2024-04-17T19:53:11.867699+0000","last_undegraded":"2024-04-17T19:53:11.867699+0000","last_fullsized":"2024-04-17T19:53:11.867699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:20:57.763858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.867688+0000","last_change":"2024-04-17T19:53:04.465717+0000","last_active":"2024-04-17T19:53:11.867688+0000","last_peered":"2024-04-17T19:53:11.867688+0000","last_clean":"2024-04-17T19:53:11.867688+0000","last_became_active":"2024-04-17T19:53:04.464701+0000","last_became_peered":"2024-04-17T19:53:04.464701+0000","last_unstale":"2024-04-17T19:53:11.867688+0000","last_undegraded":"2024-04-17T19:53:11.867688+0000","last_fullsized":"2024-04-17T19:53:11.867688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:18:11.256327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.866220+0000","last_change":"2024-04-17T19:53:09.530585+0000","last_active":"2024-04-17T19:53:11.866220+0000","last_peered":"2024-04-17T19:53:11.866220+0000","last_clean":"2024-04-17T19:53:11.866220+0000","last_became_active":"2024-04-17T19:53:09.529345+0000","last_became_peered":"2024-04-17T19:53:09.529345+0000","last_unstale":"2024-04-17T19:53:11.866220+0000","last_undegraded":"2024-04-17T19:53:11.866220+0000","last_fullsized":"2024-04-17T19:53:11.866220+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:01:38.507428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.497866+0000","last_change":"2024-04-17T19:53:05.452177+0000","last_active":"2024-04-17T19:53:10.497866+0000","last_peered":"2024-04-17T19:53:10.497866+0000","last_clean":"2024-04-17T19:53:10.497866+0000","last_became_active":"2024-04-17T19:53:05.451272+0000","last_became_peered":"2024-04-17T19:53:05.451272+0000","last_unstale":"2024-04-17T19:53:10.497866+0000","last_undegraded":"2024-04-17T19:53:10.497866+0000","last_fullsized":"2024-04-17T19:53:10.497866+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:51:17.675125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.493390+0000","last_change":"2024-04-17T19:53:04.471944+0000","last_active":"2024-04-17T19:53:10.493390+0000","last_peered":"2024-04-17T19:53:10.493390+0000","last_clean":"2024-04-17T19:53:10.493390+0000","last_became_active":"2024-04-17T19:53:04.471458+0000","last_became_peered":"2024-04-17T19:53:04.471458+0000","last_unstale":"2024-04-17T19:53:10.493390+0000","last_undegraded":"2024-04-17T19:53:10.493390+0000","last_fullsized":"2024-04-17T19:53:10.493390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:12:02.438192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.495688+0000","last_change":"2024-04-17T19:53:09.549998+0000","last_active":"2024-04-17T19:53:10.495688+0000","last_peered":"2024-04-17T19:53:10.495688+0000","last_clean":"2024-04-17T19:53:10.495688+0000","last_became_active":"2024-04-17T19:53:09.548136+0000","last_became_peered":"2024-04-17T19:53:09.548136+0000","last_unstale":"2024-04-17T19:53:10.495688+0000","last_undegraded":"2024-04-17T19:53:10.495688+0000","last_fullsized":"2024-04-17T19:53:10.495688+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:02:14.459968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.863519+0000","last_change":"2024-04-17T19:53:05.472884+0000","last_active":"2024-04-17T19:53:11.863519+0000","last_peered":"2024-04-17T19:53:11.863519+0000","last_clean":"2024-04-17T19:53:11.863519+0000","last_became_active":"2024-04-17T19:53:05.472513+0000","last_became_peered":"2024-04-17T19:53:05.472513+0000","last_unstale":"2024-04-17T19:53:11.863519+0000","last_undegraded":"2024-04-17T19:53:11.863519+0000","last_fullsized":"2024-04-17T19:53:11.863519+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:21:37.163564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.493966+0000","last_change":"2024-04-17T19:53:04.487713+0000","last_active":"2024-04-17T19:53:10.493966+0000","last_peered":"2024-04-17T19:53:10.493966+0000","last_clean":"2024-04-17T19:53:10.493966+0000","last_became_active":"2024-04-17T19:53:04.487005+0000","last_became_peered":"2024-04-17T19:53:04.487005+0000","last_unstale":"2024-04-17T19:53:10.493966+0000","last_undegraded":"2024-04-17T19:53:10.493966+0000","last_fullsized":"2024-04-17T19:53:10.493966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:53:36.130201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.496249+0000","last_change":"2024-04-17T19:53:09.547824+0000","last_active":"2024-04-17T19:53:10.496249+0000","last_peered":"2024-04-17T19:53:10.496249+0000","last_clean":"2024-04-17T19:53:10.496249+0000","last_became_active":"2024-04-17T19:53:09.545636+0000","last_became_peered":"2024-04-17T19:53:09.545636+0000","last_unstale":"2024-04-17T19:53:10.496249+0000","last_undegraded":"2024-04-17T19:53:10.496249+0000","last_fullsized":"2024-04-17T19:53:10.496249+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:06:17.885652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.529514+0000","last_change":"2024-04-17T19:53:05.465820+0000","last_active":"2024-04-17T19:53:10.529514+0000","last_peered":"2024-04-17T19:53:10.529514+0000","last_clean":"2024-04-17T19:53:10.529514+0000","last_became_active":"2024-04-17T19:53:05.464376+0000","last_became_peered":"2024-04-17T19:53:05.464376+0000","last_unstale":"2024-04-17T19:53:10.529514+0000","last_undegraded":"2024-04-17T19:53:10.529514+0000","last_fullsized":"2024-04-17T19:53:10.529514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:53:13.956259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.492409+0000","last_change":"2024-04-17T19:53:04.464706+0000","last_active":"2024-04-17T19:53:10.492409+0000","last_peered":"2024-04-17T19:53:10.492409+0000","last_clean":"2024-04-17T19:53:10.492409+0000","last_became_active":"2024-04-17T19:53:04.464109+0000","last_became_peered":"2024-04-17T19:53:04.464109+0000","last_unstale":"2024-04-17T19:53:10.492409+0000","last_undegraded":"2024-04-17T19:53:10.492409+0000","last_fullsized":"2024-04-17T19:53:10.492409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:38:40.499868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.497647+0000","last_change":"2024-04-17T19:53:09.553078+0000","last_active":"2024-04-17T19:53:10.497647+0000","last_peered":"2024-04-17T19:53:10.497647+0000","last_clean":"2024-04-17T19:53:10.497647+0000","last_became_active":"2024-04-17T19:53:09.548806+0000","last_became_peered":"2024-04-17T19:53:09.548806+0000","last_unstale":"2024-04-17T19:53:10.497647+0000","last_undegraded":"2024-04-17T19:53:10.497647+0000","last_fullsized":"2024-04-17T19:53:10.497647+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:33:37.250066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.493540+0000","last_change":"2024-04-17T19:53:05.476631+0000","last_active":"2024-04-17T19:53:10.493540+0000","last_peered":"2024-04-17T19:53:10.493540+0000","last_clean":"2024-04-17T19:53:10.493540+0000","last_became_active":"2024-04-17T19:53:05.474164+0000","last_became_peered":"2024-04-17T19:53:05.474164+0000","last_unstale":"2024-04-17T19:53:10.493540+0000","last_undegraded":"2024-04-17T19:53:10.493540+0000","last_fullsized":"2024-04-17T19:53:10.493540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:53:13.956259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.779561+0000","last_change":"2024-04-17T19:53:04.486117+0000","last_active":"2024-04-17T19:53:10.779561+0000","last_peered":"2024-04-17T19:53:10.779561+0000","last_clean":"2024-04-17T19:53:10.779561+0000","last_became_active":"2024-04-17T19:53:04.485424+0000","last_became_peered":"2024-04-17T19:53:04.485424+0000","last_unstale":"2024-04-17T19:53:10.779561+0000","last_undegraded":"2024-04-17T19:53:10.779561+0000","last_fullsized":"2024-04-17T19:53:10.779561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:21:45.875274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.496364+0000","last_change":"2024-04-17T19:53:09.549846+0000","last_active":"2024-04-17T19:53:10.496364+0000","last_peered":"2024-04-17T19:53:10.496364+0000","last_clean":"2024-04-17T19:53:10.496364+0000","last_became_active":"2024-04-17T19:53:09.548070+0000","last_became_peered":"2024-04-17T19:53:09.548070+0000","last_unstale":"2024-04-17T19:53:10.496364+0000","last_undegraded":"2024-04-17T19:53:10.496364+0000","last_fullsized":"2024-04-17T19:53:10.496364+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:05.469665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.495415+0000","last_change":"2024-04-17T19:53:05.469993+0000","last_active":"2024-04-17T19:53:10.495415+0000","last_peered":"2024-04-17T19:53:10.495415+0000","last_clean":"2024-04-17T19:53:10.495415+0000","last_became_active":"2024-04-17T19:53:05.468241+0000","last_became_peered":"2024-04-17T19:53:05.468241+0000","last_unstale":"2024-04-17T19:53:10.495415+0000","last_undegraded":"2024-04-17T19:53:10.495415+0000","last_fullsized":"2024-04-17T19:53:10.495415+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:39:15.005822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.491765+0000","last_change":"2024-04-17T19:53:04.484259+0000","last_active":"2024-04-17T19:53:10.491765+0000","last_peered":"2024-04-17T19:53:10.491765+0000","last_clean":"2024-04-17T19:53:10.491765+0000","last_became_active":"2024-04-17T19:53:04.483882+0000","last_became_peered":"2024-04-17T19:53:04.483882+0000","last_unstale":"2024-04-17T19:53:10.491765+0000","last_undegraded":"2024-04-17T19:53:10.491765+0000","last_fullsized":"2024-04-17T19:53:10.491765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:18:11.256327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.495038+0000","last_change":"2024-04-17T19:53:09.559932+0000","last_active":"2024-04-17T19:53:10.495038+0000","last_peered":"2024-04-17T19:53:10.495038+0000","last_clean":"2024-04-17T19:53:10.495038+0000","last_became_active":"2024-04-17T19:53:09.558888+0000","last_became_peered":"2024-04-17T19:53:09.558888+0000","last_unstale":"2024-04-17T19:53:10.495038+0000","last_undegraded":"2024-04-17T19:53:10.495038+0000","last_fullsized":"2024-04-17T19:53:10.495038+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:22:59.388953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.866936+0000","last_change":"2024-04-17T19:53:05.463658+0000","last_active":"2024-04-17T19:53:11.866936+0000","last_peered":"2024-04-17T19:53:11.866936+0000","last_clean":"2024-04-17T19:53:11.866936+0000","last_became_active":"2024-04-17T19:53:05.462437+0000","last_became_peered":"2024-04-17T19:53:05.462437+0000","last_unstale":"2024-04-17T19:53:11.866936+0000","last_undegraded":"2024-04-17T19:53:11.866936+0000","last_fullsized":"2024-04-17T19:53:11.866936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:06:14.699788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.492615+0000","last_change":"2024-04-17T19:53:04.459172+0000","last_active":"2024-04-17T19:53:10.492615+0000","last_peered":"2024-04-17T19:53:10.492615+0000","last_clean":"2024-04-17T19:53:10.492615+0000","last_became_active":"2024-04-17T19:53:04.458798+0000","last_became_peered":"2024-04-17T19:53:04.458798+0000","last_unstale":"2024-04-17T19:53:10.492615+0000","last_undegraded":"2024-04-17T19:53:10.492615+0000","last_fullsized":"2024-04-17T19:53:10.492615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:21:36.152247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":177,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.527066+0000","last_change":"2024-04-17T19:52:54.651873+0000","last_active":"2024-04-17T19:53:11.527066+0000","last_peered":"2024-04-17T19:53:11.527066+0000","last_clean":"2024-04-17T19:53:11.527066+0000","last_became_active":"2024-04-17T19:52:54.649700+0000","last_became_peered":"2024-04-17T19:52:54.649700+0000","last_unstale":"2024-04-17T19:53:11.527066+0000","last_undegraded":"2024-04-17T19:53:11.527066+0000","last_fullsized":"2024-04-17T19:53:11.527066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:52:53.245174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:52:53.245174+0000","last_clean_scrub_stamp":"2024-04-17T19:52:53.245174+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:26:16.094093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.493284+0000","last_change":"2024-04-17T19:53:09.520288+0000","last_active":"2024-04-17T19:53:10.493284+0000","last_peered":"2024-04-17T19:53:10.493284+0000","last_clean":"2024-04-17T19:53:10.493284+0000","last_became_active":"2024-04-17T19:53:09.519226+0000","last_became_peered":"2024-04-17T19:53:09.519226+0000","last_unstale":"2024-04-17T19:53:10.493284+0000","last_undegraded":"2024-04-17T19:53:10.493284+0000","last_fullsized":"2024-04-17T19:53:10.493284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:35:04.617369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.492930+0000","last_change":"2024-04-17T19:53:05.475968+0000","last_active":"2024-04-17T19:53:10.492930+0000","last_peered":"2024-04-17T19:53:10.492930+0000","last_clean":"2024-04-17T19:53:10.492930+0000","last_became_active":"2024-04-17T19:53:05.475600+0000","last_became_peered":"2024-04-17T19:53:05.475600+0000","last_unstale":"2024-04-17T19:53:10.492930+0000","last_undegraded":"2024-04-17T19:53:10.492930+0000","last_fullsized":"2024-04-17T19:53:10.492930+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:34:03.644428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.497904+0000","last_change":"2024-04-17T19:53:04.457214+0000","last_active":"2024-04-17T19:53:10.497904+0000","last_peered":"2024-04-17T19:53:10.497904+0000","last_clean":"2024-04-17T19:53:10.497904+0000","last_became_active":"2024-04-17T19:53:04.453473+0000","last_became_peered":"2024-04-17T19:53:04.453473+0000","last_unstale":"2024-04-17T19:53:10.497904+0000","last_undegraded":"2024-04-17T19:53:10.497904+0000","last_fullsized":"2024-04-17T19:53:10.497904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:14:03.008171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.863346+0000","last_change":"2024-04-17T19:53:09.548981+0000","last_active":"2024-04-17T19:53:11.863346+0000","last_peered":"2024-04-17T19:53:11.863346+0000","last_clean":"2024-04-17T19:53:11.863346+0000","last_became_active":"2024-04-17T19:53:09.548575+0000","last_became_peered":"2024-04-17T19:53:09.548575+0000","last_unstale":"2024-04-17T19:53:11.863346+0000","last_undegraded":"2024-04-17T19:53:11.863346+0000","last_fullsized":"2024-04-17T19:53:11.863346+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:05:25.218656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.529559+0000","last_change":"2024-04-17T19:53:05.464697+0000","last_active":"2024-04-17T19:53:10.529559+0000","last_peered":"2024-04-17T19:53:10.529559+0000","last_clean":"2024-04-17T19:53:10.529559+0000","last_became_active":"2024-04-17T19:53:05.463935+0000","last_became_peered":"2024-04-17T19:53:05.463935+0000","last_unstale":"2024-04-17T19:53:10.529559+0000","last_undegraded":"2024-04-17T19:53:10.529559+0000","last_fullsized":"2024-04-17T19:53:10.529559+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:15:45.727550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.494522+0000","last_change":"2024-04-17T19:53:04.475555+0000","last_active":"2024-04-17T19:53:10.494522+0000","last_peered":"2024-04-17T19:53:10.494522+0000","last_clean":"2024-04-17T19:53:10.494522+0000","last_became_active":"2024-04-17T19:53:04.467881+0000","last_became_peered":"2024-04-17T19:53:04.467881+0000","last_unstale":"2024-04-17T19:53:10.494522+0000","last_undegraded":"2024-04-17T19:53:10.494522+0000","last_fullsized":"2024-04-17T19:53:10.494522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:22:17.837334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.494205+0000","last_change":"2024-04-17T19:53:09.535560+0000","last_active":"2024-04-17T19:53:10.494205+0000","last_peered":"2024-04-17T19:53:10.494205+0000","last_clean":"2024-04-17T19:53:10.494205+0000","last_became_active":"2024-04-17T19:53:09.534631+0000","last_became_peered":"2024-04-17T19:53:09.534631+0000","last_unstale":"2024-04-17T19:53:10.494205+0000","last_undegraded":"2024-04-17T19:53:10.494205+0000","last_fullsized":"2024-04-17T19:53:10.494205+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:30:27.062045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.530016+0000","last_change":"2024-04-17T19:53:05.460324+0000","last_active":"2024-04-17T19:53:10.530016+0000","last_peered":"2024-04-17T19:53:10.530016+0000","last_clean":"2024-04-17T19:53:10.530016+0000","last_became_active":"2024-04-17T19:53:05.459941+0000","last_became_peered":"2024-04-17T19:53:05.459941+0000","last_unstale":"2024-04-17T19:53:10.530016+0000","last_undegraded":"2024-04-17T19:53:10.530016+0000","last_fullsized":"2024-04-17T19:53:10.530016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:34:03.644428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.867646+0000","last_change":"2024-04-17T19:53:04.467765+0000","last_active":"2024-04-17T19:53:11.867646+0000","last_peered":"2024-04-17T19:53:11.867646+0000","last_clean":"2024-04-17T19:53:11.867646+0000","last_became_active":"2024-04-17T19:53:04.466753+0000","last_became_peered":"2024-04-17T19:53:04.466753+0000","last_unstale":"2024-04-17T19:53:11.867646+0000","last_undegraded":"2024-04-17T19:53:11.867646+0000","last_fullsized":"2024-04-17T19:53:11.867646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:53:36.130201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.491139+0000","last_change":"2024-04-17T19:53:09.519632+0000","last_active":"2024-04-17T19:53:10.491139+0000","last_peered":"2024-04-17T19:53:10.491139+0000","last_clean":"2024-04-17T19:53:10.491139+0000","last_became_active":"2024-04-17T19:53:09.518979+0000","last_became_peered":"2024-04-17T19:53:09.518979+0000","last_unstale":"2024-04-17T19:53:10.491139+0000","last_undegraded":"2024-04-17T19:53:10.491139+0000","last_fullsized":"2024-04-17T19:53:10.491139+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:07:11.268705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.864298+0000","last_change":"2024-04-17T19:53:05.464583+0000","last_active":"2024-04-17T19:53:11.864298+0000","last_peered":"2024-04-17T19:53:11.864298+0000","last_clean":"2024-04-17T19:53:11.864298+0000","last_became_active":"2024-04-17T19:53:05.464158+0000","last_became_peered":"2024-04-17T19:53:05.464158+0000","last_unstale":"2024-04-17T19:53:11.864298+0000","last_undegraded":"2024-04-17T19:53:11.864298+0000","last_fullsized":"2024-04-17T19:53:11.864298+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:38:41.511185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.530315+0000","last_change":"2024-04-17T19:53:04.477502+0000","last_active":"2024-04-17T19:53:10.530315+0000","last_peered":"2024-04-17T19:53:10.530315+0000","last_clean":"2024-04-17T19:53:10.530315+0000","last_became_active":"2024-04-17T19:53:04.477162+0000","last_became_peered":"2024-04-17T19:53:04.477162+0000","last_unstale":"2024-04-17T19:53:10.530315+0000","last_undegraded":"2024-04-17T19:53:10.530315+0000","last_fullsized":"2024-04-17T19:53:10.530315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:21:36.152247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.528690+0000","last_change":"2024-04-17T19:53:09.533476+0000","last_active":"2024-04-17T19:53:11.528690+0000","last_peered":"2024-04-17T19:53:11.528690+0000","last_clean":"2024-04-17T19:53:11.528690+0000","last_became_active":"2024-04-17T19:53:09.532715+0000","last_became_peered":"2024-04-17T19:53:09.532715+0000","last_unstale":"2024-04-17T19:53:11.528690+0000","last_undegraded":"2024-04-17T19:53:11.528690+0000","last_fullsized":"2024-04-17T19:53:11.528690+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:38:45.556791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.491188+0000","last_change":"2024-04-17T19:53:05.473330+0000","last_active":"2024-04-17T19:53:10.491188+0000","last_peered":"2024-04-17T19:53:10.491188+0000","last_clean":"2024-04-17T19:53:10.491188+0000","last_became_active":"2024-04-17T19:53:05.468223+0000","last_became_peered":"2024-04-17T19:53:05.468223+0000","last_unstale":"2024-04-17T19:53:10.491188+0000","last_undegraded":"2024-04-17T19:53:10.491188+0000","last_fullsized":"2024-04-17T19:53:10.491188+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:01:34.461822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.866359+0000","last_change":"2024-04-17T19:53:04.461896+0000","last_active":"2024-04-17T19:53:11.866359+0000","last_peered":"2024-04-17T19:53:11.866359+0000","last_clean":"2024-04-17T19:53:11.866359+0000","last_became_active":"2024-04-17T19:53:04.460919+0000","last_became_peered":"2024-04-17T19:53:04.460919+0000","last_unstale":"2024-04-17T19:53:11.866359+0000","last_undegraded":"2024-04-17T19:53:11.866359+0000","last_fullsized":"2024-04-17T19:53:11.866359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:22:17.837334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.495547+0000","last_change":"2024-04-17T19:53:09.547397+0000","last_active":"2024-04-17T19:53:10.495547+0000","last_peered":"2024-04-17T19:53:10.495547+0000","last_clean":"2024-04-17T19:53:10.495547+0000","last_became_active":"2024-04-17T19:53:09.546048+0000","last_became_peered":"2024-04-17T19:53:09.546048+0000","last_unstale":"2024-04-17T19:53:10.495547+0000","last_undegraded":"2024-04-17T19:53:10.495547+0000","last_fullsized":"2024-04-17T19:53:10.495547+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:58:59.810415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.528039+0000","last_change":"2024-04-17T19:53:05.474322+0000","last_active":"2024-04-17T19:53:11.528039+0000","last_peered":"2024-04-17T19:53:11.528039+0000","last_clean":"2024-04-17T19:53:11.528039+0000","last_became_active":"2024-04-17T19:53:05.473892+0000","last_became_peered":"2024-04-17T19:53:05.473892+0000","last_unstale":"2024-04-17T19:53:11.528039+0000","last_undegraded":"2024-04-17T19:53:11.528039+0000","last_fullsized":"2024-04-17T19:53:11.528039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:18:12.267644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.528714+0000","last_change":"2024-04-17T19:53:04.460138+0000","last_active":"2024-04-17T19:53:10.528714+0000","last_peered":"2024-04-17T19:53:10.528714+0000","last_clean":"2024-04-17T19:53:10.528714+0000","last_became_active":"2024-04-17T19:53:04.459663+0000","last_became_peered":"2024-04-17T19:53:04.459663+0000","last_unstale":"2024-04-17T19:53:10.528714+0000","last_undegraded":"2024-04-17T19:53:10.528714+0000","last_fullsized":"2024-04-17T19:53:10.528714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:06:00.469757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.494889+0000","last_change":"2024-04-17T19:53:09.533802+0000","last_active":"2024-04-17T19:53:10.494889+0000","last_peered":"2024-04-17T19:53:10.494889+0000","last_clean":"2024-04-17T19:53:10.494889+0000","last_became_active":"2024-04-17T19:53:09.532504+0000","last_became_peered":"2024-04-17T19:53:09.532504+0000","last_unstale":"2024-04-17T19:53:10.494889+0000","last_undegraded":"2024-04-17T19:53:10.494889+0000","last_fullsized":"2024-04-17T19:53:10.494889+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:04:59.171017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.492057+0000","last_change":"2024-04-17T19:53:05.467855+0000","last_active":"2024-04-17T19:53:10.492057+0000","last_peered":"2024-04-17T19:53:10.492057+0000","last_clean":"2024-04-17T19:53:10.492057+0000","last_became_active":"2024-04-17T19:53:05.467349+0000","last_became_peered":"2024-04-17T19:53:05.467349+0000","last_unstale":"2024-04-17T19:53:10.492057+0000","last_undegraded":"2024-04-17T19:53:10.492057+0000","last_fullsized":"2024-04-17T19:53:10.492057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:52:55.878755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.492398+0000","last_change":"2024-04-17T19:53:04.465826+0000","last_active":"2024-04-17T19:53:10.492398+0000","last_peered":"2024-04-17T19:53:10.492398+0000","last_clean":"2024-04-17T19:53:10.492398+0000","last_became_active":"2024-04-17T19:53:04.465333+0000","last_became_peered":"2024-04-17T19:53:04.465333+0000","last_unstale":"2024-04-17T19:53:10.492398+0000","last_undegraded":"2024-04-17T19:53:10.492398+0000","last_fullsized":"2024-04-17T19:53:10.492398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:25:21.542158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.497344+0000","last_change":"2024-04-17T19:53:09.550127+0000","last_active":"2024-04-17T19:53:10.497344+0000","last_peered":"2024-04-17T19:53:10.497344+0000","last_clean":"2024-04-17T19:53:10.497344+0000","last_became_active":"2024-04-17T19:53:09.548109+0000","last_became_peered":"2024-04-17T19:53:09.548109+0000","last_unstale":"2024-04-17T19:53:10.497344+0000","last_undegraded":"2024-04-17T19:53:10.497344+0000","last_fullsized":"2024-04-17T19:53:10.497344+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:03:47.252621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.496697+0000","last_change":"2024-04-17T19:53:05.455185+0000","last_active":"2024-04-17T19:53:10.496697+0000","last_peered":"2024-04-17T19:53:10.496697+0000","last_clean":"2024-04-17T19:53:10.496697+0000","last_became_active":"2024-04-17T19:53:05.454358+0000","last_became_peered":"2024-04-17T19:53:05.454358+0000","last_unstale":"2024-04-17T19:53:10.496697+0000","last_undegraded":"2024-04-17T19:53:10.496697+0000","last_fullsized":"2024-04-17T19:53:10.496697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:26:54.093651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.780019+0000","last_change":"2024-04-17T19:53:04.474288+0000","last_active":"2024-04-17T19:53:10.780019+0000","last_peered":"2024-04-17T19:53:10.780019+0000","last_clean":"2024-04-17T19:53:10.780019+0000","last_became_active":"2024-04-17T19:53:04.473389+0000","last_became_peered":"2024-04-17T19:53:04.473389+0000","last_unstale":"2024-04-17T19:53:10.780019+0000","last_undegraded":"2024-04-17T19:53:10.780019+0000","last_fullsized":"2024-04-17T19:53:10.780019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:31:27.754909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.492763+0000","last_change":"2024-04-17T19:53:09.524630+0000","last_active":"2024-04-17T19:53:10.492763+0000","last_peered":"2024-04-17T19:53:10.492763+0000","last_clean":"2024-04-17T19:53:10.492763+0000","last_became_active":"2024-04-17T19:53:09.521522+0000","last_became_peered":"2024-04-17T19:53:09.521522+0000","last_unstale":"2024-04-17T19:53:10.492763+0000","last_undegraded":"2024-04-17T19:53:10.492763+0000","last_fullsized":"2024-04-17T19:53:10.492763+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:59:47.402073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.529373+0000","last_change":"2024-04-17T19:53:05.455865+0000","last_active":"2024-04-17T19:53:10.529373+0000","last_peered":"2024-04-17T19:53:10.529373+0000","last_clean":"2024-04-17T19:53:10.529373+0000","last_became_active":"2024-04-17T19:53:05.455429+0000","last_became_peered":"2024-04-17T19:53:05.455429+0000","last_unstale":"2024-04-17T19:53:10.529373+0000","last_undegraded":"2024-04-17T19:53:10.529373+0000","last_fullsized":"2024-04-17T19:53:10.529373+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:01:34.461822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'10","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:20.688890+0000","last_change":"2024-04-17T19:53:04.460295+0000","last_active":"2024-04-17T19:53:20.688890+0000","last_peered":"2024-04-17T19:53:20.688890+0000","last_clean":"2024-04-17T19:53:20.688890+0000","last_became_active":"2024-04-17T19:53:04.459855+0000","last_became_peered":"2024-04-17T19:53:04.459855+0000","last_unstale":"2024-04-17T19:53:20.688890+0000","last_undegraded":"2024-04-17T19:53:20.688890+0000","last_fullsized":"2024-04-17T19:53:20.688890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:21:45.875274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.866367+0000","last_change":"2024-04-17T19:53:09.530008+0000","last_active":"2024-04-17T19:53:11.866367+0000","last_peered":"2024-04-17T19:53:11.866367+0000","last_clean":"2024-04-17T19:53:11.866367+0000","last_became_active":"2024-04-17T19:53:09.528987+0000","last_became_peered":"2024-04-17T19:53:09.528987+0000","last_unstale":"2024-04-17T19:53:11.866367+0000","last_undegraded":"2024-04-17T19:53:11.866367+0000","last_fullsized":"2024-04-17T19:53:11.866367+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:34:07.690034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.491729+0000","last_change":"2024-04-17T19:53:05.472755+0000","last_active":"2024-04-17T19:53:10.491729+0000","last_peered":"2024-04-17T19:53:10.491729+0000","last_clean":"2024-04-17T19:53:10.491729+0000","last_became_active":"2024-04-17T19:53:05.468432+0000","last_became_peered":"2024-04-17T19:53:05.468432+0000","last_unstale":"2024-04-17T19:53:10.491729+0000","last_undegraded":"2024-04-17T19:53:10.491729+0000","last_fullsized":"2024-04-17T19:53:10.491729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:30:23.016439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.780569+0000","last_change":"2024-04-17T19:53:04.474378+0000","last_active":"2024-04-17T19:53:10.780569+0000","last_peered":"2024-04-17T19:53:10.780569+0000","last_clean":"2024-04-17T19:53:10.780569+0000","last_became_active":"2024-04-17T19:53:04.473458+0000","last_became_peered":"2024-04-17T19:53:04.473458+0000","last_unstale":"2024-04-17T19:53:10.780569+0000","last_undegraded":"2024-04-17T19:53:10.780569+0000","last_fullsized":"2024-04-17T19:53:10.780569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:16:30.888573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.863832+0000","last_change":"2024-04-17T19:53:09.558527+0000","last_active":"2024-04-17T19:53:11.863832+0000","last_peered":"2024-04-17T19:53:11.863832+0000","last_clean":"2024-04-17T19:53:11.863832+0000","last_became_active":"2024-04-17T19:53:09.557653+0000","last_became_peered":"2024-04-17T19:53:09.557653+0000","last_unstale":"2024-04-17T19:53:11.863832+0000","last_undegraded":"2024-04-17T19:53:11.863832+0000","last_fullsized":"2024-04-17T19:53:11.863832+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:01:38.507428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.495008+0000","last_change":"2024-04-17T19:53:05.467990+0000","last_active":"2024-04-17T19:53:10.495008+0000","last_peered":"2024-04-17T19:53:10.495008+0000","last_clean":"2024-04-17T19:53:10.495008+0000","last_became_active":"2024-04-17T19:53:05.461293+0000","last_became_peered":"2024-04-17T19:53:05.461293+0000","last_unstale":"2024-04-17T19:53:10.495008+0000","last_undegraded":"2024-04-17T19:53:10.495008+0000","last_fullsized":"2024-04-17T19:53:10.495008+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:01:34.461822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.530046+0000","last_change":"2024-04-17T19:53:04.472928+0000","last_active":"2024-04-17T19:53:10.530046+0000","last_peered":"2024-04-17T19:53:10.530046+0000","last_clean":"2024-04-17T19:53:10.530046+0000","last_became_active":"2024-04-17T19:53:04.467986+0000","last_became_peered":"2024-04-17T19:53:04.467986+0000","last_unstale":"2024-04-17T19:53:10.530046+0000","last_undegraded":"2024-04-17T19:53:10.530046+0000","last_fullsized":"2024-04-17T19:53:10.530046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:53:36.130201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.779233+0000","last_change":"2024-04-17T19:53:09.560792+0000","last_active":"2024-04-17T19:53:10.779233+0000","last_peered":"2024-04-17T19:53:10.779233+0000","last_clean":"2024-04-17T19:53:10.779233+0000","last_became_active":"2024-04-17T19:53:09.558779+0000","last_became_peered":"2024-04-17T19:53:09.558779+0000","last_unstale":"2024-04-17T19:53:10.779233+0000","last_undegraded":"2024-04-17T19:53:10.779233+0000","last_fullsized":"2024-04-17T19:53:10.779233+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:13:52.775623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.864234+0000","last_change":"2024-04-17T19:53:05.459934+0000","last_active":"2024-04-17T19:53:11.864234+0000","last_peered":"2024-04-17T19:53:11.864234+0000","last_clean":"2024-04-17T19:53:11.864234+0000","last_became_active":"2024-04-17T19:53:05.459538+0000","last_became_peered":"2024-04-17T19:53:05.459538+0000","last_unstale":"2024-04-17T19:53:11.864234+0000","last_undegraded":"2024-04-17T19:53:11.864234+0000","last_fullsized":"2024-04-17T19:53:11.864234+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:25:22.553475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.529342+0000","last_change":"2024-04-17T19:53:04.460345+0000","last_active":"2024-04-17T19:53:11.529342+0000","last_peered":"2024-04-17T19:53:11.529342+0000","last_clean":"2024-04-17T19:53:11.529342+0000","last_became_active":"2024-04-17T19:53:04.459787+0000","last_became_peered":"2024-04-17T19:53:04.459787+0000","last_unstale":"2024-04-17T19:53:11.529342+0000","last_undegraded":"2024-04-17T19:53:11.529342+0000","last_fullsized":"2024-04-17T19:53:11.529342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:16:30.888573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.866660+0000","last_change":"2024-04-17T19:53:09.557144+0000","last_active":"2024-04-17T19:53:11.866660+0000","last_peered":"2024-04-17T19:53:11.866660+0000","last_clean":"2024-04-17T19:53:11.866660+0000","last_became_active":"2024-04-17T19:53:09.555953+0000","last_became_peered":"2024-04-17T19:53:09.555953+0000","last_unstale":"2024-04-17T19:53:11.866660+0000","last_undegraded":"2024-04-17T19:53:11.866660+0000","last_fullsized":"2024-04-17T19:53:11.866660+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:10:36.885109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.867320+0000","last_change":"2024-04-17T19:53:09.536930+0000","last_active":"2024-04-17T19:53:11.867320+0000","last_peered":"2024-04-17T19:53:11.867320+0000","last_clean":"2024-04-17T19:53:11.867320+0000","last_became_active":"2024-04-17T19:53:09.535559+0000","last_became_peered":"2024-04-17T19:53:09.535559+0000","last_unstale":"2024-04-17T19:53:11.867320+0000","last_undegraded":"2024-04-17T19:53:11.867320+0000","last_fullsized":"2024-04-17T19:53:11.867320+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:29:54.335720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.867019+0000","last_change":"2024-04-17T19:53:05.440653+0000","last_active":"2024-04-17T19:53:11.867019+0000","last_peered":"2024-04-17T19:53:11.867019+0000","last_clean":"2024-04-17T19:53:11.867019+0000","last_became_active":"2024-04-17T19:53:05.439793+0000","last_became_peered":"2024-04-17T19:53:05.439793+0000","last_unstale":"2024-04-17T19:53:11.867019+0000","last_undegraded":"2024-04-17T19:53:11.867019+0000","last_fullsized":"2024-04-17T19:53:11.867019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:10:21.772873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.491426+0000","last_change":"2024-04-17T19:53:04.461705+0000","last_active":"2024-04-17T19:53:10.491426+0000","last_peered":"2024-04-17T19:53:10.491426+0000","last_clean":"2024-04-17T19:53:10.491426+0000","last_became_active":"2024-04-17T19:53:04.461020+0000","last_became_peered":"2024-04-17T19:53:04.461020+0000","last_unstale":"2024-04-17T19:53:10.491426+0000","last_undegraded":"2024-04-17T19:53:10.491426+0000","last_fullsized":"2024-04-17T19:53:10.491426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:53:36.130201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.494505+0000","last_change":"2024-04-17T19:53:09.535147+0000","last_active":"2024-04-17T19:53:10.494505+0000","last_peered":"2024-04-17T19:53:10.494505+0000","last_clean":"2024-04-17T19:53:10.494505+0000","last_became_active":"2024-04-17T19:53:09.534655+0000","last_became_peered":"2024-04-17T19:53:09.534655+0000","last_unstale":"2024-04-17T19:53:10.494505+0000","last_undegraded":"2024-04-17T19:53:10.494505+0000","last_fullsized":"2024-04-17T19:53:10.494505+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:06:37.779654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.494234+0000","last_change":"2024-04-17T19:53:05.455848+0000","last_active":"2024-04-17T19:53:10.494234+0000","last_peered":"2024-04-17T19:53:10.494234+0000","last_clean":"2024-04-17T19:53:10.494234+0000","last_became_active":"2024-04-17T19:53:05.452844+0000","last_became_peered":"2024-04-17T19:53:05.452844+0000","last_unstale":"2024-04-17T19:53:10.494234+0000","last_undegraded":"2024-04-17T19:53:10.494234+0000","last_fullsized":"2024-04-17T19:53:10.494234+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:54:27.523970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.496158+0000","last_change":"2024-04-17T19:53:04.470824+0000","last_active":"2024-04-17T19:53:10.496158+0000","last_peered":"2024-04-17T19:53:10.496158+0000","last_clean":"2024-04-17T19:53:10.496158+0000","last_became_active":"2024-04-17T19:53:04.469777+0000","last_became_peered":"2024-04-17T19:53:04.469777+0000","last_unstale":"2024-04-17T19:53:10.496158+0000","last_undegraded":"2024-04-17T19:53:10.496158+0000","last_fullsized":"2024-04-17T19:53:10.496158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:30:04.861958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.492143+0000","last_change":"2024-04-17T19:53:04.469785+0000","last_active":"2024-04-17T19:53:10.492143+0000","last_peered":"2024-04-17T19:53:10.492143+0000","last_clean":"2024-04-17T19:53:10.492143+0000","last_became_active":"2024-04-17T19:53:04.469297+0000","last_became_peered":"2024-04-17T19:53:04.469297+0000","last_unstale":"2024-04-17T19:53:10.492143+0000","last_undegraded":"2024-04-17T19:53:10.492143+0000","last_fullsized":"2024-04-17T19:53:10.492143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:50:02.697725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.866551+0000","last_change":"2024-04-17T19:53:05.460191+0000","last_active":"2024-04-17T19:53:11.866551+0000","last_peered":"2024-04-17T19:53:11.866551+0000","last_clean":"2024-04-17T19:53:11.866551+0000","last_became_active":"2024-04-17T19:53:05.459616+0000","last_became_peered":"2024-04-17T19:53:05.459616+0000","last_unstale":"2024-04-17T19:53:11.866551+0000","last_undegraded":"2024-04-17T19:53:11.866551+0000","last_fullsized":"2024-04-17T19:53:11.866551+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:12:15.307126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.867060+0000","last_change":"2024-04-17T19:53:09.557279+0000","last_active":"2024-04-17T19:53:11.867060+0000","last_peered":"2024-04-17T19:53:11.867060+0000","last_clean":"2024-04-17T19:53:11.867060+0000","last_became_active":"2024-04-17T19:53:09.556190+0000","last_became_peered":"2024-04-17T19:53:09.556190+0000","last_unstale":"2024-04-17T19:53:11.867060+0000","last_undegraded":"2024-04-17T19:53:11.867060+0000","last_fullsized":"2024-04-17T19:53:11.867060+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:40:02.858481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.495230+0000","last_change":"2024-04-17T19:53:04.487292+0000","last_active":"2024-04-17T19:53:10.495230+0000","last_peered":"2024-04-17T19:53:10.495230+0000","last_clean":"2024-04-17T19:53:10.495230+0000","last_became_active":"2024-04-17T19:53:04.486707+0000","last_became_peered":"2024-04-17T19:53:04.486707+0000","last_unstale":"2024-04-17T19:53:10.495230+0000","last_undegraded":"2024-04-17T19:53:10.495230+0000","last_fullsized":"2024-04-17T19:53:10.495230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:48:50.049562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.527598+0000","last_change":"2024-04-17T19:53:05.449319+0000","last_active":"2024-04-17T19:53:11.527598+0000","last_peered":"2024-04-17T19:53:11.527598+0000","last_clean":"2024-04-17T19:53:11.527598+0000","last_became_active":"2024-04-17T19:53:05.448374+0000","last_became_peered":"2024-04-17T19:53:05.448374+0000","last_unstale":"2024-04-17T19:53:11.527598+0000","last_undegraded":"2024-04-17T19:53:11.527598+0000","last_fullsized":"2024-04-17T19:53:11.527598+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:21:37.163564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.780524+0000","last_change":"2024-04-17T19:53:09.561127+0000","last_active":"2024-04-17T19:53:10.780524+0000","last_peered":"2024-04-17T19:53:10.780524+0000","last_clean":"2024-04-17T19:53:10.780524+0000","last_became_active":"2024-04-17T19:53:09.560076+0000","last_became_peered":"2024-04-17T19:53:09.560076+0000","last_unstale":"2024-04-17T19:53:10.780524+0000","last_undegraded":"2024-04-17T19:53:10.780524+0000","last_fullsized":"2024-04-17T19:53:10.780524+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:25:20.343613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.863628+0000","last_change":"2024-04-17T19:53:05.472665+0000","last_active":"2024-04-17T19:53:11.863628+0000","last_peered":"2024-04-17T19:53:11.863628+0000","last_clean":"2024-04-17T19:53:11.863628+0000","last_became_active":"2024-04-17T19:53:05.472324+0000","last_became_peered":"2024-04-17T19:53:05.472324+0000","last_unstale":"2024-04-17T19:53:11.863628+0000","last_undegraded":"2024-04-17T19:53:11.863628+0000","last_fullsized":"2024-04-17T19:53:11.863628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:50:03.709043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.779246+0000","last_change":"2024-04-17T19:53:05.477190+0000","last_active":"2024-04-17T19:53:10.779246+0000","last_peered":"2024-04-17T19:53:10.779246+0000","last_clean":"2024-04-17T19:53:10.779246+0000","last_became_active":"2024-04-17T19:53:05.475823+0000","last_became_peered":"2024-04-17T19:53:05.475823+0000","last_unstale":"2024-04-17T19:53:10.779246+0000","last_undegraded":"2024-04-17T19:53:10.779246+0000","last_fullsized":"2024-04-17T19:53:10.779246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:53:37.141518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.491805+0000","last_change":"2024-04-17T19:53:05.453565+0000","last_active":"2024-04-17T19:53:10.491805+0000","last_peered":"2024-04-17T19:53:10.491805+0000","last_clean":"2024-04-17T19:53:10.491805+0000","last_became_active":"2024-04-17T19:53:05.453142+0000","last_became_peered":"2024-04-17T19:53:05.453142+0000","last_unstale":"2024-04-17T19:53:10.491805+0000","last_undegraded":"2024-04-17T19:53:10.491805+0000","last_fullsized":"2024-04-17T19:53:10.491805+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:39:58.812875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.494369+0000","last_change":"2024-04-17T19:53:05.476450+0000","last_active":"2024-04-17T19:53:10.494369+0000","last_peered":"2024-04-17T19:53:10.494369+0000","last_clean":"2024-04-17T19:53:10.494369+0000","last_became_active":"2024-04-17T19:53:05.473931+0000","last_became_peered":"2024-04-17T19:53:05.473931+0000","last_unstale":"2024-04-17T19:53:10.494369+0000","last_undegraded":"2024-04-17T19:53:10.494369+0000","last_fullsized":"2024-04-17T19:53:10.494369+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:10:21.772873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.497745+0000","last_change":"2024-04-17T19:53:05.469653+0000","last_active":"2024-04-17T19:53:10.497745+0000","last_peered":"2024-04-17T19:53:10.497745+0000","last_clean":"2024-04-17T19:53:10.497745+0000","last_became_active":"2024-04-17T19:53:05.467838+0000","last_became_peered":"2024-04-17T19:53:05.467838+0000","last_unstale":"2024-04-17T19:53:10.497745+0000","last_undegraded":"2024-04-17T19:53:10.497745+0000","last_fullsized":"2024-04-17T19:53:10.497745+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:38:51.699072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.496163+0000","last_change":"2024-04-17T19:53:05.462678+0000","last_active":"2024-04-17T19:53:10.496163+0000","last_peered":"2024-04-17T19:53:10.496163+0000","last_clean":"2024-04-17T19:53:10.496163+0000","last_became_active":"2024-04-17T19:53:05.461829+0000","last_became_peered":"2024-04-17T19:53:05.461829+0000","last_unstale":"2024-04-17T19:53:10.496163+0000","last_undegraded":"2024-04-17T19:53:10.496163+0000","last_fullsized":"2024-04-17T19:53:10.496163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:03:53.876774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.864168+0000","last_change":"2024-04-17T19:53:05.465993+0000","last_active":"2024-04-17T19:53:11.864168+0000","last_peered":"2024-04-17T19:53:11.864168+0000","last_clean":"2024-04-17T19:53:11.864168+0000","last_became_active":"2024-04-17T19:53:05.465547+0000","last_became_peered":"2024-04-17T19:53:05.465547+0000","last_unstale":"2024-04-17T19:53:11.864168+0000","last_undegraded":"2024-04-17T19:53:11.864168+0000","last_fullsized":"2024-04-17T19:53:11.864168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:12:03.449509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.494257+0000","last_change":"2024-04-17T19:53:05.477188+0000","last_active":"2024-04-17T19:53:10.494257+0000","last_peered":"2024-04-17T19:53:10.494257+0000","last_clean":"2024-04-17T19:53:10.494257+0000","last_became_active":"2024-04-17T19:53:05.474798+0000","last_became_peered":"2024-04-17T19:53:05.474798+0000","last_unstale":"2024-04-17T19:53:10.494257+0000","last_undegraded":"2024-04-17T19:53:10.494257+0000","last_fullsized":"2024-04-17T19:53:10.494257+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:15:45.727550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.491362+0000","last_change":"2024-04-17T19:53:05.484009+0000","last_active":"2024-04-17T19:53:10.491362+0000","last_peered":"2024-04-17T19:53:10.491362+0000","last_clean":"2024-04-17T19:53:10.491362+0000","last_became_active":"2024-04-17T19:53:05.483664+0000","last_became_peered":"2024-04-17T19:53:05.483664+0000","last_unstale":"2024-04-17T19:53:10.491362+0000","last_undegraded":"2024-04-17T19:53:10.491362+0000","last_fullsized":"2024-04-17T19:53:10.491362+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:47:05.354826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.494973+0000","last_change":"2024-04-17T19:53:05.466532+0000","last_active":"2024-04-17T19:53:10.494973+0000","last_peered":"2024-04-17T19:53:10.494973+0000","last_clean":"2024-04-17T19:53:10.494973+0000","last_became_active":"2024-04-17T19:53:05.465302+0000","last_became_peered":"2024-04-17T19:53:05.465302+0000","last_unstale":"2024-04-17T19:53:10.494973+0000","last_undegraded":"2024-04-17T19:53:10.494973+0000","last_fullsized":"2024-04-17T19:53:10.494973+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:27:51.520335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.527637+0000","last_change":"2024-04-17T19:53:05.456313+0000","last_active":"2024-04-17T19:53:11.527637+0000","last_peered":"2024-04-17T19:53:11.527637+0000","last_clean":"2024-04-17T19:53:11.527637+0000","last_became_active":"2024-04-17T19:53:05.455862+0000","last_became_peered":"2024-04-17T19:53:05.455862+0000","last_unstale":"2024-04-17T19:53:11.527637+0000","last_undegraded":"2024-04-17T19:53:11.527637+0000","last_fullsized":"2024-04-17T19:53:11.527637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:23:03.879786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.866381+0000","last_change":"2024-04-17T19:53:05.465083+0000","last_active":"2024-04-17T19:53:11.866381+0000","last_peered":"2024-04-17T19:53:11.866381+0000","last_clean":"2024-04-17T19:53:11.866381+0000","last_became_active":"2024-04-17T19:53:05.463806+0000","last_became_peered":"2024-04-17T19:53:05.463806+0000","last_unstale":"2024-04-17T19:53:11.866381+0000","last_undegraded":"2024-04-17T19:53:11.866381+0000","last_fullsized":"2024-04-17T19:53:11.866381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:25:16.298007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.529357+0000","last_change":"2024-04-17T19:53:05.464340+0000","last_active":"2024-04-17T19:53:10.529357+0000","last_peered":"2024-04-17T19:53:10.529357+0000","last_clean":"2024-04-17T19:53:10.529357+0000","last_became_active":"2024-04-17T19:53:05.463286+0000","last_became_peered":"2024-04-17T19:53:05.463286+0000","last_unstale":"2024-04-17T19:53:10.529357+0000","last_undegraded":"2024-04-17T19:53:10.529357+0000","last_fullsized":"2024-04-17T19:53:10.529357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:54:27.523970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.493221+0000","last_change":"2024-04-17T19:53:05.475791+0000","last_active":"2024-04-17T19:53:10.493221+0000","last_peered":"2024-04-17T19:53:10.493221+0000","last_clean":"2024-04-17T19:53:10.493221+0000","last_became_active":"2024-04-17T19:53:05.475372+0000","last_became_peered":"2024-04-17T19:53:05.475372+0000","last_unstale":"2024-04-17T19:53:10.493221+0000","last_undegraded":"2024-04-17T19:53:10.493221+0000","last_fullsized":"2024-04-17T19:53:10.493221+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:10:32.839503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.781055+0000","last_change":"2024-04-17T19:53:05.496650+0000","last_active":"2024-04-17T19:53:10.781055+0000","last_peered":"2024-04-17T19:53:10.781055+0000","last_clean":"2024-04-17T19:53:10.781055+0000","last_became_active":"2024-04-17T19:53:05.495881+0000","last_became_peered":"2024-04-17T19:53:05.495881+0000","last_unstale":"2024-04-17T19:53:10.781055+0000","last_undegraded":"2024-04-17T19:53:10.781055+0000","last_fullsized":"2024-04-17T19:53:10.781055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:23:03.879786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.494848+0000","last_change":"2024-04-17T19:53:05.461335+0000","last_active":"2024-04-17T19:53:10.494848+0000","last_peered":"2024-04-17T19:53:10.494848+0000","last_clean":"2024-04-17T19:53:10.494848+0000","last_became_active":"2024-04-17T19:53:05.460831+0000","last_became_peered":"2024-04-17T19:53:05.460831+0000","last_unstale":"2024-04-17T19:53:10.494848+0000","last_undegraded":"2024-04-17T19:53:10.494848+0000","last_fullsized":"2024-04-17T19:53:10.494848+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:22:55.343347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.491071+0000","last_change":"2024-04-17T19:53:05.473875+0000","last_active":"2024-04-17T19:53:10.491071+0000","last_peered":"2024-04-17T19:53:10.491071+0000","last_clean":"2024-04-17T19:53:10.491071+0000","last_became_active":"2024-04-17T19:53:05.467366+0000","last_became_peered":"2024-04-17T19:53:05.467366+0000","last_unstale":"2024-04-17T19:53:10.491071+0000","last_undegraded":"2024-04-17T19:53:10.491071+0000","last_fullsized":"2024-04-17T19:53:10.491071+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:05:21.173050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.493287+0000","last_change":"2024-04-17T19:53:05.467405+0000","last_active":"2024-04-17T19:53:10.493287+0000","last_peered":"2024-04-17T19:53:10.493287+0000","last_clean":"2024-04-17T19:53:10.493287+0000","last_became_active":"2024-04-17T19:53:05.466427+0000","last_became_peered":"2024-04-17T19:53:05.466427+0000","last_unstale":"2024-04-17T19:53:10.493287+0000","last_undegraded":"2024-04-17T19:53:10.493287+0000","last_fullsized":"2024-04-17T19:53:10.493287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:19:09.456602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.496615+0000","last_change":"2024-04-17T19:53:05.465968+0000","last_active":"2024-04-17T19:53:10.496615+0000","last_peered":"2024-04-17T19:53:10.496615+0000","last_clean":"2024-04-17T19:53:10.496615+0000","last_became_active":"2024-04-17T19:53:05.465145+0000","last_became_peered":"2024-04-17T19:53:05.465145+0000","last_unstale":"2024-04-17T19:53:10.496615+0000","last_undegraded":"2024-04-17T19:53:10.496615+0000","last_fullsized":"2024-04-17T19:53:10.496615+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:47:46.099722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.495836+0000","last_change":"2024-04-17T19:53:05.463993+0000","last_active":"2024-04-17T19:53:10.495836+0000","last_peered":"2024-04-17T19:53:10.495836+0000","last_clean":"2024-04-17T19:53:10.495836+0000","last_became_active":"2024-04-17T19:53:05.463172+0000","last_became_peered":"2024-04-17T19:53:05.463172+0000","last_unstale":"2024-04-17T19:53:10.495836+0000","last_undegraded":"2024-04-17T19:53:10.495836+0000","last_fullsized":"2024-04-17T19:53:10.495836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:29:50.457953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.529222+0000","last_change":"2024-04-17T19:53:05.471782+0000","last_active":"2024-04-17T19:53:10.529222+0000","last_peered":"2024-04-17T19:53:10.529222+0000","last_clean":"2024-04-17T19:53:10.529222+0000","last_became_active":"2024-04-17T19:53:05.471347+0000","last_became_peered":"2024-04-17T19:53:05.471347+0000","last_unstale":"2024-04-17T19:53:10.529222+0000","last_undegraded":"2024-04-17T19:53:10.529222+0000","last_fullsized":"2024-04-17T19:53:10.529222+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:42:22.878631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.529347+0000","last_change":"2024-04-17T19:53:05.460256+0000","last_active":"2024-04-17T19:53:10.529347+0000","last_peered":"2024-04-17T19:53:10.529347+0000","last_clean":"2024-04-17T19:53:10.529347+0000","last_became_active":"2024-04-17T19:53:05.459869+0000","last_became_peered":"2024-04-17T19:53:05.459869+0000","last_unstale":"2024-04-17T19:53:10.529347+0000","last_undegraded":"2024-04-17T19:53:10.529347+0000","last_fullsized":"2024-04-17T19:53:10.529347+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:47:05.354826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.529487+0000","last_change":"2024-04-17T19:53:05.467331+0000","last_active":"2024-04-17T19:53:10.529487+0000","last_peered":"2024-04-17T19:53:10.529487+0000","last_clean":"2024-04-17T19:53:10.529487+0000","last_became_active":"2024-04-17T19:53:05.467015+0000","last_became_peered":"2024-04-17T19:53:05.467015+0000","last_unstale":"2024-04-17T19:53:10.529487+0000","last_undegraded":"2024-04-17T19:53:10.529487+0000","last_fullsized":"2024-04-17T19:53:10.529487+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:10:32.839503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.529339+0000","last_change":"2024-04-17T19:53:05.462631+0000","last_active":"2024-04-17T19:53:11.529339+0000","last_peered":"2024-04-17T19:53:11.529339+0000","last_clean":"2024-04-17T19:53:11.529339+0000","last_became_active":"2024-04-17T19:53:05.462217+0000","last_became_peered":"2024-04-17T19:53:05.462217+0000","last_unstale":"2024-04-17T19:53:11.529339+0000","last_undegraded":"2024-04-17T19:53:11.529339+0000","last_fullsized":"2024-04-17T19:53:11.529339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:50:03.709043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.493026+0000","last_change":"2024-04-17T19:53:05.467941+0000","last_active":"2024-04-17T19:53:10.493026+0000","last_peered":"2024-04-17T19:53:10.493026+0000","last_clean":"2024-04-17T19:53:10.493026+0000","last_became_active":"2024-04-17T19:53:05.467093+0000","last_became_peered":"2024-04-17T19:53:05.467093+0000","last_unstale":"2024-04-17T19:53:10.493026+0000","last_undegraded":"2024-04-17T19:53:10.493026+0000","last_fullsized":"2024-04-17T19:53:10.493026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:12:15.307126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.528642+0000","last_change":"2024-04-17T19:53:05.465748+0000","last_active":"2024-04-17T19:53:10.528642+0000","last_peered":"2024-04-17T19:53:10.528642+0000","last_clean":"2024-04-17T19:53:10.528642+0000","last_became_active":"2024-04-17T19:53:05.465436+0000","last_became_peered":"2024-04-17T19:53:05.465436+0000","last_unstale":"2024-04-17T19:53:10.528642+0000","last_undegraded":"2024-04-17T19:53:10.528642+0000","last_fullsized":"2024-04-17T19:53:10.528642+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:02:40.799364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.863626+0000","last_change":"2024-04-17T19:53:05.458098+0000","last_active":"2024-04-17T19:53:11.863626+0000","last_peered":"2024-04-17T19:53:11.863626+0000","last_clean":"2024-04-17T19:53:11.863626+0000","last_became_active":"2024-04-17T19:53:05.457656+0000","last_became_peered":"2024-04-17T19:53:05.457656+0000","last_unstale":"2024-04-17T19:53:11.863626+0000","last_undegraded":"2024-04-17T19:53:11.863626+0000","last_fullsized":"2024-04-17T19:53:11.863626+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:40:31.558660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.529015+0000","last_change":"2024-04-17T19:53:05.477086+0000","last_active":"2024-04-17T19:53:10.529015+0000","last_peered":"2024-04-17T19:53:10.529015+0000","last_clean":"2024-04-17T19:53:10.529015+0000","last_became_active":"2024-04-17T19:53:05.476734+0000","last_became_peered":"2024-04-17T19:53:05.476734+0000","last_unstale":"2024-04-17T19:53:10.529015+0000","last_undegraded":"2024-04-17T19:53:10.529015+0000","last_fullsized":"2024-04-17T19:53:10.529015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:10:21.772873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.863461+0000","last_change":"2024-04-17T19:53:05.458378+0000","last_active":"2024-04-17T19:53:11.863461+0000","last_peered":"2024-04-17T19:53:11.863461+0000","last_clean":"2024-04-17T19:53:11.863461+0000","last_became_active":"2024-04-17T19:53:05.457210+0000","last_became_peered":"2024-04-17T19:53:05.457210+0000","last_unstale":"2024-04-17T19:53:11.863461+0000","last_undegraded":"2024-04-17T19:53:11.863461+0000","last_fullsized":"2024-04-17T19:53:11.863461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:23:03.879786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.494175+0000","last_change":"2024-04-17T19:53:05.455054+0000","last_active":"2024-04-17T19:53:10.494175+0000","last_peered":"2024-04-17T19:53:10.494175+0000","last_clean":"2024-04-17T19:53:10.494175+0000","last_became_active":"2024-04-17T19:53:05.454065+0000","last_became_peered":"2024-04-17T19:53:05.454065+0000","last_unstale":"2024-04-17T19:53:10.494175+0000","last_undegraded":"2024-04-17T19:53:10.494175+0000","last_fullsized":"2024-04-17T19:53:10.494175+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:42:22.878631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.496956+0000","last_change":"2024-04-17T19:53:05.456675+0000","last_active":"2024-04-17T19:53:10.496956+0000","last_peered":"2024-04-17T19:53:10.496956+0000","last_clean":"2024-04-17T19:53:10.496956+0000","last_became_active":"2024-04-17T19:53:05.455779+0000","last_became_peered":"2024-04-17T19:53:05.455779+0000","last_unstale":"2024-04-17T19:53:10.496956+0000","last_undegraded":"2024-04-17T19:53:10.496956+0000","last_fullsized":"2024-04-17T19:53:10.496956+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:02:40.799364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.529904+0000","last_change":"2024-04-17T19:53:05.461773+0000","last_active":"2024-04-17T19:53:10.529904+0000","last_peered":"2024-04-17T19:53:10.529904+0000","last_clean":"2024-04-17T19:53:10.529904+0000","last_became_active":"2024-04-17T19:53:05.461324+0000","last_became_peered":"2024-04-17T19:53:05.461324+0000","last_unstale":"2024-04-17T19:53:10.529904+0000","last_undegraded":"2024-04-17T19:53:10.529904+0000","last_fullsized":"2024-04-17T19:53:10.529904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:05:21.173050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":110409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":884736,"data_stored":700745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":114799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31468,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340372,"statfs":{"total":96636764160,"available":96604540928,"internally_reserved":0,"allocated":286720,"data_stored":110867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":294912,"data_stored":114127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32040,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339800,"statfs":{"total":96636764160,"available":96603955200,"internally_reserved":0,"allocated":880640,"data_stored":700723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":290816,"data_stored":110341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542152,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":110285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T19:53:24.681 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T19:53:24.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.861+0000 7fdfb01f7640 1 Processor -- start 2024-04-17T19:53:24.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.861+0000 7fdfb01f7640 1 -- start start 2024-04-17T19:53:24.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.861+0000 7fdfb01f7640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fdfa8164f70 0x7fdfa8167390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:24.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.861+0000 7fdfb01f7640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfa815fc90 con 0x7fdfa806cd60 2024-04-17T19:53:24.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.861+0000 7fdfb01f7640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfa8142870 con 0x7fdfa815c7c0 2024-04-17T19:53:24.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.861+0000 7fdfb01f7640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7fdfa815e7d0 con 0x7fdfa8164f70 2024-04-17T19:53:24.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.861+0000 7fdfadf93640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fdfa806cd60 0x7fdfa806d170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:51096/0 (socket says 172.21.15.18:51096) 2024-04-17T19:53:24.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.861+0000 7fdfadf93640 1 -- 172.21.15.18:0/3046202699 learned_addr learned my addr 172.21.15.18:0/3046202699 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:24.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.861+0000 7fdfacf91640 1 -- 172.21.15.18:0/3046202699 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2206191042 0 0) 0x7fdfa815fc90 con 0x7fdfa806cd60 2024-04-17T19:53:24.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.861+0000 7fdfacf91640 1 -- 172.21.15.18:0/3046202699 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf94003530 con 0x7fdfa806cd60 2024-04-17T19:53:24.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.861+0000 7fdfae794640 1 --2- 172.21.15.18:0/3046202699 >> v2:172.21.15.173:3300/0 conn(0x7fdfa8164f70 0x7fdfa8167390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:24.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.861+0000 7fdfacf91640 1 -- 172.21.15.18:0/3046202699 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3744845547 0 0) 0x7fdf94003530 con 0x7fdfa806cd60 2024-04-17T19:53:24.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.861+0000 7fdfacf91640 1 -- 172.21.15.18:0/3046202699 >> v2:172.21.15.173:3300/0 conn(0x7fdfa8164f70 msgr2=0x7fdfa8167390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:24.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.861+0000 7fdfacf91640 1 --2- 172.21.15.18:0/3046202699 >> v2:172.21.15.173:3300/0 conn(0x7fdfa8164f70 0x7fdfa8167390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:24.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.861+0000 7fdfacf91640 1 -- 172.21.15.18:0/3046202699 >> v1:172.21.15.173:6789/0 conn(0x7fdfa815c7c0 legacy=0x7fdfa815cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:24.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.861+0000 7fdfacf91640 1 -- 172.21.15.18:0/3046202699 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfa815ff00 con 0x7fdfa806cd60 2024-04-17T19:53:24.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.861+0000 7fdfacf91640 1 -- 172.21.15.18:0/3046202699 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3208559991 0 0) 0x7fdfa40016a0 con 0x7fdfa806cd60 2024-04-17T19:53:24.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.861+0000 7fdfacf91640 1 -- 172.21.15.18:0/3046202699 >> v1:172.21.15.18:6789/0 conn(0x7fdfa806cd60 legacy=0x7fdfa806d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:24.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.861+0000 7fdfacf91640 1 --2- 172.21.15.18:0/3046202699 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf940039c0 0x7fdf94003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:24.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.861+0000 7fdfacf91640 1 --2- 172.21.15.18:0/3046202699 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf94004810 0x7fdf94004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:24.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.861+0000 7fdfacf91640 1 --2- 172.21.15.18:0/3046202699 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf94005310 0x7fdf9400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:24.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.861+0000 7fdfacf91640 1 -- 172.21.15.18:0/3046202699 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa815e7d0 con 0x7fdf940039c0 2024-04-17T19:53:24.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.861+0000 7fdfacf91640 1 -- 172.21.15.18:0/3046202699 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fdf9400c2b0 con 0x7fdf94005310 2024-04-17T19:53:24.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.861+0000 7fdfacf91640 1 -- 172.21.15.18:0/3046202699 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fdf9400c4b0 con 0x7fdf94004810 2024-04-17T19:53:24.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.861+0000 7fdfadf93640 1 --2- 172.21.15.18:0/3046202699 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf940039c0 0x7fdf94003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:24.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.861+0000 7fdfad792640 1 --2- 172.21.15.18:0/3046202699 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf94004810 0x7fdf94004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:24.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.861+0000 7fdfae794640 1 --2- 172.21.15.18:0/3046202699 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf94005310 0x7fdf9400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:24.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.861+0000 7fdfadf93640 1 -- 172.21.15.18:0/3046202699 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf94004810 msgr2=0x7fdf94004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:24.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.861+0000 7fdfadf93640 1 --2- 172.21.15.18:0/3046202699 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf94004810 0x7fdf94004c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:24.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.861+0000 7fdfadf93640 1 -- 172.21.15.18:0/3046202699 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf94005310 msgr2=0x7fdf9400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:24.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.861+0000 7fdfadf93640 1 --2- 172.21.15.18:0/3046202699 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf94005310 0x7fdf9400b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:24.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.861+0000 7fdfadf93640 1 -- 172.21.15.18:0/3046202699 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf94003530 con 0x7fdf940039c0 2024-04-17T19:53:24.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.861+0000 7fdfae794640 1 -- 172.21.15.18:0/3046202699 reap_dead start 2024-04-17T19:53:24.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.865+0000 7fdfadf93640 1 --2- 172.21.15.18:0/3046202699 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf940039c0 0x7fdf94003e30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdfa80719c0 tx=0x7fdfa815d3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=429b633d44b4318d server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:24.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.865+0000 7fdfacf91640 1 -- 172.21.15.18:0/3046202699 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa4007d60 con 0x7fdf940039c0 2024-04-17T19:53:24.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.865+0000 7fdfacf91640 1 -- 172.21.15.18:0/3046202699 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfa40a9020 con 0x7fdf940039c0 2024-04-17T19:53:24.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.865+0000 7fdfacf91640 1 -- 172.21.15.18:0/3046202699 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa4005ae0 con 0x7fdf940039c0 2024-04-17T19:53:24.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.865+0000 7fdfb01f7640 1 -- 172.21.15.18:0/3046202699 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf940039c0 msgr2=0x7fdf94003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:24.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.865+0000 7fdfb01f7640 1 --2- 172.21.15.18:0/3046202699 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf940039c0 0x7fdf94003e30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdfa80719c0 tx=0x7fdfa815d3e0 comp rx=0 tx=0).stop 2024-04-17T19:53:24.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.865+0000 7fdfb01f7640 1 -- 172.21.15.18:0/3046202699 shutdown_connections 2024-04-17T19:53:24.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.865+0000 7fdfb01f7640 1 --2- 172.21.15.18:0/3046202699 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf940039c0 0x7fdf94003e30 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:24.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.865+0000 7fdfb01f7640 1 -- 172.21.15.18:0/3046202699 >> 172.21.15.18:0/3046202699 conn(0x7fdfa8072bb0 msgr2=0x7fdfa8072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:24.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.865+0000 7fdfb01f7640 1 -- 172.21.15.18:0/3046202699 shutdown_connections 2024-04-17T19:53:24.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.865+0000 7fdfb01f7640 1 -- 172.21.15.18:0/3046202699 wait complete. 2024-04-17T19:53:24.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.869+0000 7fdfb01f7640 1 Processor -- start 2024-04-17T19:53:24.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.869+0000 7fdfb01f7640 1 -- start start 2024-04-17T19:53:24.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.869+0000 7fdfb01f7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf940039c0 0x7fdfa8156670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:24.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.869+0000 7fdfb01f7640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdfa81337f0 0x7fdfa815b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:24.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.869+0000 7fdfb01f7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdfa815b5d0 0x7fdfa8134180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:24.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.869+0000 7fdfb01f7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa81609e0 con 0x7fdf940039c0 2024-04-17T19:53:24.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.869+0000 7fdfb01f7640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa806d580 con 0x7fdfa815b5d0 2024-04-17T19:53:24.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.869+0000 7fdfb01f7640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fdfa81353e0 con 0x7fdfa81337f0 2024-04-17T19:53:24.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.869+0000 7fdfadf93640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf940039c0 0x7fdfa8156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:24.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.869+0000 7fdfadf93640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf940039c0 0x7fdfa8156670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49648/0 (socket says 172.21.15.18:49648) 2024-04-17T19:53:24.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.869+0000 7fdfadf93640 1 -- 172.21.15.18:0/3923138098 learned_addr learned my addr 172.21.15.18:0/3923138098 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:24.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.869+0000 7fdfae794640 1 --2- 172.21.15.18:0/3923138098 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdfa815b5d0 0x7fdfa8134180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:24.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.869+0000 7fdfad792640 1 --2- 172.21.15.18:0/3923138098 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdfa81337f0 0x7fdfa815b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:24.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.869+0000 7fdfadf93640 1 -- 172.21.15.18:0/3923138098 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdfa81337f0 msgr2=0x7fdfa815b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:24.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.869+0000 7fdfadf93640 1 --2- 172.21.15.18:0/3923138098 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdfa81337f0 0x7fdfa815b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:24.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.869+0000 7fdfadf93640 1 -- 172.21.15.18:0/3923138098 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdfa815b5d0 msgr2=0x7fdfa8134180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:24.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.869+0000 7fdfadf93640 1 --2- 172.21.15.18:0/3923138098 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdfa815b5d0 0x7fdfa8134180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:24.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.869+0000 7fdfadf93640 1 -- 172.21.15.18:0/3923138098 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfa815b9e0 con 0x7fdf940039c0 2024-04-17T19:53:24.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.869+0000 7fdfae794640 1 --2- 172.21.15.18:0/3923138098 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdfa815b5d0 0x7fdfa8134180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:53:24.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.869+0000 7fdfadf93640 1 --2- 172.21.15.18:0/3923138098 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf940039c0 0x7fdfa8156670 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdfa401c6e0 tx=0x7fdf94005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:24.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.869+0000 7fdf9e7fc640 1 -- 172.21.15.18:0/3923138098 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa40b4070 con 0x7fdf940039c0 2024-04-17T19:53:24.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.869+0000 7fdf9e7fc640 1 -- 172.21.15.18:0/3923138098 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfa4001660 con 0x7fdf940039c0 2024-04-17T19:53:24.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.869+0000 7fdfb01f7640 1 -- 172.21.15.18:0/3923138098 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfa81382b0 con 0x7fdf940039c0 2024-04-17T19:53:24.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.869+0000 7fdf9e7fc640 1 -- 172.21.15.18:0/3923138098 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa4007d60 con 0x7fdf940039c0 2024-04-17T19:53:24.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.869+0000 7fdfb01f7640 1 -- 172.21.15.18:0/3923138098 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfa8138870 con 0x7fdf940039c0 2024-04-17T19:53:24.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.869+0000 7fdfb01f7640 1 -- 172.21.15.18:0/3923138098 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfa80684c0 con 0x7fdf940039c0 2024-04-17T19:53:24.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.873+0000 7fdf9e7fc640 1 -- 172.21.15.18:0/3923138098 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdfa40072f0 con 0x7fdf940039c0 2024-04-17T19:53:24.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.873+0000 7fdf9e7fc640 1 --2- 172.21.15.18:0/3923138098 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fdf8c068380 0x7fdf8c06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:24.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.873+0000 7fdfad792640 1 --2- 172.21.15.18:0/3923138098 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fdf8c068380 0x7fdf8c06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:24.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.873+0000 7fdf9e7fc640 1 -- 172.21.15.18:0/3923138098 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fdfa4120430 con 0x7fdf940039c0 2024-04-17T19:53:24.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.873+0000 7fdfad792640 1 --2- 172.21.15.18:0/3923138098 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fdf8c068380 0x7fdf8c06a890 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdfa813bd00 tx=0x7fdf98009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:24.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:24.877+0000 7fdf9e7fc640 1 -- 172.21.15.18:0/3923138098 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdfa815b9e0 con 0x7fdf940039c0 2024-04-17T19:53:25.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.029+0000 7fdfb01f7640 1 -- 172.21.15.18:0/3923138098 --> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdfa8069950 con 0x7fdf8c068380 2024-04-17T19:53:25.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.053+0000 7fdf9e7fc640 1 -- 172.21.15.18:0/3923138098 <== mgr.4104 v2:172.21.15.18:6832/751466605 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332558 (secure 0 0 0) 0x7fdfa8069950 con 0x7fdf8c068380 2024-04-17T19:53:25.052 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:53:25.054 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-17T19:53:25.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.057+0000 7fdfb01f7640 1 -- 172.21.15.18:0/3923138098 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fdf8c068380 msgr2=0x7fdf8c06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:25.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.057+0000 7fdfb01f7640 1 --2- 172.21.15.18:0/3923138098 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fdf8c068380 0x7fdf8c06a890 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdfa813bd00 tx=0x7fdf98009040 comp rx=0 tx=0).stop 2024-04-17T19:53:25.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.057+0000 7fdfb01f7640 1 -- 172.21.15.18:0/3923138098 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf940039c0 msgr2=0x7fdfa8156670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:25.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.057+0000 7fdfb01f7640 1 --2- 172.21.15.18:0/3923138098 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf940039c0 0x7fdfa8156670 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdfa401c6e0 tx=0x7fdf94005840 comp rx=0 tx=0).stop 2024-04-17T19:53:25.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.057+0000 7fdfb01f7640 1 -- 172.21.15.18:0/3923138098 shutdown_connections 2024-04-17T19:53:25.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.057+0000 7fdfb01f7640 1 --2- 172.21.15.18:0/3923138098 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fdf8c068380 0x7fdf8c06a890 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:25.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.057+0000 7fdfb01f7640 1 --2- 172.21.15.18:0/3923138098 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdfa815b5d0 0x7fdfa8134180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:25.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.057+0000 7fdfb01f7640 1 --2- 172.21.15.18:0/3923138098 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdfa81337f0 0x7fdfa815b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:25.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.057+0000 7fdfb01f7640 1 --2- 172.21.15.18:0/3923138098 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf940039c0 0x7fdfa8156670 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:25.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.057+0000 7fdfb01f7640 1 -- 172.21.15.18:0/3923138098 >> 172.21.15.18:0/3923138098 conn(0x7fdfa8072bb0 msgr2=0x7fdfa80b5180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:25.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.057+0000 7fdfb01f7640 1 -- 172.21.15.18:0/3923138098 shutdown_connections 2024-04-17T19:53:25.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.057+0000 7fdfb01f7640 1 -- 172.21.15.18:0/3923138098 wait complete. 2024-04-17T19:53:25.072 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-04-17T19:53:24.348831+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236256,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738464,"statfs":{"total":773094113280,"available":772852187136,"internally_reserved":0,"allocated":3514368,"data_stored":2072296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":238276148},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005008"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.867881+0000","last_change":"2024-04-17T19:53:04.461184+0000","last_active":"2024-04-17T19:53:11.867881+0000","last_peered":"2024-04-17T19:53:11.867881+0000","last_clean":"2024-04-17T19:53:11.867881+0000","last_became_active":"2024-04-17T19:53:04.460006+0000","last_became_peered":"2024-04-17T19:53:04.460006+0000","last_unstale":"2024-04-17T19:53:11.867881+0000","last_undegraded":"2024-04-17T19:53:11.867881+0000","last_fullsized":"2024-04-17T19:53:11.867881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:23:02.868468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.495714+0000","last_change":"2024-04-17T19:53:05.474006+0000","last_active":"2024-04-17T19:53:10.495714+0000","last_peered":"2024-04-17T19:53:10.495714+0000","last_clean":"2024-04-17T19:53:10.495714+0000","last_became_active":"2024-04-17T19:53:05.467848+0000","last_became_peered":"2024-04-17T19:53:05.467848+0000","last_unstale":"2024-04-17T19:53:10.495714+0000","last_undegraded":"2024-04-17T19:53:10.495714+0000","last_fullsized":"2024-04-17T19:53:10.495714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:05:21.173050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.779378+0000","last_change":"2024-04-17T19:53:09.559397+0000","last_active":"2024-04-17T19:53:10.779378+0000","last_peered":"2024-04-17T19:53:10.779378+0000","last_clean":"2024-04-17T19:53:10.779378+0000","last_became_active":"2024-04-17T19:53:09.558504+0000","last_became_peered":"2024-04-17T19:53:09.558504+0000","last_unstale":"2024-04-17T19:53:10.779378+0000","last_undegraded":"2024-04-17T19:53:10.779378+0000","last_fullsized":"2024-04-17T19:53:10.779378+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:06:18.745394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.496229+0000","last_change":"2024-04-17T19:53:04.484961+0000","last_active":"2024-04-17T19:53:10.496229+0000","last_peered":"2024-04-17T19:53:10.496229+0000","last_clean":"2024-04-17T19:53:10.496229+0000","last_became_active":"2024-04-17T19:53:04.468291+0000","last_became_peered":"2024-04-17T19:53:04.468291+0000","last_unstale":"2024-04-17T19:53:10.496229+0000","last_undegraded":"2024-04-17T19:53:10.496229+0000","last_fullsized":"2024-04-17T19:53:10.496229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:06:00.469757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.494707+0000","last_change":"2024-04-17T19:53:05.475578+0000","last_active":"2024-04-17T19:53:10.494707+0000","last_peered":"2024-04-17T19:53:10.494707+0000","last_clean":"2024-04-17T19:53:10.494707+0000","last_became_active":"2024-04-17T19:53:05.473678+0000","last_became_peered":"2024-04-17T19:53:05.473678+0000","last_unstale":"2024-04-17T19:53:10.494707+0000","last_undegraded":"2024-04-17T19:53:10.494707+0000","last_fullsized":"2024-04-17T19:53:10.494707+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:47:05.354826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.863354+0000","last_change":"2024-04-17T19:53:09.545180+0000","last_active":"2024-04-17T19:53:11.863354+0000","last_peered":"2024-04-17T19:53:11.863354+0000","last_clean":"2024-04-17T19:53:11.863354+0000","last_became_active":"2024-04-17T19:53:09.544580+0000","last_became_peered":"2024-04-17T19:53:09.544580+0000","last_unstale":"2024-04-17T19:53:11.863354+0000","last_undegraded":"2024-04-17T19:53:11.863354+0000","last_fullsized":"2024-04-17T19:53:11.863354+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:02:44.844970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.529583+0000","last_change":"2024-04-17T19:53:04.468009+0000","last_active":"2024-04-17T19:53:10.529583+0000","last_peered":"2024-04-17T19:53:10.529583+0000","last_clean":"2024-04-17T19:53:10.529583+0000","last_became_active":"2024-04-17T19:53:04.467568+0000","last_became_peered":"2024-04-17T19:53:04.467568+0000","last_unstale":"2024-04-17T19:53:10.529583+0000","last_undegraded":"2024-04-17T19:53:10.529583+0000","last_fullsized":"2024-04-17T19:53:10.529583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:18:11.256327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.528343+0000","last_change":"2024-04-17T19:53:05.464961+0000","last_active":"2024-04-17T19:53:11.528343+0000","last_peered":"2024-04-17T19:53:11.528343+0000","last_clean":"2024-04-17T19:53:11.528343+0000","last_became_active":"2024-04-17T19:53:05.464601+0000","last_became_peered":"2024-04-17T19:53:05.464601+0000","last_unstale":"2024-04-17T19:53:11.528343+0000","last_undegraded":"2024-04-17T19:53:11.528343+0000","last_fullsized":"2024-04-17T19:53:11.528343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:12:03.449509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.863767+0000","last_change":"2024-04-17T19:53:09.529447+0000","last_active":"2024-04-17T19:53:11.863767+0000","last_peered":"2024-04-17T19:53:11.863767+0000","last_clean":"2024-04-17T19:53:11.863767+0000","last_became_active":"2024-04-17T19:53:09.528285+0000","last_became_peered":"2024-04-17T19:53:09.528285+0000","last_unstale":"2024-04-17T19:53:11.863767+0000","last_undegraded":"2024-04-17T19:53:11.863767+0000","last_fullsized":"2024-04-17T19:53:11.863767+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:47:09.400433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.529734+0000","last_change":"2024-04-17T19:53:04.467639+0000","last_active":"2024-04-17T19:53:10.529734+0000","last_peered":"2024-04-17T19:53:10.529734+0000","last_clean":"2024-04-17T19:53:10.529734+0000","last_became_active":"2024-04-17T19:53:04.467004+0000","last_became_peered":"2024-04-17T19:53:04.467004+0000","last_unstale":"2024-04-17T19:53:10.529734+0000","last_undegraded":"2024-04-17T19:53:10.529734+0000","last_fullsized":"2024-04-17T19:53:10.529734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:38:40.499868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.492819+0000","last_change":"2024-04-17T19:53:05.468179+0000","last_active":"2024-04-17T19:53:10.492819+0000","last_peered":"2024-04-17T19:53:10.492819+0000","last_clean":"2024-04-17T19:53:10.492819+0000","last_became_active":"2024-04-17T19:53:05.467217+0000","last_became_peered":"2024-04-17T19:53:05.467217+0000","last_unstale":"2024-04-17T19:53:10.492819+0000","last_undegraded":"2024-04-17T19:53:10.492819+0000","last_fullsized":"2024-04-17T19:53:10.492819+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:29:50.290114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.863352+0000","last_change":"2024-04-17T19:53:09.549722+0000","last_active":"2024-04-17T19:53:11.863352+0000","last_peered":"2024-04-17T19:53:11.863352+0000","last_clean":"2024-04-17T19:53:11.863352+0000","last_became_active":"2024-04-17T19:53:09.548876+0000","last_became_peered":"2024-04-17T19:53:09.548876+0000","last_unstale":"2024-04-17T19:53:11.863352+0000","last_undegraded":"2024-04-17T19:53:11.863352+0000","last_fullsized":"2024-04-17T19:53:11.863352+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:15:49.773156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.491904+0000","last_change":"2024-04-17T19:53:05.475996+0000","last_active":"2024-04-17T19:53:10.491904+0000","last_peered":"2024-04-17T19:53:10.491904+0000","last_clean":"2024-04-17T19:53:10.491904+0000","last_became_active":"2024-04-17T19:53:05.475517+0000","last_became_peered":"2024-04-17T19:53:05.475517+0000","last_unstale":"2024-04-17T19:53:10.491904+0000","last_undegraded":"2024-04-17T19:53:10.491904+0000","last_fullsized":"2024-04-17T19:53:10.491904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:39:47.272961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.492869+0000","last_change":"2024-04-17T19:53:04.465884+0000","last_active":"2024-04-17T19:53:10.492869+0000","last_peered":"2024-04-17T19:53:10.492869+0000","last_clean":"2024-04-17T19:53:10.492869+0000","last_became_active":"2024-04-17T19:53:04.465108+0000","last_became_peered":"2024-04-17T19:53:04.465108+0000","last_unstale":"2024-04-17T19:53:10.492869+0000","last_undegraded":"2024-04-17T19:53:10.492869+0000","last_fullsized":"2024-04-17T19:53:10.492869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:23:02.868468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.492043+0000","last_change":"2024-04-17T19:53:09.545287+0000","last_active":"2024-04-17T19:53:10.492043+0000","last_peered":"2024-04-17T19:53:10.492043+0000","last_clean":"2024-04-17T19:53:10.492043+0000","last_became_active":"2024-04-17T19:53:09.544328+0000","last_became_peered":"2024-04-17T19:53:09.544328+0000","last_unstale":"2024-04-17T19:53:10.492043+0000","last_undegraded":"2024-04-17T19:53:10.492043+0000","last_fullsized":"2024-04-17T19:53:10.492043+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:47:26.887721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.779852+0000","last_change":"2024-04-17T19:53:05.496585+0000","last_active":"2024-04-17T19:53:10.779852+0000","last_peered":"2024-04-17T19:53:10.779852+0000","last_clean":"2024-04-17T19:53:10.779852+0000","last_became_active":"2024-04-17T19:53:05.495800+0000","last_became_peered":"2024-04-17T19:53:05.495800+0000","last_unstale":"2024-04-17T19:53:10.779852+0000","last_undegraded":"2024-04-17T19:53:10.779852+0000","last_fullsized":"2024-04-17T19:53:10.779852+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:18:12.267644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.496900+0000","last_change":"2024-04-17T19:53:04.479274+0000","last_active":"2024-04-17T19:53:10.496900+0000","last_peered":"2024-04-17T19:53:10.496900+0000","last_clean":"2024-04-17T19:53:10.496900+0000","last_became_active":"2024-04-17T19:53:04.478425+0000","last_became_peered":"2024-04-17T19:53:04.478425+0000","last_unstale":"2024-04-17T19:53:10.496900+0000","last_undegraded":"2024-04-17T19:53:10.496900+0000","last_fullsized":"2024-04-17T19:53:10.496900+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:16:15.623557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.529101+0000","last_change":"2024-04-17T19:53:09.526995+0000","last_active":"2024-04-17T19:53:10.529101+0000","last_peered":"2024-04-17T19:53:10.529101+0000","last_clean":"2024-04-17T19:53:10.529101+0000","last_became_active":"2024-04-17T19:53:09.525577+0000","last_became_peered":"2024-04-17T19:53:09.525577+0000","last_unstale":"2024-04-17T19:53:10.529101+0000","last_undegraded":"2024-04-17T19:53:10.529101+0000","last_fullsized":"2024-04-17T19:53:10.529101+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:52:59.924361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.866027+0000","last_change":"2024-04-17T19:53:05.463312+0000","last_active":"2024-04-17T19:53:11.866027+0000","last_peered":"2024-04-17T19:53:11.866027+0000","last_clean":"2024-04-17T19:53:11.866027+0000","last_became_active":"2024-04-17T19:53:05.462415+0000","last_became_peered":"2024-04-17T19:53:05.462415+0000","last_unstale":"2024-04-17T19:53:11.866027+0000","last_undegraded":"2024-04-17T19:53:11.866027+0000","last_fullsized":"2024-04-17T19:53:11.866027+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:27:51.520335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.867287+0000","last_change":"2024-04-17T19:53:04.471150+0000","last_active":"2024-04-17T19:53:11.867287+0000","last_peered":"2024-04-17T19:53:11.867287+0000","last_clean":"2024-04-17T19:53:11.867287+0000","last_became_active":"2024-04-17T19:53:04.470258+0000","last_became_peered":"2024-04-17T19:53:04.470258+0000","last_unstale":"2024-04-17T19:53:11.867287+0000","last_undegraded":"2024-04-17T19:53:11.867287+0000","last_fullsized":"2024-04-17T19:53:11.867287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:06:00.469757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.780980+0000","last_change":"2024-04-17T19:53:09.565387+0000","last_active":"2024-04-17T19:53:10.780980+0000","last_peered":"2024-04-17T19:53:10.780980+0000","last_clean":"2024-04-17T19:53:10.780980+0000","last_became_active":"2024-04-17T19:53:09.564134+0000","last_became_peered":"2024-04-17T19:53:09.564134+0000","last_unstale":"2024-04-17T19:53:10.780980+0000","last_undegraded":"2024-04-17T19:53:10.780980+0000","last_fullsized":"2024-04-17T19:53:10.780980+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:21:01.809464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.491285+0000","last_change":"2024-04-17T19:53:05.468962+0000","last_active":"2024-04-17T19:53:10.491285+0000","last_peered":"2024-04-17T19:53:10.491285+0000","last_clean":"2024-04-17T19:53:10.491285+0000","last_became_active":"2024-04-17T19:53:05.466996+0000","last_became_peered":"2024-04-17T19:53:05.466996+0000","last_unstale":"2024-04-17T19:53:10.491285+0000","last_undegraded":"2024-04-17T19:53:10.491285+0000","last_fullsized":"2024-04-17T19:53:10.491285+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:04:55.125411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.528304+0000","last_change":"2024-04-17T19:53:04.472916+0000","last_active":"2024-04-17T19:53:10.528304+0000","last_peered":"2024-04-17T19:53:10.528304+0000","last_clean":"2024-04-17T19:53:10.528304+0000","last_became_active":"2024-04-17T19:53:04.468136+0000","last_became_peered":"2024-04-17T19:53:04.468136+0000","last_unstale":"2024-04-17T19:53:10.528304+0000","last_undegraded":"2024-04-17T19:53:10.528304+0000","last_fullsized":"2024-04-17T19:53:10.528304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:23:02.868468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.864193+0000","last_change":"2024-04-17T19:53:09.558352+0000","last_active":"2024-04-17T19:53:11.864193+0000","last_peered":"2024-04-17T19:53:11.864193+0000","last_clean":"2024-04-17T19:53:11.864193+0000","last_became_active":"2024-04-17T19:53:09.557871+0000","last_became_peered":"2024-04-17T19:53:09.557871+0000","last_unstale":"2024-04-17T19:53:11.864193+0000","last_undegraded":"2024-04-17T19:53:11.864193+0000","last_fullsized":"2024-04-17T19:53:11.864193+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:34:07.690034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.867320+0000","last_change":"2024-04-17T19:53:05.467799+0000","last_active":"2024-04-17T19:53:11.867320+0000","last_peered":"2024-04-17T19:53:11.867320+0000","last_clean":"2024-04-17T19:53:11.867320+0000","last_became_active":"2024-04-17T19:53:05.465048+0000","last_became_peered":"2024-04-17T19:53:05.465048+0000","last_unstale":"2024-04-17T19:53:11.867320+0000","last_undegraded":"2024-04-17T19:53:11.867320+0000","last_fullsized":"2024-04-17T19:53:11.867320+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:19:09.456602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.494989+0000","last_change":"2024-04-17T19:53:04.469594+0000","last_active":"2024-04-17T19:53:10.494989+0000","last_peered":"2024-04-17T19:53:10.494989+0000","last_clean":"2024-04-17T19:53:10.494989+0000","last_became_active":"2024-04-17T19:53:04.469119+0000","last_became_peered":"2024-04-17T19:53:04.469119+0000","last_unstale":"2024-04-17T19:53:10.494989+0000","last_undegraded":"2024-04-17T19:53:10.494989+0000","last_fullsized":"2024-04-17T19:53:10.494989+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:40:30.547343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.863355+0000","last_change":"2024-04-17T19:53:09.527277+0000","last_active":"2024-04-17T19:53:11.863355+0000","last_peered":"2024-04-17T19:53:11.863355+0000","last_clean":"2024-04-17T19:53:11.863355+0000","last_became_active":"2024-04-17T19:53:09.526436+0000","last_became_peered":"2024-04-17T19:53:09.526436+0000","last_unstale":"2024-04-17T19:53:11.863355+0000","last_undegraded":"2024-04-17T19:53:11.863355+0000","last_fullsized":"2024-04-17T19:53:11.863355+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:54:31.569576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.867699+0000","last_change":"2024-04-17T19:53:05.443712+0000","last_active":"2024-04-17T19:53:11.867699+0000","last_peered":"2024-04-17T19:53:11.867699+0000","last_clean":"2024-04-17T19:53:11.867699+0000","last_became_active":"2024-04-17T19:53:05.442881+0000","last_became_peered":"2024-04-17T19:53:05.442881+0000","last_unstale":"2024-04-17T19:53:11.867699+0000","last_undegraded":"2024-04-17T19:53:11.867699+0000","last_fullsized":"2024-04-17T19:53:11.867699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:20:57.763858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.867688+0000","last_change":"2024-04-17T19:53:04.465717+0000","last_active":"2024-04-17T19:53:11.867688+0000","last_peered":"2024-04-17T19:53:11.867688+0000","last_clean":"2024-04-17T19:53:11.867688+0000","last_became_active":"2024-04-17T19:53:04.464701+0000","last_became_peered":"2024-04-17T19:53:04.464701+0000","last_unstale":"2024-04-17T19:53:11.867688+0000","last_undegraded":"2024-04-17T19:53:11.867688+0000","last_fullsized":"2024-04-17T19:53:11.867688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:18:11.256327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.866220+0000","last_change":"2024-04-17T19:53:09.530585+0000","last_active":"2024-04-17T19:53:11.866220+0000","last_peered":"2024-04-17T19:53:11.866220+0000","last_clean":"2024-04-17T19:53:11.866220+0000","last_became_active":"2024-04-17T19:53:09.529345+0000","last_became_peered":"2024-04-17T19:53:09.529345+0000","last_unstale":"2024-04-17T19:53:11.866220+0000","last_undegraded":"2024-04-17T19:53:11.866220+0000","last_fullsized":"2024-04-17T19:53:11.866220+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:01:38.507428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.497866+0000","last_change":"2024-04-17T19:53:05.452177+0000","last_active":"2024-04-17T19:53:10.497866+0000","last_peered":"2024-04-17T19:53:10.497866+0000","last_clean":"2024-04-17T19:53:10.497866+0000","last_became_active":"2024-04-17T19:53:05.451272+0000","last_became_peered":"2024-04-17T19:53:05.451272+0000","last_unstale":"2024-04-17T19:53:10.497866+0000","last_undegraded":"2024-04-17T19:53:10.497866+0000","last_fullsized":"2024-04-17T19:53:10.497866+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:51:17.675125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.493390+0000","last_change":"2024-04-17T19:53:04.471944+0000","last_active":"2024-04-17T19:53:10.493390+0000","last_peered":"2024-04-17T19:53:10.493390+0000","last_clean":"2024-04-17T19:53:10.493390+0000","last_became_active":"2024-04-17T19:53:04.471458+0000","last_became_peered":"2024-04-17T19:53:04.471458+0000","last_unstale":"2024-04-17T19:53:10.493390+0000","last_undegraded":"2024-04-17T19:53:10.493390+0000","last_fullsized":"2024-04-17T19:53:10.493390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:12:02.438192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.495688+0000","last_change":"2024-04-17T19:53:09.549998+0000","last_active":"2024-04-17T19:53:10.495688+0000","last_peered":"2024-04-17T19:53:10.495688+0000","last_clean":"2024-04-17T19:53:10.495688+0000","last_became_active":"2024-04-17T19:53:09.548136+0000","last_became_peered":"2024-04-17T19:53:09.548136+0000","last_unstale":"2024-04-17T19:53:10.495688+0000","last_undegraded":"2024-04-17T19:53:10.495688+0000","last_fullsized":"2024-04-17T19:53:10.495688+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:02:14.459968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.863519+0000","last_change":"2024-04-17T19:53:05.472884+0000","last_active":"2024-04-17T19:53:11.863519+0000","last_peered":"2024-04-17T19:53:11.863519+0000","last_clean":"2024-04-17T19:53:11.863519+0000","last_became_active":"2024-04-17T19:53:05.472513+0000","last_became_peered":"2024-04-17T19:53:05.472513+0000","last_unstale":"2024-04-17T19:53:11.863519+0000","last_undegraded":"2024-04-17T19:53:11.863519+0000","last_fullsized":"2024-04-17T19:53:11.863519+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:21:37.163564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.493966+0000","last_change":"2024-04-17T19:53:04.487713+0000","last_active":"2024-04-17T19:53:10.493966+0000","last_peered":"2024-04-17T19:53:10.493966+0000","last_clean":"2024-04-17T19:53:10.493966+0000","last_became_active":"2024-04-17T19:53:04.487005+0000","last_became_peered":"2024-04-17T19:53:04.487005+0000","last_unstale":"2024-04-17T19:53:10.493966+0000","last_undegraded":"2024-04-17T19:53:10.493966+0000","last_fullsized":"2024-04-17T19:53:10.493966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:53:36.130201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.496249+0000","last_change":"2024-04-17T19:53:09.547824+0000","last_active":"2024-04-17T19:53:10.496249+0000","last_peered":"2024-04-17T19:53:10.496249+0000","last_clean":"2024-04-17T19:53:10.496249+0000","last_became_active":"2024-04-17T19:53:09.545636+0000","last_became_peered":"2024-04-17T19:53:09.545636+0000","last_unstale":"2024-04-17T19:53:10.496249+0000","last_undegraded":"2024-04-17T19:53:10.496249+0000","last_fullsized":"2024-04-17T19:53:10.496249+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:06:17.885652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.529514+0000","last_change":"2024-04-17T19:53:05.465820+0000","last_active":"2024-04-17T19:53:10.529514+0000","last_peered":"2024-04-17T19:53:10.529514+0000","last_clean":"2024-04-17T19:53:10.529514+0000","last_became_active":"2024-04-17T19:53:05.464376+0000","last_became_peered":"2024-04-17T19:53:05.464376+0000","last_unstale":"2024-04-17T19:53:10.529514+0000","last_undegraded":"2024-04-17T19:53:10.529514+0000","last_fullsized":"2024-04-17T19:53:10.529514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:53:13.956259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.492409+0000","last_change":"2024-04-17T19:53:04.464706+0000","last_active":"2024-04-17T19:53:10.492409+0000","last_peered":"2024-04-17T19:53:10.492409+0000","last_clean":"2024-04-17T19:53:10.492409+0000","last_became_active":"2024-04-17T19:53:04.464109+0000","last_became_peered":"2024-04-17T19:53:04.464109+0000","last_unstale":"2024-04-17T19:53:10.492409+0000","last_undegraded":"2024-04-17T19:53:10.492409+0000","last_fullsized":"2024-04-17T19:53:10.492409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:38:40.499868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.497647+0000","last_change":"2024-04-17T19:53:09.553078+0000","last_active":"2024-04-17T19:53:10.497647+0000","last_peered":"2024-04-17T19:53:10.497647+0000","last_clean":"2024-04-17T19:53:10.497647+0000","last_became_active":"2024-04-17T19:53:09.548806+0000","last_became_peered":"2024-04-17T19:53:09.548806+0000","last_unstale":"2024-04-17T19:53:10.497647+0000","last_undegraded":"2024-04-17T19:53:10.497647+0000","last_fullsized":"2024-04-17T19:53:10.497647+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:33:37.250066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.493540+0000","last_change":"2024-04-17T19:53:05.476631+0000","last_active":"2024-04-17T19:53:10.493540+0000","last_peered":"2024-04-17T19:53:10.493540+0000","last_clean":"2024-04-17T19:53:10.493540+0000","last_became_active":"2024-04-17T19:53:05.474164+0000","last_became_peered":"2024-04-17T19:53:05.474164+0000","last_unstale":"2024-04-17T19:53:10.493540+0000","last_undegraded":"2024-04-17T19:53:10.493540+0000","last_fullsized":"2024-04-17T19:53:10.493540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:53:13.956259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.779561+0000","last_change":"2024-04-17T19:53:04.486117+0000","last_active":"2024-04-17T19:53:10.779561+0000","last_peered":"2024-04-17T19:53:10.779561+0000","last_clean":"2024-04-17T19:53:10.779561+0000","last_became_active":"2024-04-17T19:53:04.485424+0000","last_became_peered":"2024-04-17T19:53:04.485424+0000","last_unstale":"2024-04-17T19:53:10.779561+0000","last_undegraded":"2024-04-17T19:53:10.779561+0000","last_fullsized":"2024-04-17T19:53:10.779561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:21:45.875274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.496364+0000","last_change":"2024-04-17T19:53:09.549846+0000","last_active":"2024-04-17T19:53:10.496364+0000","last_peered":"2024-04-17T19:53:10.496364+0000","last_clean":"2024-04-17T19:53:10.496364+0000","last_became_active":"2024-04-17T19:53:09.548070+0000","last_became_peered":"2024-04-17T19:53:09.548070+0000","last_unstale":"2024-04-17T19:53:10.496364+0000","last_undegraded":"2024-04-17T19:53:10.496364+0000","last_fullsized":"2024-04-17T19:53:10.496364+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:05.469665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.495415+0000","last_change":"2024-04-17T19:53:05.469993+0000","last_active":"2024-04-17T19:53:10.495415+0000","last_peered":"2024-04-17T19:53:10.495415+0000","last_clean":"2024-04-17T19:53:10.495415+0000","last_became_active":"2024-04-17T19:53:05.468241+0000","last_became_peered":"2024-04-17T19:53:05.468241+0000","last_unstale":"2024-04-17T19:53:10.495415+0000","last_undegraded":"2024-04-17T19:53:10.495415+0000","last_fullsized":"2024-04-17T19:53:10.495415+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:39:15.005822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.491765+0000","last_change":"2024-04-17T19:53:04.484259+0000","last_active":"2024-04-17T19:53:10.491765+0000","last_peered":"2024-04-17T19:53:10.491765+0000","last_clean":"2024-04-17T19:53:10.491765+0000","last_became_active":"2024-04-17T19:53:04.483882+0000","last_became_peered":"2024-04-17T19:53:04.483882+0000","last_unstale":"2024-04-17T19:53:10.491765+0000","last_undegraded":"2024-04-17T19:53:10.491765+0000","last_fullsized":"2024-04-17T19:53:10.491765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:18:11.256327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.495038+0000","last_change":"2024-04-17T19:53:09.559932+0000","last_active":"2024-04-17T19:53:10.495038+0000","last_peered":"2024-04-17T19:53:10.495038+0000","last_clean":"2024-04-17T19:53:10.495038+0000","last_became_active":"2024-04-17T19:53:09.558888+0000","last_became_peered":"2024-04-17T19:53:09.558888+0000","last_unstale":"2024-04-17T19:53:10.495038+0000","last_undegraded":"2024-04-17T19:53:10.495038+0000","last_fullsized":"2024-04-17T19:53:10.495038+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:22:59.388953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.866936+0000","last_change":"2024-04-17T19:53:05.463658+0000","last_active":"2024-04-17T19:53:11.866936+0000","last_peered":"2024-04-17T19:53:11.866936+0000","last_clean":"2024-04-17T19:53:11.866936+0000","last_became_active":"2024-04-17T19:53:05.462437+0000","last_became_peered":"2024-04-17T19:53:05.462437+0000","last_unstale":"2024-04-17T19:53:11.866936+0000","last_undegraded":"2024-04-17T19:53:11.866936+0000","last_fullsized":"2024-04-17T19:53:11.866936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:06:14.699788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.492615+0000","last_change":"2024-04-17T19:53:04.459172+0000","last_active":"2024-04-17T19:53:10.492615+0000","last_peered":"2024-04-17T19:53:10.492615+0000","last_clean":"2024-04-17T19:53:10.492615+0000","last_became_active":"2024-04-17T19:53:04.458798+0000","last_became_peered":"2024-04-17T19:53:04.458798+0000","last_unstale":"2024-04-17T19:53:10.492615+0000","last_undegraded":"2024-04-17T19:53:10.492615+0000","last_fullsized":"2024-04-17T19:53:10.492615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:21:36.152247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":177,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.527066+0000","last_change":"2024-04-17T19:52:54.651873+0000","last_active":"2024-04-17T19:53:11.527066+0000","last_peered":"2024-04-17T19:53:11.527066+0000","last_clean":"2024-04-17T19:53:11.527066+0000","last_became_active":"2024-04-17T19:52:54.649700+0000","last_became_peered":"2024-04-17T19:52:54.649700+0000","last_unstale":"2024-04-17T19:53:11.527066+0000","last_undegraded":"2024-04-17T19:53:11.527066+0000","last_fullsized":"2024-04-17T19:53:11.527066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:52:53.245174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:52:53.245174+0000","last_clean_scrub_stamp":"2024-04-17T19:52:53.245174+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:26:16.094093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.493284+0000","last_change":"2024-04-17T19:53:09.520288+0000","last_active":"2024-04-17T19:53:10.493284+0000","last_peered":"2024-04-17T19:53:10.493284+0000","last_clean":"2024-04-17T19:53:10.493284+0000","last_became_active":"2024-04-17T19:53:09.519226+0000","last_became_peered":"2024-04-17T19:53:09.519226+0000","last_unstale":"2024-04-17T19:53:10.493284+0000","last_undegraded":"2024-04-17T19:53:10.493284+0000","last_fullsized":"2024-04-17T19:53:10.493284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:35:04.617369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.492930+0000","last_change":"2024-04-17T19:53:05.475968+0000","last_active":"2024-04-17T19:53:10.492930+0000","last_peered":"2024-04-17T19:53:10.492930+0000","last_clean":"2024-04-17T19:53:10.492930+0000","last_became_active":"2024-04-17T19:53:05.475600+0000","last_became_peered":"2024-04-17T19:53:05.475600+0000","last_unstale":"2024-04-17T19:53:10.492930+0000","last_undegraded":"2024-04-17T19:53:10.492930+0000","last_fullsized":"2024-04-17T19:53:10.492930+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:34:03.644428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.497904+0000","last_change":"2024-04-17T19:53:04.457214+0000","last_active":"2024-04-17T19:53:10.497904+0000","last_peered":"2024-04-17T19:53:10.497904+0000","last_clean":"2024-04-17T19:53:10.497904+0000","last_became_active":"2024-04-17T19:53:04.453473+0000","last_became_peered":"2024-04-17T19:53:04.453473+0000","last_unstale":"2024-04-17T19:53:10.497904+0000","last_undegraded":"2024-04-17T19:53:10.497904+0000","last_fullsized":"2024-04-17T19:53:10.497904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:14:03.008171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.863346+0000","last_change":"2024-04-17T19:53:09.548981+0000","last_active":"2024-04-17T19:53:11.863346+0000","last_peered":"2024-04-17T19:53:11.863346+0000","last_clean":"2024-04-17T19:53:11.863346+0000","last_became_active":"2024-04-17T19:53:09.548575+0000","last_became_peered":"2024-04-17T19:53:09.548575+0000","last_unstale":"2024-04-17T19:53:11.863346+0000","last_undegraded":"2024-04-17T19:53:11.863346+0000","last_fullsized":"2024-04-17T19:53:11.863346+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:05:25.218656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.529559+0000","last_change":"2024-04-17T19:53:05.464697+0000","last_active":"2024-04-17T19:53:10.529559+0000","last_peered":"2024-04-17T19:53:10.529559+0000","last_clean":"2024-04-17T19:53:10.529559+0000","last_became_active":"2024-04-17T19:53:05.463935+0000","last_became_peered":"2024-04-17T19:53:05.463935+0000","last_unstale":"2024-04-17T19:53:10.529559+0000","last_undegraded":"2024-04-17T19:53:10.529559+0000","last_fullsized":"2024-04-17T19:53:10.529559+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:15:45.727550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.494522+0000","last_change":"2024-04-17T19:53:04.475555+0000","last_active":"2024-04-17T19:53:10.494522+0000","last_peered":"2024-04-17T19:53:10.494522+0000","last_clean":"2024-04-17T19:53:10.494522+0000","last_became_active":"2024-04-17T19:53:04.467881+0000","last_became_peered":"2024-04-17T19:53:04.467881+0000","last_unstale":"2024-04-17T19:53:10.494522+0000","last_undegraded":"2024-04-17T19:53:10.494522+0000","last_fullsized":"2024-04-17T19:53:10.494522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:22:17.837334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.494205+0000","last_change":"2024-04-17T19:53:09.535560+0000","last_active":"2024-04-17T19:53:10.494205+0000","last_peered":"2024-04-17T19:53:10.494205+0000","last_clean":"2024-04-17T19:53:10.494205+0000","last_became_active":"2024-04-17T19:53:09.534631+0000","last_became_peered":"2024-04-17T19:53:09.534631+0000","last_unstale":"2024-04-17T19:53:10.494205+0000","last_undegraded":"2024-04-17T19:53:10.494205+0000","last_fullsized":"2024-04-17T19:53:10.494205+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:30:27.062045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.530016+0000","last_change":"2024-04-17T19:53:05.460324+0000","last_active":"2024-04-17T19:53:10.530016+0000","last_peered":"2024-04-17T19:53:10.530016+0000","last_clean":"2024-04-17T19:53:10.530016+0000","last_became_active":"2024-04-17T19:53:05.459941+0000","last_became_peered":"2024-04-17T19:53:05.459941+0000","last_unstale":"2024-04-17T19:53:10.530016+0000","last_undegraded":"2024-04-17T19:53:10.530016+0000","last_fullsized":"2024-04-17T19:53:10.530016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:34:03.644428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.867646+0000","last_change":"2024-04-17T19:53:04.467765+0000","last_active":"2024-04-17T19:53:11.867646+0000","last_peered":"2024-04-17T19:53:11.867646+0000","last_clean":"2024-04-17T19:53:11.867646+0000","last_became_active":"2024-04-17T19:53:04.466753+0000","last_became_peered":"2024-04-17T19:53:04.466753+0000","last_unstale":"2024-04-17T19:53:11.867646+0000","last_undegraded":"2024-04-17T19:53:11.867646+0000","last_fullsized":"2024-04-17T19:53:11.867646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:53:36.130201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.491139+0000","last_change":"2024-04-17T19:53:09.519632+0000","last_active":"2024-04-17T19:53:10.491139+0000","last_peered":"2024-04-17T19:53:10.491139+0000","last_clean":"2024-04-17T19:53:10.491139+0000","last_became_active":"2024-04-17T19:53:09.518979+0000","last_became_peered":"2024-04-17T19:53:09.518979+0000","last_unstale":"2024-04-17T19:53:10.491139+0000","last_undegraded":"2024-04-17T19:53:10.491139+0000","last_fullsized":"2024-04-17T19:53:10.491139+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:07:11.268705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.864298+0000","last_change":"2024-04-17T19:53:05.464583+0000","last_active":"2024-04-17T19:53:11.864298+0000","last_peered":"2024-04-17T19:53:11.864298+0000","last_clean":"2024-04-17T19:53:11.864298+0000","last_became_active":"2024-04-17T19:53:05.464158+0000","last_became_peered":"2024-04-17T19:53:05.464158+0000","last_unstale":"2024-04-17T19:53:11.864298+0000","last_undegraded":"2024-04-17T19:53:11.864298+0000","last_fullsized":"2024-04-17T19:53:11.864298+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:38:41.511185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.530315+0000","last_change":"2024-04-17T19:53:04.477502+0000","last_active":"2024-04-17T19:53:10.530315+0000","last_peered":"2024-04-17T19:53:10.530315+0000","last_clean":"2024-04-17T19:53:10.530315+0000","last_became_active":"2024-04-17T19:53:04.477162+0000","last_became_peered":"2024-04-17T19:53:04.477162+0000","last_unstale":"2024-04-17T19:53:10.530315+0000","last_undegraded":"2024-04-17T19:53:10.530315+0000","last_fullsized":"2024-04-17T19:53:10.530315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:21:36.152247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.528690+0000","last_change":"2024-04-17T19:53:09.533476+0000","last_active":"2024-04-17T19:53:11.528690+0000","last_peered":"2024-04-17T19:53:11.528690+0000","last_clean":"2024-04-17T19:53:11.528690+0000","last_became_active":"2024-04-17T19:53:09.532715+0000","last_became_peered":"2024-04-17T19:53:09.532715+0000","last_unstale":"2024-04-17T19:53:11.528690+0000","last_undegraded":"2024-04-17T19:53:11.528690+0000","last_fullsized":"2024-04-17T19:53:11.528690+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:38:45.556791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.491188+0000","last_change":"2024-04-17T19:53:05.473330+0000","last_active":"2024-04-17T19:53:10.491188+0000","last_peered":"2024-04-17T19:53:10.491188+0000","last_clean":"2024-04-17T19:53:10.491188+0000","last_became_active":"2024-04-17T19:53:05.468223+0000","last_became_peered":"2024-04-17T19:53:05.468223+0000","last_unstale":"2024-04-17T19:53:10.491188+0000","last_undegraded":"2024-04-17T19:53:10.491188+0000","last_fullsized":"2024-04-17T19:53:10.491188+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:01:34.461822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.866359+0000","last_change":"2024-04-17T19:53:04.461896+0000","last_active":"2024-04-17T19:53:11.866359+0000","last_peered":"2024-04-17T19:53:11.866359+0000","last_clean":"2024-04-17T19:53:11.866359+0000","last_became_active":"2024-04-17T19:53:04.460919+0000","last_became_peered":"2024-04-17T19:53:04.460919+0000","last_unstale":"2024-04-17T19:53:11.866359+0000","last_undegraded":"2024-04-17T19:53:11.866359+0000","last_fullsized":"2024-04-17T19:53:11.866359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:22:17.837334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.495547+0000","last_change":"2024-04-17T19:53:09.547397+0000","last_active":"2024-04-17T19:53:10.495547+0000","last_peered":"2024-04-17T19:53:10.495547+0000","last_clean":"2024-04-17T19:53:10.495547+0000","last_became_active":"2024-04-17T19:53:09.546048+0000","last_became_peered":"2024-04-17T19:53:09.546048+0000","last_unstale":"2024-04-17T19:53:10.495547+0000","last_undegraded":"2024-04-17T19:53:10.495547+0000","last_fullsized":"2024-04-17T19:53:10.495547+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:58:59.810415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.528039+0000","last_change":"2024-04-17T19:53:05.474322+0000","last_active":"2024-04-17T19:53:11.528039+0000","last_peered":"2024-04-17T19:53:11.528039+0000","last_clean":"2024-04-17T19:53:11.528039+0000","last_became_active":"2024-04-17T19:53:05.473892+0000","last_became_peered":"2024-04-17T19:53:05.473892+0000","last_unstale":"2024-04-17T19:53:11.528039+0000","last_undegraded":"2024-04-17T19:53:11.528039+0000","last_fullsized":"2024-04-17T19:53:11.528039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:18:12.267644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.528714+0000","last_change":"2024-04-17T19:53:04.460138+0000","last_active":"2024-04-17T19:53:10.528714+0000","last_peered":"2024-04-17T19:53:10.528714+0000","last_clean":"2024-04-17T19:53:10.528714+0000","last_became_active":"2024-04-17T19:53:04.459663+0000","last_became_peered":"2024-04-17T19:53:04.459663+0000","last_unstale":"2024-04-17T19:53:10.528714+0000","last_undegraded":"2024-04-17T19:53:10.528714+0000","last_fullsized":"2024-04-17T19:53:10.528714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:06:00.469757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.494889+0000","last_change":"2024-04-17T19:53:09.533802+0000","last_active":"2024-04-17T19:53:10.494889+0000","last_peered":"2024-04-17T19:53:10.494889+0000","last_clean":"2024-04-17T19:53:10.494889+0000","last_became_active":"2024-04-17T19:53:09.532504+0000","last_became_peered":"2024-04-17T19:53:09.532504+0000","last_unstale":"2024-04-17T19:53:10.494889+0000","last_undegraded":"2024-04-17T19:53:10.494889+0000","last_fullsized":"2024-04-17T19:53:10.494889+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:04:59.171017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.492057+0000","last_change":"2024-04-17T19:53:05.467855+0000","last_active":"2024-04-17T19:53:10.492057+0000","last_peered":"2024-04-17T19:53:10.492057+0000","last_clean":"2024-04-17T19:53:10.492057+0000","last_became_active":"2024-04-17T19:53:05.467349+0000","last_became_peered":"2024-04-17T19:53:05.467349+0000","last_unstale":"2024-04-17T19:53:10.492057+0000","last_undegraded":"2024-04-17T19:53:10.492057+0000","last_fullsized":"2024-04-17T19:53:10.492057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:52:55.878755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.492398+0000","last_change":"2024-04-17T19:53:04.465826+0000","last_active":"2024-04-17T19:53:10.492398+0000","last_peered":"2024-04-17T19:53:10.492398+0000","last_clean":"2024-04-17T19:53:10.492398+0000","last_became_active":"2024-04-17T19:53:04.465333+0000","last_became_peered":"2024-04-17T19:53:04.465333+0000","last_unstale":"2024-04-17T19:53:10.492398+0000","last_undegraded":"2024-04-17T19:53:10.492398+0000","last_fullsized":"2024-04-17T19:53:10.492398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:25:21.542158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.497344+0000","last_change":"2024-04-17T19:53:09.550127+0000","last_active":"2024-04-17T19:53:10.497344+0000","last_peered":"2024-04-17T19:53:10.497344+0000","last_clean":"2024-04-17T19:53:10.497344+0000","last_became_active":"2024-04-17T19:53:09.548109+0000","last_became_peered":"2024-04-17T19:53:09.548109+0000","last_unstale":"2024-04-17T19:53:10.497344+0000","last_undegraded":"2024-04-17T19:53:10.497344+0000","last_fullsized":"2024-04-17T19:53:10.497344+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:03:47.252621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.496697+0000","last_change":"2024-04-17T19:53:05.455185+0000","last_active":"2024-04-17T19:53:10.496697+0000","last_peered":"2024-04-17T19:53:10.496697+0000","last_clean":"2024-04-17T19:53:10.496697+0000","last_became_active":"2024-04-17T19:53:05.454358+0000","last_became_peered":"2024-04-17T19:53:05.454358+0000","last_unstale":"2024-04-17T19:53:10.496697+0000","last_undegraded":"2024-04-17T19:53:10.496697+0000","last_fullsized":"2024-04-17T19:53:10.496697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:26:54.093651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.780019+0000","last_change":"2024-04-17T19:53:04.474288+0000","last_active":"2024-04-17T19:53:10.780019+0000","last_peered":"2024-04-17T19:53:10.780019+0000","last_clean":"2024-04-17T19:53:10.780019+0000","last_became_active":"2024-04-17T19:53:04.473389+0000","last_became_peered":"2024-04-17T19:53:04.473389+0000","last_unstale":"2024-04-17T19:53:10.780019+0000","last_undegraded":"2024-04-17T19:53:10.780019+0000","last_fullsized":"2024-04-17T19:53:10.780019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:31:27.754909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.492763+0000","last_change":"2024-04-17T19:53:09.524630+0000","last_active":"2024-04-17T19:53:10.492763+0000","last_peered":"2024-04-17T19:53:10.492763+0000","last_clean":"2024-04-17T19:53:10.492763+0000","last_became_active":"2024-04-17T19:53:09.521522+0000","last_became_peered":"2024-04-17T19:53:09.521522+0000","last_unstale":"2024-04-17T19:53:10.492763+0000","last_undegraded":"2024-04-17T19:53:10.492763+0000","last_fullsized":"2024-04-17T19:53:10.492763+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:59:47.402073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.529373+0000","last_change":"2024-04-17T19:53:05.455865+0000","last_active":"2024-04-17T19:53:10.529373+0000","last_peered":"2024-04-17T19:53:10.529373+0000","last_clean":"2024-04-17T19:53:10.529373+0000","last_became_active":"2024-04-17T19:53:05.455429+0000","last_became_peered":"2024-04-17T19:53:05.455429+0000","last_unstale":"2024-04-17T19:53:10.529373+0000","last_undegraded":"2024-04-17T19:53:10.529373+0000","last_fullsized":"2024-04-17T19:53:10.529373+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:01:34.461822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'10","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:20.688890+0000","last_change":"2024-04-17T19:53:04.460295+0000","last_active":"2024-04-17T19:53:20.688890+0000","last_peered":"2024-04-17T19:53:20.688890+0000","last_clean":"2024-04-17T19:53:20.688890+0000","last_became_active":"2024-04-17T19:53:04.459855+0000","last_became_peered":"2024-04-17T19:53:04.459855+0000","last_unstale":"2024-04-17T19:53:20.688890+0000","last_undegraded":"2024-04-17T19:53:20.688890+0000","last_fullsized":"2024-04-17T19:53:20.688890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:21:45.875274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.866367+0000","last_change":"2024-04-17T19:53:09.530008+0000","last_active":"2024-04-17T19:53:11.866367+0000","last_peered":"2024-04-17T19:53:11.866367+0000","last_clean":"2024-04-17T19:53:11.866367+0000","last_became_active":"2024-04-17T19:53:09.528987+0000","last_became_peered":"2024-04-17T19:53:09.528987+0000","last_unstale":"2024-04-17T19:53:11.866367+0000","last_undegraded":"2024-04-17T19:53:11.866367+0000","last_fullsized":"2024-04-17T19:53:11.866367+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:34:07.690034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.491729+0000","last_change":"2024-04-17T19:53:05.472755+0000","last_active":"2024-04-17T19:53:10.491729+0000","last_peered":"2024-04-17T19:53:10.491729+0000","last_clean":"2024-04-17T19:53:10.491729+0000","last_became_active":"2024-04-17T19:53:05.468432+0000","last_became_peered":"2024-04-17T19:53:05.468432+0000","last_unstale":"2024-04-17T19:53:10.491729+0000","last_undegraded":"2024-04-17T19:53:10.491729+0000","last_fullsized":"2024-04-17T19:53:10.491729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:30:23.016439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.780569+0000","last_change":"2024-04-17T19:53:04.474378+0000","last_active":"2024-04-17T19:53:10.780569+0000","last_peered":"2024-04-17T19:53:10.780569+0000","last_clean":"2024-04-17T19:53:10.780569+0000","last_became_active":"2024-04-17T19:53:04.473458+0000","last_became_peered":"2024-04-17T19:53:04.473458+0000","last_unstale":"2024-04-17T19:53:10.780569+0000","last_undegraded":"2024-04-17T19:53:10.780569+0000","last_fullsized":"2024-04-17T19:53:10.780569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:16:30.888573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.863832+0000","last_change":"2024-04-17T19:53:09.558527+0000","last_active":"2024-04-17T19:53:11.863832+0000","last_peered":"2024-04-17T19:53:11.863832+0000","last_clean":"2024-04-17T19:53:11.863832+0000","last_became_active":"2024-04-17T19:53:09.557653+0000","last_became_peered":"2024-04-17T19:53:09.557653+0000","last_unstale":"2024-04-17T19:53:11.863832+0000","last_undegraded":"2024-04-17T19:53:11.863832+0000","last_fullsized":"2024-04-17T19:53:11.863832+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:01:38.507428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.495008+0000","last_change":"2024-04-17T19:53:05.467990+0000","last_active":"2024-04-17T19:53:10.495008+0000","last_peered":"2024-04-17T19:53:10.495008+0000","last_clean":"2024-04-17T19:53:10.495008+0000","last_became_active":"2024-04-17T19:53:05.461293+0000","last_became_peered":"2024-04-17T19:53:05.461293+0000","last_unstale":"2024-04-17T19:53:10.495008+0000","last_undegraded":"2024-04-17T19:53:10.495008+0000","last_fullsized":"2024-04-17T19:53:10.495008+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:01:34.461822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.530046+0000","last_change":"2024-04-17T19:53:04.472928+0000","last_active":"2024-04-17T19:53:10.530046+0000","last_peered":"2024-04-17T19:53:10.530046+0000","last_clean":"2024-04-17T19:53:10.530046+0000","last_became_active":"2024-04-17T19:53:04.467986+0000","last_became_peered":"2024-04-17T19:53:04.467986+0000","last_unstale":"2024-04-17T19:53:10.530046+0000","last_undegraded":"2024-04-17T19:53:10.530046+0000","last_fullsized":"2024-04-17T19:53:10.530046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:53:36.130201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.779233+0000","last_change":"2024-04-17T19:53:09.560792+0000","last_active":"2024-04-17T19:53:10.779233+0000","last_peered":"2024-04-17T19:53:10.779233+0000","last_clean":"2024-04-17T19:53:10.779233+0000","last_became_active":"2024-04-17T19:53:09.558779+0000","last_became_peered":"2024-04-17T19:53:09.558779+0000","last_unstale":"2024-04-17T19:53:10.779233+0000","last_undegraded":"2024-04-17T19:53:10.779233+0000","last_fullsized":"2024-04-17T19:53:10.779233+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:13:52.775623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.864234+0000","last_change":"2024-04-17T19:53:05.459934+0000","last_active":"2024-04-17T19:53:11.864234+0000","last_peered":"2024-04-17T19:53:11.864234+0000","last_clean":"2024-04-17T19:53:11.864234+0000","last_became_active":"2024-04-17T19:53:05.459538+0000","last_became_peered":"2024-04-17T19:53:05.459538+0000","last_unstale":"2024-04-17T19:53:11.864234+0000","last_undegraded":"2024-04-17T19:53:11.864234+0000","last_fullsized":"2024-04-17T19:53:11.864234+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:25:22.553475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.529342+0000","last_change":"2024-04-17T19:53:04.460345+0000","last_active":"2024-04-17T19:53:11.529342+0000","last_peered":"2024-04-17T19:53:11.529342+0000","last_clean":"2024-04-17T19:53:11.529342+0000","last_became_active":"2024-04-17T19:53:04.459787+0000","last_became_peered":"2024-04-17T19:53:04.459787+0000","last_unstale":"2024-04-17T19:53:11.529342+0000","last_undegraded":"2024-04-17T19:53:11.529342+0000","last_fullsized":"2024-04-17T19:53:11.529342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:16:30.888573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.866660+0000","last_change":"2024-04-17T19:53:09.557144+0000","last_active":"2024-04-17T19:53:11.866660+0000","last_peered":"2024-04-17T19:53:11.866660+0000","last_clean":"2024-04-17T19:53:11.866660+0000","last_became_active":"2024-04-17T19:53:09.555953+0000","last_became_peered":"2024-04-17T19:53:09.555953+0000","last_unstale":"2024-04-17T19:53:11.866660+0000","last_undegraded":"2024-04-17T19:53:11.866660+0000","last_fullsized":"2024-04-17T19:53:11.866660+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:10:36.885109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.867320+0000","last_change":"2024-04-17T19:53:09.536930+0000","last_active":"2024-04-17T19:53:11.867320+0000","last_peered":"2024-04-17T19:53:11.867320+0000","last_clean":"2024-04-17T19:53:11.867320+0000","last_became_active":"2024-04-17T19:53:09.535559+0000","last_became_peered":"2024-04-17T19:53:09.535559+0000","last_unstale":"2024-04-17T19:53:11.867320+0000","last_undegraded":"2024-04-17T19:53:11.867320+0000","last_fullsized":"2024-04-17T19:53:11.867320+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:29:54.335720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.867019+0000","last_change":"2024-04-17T19:53:05.440653+0000","last_active":"2024-04-17T19:53:11.867019+0000","last_peered":"2024-04-17T19:53:11.867019+0000","last_clean":"2024-04-17T19:53:11.867019+0000","last_became_active":"2024-04-17T19:53:05.439793+0000","last_became_peered":"2024-04-17T19:53:05.439793+0000","last_unstale":"2024-04-17T19:53:11.867019+0000","last_undegraded":"2024-04-17T19:53:11.867019+0000","last_fullsized":"2024-04-17T19:53:11.867019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:10:21.772873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.491426+0000","last_change":"2024-04-17T19:53:04.461705+0000","last_active":"2024-04-17T19:53:10.491426+0000","last_peered":"2024-04-17T19:53:10.491426+0000","last_clean":"2024-04-17T19:53:10.491426+0000","last_became_active":"2024-04-17T19:53:04.461020+0000","last_became_peered":"2024-04-17T19:53:04.461020+0000","last_unstale":"2024-04-17T19:53:10.491426+0000","last_undegraded":"2024-04-17T19:53:10.491426+0000","last_fullsized":"2024-04-17T19:53:10.491426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:53:36.130201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.494505+0000","last_change":"2024-04-17T19:53:09.535147+0000","last_active":"2024-04-17T19:53:10.494505+0000","last_peered":"2024-04-17T19:53:10.494505+0000","last_clean":"2024-04-17T19:53:10.494505+0000","last_became_active":"2024-04-17T19:53:09.534655+0000","last_became_peered":"2024-04-17T19:53:09.534655+0000","last_unstale":"2024-04-17T19:53:10.494505+0000","last_undegraded":"2024-04-17T19:53:10.494505+0000","last_fullsized":"2024-04-17T19:53:10.494505+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:06:37.779654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.494234+0000","last_change":"2024-04-17T19:53:05.455848+0000","last_active":"2024-04-17T19:53:10.494234+0000","last_peered":"2024-04-17T19:53:10.494234+0000","last_clean":"2024-04-17T19:53:10.494234+0000","last_became_active":"2024-04-17T19:53:05.452844+0000","last_became_peered":"2024-04-17T19:53:05.452844+0000","last_unstale":"2024-04-17T19:53:10.494234+0000","last_undegraded":"2024-04-17T19:53:10.494234+0000","last_fullsized":"2024-04-17T19:53:10.494234+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:54:27.523970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.496158+0000","last_change":"2024-04-17T19:53:04.470824+0000","last_active":"2024-04-17T19:53:10.496158+0000","last_peered":"2024-04-17T19:53:10.496158+0000","last_clean":"2024-04-17T19:53:10.496158+0000","last_became_active":"2024-04-17T19:53:04.469777+0000","last_became_peered":"2024-04-17T19:53:04.469777+0000","last_unstale":"2024-04-17T19:53:10.496158+0000","last_undegraded":"2024-04-17T19:53:10.496158+0000","last_fullsized":"2024-04-17T19:53:10.496158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:30:04.861958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.492143+0000","last_change":"2024-04-17T19:53:04.469785+0000","last_active":"2024-04-17T19:53:10.492143+0000","last_peered":"2024-04-17T19:53:10.492143+0000","last_clean":"2024-04-17T19:53:10.492143+0000","last_became_active":"2024-04-17T19:53:04.469297+0000","last_became_peered":"2024-04-17T19:53:04.469297+0000","last_unstale":"2024-04-17T19:53:10.492143+0000","last_undegraded":"2024-04-17T19:53:10.492143+0000","last_fullsized":"2024-04-17T19:53:10.492143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:50:02.697725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.866551+0000","last_change":"2024-04-17T19:53:05.460191+0000","last_active":"2024-04-17T19:53:11.866551+0000","last_peered":"2024-04-17T19:53:11.866551+0000","last_clean":"2024-04-17T19:53:11.866551+0000","last_became_active":"2024-04-17T19:53:05.459616+0000","last_became_peered":"2024-04-17T19:53:05.459616+0000","last_unstale":"2024-04-17T19:53:11.866551+0000","last_undegraded":"2024-04-17T19:53:11.866551+0000","last_fullsized":"2024-04-17T19:53:11.866551+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:12:15.307126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.867060+0000","last_change":"2024-04-17T19:53:09.557279+0000","last_active":"2024-04-17T19:53:11.867060+0000","last_peered":"2024-04-17T19:53:11.867060+0000","last_clean":"2024-04-17T19:53:11.867060+0000","last_became_active":"2024-04-17T19:53:09.556190+0000","last_became_peered":"2024-04-17T19:53:09.556190+0000","last_unstale":"2024-04-17T19:53:11.867060+0000","last_undegraded":"2024-04-17T19:53:11.867060+0000","last_fullsized":"2024-04-17T19:53:11.867060+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:40:02.858481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.495230+0000","last_change":"2024-04-17T19:53:04.487292+0000","last_active":"2024-04-17T19:53:10.495230+0000","last_peered":"2024-04-17T19:53:10.495230+0000","last_clean":"2024-04-17T19:53:10.495230+0000","last_became_active":"2024-04-17T19:53:04.486707+0000","last_became_peered":"2024-04-17T19:53:04.486707+0000","last_unstale":"2024-04-17T19:53:10.495230+0000","last_undegraded":"2024-04-17T19:53:10.495230+0000","last_fullsized":"2024-04-17T19:53:10.495230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:48:50.049562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.527598+0000","last_change":"2024-04-17T19:53:05.449319+0000","last_active":"2024-04-17T19:53:11.527598+0000","last_peered":"2024-04-17T19:53:11.527598+0000","last_clean":"2024-04-17T19:53:11.527598+0000","last_became_active":"2024-04-17T19:53:05.448374+0000","last_became_peered":"2024-04-17T19:53:05.448374+0000","last_unstale":"2024-04-17T19:53:11.527598+0000","last_undegraded":"2024-04-17T19:53:11.527598+0000","last_fullsized":"2024-04-17T19:53:11.527598+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:21:37.163564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.780524+0000","last_change":"2024-04-17T19:53:09.561127+0000","last_active":"2024-04-17T19:53:10.780524+0000","last_peered":"2024-04-17T19:53:10.780524+0000","last_clean":"2024-04-17T19:53:10.780524+0000","last_became_active":"2024-04-17T19:53:09.560076+0000","last_became_peered":"2024-04-17T19:53:09.560076+0000","last_unstale":"2024-04-17T19:53:10.780524+0000","last_undegraded":"2024-04-17T19:53:10.780524+0000","last_fullsized":"2024-04-17T19:53:10.780524+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:25:20.343613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.863628+0000","last_change":"2024-04-17T19:53:05.472665+0000","last_active":"2024-04-17T19:53:11.863628+0000","last_peered":"2024-04-17T19:53:11.863628+0000","last_clean":"2024-04-17T19:53:11.863628+0000","last_became_active":"2024-04-17T19:53:05.472324+0000","last_became_peered":"2024-04-17T19:53:05.472324+0000","last_unstale":"2024-04-17T19:53:11.863628+0000","last_undegraded":"2024-04-17T19:53:11.863628+0000","last_fullsized":"2024-04-17T19:53:11.863628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:50:03.709043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.779246+0000","last_change":"2024-04-17T19:53:05.477190+0000","last_active":"2024-04-17T19:53:10.779246+0000","last_peered":"2024-04-17T19:53:10.779246+0000","last_clean":"2024-04-17T19:53:10.779246+0000","last_became_active":"2024-04-17T19:53:05.475823+0000","last_became_peered":"2024-04-17T19:53:05.475823+0000","last_unstale":"2024-04-17T19:53:10.779246+0000","last_undegraded":"2024-04-17T19:53:10.779246+0000","last_fullsized":"2024-04-17T19:53:10.779246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:53:37.141518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.491805+0000","last_change":"2024-04-17T19:53:05.453565+0000","last_active":"2024-04-17T19:53:10.491805+0000","last_peered":"2024-04-17T19:53:10.491805+0000","last_clean":"2024-04-17T19:53:10.491805+0000","last_became_active":"2024-04-17T19:53:05.453142+0000","last_became_peered":"2024-04-17T19:53:05.453142+0000","last_unstale":"2024-04-17T19:53:10.491805+0000","last_undegraded":"2024-04-17T19:53:10.491805+0000","last_fullsized":"2024-04-17T19:53:10.491805+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:39:58.812875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.494369+0000","last_change":"2024-04-17T19:53:05.476450+0000","last_active":"2024-04-17T19:53:10.494369+0000","last_peered":"2024-04-17T19:53:10.494369+0000","last_clean":"2024-04-17T19:53:10.494369+0000","last_became_active":"2024-04-17T19:53:05.473931+0000","last_became_peered":"2024-04-17T19:53:05.473931+0000","last_unstale":"2024-04-17T19:53:10.494369+0000","last_undegraded":"2024-04-17T19:53:10.494369+0000","last_fullsized":"2024-04-17T19:53:10.494369+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:10:21.772873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.497745+0000","last_change":"2024-04-17T19:53:05.469653+0000","last_active":"2024-04-17T19:53:10.497745+0000","last_peered":"2024-04-17T19:53:10.497745+0000","last_clean":"2024-04-17T19:53:10.497745+0000","last_became_active":"2024-04-17T19:53:05.467838+0000","last_became_peered":"2024-04-17T19:53:05.467838+0000","last_unstale":"2024-04-17T19:53:10.497745+0000","last_undegraded":"2024-04-17T19:53:10.497745+0000","last_fullsized":"2024-04-17T19:53:10.497745+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:38:51.699072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.496163+0000","last_change":"2024-04-17T19:53:05.462678+0000","last_active":"2024-04-17T19:53:10.496163+0000","last_peered":"2024-04-17T19:53:10.496163+0000","last_clean":"2024-04-17T19:53:10.496163+0000","last_became_active":"2024-04-17T19:53:05.461829+0000","last_became_peered":"2024-04-17T19:53:05.461829+0000","last_unstale":"2024-04-17T19:53:10.496163+0000","last_undegraded":"2024-04-17T19:53:10.496163+0000","last_fullsized":"2024-04-17T19:53:10.496163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:03:53.876774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.864168+0000","last_change":"2024-04-17T19:53:05.465993+0000","last_active":"2024-04-17T19:53:11.864168+0000","last_peered":"2024-04-17T19:53:11.864168+0000","last_clean":"2024-04-17T19:53:11.864168+0000","last_became_active":"2024-04-17T19:53:05.465547+0000","last_became_peered":"2024-04-17T19:53:05.465547+0000","last_unstale":"2024-04-17T19:53:11.864168+0000","last_undegraded":"2024-04-17T19:53:11.864168+0000","last_fullsized":"2024-04-17T19:53:11.864168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:12:03.449509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.494257+0000","last_change":"2024-04-17T19:53:05.477188+0000","last_active":"2024-04-17T19:53:10.494257+0000","last_peered":"2024-04-17T19:53:10.494257+0000","last_clean":"2024-04-17T19:53:10.494257+0000","last_became_active":"2024-04-17T19:53:05.474798+0000","last_became_peered":"2024-04-17T19:53:05.474798+0000","last_unstale":"2024-04-17T19:53:10.494257+0000","last_undegraded":"2024-04-17T19:53:10.494257+0000","last_fullsized":"2024-04-17T19:53:10.494257+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:15:45.727550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.491362+0000","last_change":"2024-04-17T19:53:05.484009+0000","last_active":"2024-04-17T19:53:10.491362+0000","last_peered":"2024-04-17T19:53:10.491362+0000","last_clean":"2024-04-17T19:53:10.491362+0000","last_became_active":"2024-04-17T19:53:05.483664+0000","last_became_peered":"2024-04-17T19:53:05.483664+0000","last_unstale":"2024-04-17T19:53:10.491362+0000","last_undegraded":"2024-04-17T19:53:10.491362+0000","last_fullsized":"2024-04-17T19:53:10.491362+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:47:05.354826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.494973+0000","last_change":"2024-04-17T19:53:05.466532+0000","last_active":"2024-04-17T19:53:10.494973+0000","last_peered":"2024-04-17T19:53:10.494973+0000","last_clean":"2024-04-17T19:53:10.494973+0000","last_became_active":"2024-04-17T19:53:05.465302+0000","last_became_peered":"2024-04-17T19:53:05.465302+0000","last_unstale":"2024-04-17T19:53:10.494973+0000","last_undegraded":"2024-04-17T19:53:10.494973+0000","last_fullsized":"2024-04-17T19:53:10.494973+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:27:51.520335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.527637+0000","last_change":"2024-04-17T19:53:05.456313+0000","last_active":"2024-04-17T19:53:11.527637+0000","last_peered":"2024-04-17T19:53:11.527637+0000","last_clean":"2024-04-17T19:53:11.527637+0000","last_became_active":"2024-04-17T19:53:05.455862+0000","last_became_peered":"2024-04-17T19:53:05.455862+0000","last_unstale":"2024-04-17T19:53:11.527637+0000","last_undegraded":"2024-04-17T19:53:11.527637+0000","last_fullsized":"2024-04-17T19:53:11.527637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:23:03.879786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.866381+0000","last_change":"2024-04-17T19:53:05.465083+0000","last_active":"2024-04-17T19:53:11.866381+0000","last_peered":"2024-04-17T19:53:11.866381+0000","last_clean":"2024-04-17T19:53:11.866381+0000","last_became_active":"2024-04-17T19:53:05.463806+0000","last_became_peered":"2024-04-17T19:53:05.463806+0000","last_unstale":"2024-04-17T19:53:11.866381+0000","last_undegraded":"2024-04-17T19:53:11.866381+0000","last_fullsized":"2024-04-17T19:53:11.866381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:25:16.298007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.529357+0000","last_change":"2024-04-17T19:53:05.464340+0000","last_active":"2024-04-17T19:53:10.529357+0000","last_peered":"2024-04-17T19:53:10.529357+0000","last_clean":"2024-04-17T19:53:10.529357+0000","last_became_active":"2024-04-17T19:53:05.463286+0000","last_became_peered":"2024-04-17T19:53:05.463286+0000","last_unstale":"2024-04-17T19:53:10.529357+0000","last_undegraded":"2024-04-17T19:53:10.529357+0000","last_fullsized":"2024-04-17T19:53:10.529357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:54:27.523970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.493221+0000","last_change":"2024-04-17T19:53:05.475791+0000","last_active":"2024-04-17T19:53:10.493221+0000","last_peered":"2024-04-17T19:53:10.493221+0000","last_clean":"2024-04-17T19:53:10.493221+0000","last_became_active":"2024-04-17T19:53:05.475372+0000","last_became_peered":"2024-04-17T19:53:05.475372+0000","last_unstale":"2024-04-17T19:53:10.493221+0000","last_undegraded":"2024-04-17T19:53:10.493221+0000","last_fullsized":"2024-04-17T19:53:10.493221+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:10:32.839503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.781055+0000","last_change":"2024-04-17T19:53:05.496650+0000","last_active":"2024-04-17T19:53:10.781055+0000","last_peered":"2024-04-17T19:53:10.781055+0000","last_clean":"2024-04-17T19:53:10.781055+0000","last_became_active":"2024-04-17T19:53:05.495881+0000","last_became_peered":"2024-04-17T19:53:05.495881+0000","last_unstale":"2024-04-17T19:53:10.781055+0000","last_undegraded":"2024-04-17T19:53:10.781055+0000","last_fullsized":"2024-04-17T19:53:10.781055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:23:03.879786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.494848+0000","last_change":"2024-04-17T19:53:05.461335+0000","last_active":"2024-04-17T19:53:10.494848+0000","last_peered":"2024-04-17T19:53:10.494848+0000","last_clean":"2024-04-17T19:53:10.494848+0000","last_became_active":"2024-04-17T19:53:05.460831+0000","last_became_peered":"2024-04-17T19:53:05.460831+0000","last_unstale":"2024-04-17T19:53:10.494848+0000","last_undegraded":"2024-04-17T19:53:10.494848+0000","last_fullsized":"2024-04-17T19:53:10.494848+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:22:55.343347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.491071+0000","last_change":"2024-04-17T19:53:05.473875+0000","last_active":"2024-04-17T19:53:10.491071+0000","last_peered":"2024-04-17T19:53:10.491071+0000","last_clean":"2024-04-17T19:53:10.491071+0000","last_became_active":"2024-04-17T19:53:05.467366+0000","last_became_peered":"2024-04-17T19:53:05.467366+0000","last_unstale":"2024-04-17T19:53:10.491071+0000","last_undegraded":"2024-04-17T19:53:10.491071+0000","last_fullsized":"2024-04-17T19:53:10.491071+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:05:21.173050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.493287+0000","last_change":"2024-04-17T19:53:05.467405+0000","last_active":"2024-04-17T19:53:10.493287+0000","last_peered":"2024-04-17T19:53:10.493287+0000","last_clean":"2024-04-17T19:53:10.493287+0000","last_became_active":"2024-04-17T19:53:05.466427+0000","last_became_peered":"2024-04-17T19:53:05.466427+0000","last_unstale":"2024-04-17T19:53:10.493287+0000","last_undegraded":"2024-04-17T19:53:10.493287+0000","last_fullsized":"2024-04-17T19:53:10.493287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:19:09.456602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.496615+0000","last_change":"2024-04-17T19:53:05.465968+0000","last_active":"2024-04-17T19:53:10.496615+0000","last_peered":"2024-04-17T19:53:10.496615+0000","last_clean":"2024-04-17T19:53:10.496615+0000","last_became_active":"2024-04-17T19:53:05.465145+0000","last_became_peered":"2024-04-17T19:53:05.465145+0000","last_unstale":"2024-04-17T19:53:10.496615+0000","last_undegraded":"2024-04-17T19:53:10.496615+0000","last_fullsized":"2024-04-17T19:53:10.496615+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:47:46.099722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.495836+0000","last_change":"2024-04-17T19:53:05.463993+0000","last_active":"2024-04-17T19:53:10.495836+0000","last_peered":"2024-04-17T19:53:10.495836+0000","last_clean":"2024-04-17T19:53:10.495836+0000","last_became_active":"2024-04-17T19:53:05.463172+0000","last_became_peered":"2024-04-17T19:53:05.463172+0000","last_unstale":"2024-04-17T19:53:10.495836+0000","last_undegraded":"2024-04-17T19:53:10.495836+0000","last_fullsized":"2024-04-17T19:53:10.495836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:29:50.457953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.529222+0000","last_change":"2024-04-17T19:53:05.471782+0000","last_active":"2024-04-17T19:53:10.529222+0000","last_peered":"2024-04-17T19:53:10.529222+0000","last_clean":"2024-04-17T19:53:10.529222+0000","last_became_active":"2024-04-17T19:53:05.471347+0000","last_became_peered":"2024-04-17T19:53:05.471347+0000","last_unstale":"2024-04-17T19:53:10.529222+0000","last_undegraded":"2024-04-17T19:53:10.529222+0000","last_fullsized":"2024-04-17T19:53:10.529222+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:42:22.878631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.529347+0000","last_change":"2024-04-17T19:53:05.460256+0000","last_active":"2024-04-17T19:53:10.529347+0000","last_peered":"2024-04-17T19:53:10.529347+0000","last_clean":"2024-04-17T19:53:10.529347+0000","last_became_active":"2024-04-17T19:53:05.459869+0000","last_became_peered":"2024-04-17T19:53:05.459869+0000","last_unstale":"2024-04-17T19:53:10.529347+0000","last_undegraded":"2024-04-17T19:53:10.529347+0000","last_fullsized":"2024-04-17T19:53:10.529347+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:47:05.354826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.529487+0000","last_change":"2024-04-17T19:53:05.467331+0000","last_active":"2024-04-17T19:53:10.529487+0000","last_peered":"2024-04-17T19:53:10.529487+0000","last_clean":"2024-04-17T19:53:10.529487+0000","last_became_active":"2024-04-17T19:53:05.467015+0000","last_became_peered":"2024-04-17T19:53:05.467015+0000","last_unstale":"2024-04-17T19:53:10.529487+0000","last_undegraded":"2024-04-17T19:53:10.529487+0000","last_fullsized":"2024-04-17T19:53:10.529487+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:10:32.839503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.529339+0000","last_change":"2024-04-17T19:53:05.462631+0000","last_active":"2024-04-17T19:53:11.529339+0000","last_peered":"2024-04-17T19:53:11.529339+0000","last_clean":"2024-04-17T19:53:11.529339+0000","last_became_active":"2024-04-17T19:53:05.462217+0000","last_became_peered":"2024-04-17T19:53:05.462217+0000","last_unstale":"2024-04-17T19:53:11.529339+0000","last_undegraded":"2024-04-17T19:53:11.529339+0000","last_fullsized":"2024-04-17T19:53:11.529339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:50:03.709043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.493026+0000","last_change":"2024-04-17T19:53:05.467941+0000","last_active":"2024-04-17T19:53:10.493026+0000","last_peered":"2024-04-17T19:53:10.493026+0000","last_clean":"2024-04-17T19:53:10.493026+0000","last_became_active":"2024-04-17T19:53:05.467093+0000","last_became_peered":"2024-04-17T19:53:05.467093+0000","last_unstale":"2024-04-17T19:53:10.493026+0000","last_undegraded":"2024-04-17T19:53:10.493026+0000","last_fullsized":"2024-04-17T19:53:10.493026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:12:15.307126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.528642+0000","last_change":"2024-04-17T19:53:05.465748+0000","last_active":"2024-04-17T19:53:10.528642+0000","last_peered":"2024-04-17T19:53:10.528642+0000","last_clean":"2024-04-17T19:53:10.528642+0000","last_became_active":"2024-04-17T19:53:05.465436+0000","last_became_peered":"2024-04-17T19:53:05.465436+0000","last_unstale":"2024-04-17T19:53:10.528642+0000","last_undegraded":"2024-04-17T19:53:10.528642+0000","last_fullsized":"2024-04-17T19:53:10.528642+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:02:40.799364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.863626+0000","last_change":"2024-04-17T19:53:05.458098+0000","last_active":"2024-04-17T19:53:11.863626+0000","last_peered":"2024-04-17T19:53:11.863626+0000","last_clean":"2024-04-17T19:53:11.863626+0000","last_became_active":"2024-04-17T19:53:05.457656+0000","last_became_peered":"2024-04-17T19:53:05.457656+0000","last_unstale":"2024-04-17T19:53:11.863626+0000","last_undegraded":"2024-04-17T19:53:11.863626+0000","last_fullsized":"2024-04-17T19:53:11.863626+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:40:31.558660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.529015+0000","last_change":"2024-04-17T19:53:05.477086+0000","last_active":"2024-04-17T19:53:10.529015+0000","last_peered":"2024-04-17T19:53:10.529015+0000","last_clean":"2024-04-17T19:53:10.529015+0000","last_became_active":"2024-04-17T19:53:05.476734+0000","last_became_peered":"2024-04-17T19:53:05.476734+0000","last_unstale":"2024-04-17T19:53:10.529015+0000","last_undegraded":"2024-04-17T19:53:10.529015+0000","last_fullsized":"2024-04-17T19:53:10.529015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:10:21.772873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.863461+0000","last_change":"2024-04-17T19:53:05.458378+0000","last_active":"2024-04-17T19:53:11.863461+0000","last_peered":"2024-04-17T19:53:11.863461+0000","last_clean":"2024-04-17T19:53:11.863461+0000","last_became_active":"2024-04-17T19:53:05.457210+0000","last_became_peered":"2024-04-17T19:53:05.457210+0000","last_unstale":"2024-04-17T19:53:11.863461+0000","last_undegraded":"2024-04-17T19:53:11.863461+0000","last_fullsized":"2024-04-17T19:53:11.863461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:23:03.879786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.494175+0000","last_change":"2024-04-17T19:53:05.455054+0000","last_active":"2024-04-17T19:53:10.494175+0000","last_peered":"2024-04-17T19:53:10.494175+0000","last_clean":"2024-04-17T19:53:10.494175+0000","last_became_active":"2024-04-17T19:53:05.454065+0000","last_became_peered":"2024-04-17T19:53:05.454065+0000","last_unstale":"2024-04-17T19:53:10.494175+0000","last_undegraded":"2024-04-17T19:53:10.494175+0000","last_fullsized":"2024-04-17T19:53:10.494175+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:42:22.878631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.496956+0000","last_change":"2024-04-17T19:53:05.456675+0000","last_active":"2024-04-17T19:53:10.496956+0000","last_peered":"2024-04-17T19:53:10.496956+0000","last_clean":"2024-04-17T19:53:10.496956+0000","last_became_active":"2024-04-17T19:53:05.455779+0000","last_became_peered":"2024-04-17T19:53:05.455779+0000","last_unstale":"2024-04-17T19:53:10.496956+0000","last_undegraded":"2024-04-17T19:53:10.496956+0000","last_fullsized":"2024-04-17T19:53:10.496956+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:02:40.799364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.529904+0000","last_change":"2024-04-17T19:53:05.461773+0000","last_active":"2024-04-17T19:53:10.529904+0000","last_peered":"2024-04-17T19:53:10.529904+0000","last_clean":"2024-04-17T19:53:10.529904+0000","last_became_active":"2024-04-17T19:53:05.461324+0000","last_became_peered":"2024-04-17T19:53:05.461324+0000","last_unstale":"2024-04-17T19:53:10.529904+0000","last_undegraded":"2024-04-17T19:53:10.529904+0000","last_fullsized":"2024-04-17T19:53:10.529904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:05:21.173050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":110409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":884736,"data_stored":700745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":114799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31468,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340372,"statfs":{"total":96636764160,"available":96604540928,"internally_reserved":0,"allocated":286720,"data_stored":110867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":294912,"data_stored":114127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32040,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339800,"statfs":{"total":96636764160,"available":96603955200,"internally_reserved":0,"allocated":880640,"data_stored":700723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":290816,"data_stored":110341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542152,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":110285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T19:53:25.076 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-17T19:53:25.077 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-17T19:53:25.077 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-17T19:53:25.077 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-17T19:53:25.078 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-17T19:53:25.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.257+0000 7f100dc11640 1 Processor -- start 2024-04-17T19:53:25.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.257+0000 7f100dc11640 1 -- start start 2024-04-17T19:53:25.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.261+0000 7f100dc11640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f10080b6f60 0x7f10080ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:25.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.261+0000 7f100dc11640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f10080cd090 0x7f10080cd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:25.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.261+0000 7f100dc11640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10080cf180 con 0x7f10080ced70 2024-04-17T19:53:25.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.261+0000 7f100dc11640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f10080b2c70 con 0x7f10080cd090 2024-04-17T19:53:25.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.261+0000 7f100dc11640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f10080ce4d0 con 0x7f10080b6f60 2024-04-17T19:53:25.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.261+0000 7f10077fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f10080ced70 0x7f10080b6850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:51110/0 (socket says 172.21.15.18:51110) 2024-04-17T19:53:25.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.261+0000 7f10077fe640 1 -- 172.21.15.18:0/4139573713 learned_addr learned my addr 172.21.15.18:0/4139573713 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:25.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.261+0000 7f1007fff640 1 --2- 172.21.15.18:0/4139573713 >> v2:172.21.15.18:3300/0 conn(0x7f10080cd090 0x7f10080cd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:25.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.261+0000 7f1006ffd640 1 --2- 172.21.15.18:0/4139573713 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f10080b6f60 0x7f10080ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:25.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.261+0000 7f10067fc640 1 -- 172.21.15.18:0/4139573713 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1398595444 0 0) 0x7f0ff8001120 con 0x7f10080ced70 2024-04-17T19:53:25.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.261+0000 7f1007fff640 1 -- 172.21.15.18:0/4139573713 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f10080b6f60 msgr2=0x7f10080ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:25.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.261+0000 7f1007fff640 1 --2- 172.21.15.18:0/4139573713 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f10080b6f60 0x7f10080ccb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:25.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.261+0000 7f1007fff640 1 -- 172.21.15.18:0/4139573713 >> v1:172.21.15.18:6789/0 conn(0x7f10080ced70 legacy=0x7f10080b6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:25.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.261+0000 7f1007fff640 1 -- 172.21.15.18:0/4139573713 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10080b33e0 con 0x7f10080cd090 2024-04-17T19:53:25.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.265+0000 7f1007fff640 1 --2- 172.21.15.18:0/4139573713 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10080cd090 0x7f10080cd4a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1000009d90 tx=0x7f100001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c019799e90c0c15 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:25.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.265+0000 7f10067fc640 1 -- 172.21.15.18:0/4139573713 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10000b2070 con 0x7f10080cd090 2024-04-17T19:53:25.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.265+0000 7f10067fc640 1 -- 172.21.15.18:0/4139573713 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10000a5830 con 0x7f10080cd090 2024-04-17T19:53:25.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.265+0000 7f10067fc640 1 -- 172.21.15.18:0/4139573713 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10000a5c00 con 0x7f10080cd090 2024-04-17T19:53:25.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.265+0000 7f100dc11640 1 -- 172.21.15.18:0/4139573713 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10080cd090 msgr2=0x7f10080cd4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:25.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.265+0000 7f100dc11640 1 --2- 172.21.15.18:0/4139573713 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10080cd090 0x7f10080cd4a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1000009d90 tx=0x7f100001c970 comp rx=0 tx=0).stop 2024-04-17T19:53:25.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.265+0000 7f100dc11640 1 -- 172.21.15.18:0/4139573713 shutdown_connections 2024-04-17T19:53:25.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.265+0000 7f100dc11640 1 --2- 172.21.15.18:0/4139573713 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10080cd090 0x7f10080cd4a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:25.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.265+0000 7f100dc11640 1 --2- 172.21.15.18:0/4139573713 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f10080b6f60 0x7f10080ccb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:25.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.265+0000 7f100dc11640 1 -- 172.21.15.18:0/4139573713 >> 172.21.15.18:0/4139573713 conn(0x7f100809aa70 msgr2=0x7f100809ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:25.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.265+0000 7f100dc11640 1 -- 172.21.15.18:0/4139573713 shutdown_connections 2024-04-17T19:53:25.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.265+0000 7f100dc11640 1 -- 172.21.15.18:0/4139573713 wait complete. 2024-04-17T19:53:25.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.265+0000 7f100dc11640 1 Processor -- start 2024-04-17T19:53:25.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.265+0000 7f100dc11640 1 -- start start 2024-04-17T19:53:25.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.269+0000 7f100dc11640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f10080cd090 0x7f10080c97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:25.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.269+0000 7f100dc11640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10080ced70 0x7f1008157030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:25.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.269+0000 7f100dc11640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f100815a620 0x7f100815ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:25.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.269+0000 7f100dc11640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f10080d0db0 con 0x7f10080ced70 2024-04-17T19:53:25.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.269+0000 7f100dc11640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f10080d0c30 con 0x7f100815a620 2024-04-17T19:53:25.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.269+0000 7f100dc11640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f10080d2720 con 0x7f10080cd090 2024-04-17T19:53:25.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.269+0000 7f1006ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10080ced70 0x7f1008157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:25.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.269+0000 7f1006ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10080ced70 0x7f1008157030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49666/0 (socket says 172.21.15.18:49666) 2024-04-17T19:53:25.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.269+0000 7f1006ffd640 1 -- 172.21.15.18:0/1873073371 learned_addr learned my addr 172.21.15.18:0/1873073371 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:25.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.269+0000 7f1007fff640 1 --2- 172.21.15.18:0/1873073371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f100815a620 0x7f100815ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:25.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.269+0000 7f10077fe640 1 --2- 172.21.15.18:0/1873073371 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f10080cd090 0x7f10080c97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:25.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.269+0000 7f1006ffd640 1 -- 172.21.15.18:0/1873073371 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f10080cd090 msgr2=0x7f10080c97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:25.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.269+0000 7f1006ffd640 1 --2- 172.21.15.18:0/1873073371 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f10080cd090 0x7f10080c97f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:25.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.269+0000 7f1006ffd640 1 -- 172.21.15.18:0/1873073371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f100815a620 msgr2=0x7f100815ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:25.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.269+0000 7f1006ffd640 1 --2- 172.21.15.18:0/1873073371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f100815a620 0x7f100815ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:25.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.269+0000 7f1006ffd640 1 -- 172.21.15.18:0/1873073371 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f100815c160 con 0x7f10080ced70 2024-04-17T19:53:25.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.269+0000 7f1006ffd640 1 --2- 172.21.15.18:0/1873073371 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10080ced70 0x7f1008157030 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0ff000e8a0 tx=0x7f0ff000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:25.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.269+0000 7f0ffffff640 1 -- 172.21.15.18:0/1873073371 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff0017070 con 0x7f10080ced70 2024-04-17T19:53:25.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.269+0000 7f0ffffff640 1 -- 172.21.15.18:0/1873073371 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ff000c940 con 0x7f10080ced70 2024-04-17T19:53:25.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.269+0000 7f100dc11640 1 -- 172.21.15.18:0/1873073371 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f100815c440 con 0x7f10080ced70 2024-04-17T19:53:25.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.269+0000 7f0ffffff640 1 -- 172.21.15.18:0/1873073371 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff000ccf0 con 0x7f10080ced70 2024-04-17T19:53:25.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.269+0000 7f100dc11640 1 -- 172.21.15.18:0/1873073371 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f100815ca00 con 0x7f10080ced70 2024-04-17T19:53:25.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.269+0000 7f100dc11640 1 -- 172.21.15.18:0/1873073371 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1008069950 con 0x7f10080ced70 2024-04-17T19:53:25.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.269+0000 7f0ffffff640 1 -- 172.21.15.18:0/1873073371 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0ff001a070 con 0x7f10080ced70 2024-04-17T19:53:25.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.269+0000 7f0ffffff640 1 --2- 172.21.15.18:0/1873073371 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0fe8068380 0x7f0fe806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:25.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.269+0000 7f0ffffff640 1 -- 172.21.15.18:0/1873073371 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f0ff0086c90 con 0x7f10080ced70 2024-04-17T19:53:25.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.269+0000 7f10077fe640 1 --2- 172.21.15.18:0/1873073371 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0fe8068380 0x7f0fe806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:25.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.273+0000 7f10077fe640 1 --2- 172.21.15.18:0/1873073371 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0fe8068380 0x7f0fe806a890 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8000f70 tx=0x7f0ff8007c10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:25.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.277+0000 7f0ffffff640 1 -- 172.21.15.18:0/1873073371 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0ff0056e80 con 0x7f10080ced70 2024-04-17T19:53:25.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.477+0000 7f100dc11640 1 -- 172.21.15.18:0/1873073371 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f10080cc950 con 0x7f10080ced70 2024-04-17T19:53:25.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.481+0000 7f0ffffff640 1 -- 172.21.15.18:0/1873073371 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+168080 (secure 0 0 0) 0x7f0ff0056780 con 0x7f10080ced70 2024-04-17T19:53:25.481 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:53:25.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.485+0000 7f100dc11640 1 -- 172.21.15.18:0/1873073371 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0fe8068380 msgr2=0x7f0fe806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:25.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.485+0000 7f100dc11640 1 --2- 172.21.15.18:0/1873073371 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0fe8068380 0x7f0fe806a890 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8000f70 tx=0x7f0ff8007c10 comp rx=0 tx=0).stop 2024-04-17T19:53:25.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.485+0000 7f100dc11640 1 -- 172.21.15.18:0/1873073371 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10080ced70 msgr2=0x7f1008157030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:25.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.485+0000 7f100dc11640 1 --2- 172.21.15.18:0/1873073371 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10080ced70 0x7f1008157030 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0ff000e8a0 tx=0x7f0ff000eca0 comp rx=0 tx=0).stop 2024-04-17T19:53:25.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.485+0000 7f100dc11640 1 -- 172.21.15.18:0/1873073371 shutdown_connections 2024-04-17T19:53:25.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.485+0000 7f100dc11640 1 --2- 172.21.15.18:0/1873073371 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0fe8068380 0x7f0fe806a890 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:25.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.485+0000 7f100dc11640 1 --2- 172.21.15.18:0/1873073371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f100815a620 0x7f100815ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:25.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.485+0000 7f100dc11640 1 --2- 172.21.15.18:0/1873073371 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10080ced70 0x7f1008157030 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:25.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.485+0000 7f100dc11640 1 --2- 172.21.15.18:0/1873073371 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f10080cd090 0x7f10080c97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:25.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.485+0000 7f100dc11640 1 -- 172.21.15.18:0/1873073371 >> 172.21.15.18:0/1873073371 conn(0x7f100809aa70 msgr2=0x7f1008071190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:25.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.485+0000 7f100dc11640 1 -- 172.21.15.18:0/1873073371 shutdown_connections 2024-04-17T19:53:25.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.485+0000 7f100dc11640 1 -- 172.21.15.18:0/1873073371 wait complete. 2024-04-17T19:53:25.500 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":5,"flags":0,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":751466605},{"type":"v1","addr":"172.21.15.18:6833","nonce":751466605}]},"active_addr":"172.21.15.18:6833/751466605","active_change":"2024-04-17T19:52:44.325075+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4111,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.18:0","nonce":4020393994}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.18:0","nonce":149845726}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.18:0","nonce":1740663610}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.18:0","nonce":598284693}]}]} 2024-04-17T19:53:25.504 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-17T19:53:25.504 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-17T19:53:25.504 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T19:53:25.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.661+0000 7fdc50b19640 1 Processor -- start 2024-04-17T19:53:25.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.661+0000 7fdc50b19640 1 -- start start 2024-04-17T19:53:25.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.661+0000 7fdc50b19640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fdc4c06c8b0 0x7fdc4c06ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:25.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.661+0000 7fdc50b19640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc4c0d41b0 con 0x7fdc4c0d3b80 2024-04-17T19:53:25.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.661+0000 7fdc50b19640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc4c0d4490 con 0x7fdc4c0d0620 2024-04-17T19:53:25.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.661+0000 7fdc50b19640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7fdc4c0d3f90 con 0x7fdc4c06c8b0 2024-04-17T19:53:25.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.661+0000 7fdc4a59c640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fdc4c0d3b80 0x7fdc4c0cff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:51120/0 (socket says 172.21.15.18:51120) 2024-04-17T19:53:25.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.661+0000 7fdc4a59c640 1 -- 172.21.15.18:0/2674680427 learned_addr learned my addr 172.21.15.18:0/2674680427 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:25.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.661+0000 7fdc4ad9d640 1 --2- 172.21.15.18:0/2674680427 >> v2:172.21.15.173:3300/0 conn(0x7fdc4c06c8b0 0x7fdc4c06ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:25.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.665+0000 7fdc4959a640 1 -- 172.21.15.18:0/2674680427 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2974497920 0 0) 0x7fdc4c0d41b0 con 0x7fdc4c0d3b80 2024-04-17T19:53:25.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.665+0000 7fdc4959a640 1 -- 172.21.15.18:0/2674680427 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc34003530 con 0x7fdc4c0d3b80 2024-04-17T19:53:25.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.665+0000 7fdc4959a640 1 -- 172.21.15.18:0/2674680427 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1061412887 0 0) 0x7fdc34003530 con 0x7fdc4c0d3b80 2024-04-17T19:53:25.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.665+0000 7fdc4959a640 1 -- 172.21.15.18:0/2674680427 >> v2:172.21.15.173:3300/0 conn(0x7fdc4c06c8b0 msgr2=0x7fdc4c06ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:25.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.665+0000 7fdc4959a640 1 --2- 172.21.15.18:0/2674680427 >> v2:172.21.15.173:3300/0 conn(0x7fdc4c06c8b0 0x7fdc4c06ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:25.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.665+0000 7fdc4959a640 1 -- 172.21.15.18:0/2674680427 >> v1:172.21.15.173:6789/0 conn(0x7fdc4c0d0620 legacy=0x7fdc4c06c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:25.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.665+0000 7fdc4959a640 1 -- 172.21.15.18:0/2674680427 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc4c0d4770 con 0x7fdc4c0d3b80 2024-04-17T19:53:25.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.665+0000 7fdc4959a640 1 -- 172.21.15.18:0/2674680427 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3208559991 0 0) 0x7fdc3c0016a0 con 0x7fdc4c0d3b80 2024-04-17T19:53:25.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.665+0000 7fdc4959a640 1 -- 172.21.15.18:0/2674680427 >> v1:172.21.15.18:6789/0 conn(0x7fdc4c0d3b80 legacy=0x7fdc4c0cff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:25.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.665+0000 7fdc4959a640 1 --2- 172.21.15.18:0/2674680427 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc340039c0 0x7fdc34003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:25.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.665+0000 7fdc4959a640 1 --2- 172.21.15.18:0/2674680427 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc34004810 0x7fdc34004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:25.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.665+0000 7fdc4959a640 1 --2- 172.21.15.18:0/2674680427 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdc340051d0 0x7fdc3400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:25.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.665+0000 7fdc4959a640 1 -- 172.21.15.18:0/2674680427 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fdc4c0d3f90 con 0x7fdc34004810 2024-04-17T19:53:25.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.665+0000 7fdc4959a640 1 -- 172.21.15.18:0/2674680427 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fdc3400c170 con 0x7fdc340039c0 2024-04-17T19:53:25.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.665+0000 7fdc4959a640 1 -- 172.21.15.18:0/2674680427 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fdc3400c370 con 0x7fdc340051d0 2024-04-17T19:53:25.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.665+0000 7fdc49d9b640 1 --2- 172.21.15.18:0/2674680427 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc34004810 0x7fdc34004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:25.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.665+0000 7fdc4ad9d640 1 --2- 172.21.15.18:0/2674680427 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdc340051d0 0x7fdc3400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:25.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.665+0000 7fdc4a59c640 1 --2- 172.21.15.18:0/2674680427 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc340039c0 0x7fdc34003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:25.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.665+0000 7fdc49d9b640 1 -- 172.21.15.18:0/2674680427 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdc340051d0 msgr2=0x7fdc3400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:25.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.665+0000 7fdc49d9b640 1 --2- 172.21.15.18:0/2674680427 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdc340051d0 0x7fdc3400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:25.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.665+0000 7fdc49d9b640 1 -- 172.21.15.18:0/2674680427 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc340039c0 msgr2=0x7fdc34003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:25.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.665+0000 7fdc49d9b640 1 --2- 172.21.15.18:0/2674680427 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc340039c0 0x7fdc34003e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:25.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.665+0000 7fdc49d9b640 1 -- 172.21.15.18:0/2674680427 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc34003530 con 0x7fdc34004810 2024-04-17T19:53:25.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.665+0000 7fdc4ad9d640 1 --2- 172.21.15.18:0/2674680427 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdc340051d0 0x7fdc3400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:53:25.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.665+0000 7fdc4ad9d640 1 -- 172.21.15.18:0/2674680427 reap_dead start 2024-04-17T19:53:25.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.665+0000 7fdc49d9b640 1 --2- 172.21.15.18:0/2674680427 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc34004810 0x7fdc34004c20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fdc40001780 tx=0x7fdc4001c220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=401dcb4147a04c27 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:25.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.665+0000 7fdc4959a640 1 -- 172.21.15.18:0/2674680427 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc400013a0 con 0x7fdc34004810 2024-04-17T19:53:25.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.665+0000 7fdc4959a640 1 -- 172.21.15.18:0/2674680427 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc400052f0 con 0x7fdc34004810 2024-04-17T19:53:25.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.665+0000 7fdc4959a640 1 -- 172.21.15.18:0/2674680427 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc40003840 con 0x7fdc34004810 2024-04-17T19:53:25.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.669+0000 7fdc50b19640 1 -- 172.21.15.18:0/2674680427 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc34004810 msgr2=0x7fdc34004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:25.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.669+0000 7fdc50b19640 1 --2- 172.21.15.18:0/2674680427 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc34004810 0x7fdc34004c20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fdc40001780 tx=0x7fdc4001c220 comp rx=0 tx=0).stop 2024-04-17T19:53:25.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.669+0000 7fdc50b19640 1 -- 172.21.15.18:0/2674680427 shutdown_connections 2024-04-17T19:53:25.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.669+0000 7fdc50b19640 1 --2- 172.21.15.18:0/2674680427 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc34004810 0x7fdc34004c20 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:25.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.669+0000 7fdc50b19640 1 -- 172.21.15.18:0/2674680427 >> 172.21.15.18:0/2674680427 conn(0x7fdc4c0d4ed0 msgr2=0x7fdc4c0d52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:25.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.669+0000 7fdc50b19640 1 -- 172.21.15.18:0/2674680427 shutdown_connections 2024-04-17T19:53:25.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.669+0000 7fdc50b19640 1 -- 172.21.15.18:0/2674680427 wait complete. 2024-04-17T19:53:25.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.669+0000 7fdc50b19640 1 Processor -- start 2024-04-17T19:53:25.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.669+0000 7fdc50b19640 1 -- start start 2024-04-17T19:53:25.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.669+0000 7fdc50b19640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdc34004810 0x7fdc4c1e92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:25.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.669+0000 7fdc50b19640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc4c1e97e0 0x7fdc4c15a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:25.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.669+0000 7fdc50b19640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc4c15a7a0 0x7fdc4c15abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:25.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.669+0000 7fdc50b19640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fdc4c15fdd0 con 0x7fdc4c1e97e0 2024-04-17T19:53:25.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.669+0000 7fdc50b19640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fdc4c15ff50 con 0x7fdc4c15a7a0 2024-04-17T19:53:25.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.669+0000 7fdc50b19640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fdc4c159ed0 con 0x7fdc34004810 2024-04-17T19:53:25.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.669+0000 7fdc49d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc4c1e97e0 0x7fdc4c15a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:25.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.669+0000 7fdc49d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc4c1e97e0 0x7fdc4c15a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49692/0 (socket says 172.21.15.18:49692) 2024-04-17T19:53:25.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.669+0000 7fdc49d9b640 1 -- 172.21.15.18:0/1074655595 learned_addr learned my addr 172.21.15.18:0/1074655595 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:25.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.669+0000 7fdc4ad9d640 1 --2- 172.21.15.18:0/1074655595 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc4c15a7a0 0x7fdc4c15abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:25.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.669+0000 7fdc4a59c640 1 --2- 172.21.15.18:0/1074655595 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdc34004810 0x7fdc4c1e92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:25.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.669+0000 7fdc49d9b640 1 -- 172.21.15.18:0/1074655595 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdc34004810 msgr2=0x7fdc4c1e92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:25.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.669+0000 7fdc49d9b640 1 --2- 172.21.15.18:0/1074655595 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdc34004810 0x7fdc4c1e92a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:25.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.669+0000 7fdc49d9b640 1 -- 172.21.15.18:0/1074655595 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc4c15a7a0 msgr2=0x7fdc4c15abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:25.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.669+0000 7fdc49d9b640 1 --2- 172.21.15.18:0/1074655595 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc4c15a7a0 0x7fdc4c15abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:25.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.669+0000 7fdc49d9b640 1 -- 172.21.15.18:0/1074655595 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc4c1ea010 con 0x7fdc4c1e97e0 2024-04-17T19:53:25.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.673+0000 7fdc49d9b640 1 --2- 172.21.15.18:0/1074655595 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc4c1e97e0 0x7fdc4c15a260 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdc4001c050 tx=0x7fdc34005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:25.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.673+0000 7fdc3affd640 1 -- 172.21.15.18:0/1074655595 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc40007a40 con 0x7fdc4c1e97e0 2024-04-17T19:53:25.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.673+0000 7fdc3affd640 1 -- 172.21.15.18:0/1074655595 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc400ba070 con 0x7fdc4c1e97e0 2024-04-17T19:53:25.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.673+0000 7fdc50b19640 1 -- 172.21.15.18:0/1074655595 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc4c1ea2f0 con 0x7fdc4c1e97e0 2024-04-17T19:53:25.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.673+0000 7fdc3affd640 1 -- 172.21.15.18:0/1074655595 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc400054a0 con 0x7fdc4c1e97e0 2024-04-17T19:53:25.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.673+0000 7fdc50b19640 1 -- 172.21.15.18:0/1074655595 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc4c1ea8b0 con 0x7fdc4c1e97e0 2024-04-17T19:53:25.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.673+0000 7fdc50b19640 1 -- 172.21.15.18:0/1074655595 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc4c1e9d80 con 0x7fdc4c1e97e0 2024-04-17T19:53:25.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.673+0000 7fdc3affd640 1 -- 172.21.15.18:0/1074655595 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdc40007030 con 0x7fdc4c1e97e0 2024-04-17T19:53:25.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.673+0000 7fdc3affd640 1 --2- 172.21.15.18:0/1074655595 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fdc2c068380 0x7fdc2c06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:25.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.673+0000 7fdc3affd640 1 -- 172.21.15.18:0/1074655595 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fdc40120d30 con 0x7fdc4c1e97e0 2024-04-17T19:53:25.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.673+0000 7fdc4a59c640 1 --2- 172.21.15.18:0/1074655595 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fdc2c068380 0x7fdc2c06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:25.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.673+0000 7fdc4a59c640 1 --2- 172.21.15.18:0/1074655595 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fdc2c068380 0x7fdc2c06a890 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c0011f0 tx=0x7fdc3c000ee0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:25.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.677+0000 7fdc3affd640 1 -- 172.21.15.18:0/1074655595 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdc3c001d10 con 0x7fdc4c1e97e0 2024-04-17T19:53:25.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.845+0000 7fdc50b19640 1 -- 172.21.15.18:0/1074655595 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdc4c069950 con 0x7fdc4c1e97e0 2024-04-17T19:53:25.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.845+0000 7fdc3affd640 1 -- 172.21.15.18:0/1074655595 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18506 (secure 0 0 0) 0x7fdc400f0fb0 con 0x7fdc4c1e97e0 2024-04-17T19:53:25.843 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:53:25.843 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":27,"fsid":"dd480169-5a81-4623-be5f-0499aa244b28","created":"2024-04-17T19:52:39.533760+0000","modified":"2024-04-17T19:53:09.903922+0000","last_up_change":"2024-04-17T19:52:51.229698+0000","last_in_change":"2024-04-17T19:52:42.144259+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T19:52:52.391648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T19:53:02.734240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T19:53:03.813028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T19:53:07.478812+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e232d577-2508-4ea4-b355-29fbae1ff025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6801","nonce":2323038417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6803","nonce":2323038417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6807","nonce":2323038417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6805","nonce":2323038417}]},"public_addr":"172.21.15.18:6801/2323038417","cluster_addr":"172.21.15.18:6803/2323038417","heartbeat_back_addr":"172.21.15.18:6807/2323038417","heartbeat_front_addr":"172.21.15.18:6805/2323038417","state":["exists","up"]},{"osd":1,"uuid":"31810ef3-2c71-48d6-8748-b74a2968d23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6817","nonce":1283678238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6819","nonce":1283678238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6823","nonce":1283678238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6821","nonce":1283678238}]},"public_addr":"172.21.15.18:6817/1283678238","cluster_addr":"172.21.15.18:6819/1283678238","heartbeat_back_addr":"172.21.15.18:6823/1283678238","heartbeat_front_addr":"172.21.15.18:6821/1283678238","state":["exists","up"]},{"osd":2,"uuid":"5a783cc5-a41c-4967-9e11-6b8330f97d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6809","nonce":1212875862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6811","nonce":1212875862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6815","nonce":1212875862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6813","nonce":1212875862}]},"public_addr":"172.21.15.18:6809/1212875862","cluster_addr":"172.21.15.18:6811/1212875862","heartbeat_back_addr":"172.21.15.18:6815/1212875862","heartbeat_front_addr":"172.21.15.18:6813/1212875862","state":["exists","up"]},{"osd":3,"uuid":"b7e056d9-9da5-46e1-810d-0c3e242fe5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6825","nonce":2428878428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6827","nonce":2428878428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6831","nonce":2428878428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6829","nonce":2428878428}]},"public_addr":"172.21.15.18:6825/2428878428","cluster_addr":"172.21.15.18:6827/2428878428","heartbeat_back_addr":"172.21.15.18:6831/2428878428","heartbeat_front_addr":"172.21.15.18:6829/2428878428","state":["exists","up"]},{"osd":4,"uuid":"21df023f-bc8b-4abb-93e5-0ecc91acda0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6825","nonce":1421511819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6827","nonce":1421511819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6831","nonce":1421511819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6829","nonce":1421511819}]},"public_addr":"172.21.15.173:6825/1421511819","cluster_addr":"172.21.15.173:6827/1421511819","heartbeat_back_addr":"172.21.15.173:6831/1421511819","heartbeat_front_addr":"172.21.15.173:6829/1421511819","state":["exists","up"]},{"osd":5,"uuid":"e270098a-6d33-49f8-84ed-94e09a880cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6801","nonce":4221907702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6803","nonce":4221907702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6807","nonce":4221907702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6805","nonce":4221907702}]},"public_addr":"172.21.15.173:6801/4221907702","cluster_addr":"172.21.15.173:6803/4221907702","heartbeat_back_addr":"172.21.15.173:6807/4221907702","heartbeat_front_addr":"172.21.15.173:6805/4221907702","state":["exists","up"]},{"osd":6,"uuid":"93c67c8c-268d-4e32-877c-043cd3acd87c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6809","nonce":761678552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6811","nonce":761678552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6815","nonce":761678552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6813","nonce":761678552}]},"public_addr":"172.21.15.173:6809/761678552","cluster_addr":"172.21.15.173:6811/761678552","heartbeat_back_addr":"172.21.15.173:6815/761678552","heartbeat_front_addr":"172.21.15.173:6813/761678552","state":["exists","up"]},{"osd":7,"uuid":"faf10eea-80de-40f6-abbb-34d07d3f59ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6817","nonce":383724537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6819","nonce":383724537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6823","nonce":383724537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6821","nonce":383724537}]},"public_addr":"172.21.15.173:6817/383724537","cluster_addr":"172.21.15.173:6819/383724537","heartbeat_back_addr":"172.21.15.173:6823/383724537","heartbeat_front_addr":"172.21.15.173:6821/383724537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.668924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.761747+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.768128+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.632252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.742608+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.734327+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.477107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.818292+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T19:53:25.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.849+0000 7fdc50b19640 1 -- 172.21.15.18:0/1074655595 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fdc2c068380 msgr2=0x7fdc2c06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:25.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.849+0000 7fdc50b19640 1 --2- 172.21.15.18:0/1074655595 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fdc2c068380 0x7fdc2c06a890 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c0011f0 tx=0x7fdc3c000ee0 comp rx=0 tx=0).stop 2024-04-17T19:53:25.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.849+0000 7fdc50b19640 1 -- 172.21.15.18:0/1074655595 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc4c1e97e0 msgr2=0x7fdc4c15a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:25.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.849+0000 7fdc50b19640 1 --2- 172.21.15.18:0/1074655595 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc4c1e97e0 0x7fdc4c15a260 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdc4001c050 tx=0x7fdc34005840 comp rx=0 tx=0).stop 2024-04-17T19:53:25.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.849+0000 7fdc50b19640 1 -- 172.21.15.18:0/1074655595 shutdown_connections 2024-04-17T19:53:25.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.849+0000 7fdc50b19640 1 --2- 172.21.15.18:0/1074655595 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fdc2c068380 0x7fdc2c06a890 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:25.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.849+0000 7fdc50b19640 1 --2- 172.21.15.18:0/1074655595 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc4c15a7a0 0x7fdc4c15abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:25.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.849+0000 7fdc50b19640 1 --2- 172.21.15.18:0/1074655595 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc4c1e97e0 0x7fdc4c15a260 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:25.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.849+0000 7fdc50b19640 1 --2- 172.21.15.18:0/1074655595 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdc34004810 0x7fdc4c1e92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:25.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.849+0000 7fdc50b19640 1 -- 172.21.15.18:0/1074655595 >> 172.21.15.18:0/1074655595 conn(0x7fdc4c0d4ed0 msgr2=0x7fdc4c161ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:25.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.849+0000 7fdc50b19640 1 -- 172.21.15.18:0/1074655595 shutdown_connections 2024-04-17T19:53:25.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:25.849+0000 7fdc50b19640 1 -- 172.21.15.18:0/1074655595 wait complete. 2024-04-17T19:53:25.865 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-17T19:53:25.865 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T19:53:26.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.017+0000 7fe4abfe6640 1 Processor -- start 2024-04-17T19:53:26.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.017+0000 7fe4abfe6640 1 -- start start 2024-04-17T19:53:26.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.017+0000 7fe4abfe6640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe4a415d2d0 0x7fe4a40b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.017+0000 7fe4abfe6640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe4a40ce690 0x7fe4a40ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.017+0000 7fe4abfe6640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4a40cd5f0 con 0x7fe4a4073080 2024-04-17T19:53:26.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.017+0000 7fe4abfe6640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fe4a40cd8d0 con 0x7fe4a40ce690 2024-04-17T19:53:26.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.017+0000 7fe4abfe6640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7fe4a40cdbb0 con 0x7fe4a415d2d0 2024-04-17T19:53:26.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.017+0000 7fe4aa583640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe4a40ce690 0x7fe4a40ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.017+0000 7fe4aa583640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe4a40ce690 0x7fe4a40ceaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49706/0 (socket says 172.21.15.18:49706) 2024-04-17T19:53:26.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.017+0000 7fe4aa583640 1 -- 172.21.15.18:0/598786636 learned_addr learned my addr 172.21.15.18:0/598786636 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:26.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.017+0000 7fe4a9d82640 1 --2- 172.21.15.18:0/598786636 >> v2:172.21.15.173:3300/0 conn(0x7fe4a415d2d0 0x7fe4a40b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.017+0000 7fe4aa583640 1 -- 172.21.15.18:0/598786636 >> v2:172.21.15.173:3300/0 conn(0x7fe4a415d2d0 msgr2=0x7fe4a40b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:26.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.017+0000 7fe4aa583640 1 --2- 172.21.15.18:0/598786636 >> v2:172.21.15.173:3300/0 conn(0x7fe4a415d2d0 0x7fe4a40b4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.017+0000 7fe4aa583640 1 -- 172.21.15.18:0/598786636 >> v1:172.21.15.173:6789/0 conn(0x7fe4a4073080 legacy=0x7fe4a4073490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:26.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.017+0000 7fe4aa583640 1 -- 172.21.15.18:0/598786636 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4a40cde90 con 0x7fe4a40ce690 2024-04-17T19:53:26.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.021+0000 7fe4aa583640 1 --2- 172.21.15.18:0/598786636 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4a40ce690 0x7fe4a40ceaa0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe4a40d1e40 tx=0x7fe49c01c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdc8884c79ba6211 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.021+0000 7fe4a8d80640 1 -- 172.21.15.18:0/598786636 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe49c0a5670 con 0x7fe4a40ce690 2024-04-17T19:53:26.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.021+0000 7fe4a8d80640 1 -- 172.21.15.18:0/598786636 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe49c0a5810 con 0x7fe4a40ce690 2024-04-17T19:53:26.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.021+0000 7fe4a8d80640 1 -- 172.21.15.18:0/598786636 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe49c0a5be0 con 0x7fe4a40ce690 2024-04-17T19:53:26.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.021+0000 7fe4abfe6640 1 -- 172.21.15.18:0/598786636 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4a40ce690 msgr2=0x7fe4a40ceaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.021+0000 7fe4abfe6640 1 --2- 172.21.15.18:0/598786636 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4a40ce690 0x7fe4a40ceaa0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe4a40d1e40 tx=0x7fe49c01c9b0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.021+0000 7fe4abfe6640 1 -- 172.21.15.18:0/598786636 shutdown_connections 2024-04-17T19:53:26.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.021+0000 7fe4abfe6640 1 --2- 172.21.15.18:0/598786636 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4a40ce690 0x7fe4a40ceaa0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.021+0000 7fe4abfe6640 1 --2- 172.21.15.18:0/598786636 >> v2:172.21.15.173:3300/0 conn(0x7fe4a415d2d0 0x7fe4a40b4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.021+0000 7fe4abfe6640 1 -- 172.21.15.18:0/598786636 >> 172.21.15.18:0/598786636 conn(0x7fe4a40b3910 msgr2=0x7fe4a40d12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:26.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.021+0000 7fe4abfe6640 1 -- 172.21.15.18:0/598786636 shutdown_connections 2024-04-17T19:53:26.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.021+0000 7fe4abfe6640 1 -- 172.21.15.18:0/598786636 wait complete. 2024-04-17T19:53:26.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.021+0000 7fe4abfe6640 1 Processor -- start 2024-04-17T19:53:26.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.021+0000 7fe4abfe6640 1 -- start start 2024-04-17T19:53:26.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.025+0000 7fe4abfe6640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe4a4073080 0x7fe4a4148070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.025+0000 7fe4abfe6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4a40ce690 0x7fe4a4160530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.025+0000 7fe4abfe6640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe4a415d2d0 0x7fe4a40b4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.025+0000 7fe4abfe6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a416a080 con 0x7fe4a40ce690 2024-04-17T19:53:26.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.025+0000 7fe4abfe6640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a40b5480 con 0x7fe4a415d2d0 2024-04-17T19:53:26.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.025+0000 7fe4abfe6640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fe4a416a200 con 0x7fe4a4073080 2024-04-17T19:53:26.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.025+0000 7fe4a9581640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4a40ce690 0x7fe4a4160530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.025+0000 7fe4a9581640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4a40ce690 0x7fe4a4160530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49708/0 (socket says 172.21.15.18:49708) 2024-04-17T19:53:26.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.025+0000 7fe4a9581640 1 -- 172.21.15.18:0/1094463843 learned_addr learned my addr 172.21.15.18:0/1094463843 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:26.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.025+0000 7fe4a9d82640 1 --2- 172.21.15.18:0/1094463843 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe4a4073080 0x7fe4a4148070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.025+0000 7fe4a9581640 1 -- 172.21.15.18:0/1094463843 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe4a4073080 msgr2=0x7fe4a4148070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.025+0000 7fe4a9581640 1 --2- 172.21.15.18:0/1094463843 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe4a4073080 0x7fe4a4148070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.025+0000 7fe4a9581640 1 -- 172.21.15.18:0/1094463843 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe4a415d2d0 msgr2=0x7fe4a40b4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.025+0000 7fe4a9581640 1 --2- 172.21.15.18:0/1094463843 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe4a415d2d0 0x7fe4a40b4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.025+0000 7fe4a9581640 1 -- 172.21.15.18:0/1094463843 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4a41fc050 con 0x7fe4a40ce690 2024-04-17T19:53:26.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.025+0000 7fe4a9581640 1 --2- 172.21.15.18:0/1094463843 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4a40ce690 0x7fe4a4160530 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe49400b410 tx=0x7fe49400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.025+0000 7fe49a7fc640 1 -- 172.21.15.18:0/1094463843 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe494015030 con 0x7fe4a40ce690 2024-04-17T19:53:26.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.025+0000 7fe49a7fc640 1 -- 172.21.15.18:0/1094463843 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe494004020 con 0x7fe4a40ce690 2024-04-17T19:53:26.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.025+0000 7fe4abfe6640 1 -- 172.21.15.18:0/1094463843 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4a41fc330 con 0x7fe4a40ce690 2024-04-17T19:53:26.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.025+0000 7fe49a7fc640 1 -- 172.21.15.18:0/1094463843 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe494004450 con 0x7fe4a40ce690 2024-04-17T19:53:26.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.025+0000 7fe4abfe6640 1 -- 172.21.15.18:0/1094463843 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4a41fc8f0 con 0x7fe4a40ce690 2024-04-17T19:53:26.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.025+0000 7fe4abfe6640 1 -- 172.21.15.18:0/1094463843 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4a4069950 con 0x7fe4a40ce690 2024-04-17T19:53:26.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.025+0000 7fe49a7fc640 1 -- 172.21.15.18:0/1094463843 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe494018070 con 0x7fe4a40ce690 2024-04-17T19:53:26.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.025+0000 7fe49a7fc640 1 --2- 172.21.15.18:0/1094463843 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fe488068380 0x7fe48806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.025+0000 7fe49a7fc640 1 -- 172.21.15.18:0/1094463843 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fe494087070 con 0x7fe4a40ce690 2024-04-17T19:53:26.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.025+0000 7fe4a9d82640 1 --2- 172.21.15.18:0/1094463843 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fe488068380 0x7fe48806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.025+0000 7fe4a9d82640 1 --2- 172.21.15.18:0/1094463843 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fe488068380 0x7fe48806a890 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe4a4071fb0 tx=0x7fe4a0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.029+0000 7fe49a7fc640 1 -- 172.21.15.18:0/1094463843 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe494057360 con 0x7fe4a40ce690 2024-04-17T19:53:26.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.185+0000 7fe4abfe6640 1 -- 172.21.15.18:0/1094463843 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe4a41663e0 con 0x7fe4a40ce690 2024-04-17T19:53:26.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.189+0000 7fe49a7fc640 1 -- 172.21.15.18:0/1094463843 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18506 (secure 0 0 0) 0x7fe494056c60 con 0x7fe4a40ce690 2024-04-17T19:53:26.186 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:53:26.186 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":27,"fsid":"dd480169-5a81-4623-be5f-0499aa244b28","created":"2024-04-17T19:52:39.533760+0000","modified":"2024-04-17T19:53:09.903922+0000","last_up_change":"2024-04-17T19:52:51.229698+0000","last_in_change":"2024-04-17T19:52:42.144259+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T19:52:52.391648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T19:53:02.734240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T19:53:03.813028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T19:53:07.478812+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e232d577-2508-4ea4-b355-29fbae1ff025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6801","nonce":2323038417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6803","nonce":2323038417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6807","nonce":2323038417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6805","nonce":2323038417}]},"public_addr":"172.21.15.18:6801/2323038417","cluster_addr":"172.21.15.18:6803/2323038417","heartbeat_back_addr":"172.21.15.18:6807/2323038417","heartbeat_front_addr":"172.21.15.18:6805/2323038417","state":["exists","up"]},{"osd":1,"uuid":"31810ef3-2c71-48d6-8748-b74a2968d23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6817","nonce":1283678238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6819","nonce":1283678238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6823","nonce":1283678238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6821","nonce":1283678238}]},"public_addr":"172.21.15.18:6817/1283678238","cluster_addr":"172.21.15.18:6819/1283678238","heartbeat_back_addr":"172.21.15.18:6823/1283678238","heartbeat_front_addr":"172.21.15.18:6821/1283678238","state":["exists","up"]},{"osd":2,"uuid":"5a783cc5-a41c-4967-9e11-6b8330f97d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6809","nonce":1212875862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6811","nonce":1212875862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6815","nonce":1212875862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6813","nonce":1212875862}]},"public_addr":"172.21.15.18:6809/1212875862","cluster_addr":"172.21.15.18:6811/1212875862","heartbeat_back_addr":"172.21.15.18:6815/1212875862","heartbeat_front_addr":"172.21.15.18:6813/1212875862","state":["exists","up"]},{"osd":3,"uuid":"b7e056d9-9da5-46e1-810d-0c3e242fe5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6825","nonce":2428878428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6827","nonce":2428878428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6831","nonce":2428878428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6829","nonce":2428878428}]},"public_addr":"172.21.15.18:6825/2428878428","cluster_addr":"172.21.15.18:6827/2428878428","heartbeat_back_addr":"172.21.15.18:6831/2428878428","heartbeat_front_addr":"172.21.15.18:6829/2428878428","state":["exists","up"]},{"osd":4,"uuid":"21df023f-bc8b-4abb-93e5-0ecc91acda0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6825","nonce":1421511819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6827","nonce":1421511819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6831","nonce":1421511819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6829","nonce":1421511819}]},"public_addr":"172.21.15.173:6825/1421511819","cluster_addr":"172.21.15.173:6827/1421511819","heartbeat_back_addr":"172.21.15.173:6831/1421511819","heartbeat_front_addr":"172.21.15.173:6829/1421511819","state":["exists","up"]},{"osd":5,"uuid":"e270098a-6d33-49f8-84ed-94e09a880cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6801","nonce":4221907702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6803","nonce":4221907702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6807","nonce":4221907702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6805","nonce":4221907702}]},"public_addr":"172.21.15.173:6801/4221907702","cluster_addr":"172.21.15.173:6803/4221907702","heartbeat_back_addr":"172.21.15.173:6807/4221907702","heartbeat_front_addr":"172.21.15.173:6805/4221907702","state":["exists","up"]},{"osd":6,"uuid":"93c67c8c-268d-4e32-877c-043cd3acd87c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6809","nonce":761678552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6811","nonce":761678552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6815","nonce":761678552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6813","nonce":761678552}]},"public_addr":"172.21.15.173:6809/761678552","cluster_addr":"172.21.15.173:6811/761678552","heartbeat_back_addr":"172.21.15.173:6815/761678552","heartbeat_front_addr":"172.21.15.173:6813/761678552","state":["exists","up"]},{"osd":7,"uuid":"faf10eea-80de-40f6-abbb-34d07d3f59ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6817","nonce":383724537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6819","nonce":383724537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6823","nonce":383724537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6821","nonce":383724537}]},"public_addr":"172.21.15.173:6817/383724537","cluster_addr":"172.21.15.173:6819/383724537","heartbeat_back_addr":"172.21.15.173:6823/383724537","heartbeat_front_addr":"172.21.15.173:6821/383724537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.668924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.761747+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.768128+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.632252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.742608+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.734327+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.477107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.818292+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T19:53:26.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.189+0000 7fe4abfe6640 1 -- 172.21.15.18:0/1094463843 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fe488068380 msgr2=0x7fe48806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.189+0000 7fe4abfe6640 1 --2- 172.21.15.18:0/1094463843 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fe488068380 0x7fe48806a890 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe4a4071fb0 tx=0x7fe4a0008040 comp rx=0 tx=0).stop 2024-04-17T19:53:26.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.189+0000 7fe4abfe6640 1 -- 172.21.15.18:0/1094463843 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4a40ce690 msgr2=0x7fe4a4160530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.189+0000 7fe4abfe6640 1 --2- 172.21.15.18:0/1094463843 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4a40ce690 0x7fe4a4160530 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe49400b410 tx=0x7fe49400b8d0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.193+0000 7fe4abfe6640 1 -- 172.21.15.18:0/1094463843 shutdown_connections 2024-04-17T19:53:26.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.193+0000 7fe4abfe6640 1 --2- 172.21.15.18:0/1094463843 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fe488068380 0x7fe48806a890 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.193+0000 7fe4abfe6640 1 --2- 172.21.15.18:0/1094463843 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe4a415d2d0 0x7fe4a40b4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.193+0000 7fe4abfe6640 1 --2- 172.21.15.18:0/1094463843 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4a40ce690 0x7fe4a4160530 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.193+0000 7fe4abfe6640 1 --2- 172.21.15.18:0/1094463843 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe4a4073080 0x7fe4a4148070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.193+0000 7fe4abfe6640 1 -- 172.21.15.18:0/1094463843 >> 172.21.15.18:0/1094463843 conn(0x7fe4a40b3910 msgr2=0x7fe4a4157d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:26.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.193+0000 7fe4abfe6640 1 -- 172.21.15.18:0/1094463843 shutdown_connections 2024-04-17T19:53:26.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.193+0000 7fe4abfe6640 1 -- 172.21.15.18:0/1094463843 wait complete. 2024-04-17T19:53:26.208 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-17T19:53:26.208 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-17T19:53:26.209 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-17T19:53:26.209 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-17T19:53:26.210 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-17T19:53:26.211 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-17T19:53:26.211 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-17T19:53:26.212 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-17T19:53:26.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.437+0000 7f37e4f33640 1 Processor -- start 2024-04-17T19:53:26.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.437+0000 7f37e4f33640 1 -- start start 2024-04-17T19:53:26.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.441+0000 7f0e7fb18640 1 Processor -- start 2024-04-17T19:53:26.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.441+0000 7f0e7fb18640 1 -- start start 2024-04-17T19:53:26.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.441+0000 7f37e4f33640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f37d803ba80 0x7f37d8051370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.441+0000 7f37e4f33640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f37d80dfa70 0x7f37d80dfe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.441+0000 7f37e4f33640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37d8008b30 con 0x7f37d80071c0 2024-04-17T19:53:26.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.441+0000 7f37e4f33640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f37d8039960 con 0x7f37d803ba80 2024-04-17T19:53:26.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.441+0000 7f37e4f33640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f37d8008570 con 0x7f37d80dfa70 2024-04-17T19:53:26.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.441+0000 7faf12aa3640 1 Processor -- start 2024-04-17T19:53:26.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.441+0000 7faf12aa3640 1 -- start start 2024-04-17T19:53:26.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.441+0000 7f37de59c640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f37d80071c0 0x7f37d8050c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:51134/0 (socket says 172.21.15.18:51134) 2024-04-17T19:53:26.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.441+0000 7f37de59c640 1 -- 172.21.15.18:0/1778309482 learned_addr learned my addr 172.21.15.18:0/1778309482 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:26.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.441+0000 7f3d8724f640 1 Processor -- start 2024-04-17T19:53:26.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.441+0000 7f37ddd9b640 1 --2- 172.21.15.18:0/1778309482 >> v2:172.21.15.18:3300/0 conn(0x7f37d803ba80 0x7f37d8051370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.441+0000 7f37ded9d640 1 --2- 172.21.15.18:0/1778309482 >> v2:172.21.15.173:3300/0 conn(0x7f37d80dfa70 0x7f37d80dfe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.441+0000 7f37dd59a640 1 -- 172.21.15.18:0/1778309482 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2987445793 0 0) 0x7f37d8008b30 con 0x7f37d80071c0 2024-04-17T19:53:26.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.441+0000 7f37dd59a640 1 -- 172.21.15.18:0/1778309482 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f37c8003530 con 0x7f37d80071c0 2024-04-17T19:53:26.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.441+0000 7f0e7fb18640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0e70007090 0x7f0e700074a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.441+0000 7f0e7fb18640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0e700539f0 0x7f0e70053e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.441+0000 7f0e7fb18640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e700079e0 con 0x7f0e70052300 2024-04-17T19:53:26.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.441+0000 7f0e7fb18640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f0e70050e40 con 0x7f0e700539f0 2024-04-17T19:53:26.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.441+0000 7f0e7fb18640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f0e70051120 con 0x7f0e70007090 2024-04-17T19:53:26.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.441+0000 7f0e7e0b5640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0e700539f0 0x7f0e70053e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.441+0000 7f0e7e0b5640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0e700539f0 0x7f0e70053e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49724/0 (socket says 172.21.15.18:49724) 2024-04-17T19:53:26.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.441+0000 7f0e7e0b5640 1 -- 172.21.15.18:0/2182444340 learned_addr learned my addr 172.21.15.18:0/2182444340 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:26.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.441+0000 7f0e7d0b3640 1 --2- 172.21.15.18:0/2182444340 >> v2:172.21.15.173:3300/0 conn(0x7f0e70007090 0x7f0e700074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.441+0000 7f37dd59a640 1 -- 172.21.15.18:0/1778309482 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3799615406 0 0) 0x7f37c8003530 con 0x7f37d80071c0 2024-04-17T19:53:26.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.441+0000 7f37dd59a640 1 -- 172.21.15.18:0/1778309482 >> v2:172.21.15.173:3300/0 conn(0x7f37d80dfa70 msgr2=0x7f37d80dfe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:26.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.441+0000 7f37dd59a640 1 --2- 172.21.15.18:0/1778309482 >> v2:172.21.15.173:3300/0 conn(0x7f37d80dfa70 0x7f37d80dfe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.441+0000 7f37dd59a640 1 -- 172.21.15.18:0/1778309482 >> v2:172.21.15.18:3300/0 conn(0x7f37d803ba80 msgr2=0x7f37d8051370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:26.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.441+0000 7f37dd59a640 1 --2- 172.21.15.18:0/1778309482 >> v2:172.21.15.18:3300/0 conn(0x7f37d803ba80 0x7f37d8051370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.441+0000 7f37dd59a640 1 -- 172.21.15.18:0/1778309482 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37d8008850 con 0x7f37d80071c0 2024-04-17T19:53:26.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.441+0000 7f37dd59a640 1 -- 172.21.15.18:0/1778309482 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3208559991 0 0) 0x7f37d4001680 con 0x7f37d80071c0 2024-04-17T19:53:26.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.441+0000 7f37dd59a640 1 -- 172.21.15.18:0/1778309482 >> v1:172.21.15.18:6789/0 conn(0x7f37d80071c0 legacy=0x7f37d8050c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.441+0000 7f37dd59a640 1 --2- 172.21.15.18:0/1778309482 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f37c80039c0 0x7f37c8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.441+0000 7f37dd59a640 1 --2- 172.21.15.18:0/1778309482 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37c8004810 0x7f37c8004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.441+0000 7f37dd59a640 1 --2- 172.21.15.18:0/1778309482 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37c8005160 0x7f37c800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.441+0000 7f37dd59a640 1 -- 172.21.15.18:0/1778309482 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f37d8039960 con 0x7f37c8005160 2024-04-17T19:53:26.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.441+0000 7f37dd59a640 1 -- 172.21.15.18:0/1778309482 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f37d8008570 con 0x7f37c8004810 2024-04-17T19:53:26.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.441+0000 7f37dd59a640 1 -- 172.21.15.18:0/1778309482 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f37c800c120 con 0x7f37c80039c0 2024-04-17T19:53:26.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.441+0000 7f37ddd9b640 1 --2- 172.21.15.18:0/1778309482 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37c8004810 0x7f37c8004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.441+0000 7faf12aa3640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faf0c170440 0x7faf0c06e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7faf12aa3640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf0c0ccee0 con 0x7faf0c06cd60 2024-04-17T19:53:26.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7faf12aa3640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf0c0b5680 con 0x7faf0c0b6160 2024-04-17T19:53:26.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7faf12aa3640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7faf0c0b5960 con 0x7faf0c170440 2024-04-17T19:53:26.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.441+0000 7f3d8724f640 1 -- start start 2024-04-17T19:53:26.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7f881b006640 1 Processor -- start 2024-04-17T19:53:26.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7f881b006640 1 -- start start 2024-04-17T19:53:26.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7f0e7e0b5640 1 -- 172.21.15.18:0/2182444340 >> v2:172.21.15.173:3300/0 conn(0x7f0e70007090 msgr2=0x7f0e700074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:26.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7f0e7e0b5640 1 --2- 172.21.15.18:0/2182444340 >> v2:172.21.15.173:3300/0 conn(0x7f0e70007090 0x7f0e700074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7f0e7e0b5640 1 -- 172.21.15.18:0/2182444340 >> v1:172.21.15.173:6789/0 conn(0x7f0e70052300 legacy=0x7f0e70008fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7f0e7e0b5640 1 -- 172.21.15.18:0/2182444340 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e70051400 con 0x7f0e700539f0 2024-04-17T19:53:26.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7faf11aa1640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faf0c170440 0x7faf0c06e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7faf11aa1640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faf0c170440 0x7faf0c06e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.18:60370/0 (socket says 172.21.15.18:60370) 2024-04-17T19:53:26.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7faf11aa1640 1 -- 172.21.15.18:0/3285832145 learned_addr learned my addr 172.21.15.18:0/3285832145 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:26.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7f37de59c640 1 --2- 172.21.15.18:0/1778309482 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f37c80039c0 0x7f37c8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7f37ded9d640 1 --2- 172.21.15.18:0/1778309482 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37c8005160 0x7f37c800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7f37ddd9b640 1 -- 172.21.15.18:0/1778309482 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f37c80039c0 msgr2=0x7f37c8003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:26.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7f37ddd9b640 1 --2- 172.21.15.18:0/1778309482 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f37c80039c0 0x7f37c8003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7f37ddd9b640 1 -- 172.21.15.18:0/1778309482 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37c8005160 msgr2=0x7f37c800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:26.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7f37ddd9b640 1 --2- 172.21.15.18:0/1778309482 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37c8005160 0x7f37c800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7f37ddd9b640 1 -- 172.21.15.18:0/1778309482 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37d8008850 con 0x7f37c8004810 2024-04-17T19:53:26.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7f3d8724f640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3d80167bf0 0x7f3d800730f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7f3d8724f640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3d80073630 0x7f3d800ce810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7f3d8724f640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d80073a40 con 0x7f3d800ced50 2024-04-17T19:53:26.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7f3d8724f640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f3d8006e8b0 con 0x7f3d80073630 2024-04-17T19:53:26.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7f3d8724f640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f3d80164b60 con 0x7f3d80167bf0 2024-04-17T19:53:26.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7faf11aa1640 1 -- 172.21.15.18:0/3285832145 >> v1:172.21.15.173:6789/0 conn(0x7faf0c0b6160 legacy=0x7faf0c0b6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7faf11aa1640 1 -- 172.21.15.18:0/3285832145 >> v1:172.21.15.18:6789/0 conn(0x7faf0c06cd60 legacy=0x7faf0c06d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:26.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7faf11aa1640 1 -- 172.21.15.18:0/3285832145 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf0c0b5c40 con 0x7faf0c170440 2024-04-17T19:53:26.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7f3d85a4c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3d80073630 0x7f3d800ce810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7f3d8624d640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3d80167bf0 0x7f3d800730f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7f3d85a4c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3d80073630 0x7f3d800ce810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49740/0 (socket says 172.21.15.18:49740) 2024-04-17T19:53:26.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7f3d85a4c640 1 -- 172.21.15.18:0/3239999296 learned_addr learned my addr 172.21.15.18:0/3239999296 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:26.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7f3d85a4c640 1 -- 172.21.15.18:0/3239999296 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3d80167bf0 msgr2=0x7f3d800730f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:26.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7f3d85a4c640 1 --2- 172.21.15.18:0/3239999296 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3d80167bf0 0x7f3d800730f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7f3d85a4c640 1 -- 172.21.15.18:0/3239999296 >> v1:172.21.15.18:6789/0 conn(0x7f3d800ced50 legacy=0x7f3d800b5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:26.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7f3d85a4c640 1 -- 172.21.15.18:0/3239999296 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d80163fe0 con 0x7f3d80073630 2024-04-17T19:53:26.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7f881b006640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f88140d37c0 0x7f88140d4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7f881b006640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f88140d0230 0x7f88140b82f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7f8813fff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f881406d280 0x7f88140cfb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:51166/0 (socket says 172.21.15.18:51166) 2024-04-17T19:53:26.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7f88195a3640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f88140d0230 0x7f88140b82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7f88195a3640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f88140d0230 0x7f88140b82f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49750/0 (socket says 172.21.15.18:49750) 2024-04-17T19:53:26.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7f8813fff640 1 -- 172.21.15.18:0/482248873 learned_addr learned my addr 172.21.15.18:0/482248873 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:26.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7f0e7e0b5640 1 --2- 172.21.15.18:0/2182444340 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e700539f0 0x7f0e70053e00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0e78051840 tx=0x7f0e780986e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7443cdc1cde57f95 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7f8818da2640 1 --2- 172.21.15.18:0/482248873 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f88140d37c0 0x7f88140d4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7f881b006640 1 -- 172.21.15.18:0/482248873 --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f881406c1e0 con 0x7f881406d280 2024-04-17T19:53:26.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7f881b006640 1 -- 172.21.15.18:0/482248873 --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f881406c4c0 con 0x7f88140d0230 2024-04-17T19:53:26.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7f881b006640 1 -- 172.21.15.18:0/482248873 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f881406c7a0 con 0x7f88140d37c0 2024-04-17T19:53:26.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7f88137fe640 1 -- 172.21.15.18:0/482248873 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3759671967 0 0) 0x7f881406c1e0 con 0x7f881406d280 2024-04-17T19:53:26.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7f88137fe640 1 -- 172.21.15.18:0/482248873 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8804003530 con 0x7f881406d280 2024-04-17T19:53:26.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7f0e7c8b2640 1 -- 172.21.15.18:0/2182444340 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e78127480 con 0x7f0e700539f0 2024-04-17T19:53:26.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7f0e7c8b2640 1 -- 172.21.15.18:0/2182444340 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e78123070 con 0x7f0e700539f0 2024-04-17T19:53:26.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7f0e7c8b2640 1 -- 172.21.15.18:0/2182444340 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e781278e0 con 0x7f0e700539f0 2024-04-17T19:53:26.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7f7af4c1e640 1 Processor -- start 2024-04-17T19:53:26.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7f7af4c1e640 1 -- start start 2024-04-17T19:53:26.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7f37ded9d640 1 -- 172.21.15.18:0/1778309482 reap_dead start 2024-04-17T19:53:26.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7faf11aa1640 1 --2- 172.21.15.18:0/3285832145 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faf0c170440 0x7faf0c06e8b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7faf04009e80 tx=0x7faf0401ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a416ecaf29c0ad17 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.449+0000 7faf10a9f640 1 -- 172.21.15.18:0/3285832145 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf040a5880 con 0x7faf0c170440 2024-04-17T19:53:26.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7f88195a3640 1 -- 172.21.15.18:0/482248873 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f88140d37c0 msgr2=0x7f88140d4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:26.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7f88195a3640 1 --2- 172.21.15.18:0/482248873 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f88140d37c0 0x7f88140d4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7f88195a3640 1 -- 172.21.15.18:0/482248873 >> v1:172.21.15.18:6789/0 conn(0x7f881406d280 legacy=0x7f88140cfb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.445+0000 7f88195a3640 1 -- 172.21.15.18:0/482248873 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f881406ca80 con 0x7f88140d0230 2024-04-17T19:53:26.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.449+0000 7faf10a9f640 1 -- 172.21.15.18:0/3285832145 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf040a5a20 con 0x7faf0c170440 2024-04-17T19:53:26.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.449+0000 7faf10a9f640 1 -- 172.21.15.18:0/3285832145 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf040a5df0 con 0x7faf0c170440 2024-04-17T19:53:26.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.449+0000 7f37ddd9b640 1 --2- 172.21.15.18:0/1778309482 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37c8004810 0x7f37c8004c20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f37d0009ae0 tx=0x7f37d001cad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e0933ca242b6190 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.449+0000 7f37dd59a640 1 -- 172.21.15.18:0/1778309482 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d00b2070 con 0x7f37c8004810 2024-04-17T19:53:26.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.449+0000 7f37dd59a640 1 -- 172.21.15.18:0/1778309482 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37d00a56d0 con 0x7f37c8004810 2024-04-17T19:53:26.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.449+0000 7f37dd59a640 1 -- 172.21.15.18:0/1778309482 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d00096b0 con 0x7f37c8004810 2024-04-17T19:53:26.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.449+0000 7f0e7fb18640 1 -- 172.21.15.18:0/2182444340 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e700539f0 msgr2=0x7f0e70053e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.449+0000 7f0e7fb18640 1 --2- 172.21.15.18:0/2182444340 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e700539f0 0x7f0e70053e00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0e78051840 tx=0x7f0e780986e0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.449+0000 7f37e4f33640 1 -- 172.21.15.18:0/1778309482 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37c8004810 msgr2=0x7f37c8004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.449+0000 7f37e4f33640 1 --2- 172.21.15.18:0/1778309482 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37c8004810 0x7f37c8004c20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f37d0009ae0 tx=0x7f37d001cad0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.449+0000 7faf12aa3640 1 -- 172.21.15.18:0/3285832145 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faf0c170440 msgr2=0x7faf0c06e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.449+0000 7faf12aa3640 1 --2- 172.21.15.18:0/3285832145 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faf0c170440 0x7faf0c06e8b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7faf04009e80 tx=0x7faf0401ca10 comp rx=0 tx=0).stop 2024-04-17T19:53:26.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.449+0000 7faf12aa3640 1 -- 172.21.15.18:0/3285832145 shutdown_connections 2024-04-17T19:53:26.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.449+0000 7faf12aa3640 1 --2- 172.21.15.18:0/3285832145 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faf0c170440 0x7faf0c06e8b0 secure :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7faf04009e80 tx=0x7faf0401ca10 comp rx=0 tx=0).stop 2024-04-17T19:53:26.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.449+0000 7faf12aa3640 1 -- 172.21.15.18:0/3285832145 >> 172.21.15.18:0/3285832145 conn(0x7faf0c0727a0 msgr2=0x7faf0c072bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:26.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.449+0000 7f37e4f33640 1 -- 172.21.15.18:0/1778309482 shutdown_connections 2024-04-17T19:53:26.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.449+0000 7f37e4f33640 1 --2- 172.21.15.18:0/1778309482 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37c8004810 0x7f37c8004c20 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.449+0000 7f37e4f33640 1 -- 172.21.15.18:0/1778309482 >> 172.21.15.18:0/1778309482 conn(0x7f37d8055e20 msgr2=0x7f37d8056230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:26.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.449+0000 7faf12aa3640 1 -- 172.21.15.18:0/3285832145 shutdown_connections 2024-04-17T19:53:26.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.449+0000 7f37e4f33640 1 -- 172.21.15.18:0/1778309482 shutdown_connections 2024-04-17T19:53:26.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.449+0000 7faf12aa3640 1 -- 172.21.15.18:0/3285832145 wait complete. 2024-04-17T19:53:26.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.449+0000 7f37e4f33640 1 -- 172.21.15.18:0/1778309482 wait complete. 2024-04-17T19:53:26.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.449+0000 7f7af4c1e640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7af00b4160 0x7f7af00cf700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.449+0000 7f7af4c1e640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f7af006ce60 0x7f7af00d0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.449+0000 7f7af4c1e640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7af00d3fc0 con 0x7f7af00cfc40 2024-04-17T19:53:26.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.449+0000 7f7af4c1e640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f7af00d0590 con 0x7f7af006ce60 2024-04-17T19:53:26.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.449+0000 7f7af4c1e640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f7af00d48f0 con 0x7f7af00b4160 2024-04-17T19:53:26.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.449+0000 7f8818da2640 1 --2- 172.21.15.18:0/482248873 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f88140d37c0 0x7f88140d4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:53:26.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.449+0000 7f3d85a4c640 1 --2- 172.21.15.18:0/3239999296 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d80073630 0x7f3d800ce810 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c009870 tx=0x7f3d7c01c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ff609d504282f30 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.449+0000 7f7aeffff640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f7af006ce60 0x7f7af00d0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.449+0000 7f0e7fb18640 1 -- 172.21.15.18:0/2182444340 shutdown_connections 2024-04-17T19:53:26.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.449+0000 7f0e7fb18640 1 --2- 172.21.15.18:0/2182444340 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e700539f0 0x7f0e70053e00 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.449+0000 7f0e7fb18640 1 --2- 172.21.15.18:0/2182444340 >> v2:172.21.15.173:3300/0 conn(0x7f0e70007090 0x7f0e700074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.449+0000 7f0e7fb18640 1 -- 172.21.15.18:0/2182444340 >> 172.21.15.18:0/2182444340 conn(0x7f0e70055e20 msgr2=0x7f0e70056230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:26.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.449+0000 7f7aeffff640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f7af006ce60 0x7f7af00d0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.18:43872/0 (socket says 172.21.15.18:43872) 2024-04-17T19:53:26.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.449+0000 7f7aeffff640 1 -- 172.21.15.18:0/1064077562 learned_addr learned my addr 172.21.15.18:0/1064077562 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:26.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.449+0000 7f7aef7fe640 1 --2- 172.21.15.18:0/1064077562 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7af00b4160 0x7f7af00cf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.449+0000 7f88195a3640 1 --2- 172.21.15.18:0/482248873 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88140d0230 0x7f88140b82f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f880c009d90 tx=0x7f880c01c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77f027a20fb51e19 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.449+0000 7f0e7fb18640 1 -- 172.21.15.18:0/2182444340 shutdown_connections 2024-04-17T19:53:26.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.449+0000 7f0e7fb18640 1 -- 172.21.15.18:0/2182444340 wait complete. 2024-04-17T19:53:26.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.449+0000 7f88137fe640 1 -- 172.21.15.18:0/482248873 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f880c0b2070 con 0x7f88140d0230 2024-04-17T19:53:26.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.449+0000 7f88137fe640 1 -- 172.21.15.18:0/482248873 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f880c0a5880 con 0x7f88140d0230 2024-04-17T19:53:26.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.449+0000 7f88137fe640 1 -- 172.21.15.18:0/482248873 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f880c0a5c50 con 0x7f88140d0230 2024-04-17T19:53:26.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.449+0000 7f3d8524b640 1 -- 172.21.15.18:0/3239999296 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c0b0070 con 0x7f3d80073630 2024-04-17T19:53:26.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.449+0000 7f3d8524b640 1 -- 172.21.15.18:0/3239999296 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d7c0ab600 con 0x7f3d80073630 2024-04-17T19:53:26.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.449+0000 7f3d8524b640 1 -- 172.21.15.18:0/3239999296 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c0ab9d0 con 0x7f3d80073630 2024-04-17T19:53:26.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.449+0000 7f37e4f33640 1 Processor -- start 2024-04-17T19:53:26.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.449+0000 7f37e4f33640 1 -- start start 2024-04-17T19:53:26.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7f881b006640 1 -- 172.21.15.18:0/482248873 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88140d0230 msgr2=0x7f88140b82f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7f881b006640 1 --2- 172.21.15.18:0/482248873 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88140d0230 0x7f88140b82f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f880c009d90 tx=0x7f880c01c8f0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7f881b006640 1 -- 172.21.15.18:0/482248873 shutdown_connections 2024-04-17T19:53:26.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7f3d8724f640 1 -- 172.21.15.18:0/3239999296 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d80073630 msgr2=0x7f3d800ce810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7f3d8724f640 1 --2- 172.21.15.18:0/3239999296 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d80073630 0x7f3d800ce810 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c009870 tx=0x7f3d7c01c310 comp rx=0 tx=0).stop 2024-04-17T19:53:26.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7f3d8724f640 1 -- 172.21.15.18:0/3239999296 shutdown_connections 2024-04-17T19:53:26.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7f3d8724f640 1 --2- 172.21.15.18:0/3239999296 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d80073630 0x7f3d800ce810 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7f3d8724f640 1 --2- 172.21.15.18:0/3239999296 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3d80167bf0 0x7f3d800730f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7f3d8724f640 1 -- 172.21.15.18:0/3239999296 >> 172.21.15.18:0/3239999296 conn(0x7f3d800725d0 msgr2=0x7f3d800729e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:26.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7f881b006640 1 --2- 172.21.15.18:0/482248873 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88140d0230 0x7f88140b82f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7f881b006640 1 --2- 172.21.15.18:0/482248873 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f88140d37c0 0x7f88140d4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7f881b006640 1 -- 172.21.15.18:0/482248873 >> 172.21.15.18:0/482248873 conn(0x7f88140b6cd0 msgr2=0x7f88140b70e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:26.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7f881b006640 1 -- 172.21.15.18:0/482248873 shutdown_connections 2024-04-17T19:53:26.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7f37e4f33640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37c8004810 0x7f37d80cda00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7faf12aa3640 1 Processor -- start 2024-04-17T19:53:26.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7faf12aa3640 1 -- start start 2024-04-17T19:53:26.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7f37e4f33640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f37d80ce260 0x7f37d80d25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7f37e4f33640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37d80d2b10 0x7f37d80d55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7f37e4f33640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f37d80e0000 con 0x7f37d80d2b10 2024-04-17T19:53:26.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7f37e4f33640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f37d80dfe80 con 0x7f37c8004810 2024-04-17T19:53:26.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7f37ded9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37d80d2b10 0x7f37d80d55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7f37ded9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37d80d2b10 0x7f37d80d55f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49760/0 (socket says 172.21.15.18:49760) 2024-04-17T19:53:26.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7f37ded9d640 1 -- 172.21.15.18:0/1139493767 learned_addr learned my addr 172.21.15.18:0/1139493767 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:26.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7f0e7fb18640 1 Processor -- start 2024-04-17T19:53:26.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7f3d8724f640 1 -- 172.21.15.18:0/3239999296 shutdown_connections 2024-04-17T19:53:26.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7f3d8724f640 1 -- 172.21.15.18:0/3239999296 wait complete. 2024-04-17T19:53:26.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7f0e7fb18640 1 -- start start 2024-04-17T19:53:26.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7f37de59c640 1 --2- 172.21.15.18:0/1139493767 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37c8004810 0x7f37d80cda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7f37ddd9b640 1 --2- 172.21.15.18:0/1139493767 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f37d80ce260 0x7f37d80d25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7f881b006640 1 -- 172.21.15.18:0/482248873 wait complete. 2024-04-17T19:53:26.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7f37e4f33640 1 -- 172.21.15.18:0/1139493767 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f37d80e0180 con 0x7f37d80ce260 2024-04-17T19:53:26.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7faf12aa3640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf0c06cd60 0x7faf0c165c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7faf12aa3640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faf0c0b6160 0x7faf0c215c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.449+0000 7f7aef7fe640 1 -- 172.21.15.18:0/1064077562 >> v2:172.21.15.173:3300/0 conn(0x7f7af006ce60 msgr2=0x7f7af00d0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:26.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.449+0000 7f7aef7fe640 1 --2- 172.21.15.18:0/1064077562 >> v2:172.21.15.173:3300/0 conn(0x7f7af006ce60 0x7f7af00d0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.449+0000 7f7aef7fe640 1 -- 172.21.15.18:0/1064077562 >> v1:172.21.15.18:6789/0 conn(0x7f7af00cfc40 legacy=0x7f7af0162e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.449+0000 7f7aef7fe640 1 -- 172.21.15.18:0/1064077562 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7af00d42a0 con 0x7f7af00b4160 2024-04-17T19:53:26.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7f465d4d2640 1 Processor -- start 2024-04-17T19:53:26.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7faf11aa1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf0c06cd60 0x7faf0c165c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7faf11aa1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf0c06cd60 0x7faf0c165c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.18:43892/0 (socket says 172.21.15.18:43892) 2024-04-17T19:53:26.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7faf11aa1640 1 -- 172.21.15.18:0/670626683 learned_addr learned my addr 172.21.15.18:0/670626683 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:26.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7f465d4d2640 1 -- start start 2024-04-17T19:53:26.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7faf12aa3640 1 --2- 172.21.15.18:0/670626683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faf0c2161d0 0x7faf0c219b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7f7aef7fe640 1 --2- 172.21.15.18:0/1064077562 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7af00b4160 0x7f7af00cf700 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7ae40097c0 tx=0x7f7ae401c2c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1025a49c6e1dfcf4 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7faf112a0640 1 --2- 172.21.15.18:0/670626683 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faf0c0b6160 0x7faf0c215c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7faf122a2640 1 --2- 172.21.15.18:0/670626683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faf0c2161d0 0x7faf0c219b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7faf12aa3640 1 -- 172.21.15.18:0/670626683 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7faf0c08ba20 con 0x7faf0c2161d0 2024-04-17T19:53:26.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7faf12aa3640 1 -- 172.21.15.18:0/670626683 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7faf0c08b8a0 con 0x7faf0c06cd60 2024-04-17T19:53:26.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7f37ded9d640 1 -- 172.21.15.18:0/1139493767 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f37d80ce260 msgr2=0x7f37d80d25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7f37ded9d640 1 --2- 172.21.15.18:0/1139493767 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f37d80ce260 0x7f37d80d25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7f37ded9d640 1 -- 172.21.15.18:0/1139493767 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37c8004810 msgr2=0x7f37d80cda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7f37ded9d640 1 --2- 172.21.15.18:0/1139493767 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f37c8004810 0x7f37d80cda00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7f37ded9d640 1 -- 172.21.15.18:0/1139493767 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37d80d0fe0 con 0x7f37d80d2b10 2024-04-17T19:53:26.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7faf12aa3640 1 -- 172.21.15.18:0/670626683 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7faf0c06edf0 con 0x7faf0c0b6160 2024-04-17T19:53:26.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7f37ded9d640 1 --2- 172.21.15.18:0/1139493767 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37d80d2b10 0x7f37d80d55f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f37e006aa50 tx=0x7f37e0069370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7f7aee7fc640 1 -- 172.21.15.18:0/1064077562 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae40b0070 con 0x7f7af00b4160 2024-04-17T19:53:26.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7f37ceffd640 1 -- 172.21.15.18:0/1139493767 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e0074af0 con 0x7f37d80d2b10 2024-04-17T19:53:26.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7f37ceffd640 1 -- 172.21.15.18:0/1139493767 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37e0096030 con 0x7f37d80d2b10 2024-04-17T19:53:26.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7f37ceffd640 1 -- 172.21.15.18:0/1139493767 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e0074f10 con 0x7f37d80d2b10 2024-04-17T19:53:26.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7f37e4f33640 1 -- 172.21.15.18:0/1139493767 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37d80d12c0 con 0x7f37d80d2b10 2024-04-17T19:53:26.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7faf112a0640 1 -- 172.21.15.18:0/670626683 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf0c06cd60 msgr2=0x7faf0c165c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7faf112a0640 1 --2- 172.21.15.18:0/670626683 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf0c06cd60 0x7faf0c165c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7faf112a0640 1 -- 172.21.15.18:0/670626683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faf0c2161d0 msgr2=0x7faf0c219b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7faf112a0640 1 --2- 172.21.15.18:0/670626683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faf0c2161d0 0x7faf0c219b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.453+0000 7faf112a0640 1 -- 172.21.15.18:0/670626683 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf0c1670f0 con 0x7faf0c0b6160 2024-04-17T19:53:26.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7faf112a0640 1 --2- 172.21.15.18:0/670626683 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faf0c0b6160 0x7faf0c215c90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7faefc000f70 tx=0x7faefc00c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f0e7fb18640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0e70007090 0x7f0e700ede60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f6ed616b640 1 Processor -- start 2024-04-17T19:53:26.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f0e7fb18640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e70052300 0x7f0e7004c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f3d8724f640 1 Processor -- start 2024-04-17T19:53:26.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f465d4d2640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f465806cd60 0x7f465806d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f465d4d2640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f465815bbf0 0x7f465815c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f46577fe640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f465806cd60 0x7f465806d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f46577fe640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f465806cd60 0x7f465806d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.18:60444/0 (socket says 172.21.15.18:60444) 2024-04-17T19:53:26.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f46577fe640 1 -- 172.21.15.18:0/2191817949 learned_addr learned my addr 172.21.15.18:0/2191817949 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:26.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f465ccd1640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f465815bbf0 0x7f465815c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f465d4d2640 1 -- 172.21.15.18:0/2191817949 --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46580cf670 con 0x7f46580b58e0 2024-04-17T19:53:26.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f465d4d2640 1 -- 172.21.15.18:0/2191817949 --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f46580ce810 con 0x7f465815bbf0 2024-04-17T19:53:26.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f465d4d2640 1 -- 172.21.15.18:0/2191817949 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f465806d6b0 con 0x7f465806cd60 2024-04-17T19:53:26.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f4656ffd640 1 -- 172.21.15.18:0/2191817949 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4158449216 0 0) 0x7f46580cf670 con 0x7f46580b58e0 2024-04-17T19:53:26.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f4656ffd640 1 -- 172.21.15.18:0/2191817949 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4640003530 con 0x7f46580b58e0 2024-04-17T19:53:26.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f465ccd1640 1 -- 172.21.15.18:0/2191817949 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f465806cd60 msgr2=0x7f465806d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:26.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f465ccd1640 1 --2- 172.21.15.18:0/2191817949 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f465806cd60 0x7f465806d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f465ccd1640 1 -- 172.21.15.18:0/2191817949 >> v1:172.21.15.173:6789/0 conn(0x7f46580b58e0 legacy=0x7f46580ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f465ccd1640 1 -- 172.21.15.18:0/2191817949 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46580cea60 con 0x7f465815bbf0 2024-04-17T19:53:26.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f46577fe640 1 --2- 172.21.15.18:0/2191817949 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f465806cd60 0x7f465806d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T19:53:26.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f37ceffd640 1 -- 172.21.15.18:0/1139493767 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f37e00924d0 con 0x7f37d80d2b10 2024-04-17T19:53:26.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f37ceffd640 1 --2- 172.21.15.18:0/1139493767 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f37c00683b0 0x7f37c006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f37de59c640 1 --2- 172.21.15.18:0/1139493767 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f37c00683b0 0x7f37c006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f37e4f33640 1 -- 172.21.15.18:0/1139493767 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37d80d1880 con 0x7f37d80d2b10 2024-04-17T19:53:26.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f37de59c640 1 --2- 172.21.15.18:0/1139493767 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f37c00683b0 0x7f37c006a8c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f37d4001060 tx=0x7f37d4007980 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f37ceffd640 1 -- 172.21.15.18:0/1139493767 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f37e00d34a0 con 0x7f37d80d2b10 2024-04-17T19:53:26.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f3d8724f640 1 -- start start 2024-04-17T19:53:26.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f3d8724f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d80073630 0x7f3d80160d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f3d8724f640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3d800ced50 0x7f3d801612b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f3d8724f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d80167bf0 0x7f3d80164d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f3d8724f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3d800cf570 con 0x7f3d80073630 2024-04-17T19:53:26.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f3d8724f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3d80149e90 con 0x7f3d80167bf0 2024-04-17T19:53:26.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7faf027fc640 1 -- 172.21.15.18:0/670626683 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faefc017070 con 0x7faf0c0b6160 2024-04-17T19:53:26.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7faf027fc640 1 -- 172.21.15.18:0/670626683 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faefc0052d0 con 0x7faf0c0b6160 2024-04-17T19:53:26.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7faf027fc640 1 -- 172.21.15.18:0/670626683 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faefc003840 con 0x7faf0c0b6160 2024-04-17T19:53:26.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7faf12aa3640 1 -- 172.21.15.18:0/670626683 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf0c166570 con 0x7faf0c0b6160 2024-04-17T19:53:26.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7faf12aa3640 1 -- 172.21.15.18:0/670626683 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7faf0c166b30 con 0x7faf0c0b6160 2024-04-17T19:53:26.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f881b006640 1 Processor -- start 2024-04-17T19:53:26.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f881b006640 1 -- start start 2024-04-17T19:53:26.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f0e7fb18640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e700539f0 0x7f0e70035f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f0e7fb18640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0e70009840 con 0x7f0e70052300 2024-04-17T19:53:26.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f0e7fb18640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0e700096c0 con 0x7f0e700539f0 2024-04-17T19:53:26.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f0e7fb18640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f0e700e15f0 con 0x7f0e70007090 2024-04-17T19:53:26.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f0e7e0b5640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e700539f0 0x7f0e70035f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f0e7e0b5640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e700539f0 0x7f0e70035f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.18:43908/0 (socket says 172.21.15.18:43908) 2024-04-17T19:53:26.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f0e7e0b5640 1 -- 172.21.15.18:0/830578178 learned_addr learned my addr 172.21.15.18:0/830578178 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:26.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f0e7e0b5640 1 -- 172.21.15.18:0/830578178 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0e70007090 msgr2=0x7f0e700ede60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f0e7e0b5640 1 --2- 172.21.15.18:0/830578178 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0e70007090 0x7f0e700ede60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f0e7e0b5640 1 -- 172.21.15.18:0/830578178 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e70052300 msgr2=0x7f0e7004c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f0e7e0b5640 1 --2- 172.21.15.18:0/830578178 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e70052300 0x7f0e7004c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f0e7e0b5640 1 -- 172.21.15.18:0/830578178 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e70036440 con 0x7f0e700539f0 2024-04-17T19:53:26.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f0e7e0b5640 1 --2- 172.21.15.18:0/830578178 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e700539f0 0x7f0e70035f00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0e7806b370 tx=0x7f0e78095540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f6ed616b640 1 -- start start 2024-04-17T19:53:26.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f6ed616b640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f6ec80d9d00 0x7f6ec804f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f6ed616b640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6ec804f890 0x7f6ec80dfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f6ed616b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6ec80e0220 0x7f6ec80e3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f6ed616b640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f6ec8050ce0 con 0x7f6ec80e0220 2024-04-17T19:53:26.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f6ed616b640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f6ec804fca0 con 0x7f6ec80d9d00 2024-04-17T19:53:26.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f6ed616b640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f6ec80e0a90 con 0x7f6ec804f890 2024-04-17T19:53:26.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f7aee7fc640 1 -- 172.21.15.18:0/1064077562 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ae40ab600 con 0x7f7af00b4160 2024-04-17T19:53:26.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f3d8724f640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f3d800b3b90 con 0x7f3d800ced50 2024-04-17T19:53:26.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f3d85a4c640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3d800ced50 0x7f3d801612b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f3d85a4c640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3d800ced50 0x7f3d801612b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.18:60448/0 (socket says 172.21.15.18:60448) 2024-04-17T19:53:26.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7faf12aa3640 1 -- 172.21.15.18:0/670626683 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faef4001040 con 0x7faf0c0b6160 2024-04-17T19:53:26.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f3d85a4c640 1 -- 172.21.15.18:0/4173289894 learned_addr learned my addr 172.21.15.18:0/4173289894 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:26.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f3d86a4e640 1 --2- 172.21.15.18:0/4173289894 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d80167bf0 0x7f3d80164d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f6ed5169640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f6ec80d9d00 0x7f6ec804f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f6ed5169640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f6ec80d9d00 0x7f6ec804f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.18:43920/0 (socket says 172.21.15.18:43920) 2024-04-17T19:53:26.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f6ed5169640 1 -- 172.21.15.18:0/3406571370 learned_addr learned my addr 172.21.15.18:0/3406571370 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:26.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f3d8624d640 1 --2- 172.21.15.18:0/4173289894 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d80073630 0x7f3d80160d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.461+0000 7f6ed596a640 1 --2- 172.21.15.18:0/3406571370 >> v2:172.21.15.18:3300/0 conn(0x7f6ec80e0220 0x7f6ec80e3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.461+0000 7f7af4c1e640 1 -- 172.21.15.18:0/1064077562 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7af00b4160 msgr2=0x7f7af00cf700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.461+0000 7f7af4c1e640 1 --2- 172.21.15.18:0/1064077562 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7af00b4160 0x7f7af00cf700 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7ae40097c0 tx=0x7f7ae401c2c0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.461+0000 7f7af4c1e640 1 -- 172.21.15.18:0/1064077562 shutdown_connections 2024-04-17T19:53:26.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.461+0000 7f7af4c1e640 1 --2- 172.21.15.18:0/1064077562 >> v2:172.21.15.173:3300/0 conn(0x7f7af006ce60 0x7f7af00d0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.461+0000 7f7af4c1e640 1 --2- 172.21.15.18:0/1064077562 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7af00b4160 0x7f7af00cf700 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.461+0000 7f7af4c1e640 1 -- 172.21.15.18:0/1064077562 >> 172.21.15.18:0/1064077562 conn(0x7f7af00d4cf0 msgr2=0x7f7af00d5100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:26.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.461+0000 7f3d85a4c640 1 -- 172.21.15.18:0/4173289894 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d80167bf0 msgr2=0x7f3d80164d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.461+0000 7f3d85a4c640 1 --2- 172.21.15.18:0/4173289894 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d80167bf0 0x7f3d80164d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f37e4f33640 1 --2- 172.21.15.18:0/1139493767 >> [v2:172.21.15.18:6808/1212875862,v1:172.21.15.18:6809/1212875862] conn(0x7f37d80d2f20 0x7f37d8002910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.457+0000 7f37e4f33640 1 -- 172.21.15.18:0/1139493767 --> [v2:172.21.15.18:6808/1212875862,v1:172.21.15.18:6809/1212875862] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f37d80d0d90 con 0x7f37d80d2f20 2024-04-17T19:53:26.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.461+0000 7f3d85a4c640 1 -- 172.21.15.18:0/4173289894 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d80073630 msgr2=0x7f3d80160d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.461+0000 7f3d85a4c640 1 --2- 172.21.15.18:0/4173289894 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d80073630 0x7f3d80160d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.461+0000 7f3d85a4c640 1 -- 172.21.15.18:0/4173289894 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d80162800 con 0x7f3d800ced50 2024-04-17T19:53:26.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.461+0000 7f7af4c1e640 1 -- 172.21.15.18:0/1064077562 shutdown_connections 2024-04-17T19:53:26.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.461+0000 7f3d8624d640 1 --2- 172.21.15.18:0/4173289894 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d80073630 0x7f3d80160d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T19:53:26.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.461+0000 7f7af4c1e640 1 -- 172.21.15.18:0/1064077562 wait complete. 2024-04-17T19:53:26.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.461+0000 7f37ddd9b640 1 --2- 172.21.15.18:0/1139493767 >> [v2:172.21.15.18:6808/1212875862,v1:172.21.15.18:6809/1212875862] conn(0x7f37d80d2f20 0x7f37d8002910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.461+0000 7f6ed4968640 1 --2- 172.21.15.18:0/3406571370 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6ec804f890 0x7f6ec80dfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.461+0000 7f37ddd9b640 1 --2- 172.21.15.18:0/1139493767 >> [v2:172.21.15.18:6808/1212875862,v1:172.21.15.18:6809/1212875862] conn(0x7f37d80d2f20 0x7f37d8002910 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.461+0000 7f37ceffd640 1 -- 172.21.15.18:0/1139493767 <== osd.2 v2:172.21.15.18:6808/1212875862 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f37d80d0d90 con 0x7f37d80d2f20 2024-04-17T19:53:26.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.461+0000 7f7af4c1e640 1 Processor -- start 2024-04-17T19:53:26.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.461+0000 7f3d85a4c640 1 --2- 172.21.15.18:0/4173289894 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3d800ced50 0x7f3d801612b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c01a9c0 tx=0x7f3d7c0190b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.461+0000 7f881b006640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f881406d280 0x7f881414dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.461+0000 7f881b006640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88140d37c0 0x7f8814152ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.461+0000 7f6ed596a640 1 -- 172.21.15.18:0/3406571370 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6ec804f890 msgr2=0x7f6ec80dfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:26.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.461+0000 7f6ed596a640 1 --2- 172.21.15.18:0/3406571370 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6ec804f890 0x7f6ec80dfce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.461+0000 7f6ed596a640 1 -- 172.21.15.18:0/3406571370 >> v2:172.21.15.173:3300/0 conn(0x7f6ec80d9d00 msgr2=0x7f6ec804f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:26.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.461+0000 7f6ed596a640 1 --2- 172.21.15.18:0/3406571370 >> v2:172.21.15.173:3300/0 conn(0x7f6ec80d9d00 0x7f6ec804f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.461+0000 7f6ed596a640 1 -- 172.21.15.18:0/3406571370 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ec8053a30 con 0x7f6ec80e0220 2024-04-17T19:53:26.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.461+0000 7f8813fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88140d37c0 0x7f8814152ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.461+0000 7f8813fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88140d37c0 0x7f8814152ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49810/0 (socket says 172.21.15.18:49810) 2024-04-17T19:53:26.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.461+0000 7f8818da2640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f881406d280 0x7f881414dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.461+0000 7f8818da2640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f881406d280 0x7f881414dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.18:60472/0 (socket says 172.21.15.18:60472) 2024-04-17T19:53:26.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.461+0000 7f8813fff640 1 -- 172.21.15.18:0/2707780950 learned_addr learned my addr 172.21.15.18:0/2707780950 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:26.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.461+0000 7f6ed596a640 1 --2- 172.21.15.18:0/3406571370 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ec80e0220 0x7f6ec80e3320 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6ec8007c40 tx=0x7f6ecc01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a94de015ca55b0a server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.461+0000 7f881b006640 1 --2- 172.21.15.18:0/2707780950 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88141533e0 0x7f8814158c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.461+0000 7f881b006640 1 -- 172.21.15.18:0/2707780950 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f881415ebb0 con 0x7f88140d37c0 2024-04-17T19:53:26.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.461+0000 7f881b006640 1 -- 172.21.15.18:0/2707780950 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f881415ea30 con 0x7f88141533e0 2024-04-17T19:53:26.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.461+0000 7f881b006640 1 -- 172.21.15.18:0/2707780950 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f881415ed30 con 0x7f881406d280 2024-04-17T19:53:26.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.461+0000 7faf027fc640 1 -- 172.21.15.18:0/670626683 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7faefc01a070 con 0x7faf0c0b6160 2024-04-17T19:53:26.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.461+0000 7faf027fc640 1 --2- 172.21.15.18:0/670626683 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7faef00683d0 0x7faef006a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.461+0000 7faf027fc640 1 -- 172.21.15.18:0/670626683 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7faefc0861d0 con 0x7faf0c0b6160 2024-04-17T19:53:26.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.461+0000 7faf027fc640 1 --2- 172.21.15.18:0/670626683 >> [v2:172.21.15.173:6824/1421511819,v1:172.21.15.173:6825/1421511819] conn(0x7faef0071ba0 0x7faef0074030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.461+0000 7faf027fc640 1 -- 172.21.15.18:0/670626683 --> [v2:172.21.15.173:6824/1421511819,v1:172.21.15.173:6825/1421511819] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faefc014ec0 con 0x7faef0071ba0 2024-04-17T19:53:26.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.461+0000 7faf027fc640 1 -- 172.21.15.18:0/670626683 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7faefc0866b0 con 0x7faf0c0b6160 2024-04-17T19:53:26.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.461+0000 7f6ec7fff640 1 -- 172.21.15.18:0/3406571370 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ecc0b0070 con 0x7f6ec80e0220 2024-04-17T19:53:26.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.461+0000 7f6ec7fff640 1 -- 172.21.15.18:0/3406571370 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ecc0ab600 con 0x7f6ec80e0220 2024-04-17T19:53:26.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.461+0000 7f6ec7fff640 1 -- 172.21.15.18:0/3406571370 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ecc0aba10 con 0x7f6ec80e0220 2024-04-17T19:53:26.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.465+0000 7f3d76ffd640 1 -- 172.21.15.18:0/4173289894 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c0bb070 con 0x7f3d800ced50 2024-04-17T19:53:26.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.465+0000 7f3d76ffd640 1 -- 172.21.15.18:0/4173289894 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d7c0b1040 con 0x7f3d800ced50 2024-04-17T19:53:26.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.465+0000 7f3d8724f640 1 -- 172.21.15.18:0/4173289894 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d80162ae0 con 0x7f3d800ced50 2024-04-17T19:53:26.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.465+0000 7f3d76ffd640 1 -- 172.21.15.18:0/4173289894 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c0b0070 con 0x7f3d800ced50 2024-04-17T19:53:26.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.465+0000 7f3d8724f640 1 -- 172.21.15.18:0/4173289894 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d800aabf0 con 0x7f3d800ced50 2024-04-17T19:53:26.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.465+0000 7faf11aa1640 1 --2- 172.21.15.18:0/670626683 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7faef00683d0 0x7faef006a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.465+0000 7faf122a2640 1 --2- 172.21.15.18:0/670626683 >> [v2:172.21.15.173:6824/1421511819,v1:172.21.15.173:6825/1421511819] conn(0x7faef0071ba0 0x7faef0074030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.465+0000 7faf11aa1640 1 --2- 172.21.15.18:0/670626683 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7faef00683d0 0x7faef006a8e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7faf04000f90 tx=0x7faf040a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.465+0000 7faf122a2640 1 --2- 172.21.15.18:0/670626683 >> [v2:172.21.15.173:6824/1421511819,v1:172.21.15.173:6825/1421511819] conn(0x7faef0071ba0 0x7faef0074030 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.461+0000 7f88195a3640 1 --2- 172.21.15.18:0/2707780950 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88141533e0 0x7f8814158c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.465+0000 7f8813fff640 1 -- 172.21.15.18:0/2707780950 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f881406d280 msgr2=0x7f881414dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.465+0000 7f8813fff640 1 --2- 172.21.15.18:0/2707780950 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f881406d280 0x7f881414dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.465+0000 7f8813fff640 1 -- 172.21.15.18:0/2707780950 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88141533e0 msgr2=0x7f8814158c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.465+0000 7f8813fff640 1 --2- 172.21.15.18:0/2707780950 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88141533e0 0x7f8814158c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.465+0000 7f8813fff640 1 -- 172.21.15.18:0/2707780950 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f881414e4e0 con 0x7f88140d37c0 2024-04-17T19:53:26.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.465+0000 7f8813fff640 1 --2- 172.21.15.18:0/2707780950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88140d37c0 0x7f8814152ea0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f880000c400 tx=0x7f880000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.465+0000 7f88117fa640 1 -- 172.21.15.18:0/2707780950 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8800017070 con 0x7f88140d37c0 2024-04-17T19:53:26.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.465+0000 7f88117fa640 1 -- 172.21.15.18:0/2707780950 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8800005cf0 con 0x7f88140d37c0 2024-04-17T19:53:26.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.465+0000 7f88117fa640 1 -- 172.21.15.18:0/2707780950 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88000072d0 con 0x7f88140d37c0 2024-04-17T19:53:26.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.465+0000 7f0e6e7fc640 1 -- 172.21.15.18:0/830578178 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e78137020 con 0x7f0e700539f0 2024-04-17T19:53:26.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.465+0000 7f0e7fb18640 1 -- 172.21.15.18:0/830578178 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e70034d10 con 0x7f0e700539f0 2024-04-17T19:53:26.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.465+0000 7f0e7fb18640 1 -- 172.21.15.18:0/830578178 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e7004bb10 con 0x7f0e700539f0 2024-04-17T19:53:26.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.465+0000 7f0e6e7fc640 1 -- 172.21.15.18:0/830578178 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e78127d80 con 0x7f0e700539f0 2024-04-17T19:53:26.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.465+0000 7f0e6e7fc640 1 -- 172.21.15.18:0/830578178 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e78130640 con 0x7f0e700539f0 2024-04-17T19:53:26.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.465+0000 7f6ed616b640 1 -- 172.21.15.18:0/3406571370 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ec80e0220 msgr2=0x7f6ec80e3320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.465+0000 7f6ed616b640 1 --2- 172.21.15.18:0/3406571370 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ec80e0220 0x7f6ec80e3320 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6ec8007c40 tx=0x7f6ecc01c4a0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.461+0000 7f7af4c1e640 1 -- start start 2024-04-17T19:53:26.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.465+0000 7f7af4c1e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7af006ce60 0x7f7af0154d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.465+0000 7f7af4c1e640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7af00cfc40 0x7f7af00cac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.465+0000 7f7af4c1e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7af0153260 0x7f7af0153670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.465+0000 7f7af4c1e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7af016c310 con 0x7f7af0153260 2024-04-17T19:53:26.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.465+0000 7f7af4c1e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7af016c190 con 0x7f7af006ce60 2024-04-17T19:53:26.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.465+0000 7f7af4c1e640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f7af016c490 con 0x7f7af00cfc40 2024-04-17T19:53:26.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.465+0000 7f7aeffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7af0153260 0x7f7af0153670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.465+0000 7f7aeffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7af0153260 0x7f7af0153670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49814/0 (socket says 172.21.15.18:49814) 2024-04-17T19:53:26.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.465+0000 7f7aeffff640 1 -- 172.21.15.18:0/3214870932 learned_addr learned my addr 172.21.15.18:0/3214870932 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:26.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.465+0000 7f7aef7fe640 1 --2- 172.21.15.18:0/3214870932 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7af006ce60 0x7f7af0154d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.465+0000 7f7aeeffd640 1 --2- 172.21.15.18:0/3214870932 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7af00cfc40 0x7f7af00cac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.465+0000 7f7aeffff640 1 -- 172.21.15.18:0/3214870932 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7af00cfc40 msgr2=0x7f7af00cac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.465+0000 7f7aeffff640 1 --2- 172.21.15.18:0/3214870932 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7af00cfc40 0x7f7af00cac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.465+0000 7f7aeffff640 1 -- 172.21.15.18:0/3214870932 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7af006ce60 msgr2=0x7f7af0154d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.465+0000 7f7aeffff640 1 --2- 172.21.15.18:0/3214870932 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7af006ce60 0x7f7af0154d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.465+0000 7f7aeffff640 1 -- 172.21.15.18:0/3214870932 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7af0153bb0 con 0x7f7af0153260 2024-04-17T19:53:26.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.465+0000 7f7aef7fe640 1 --2- 172.21.15.18:0/3214870932 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7af006ce60 0x7f7af0154d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T19:53:26.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.465+0000 7f7aeffff640 1 --2- 172.21.15.18:0/3214870932 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7af0153260 0x7f7af0153670 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7ae800ec80 tx=0x7f7ae800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.465+0000 7f7ad7fff640 1 -- 172.21.15.18:0/3214870932 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae800cd20 con 0x7f7af0153260 2024-04-17T19:53:26.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.465+0000 7f7ad7fff640 1 -- 172.21.15.18:0/3214870932 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ae803a070 con 0x7f7af0153260 2024-04-17T19:53:26.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.465+0000 7f7ad7fff640 1 -- 172.21.15.18:0/3214870932 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae8003be0 con 0x7f7af0153260 2024-04-17T19:53:26.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.465+0000 7f0e6e7fc640 1 -- 172.21.15.18:0/830578178 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0e781307e0 con 0x7f0e700539f0 2024-04-17T19:53:26.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.465+0000 7f3d8724f640 1 -- 172.21.15.18:0/4173289894 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3d80076150 con 0x7f3d800ced50 2024-04-17T19:53:26.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.465+0000 7f465ccd1640 1 --2- 172.21.15.18:0/2191817949 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f465815bbf0 0x7f465815c000 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f46480097c0 tx=0x7f464801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e52c40a7e3e42420 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.469+0000 7f0e7fb18640 1 -- 172.21.15.18:0/830578178 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0e60001040 con 0x7f0e700539f0 2024-04-17T19:53:26.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.469+0000 7f6ed616b640 1 -- 172.21.15.18:0/3406571370 shutdown_connections 2024-04-17T19:53:26.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.469+0000 7f6ed616b640 1 --2- 172.21.15.18:0/3406571370 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ec80e0220 0x7f6ec80e3320 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.469+0000 7f6ed616b640 1 --2- 172.21.15.18:0/3406571370 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6ec804f890 0x7f6ec80dfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.469+0000 7f6ed616b640 1 --2- 172.21.15.18:0/3406571370 >> v2:172.21.15.173:3300/0 conn(0x7f6ec80d9d00 0x7f6ec804f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.469+0000 7f6ed616b640 1 -- 172.21.15.18:0/3406571370 >> 172.21.15.18:0/3406571370 conn(0x7f6ec8054d00 msgr2=0x7f6ec8055110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:26.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.469+0000 7faf027fc640 1 -- 172.21.15.18:0/670626683 <== osd.4 v2:172.21.15.173:6824/1421511819 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7faefc014ec0 con 0x7faef0071ba0 2024-04-17T19:53:26.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.469+0000 7f6ed616b640 1 -- 172.21.15.18:0/3406571370 shutdown_connections 2024-04-17T19:53:26.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.469+0000 7f4656ffd640 1 -- 172.21.15.18:0/2191817949 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46480b2070 con 0x7f465815bbf0 2024-04-17T19:53:26.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.469+0000 7f4656ffd640 1 -- 172.21.15.18:0/2191817949 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46480ad640 con 0x7f465815bbf0 2024-04-17T19:53:26.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.469+0000 7f4656ffd640 1 -- 172.21.15.18:0/2191817949 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46480b2070 con 0x7f465815bbf0 2024-04-17T19:53:26.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.469+0000 7f465d4d2640 1 -- 172.21.15.18:0/2191817949 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f465815bbf0 msgr2=0x7f465815c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.469+0000 7f465d4d2640 1 --2- 172.21.15.18:0/2191817949 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f465815bbf0 0x7f465815c000 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f46480097c0 tx=0x7f464801c4a0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.469+0000 7f7af4c1e640 1 -- 172.21.15.18:0/3214870932 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7af015e100 con 0x7f7af0153260 2024-04-17T19:53:26.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.469+0000 7f7af4c1e640 1 -- 172.21.15.18:0/3214870932 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7af015e6c0 con 0x7f7af0153260 2024-04-17T19:53:26.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.469+0000 7f3d76ffd640 1 -- 172.21.15.18:0/4173289894 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3d7c0be070 con 0x7f3d800ced50 2024-04-17T19:53:26.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.469+0000 7f3d76ffd640 1 --2- 172.21.15.18:0/4173289894 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f3d640683d0 0x7f3d6406a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.469+0000 7f3d76ffd640 1 -- 172.21.15.18:0/4173289894 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f3d7c1205b0 con 0x7f3d800ced50 2024-04-17T19:53:26.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.469+0000 7f3d76ffd640 1 --2- 172.21.15.18:0/4173289894 >> [v2:172.21.15.18:6824/2428878428,v1:172.21.15.18:6825/2428878428] conn(0x7f3d64071ba0 0x7f3d64074030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.469+0000 7f3d76ffd640 1 -- 172.21.15.18:0/4173289894 --> [v2:172.21.15.18:6824/2428878428,v1:172.21.15.18:6825/2428878428] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3d64074700 con 0x7f3d64071ba0 2024-04-17T19:53:26.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.469+0000 7f3d76ffd640 1 -- 172.21.15.18:0/4173289894 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3d7c120a90 con 0x7f3d800ced50 2024-04-17T19:53:26.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.469+0000 7f3d86a4e640 1 --2- 172.21.15.18:0/4173289894 >> [v2:172.21.15.18:6824/2428878428,v1:172.21.15.18:6825/2428878428] conn(0x7f3d64071ba0 0x7f3d64074030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.469+0000 7f0e6e7fc640 1 --2- 172.21.15.18:0/830578178 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0e5c068400 0x7f0e5c06a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.469+0000 7f0e6e7fc640 1 -- 172.21.15.18:0/830578178 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f0e7819c0e0 con 0x7f0e700539f0 2024-04-17T19:53:26.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.469+0000 7f0e6e7fc640 1 --2- 172.21.15.18:0/830578178 >> [v2:172.21.15.173:6808/761678552,v1:172.21.15.173:6809/761678552] conn(0x7f0e5c071bc0 0x7f0e5c074050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.469+0000 7f0e6e7fc640 1 -- 172.21.15.18:0/830578178 --> [v2:172.21.15.173:6808/761678552,v1:172.21.15.173:6809/761678552] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0e78125ec0 con 0x7f0e5c071bc0 2024-04-17T19:53:26.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.469+0000 7f0e6e7fc640 1 -- 172.21.15.18:0/830578178 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0e781a3050 con 0x7f0e700539f0 2024-04-17T19:53:26.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.469+0000 7f6ed616b640 1 -- 172.21.15.18:0/3406571370 wait complete. 2024-04-17T19:53:26.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.469+0000 7f881b006640 1 -- 172.21.15.18:0/2707780950 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8814157b80 con 0x7f88140d37c0 2024-04-17T19:53:26.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.469+0000 7f465d4d2640 1 -- 172.21.15.18:0/2191817949 shutdown_connections 2024-04-17T19:53:26.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.469+0000 7f465d4d2640 1 --2- 172.21.15.18:0/2191817949 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f465815bbf0 0x7f465815c000 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.469+0000 7f465d4d2640 1 --2- 172.21.15.18:0/2191817949 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f465806cd60 0x7f465806d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.469+0000 7f465d4d2640 1 -- 172.21.15.18:0/2191817949 >> 172.21.15.18:0/2191817949 conn(0x7f46580727a0 msgr2=0x7f4658072bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:26.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.469+0000 7f3d86a4e640 1 --2- 172.21.15.18:0/4173289894 >> [v2:172.21.15.18:6824/2428878428,v1:172.21.15.18:6825/2428878428] conn(0x7f3d64071ba0 0x7f3d64074030 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.469+0000 7f7ad7fff640 1 -- 172.21.15.18:0/3214870932 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7ae8004030 con 0x7f7af0153260 2024-04-17T19:53:26.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.469+0000 7f3d76ffd640 1 -- 172.21.15.18:0/4173289894 <== osd.3 v2:172.21.15.18:6824/2428878428 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3d64074700 con 0x7f3d64071ba0 2024-04-17T19:53:26.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.469+0000 7f88117fa640 1 -- 172.21.15.18:0/2707780950 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8800007470 con 0x7f88140d37c0 2024-04-17T19:53:26.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.469+0000 7f88117fa640 1 --2- 172.21.15.18:0/2707780950 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f87f80683b0 0x7f87f806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.473+0000 7f881b006640 1 -- 172.21.15.18:0/2707780950 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8814158140 con 0x7f88140d37c0 2024-04-17T19:53:26.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.469+0000 7f7ad7fff640 1 --2- 172.21.15.18:0/3214870932 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f7adc068480 0x7f7adc06a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.469+0000 7f7ad7fff640 1 -- 172.21.15.18:0/3214870932 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f7ae80a8ef0 con 0x7f7af0153260 2024-04-17T19:53:26.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.473+0000 7f7aef7fe640 1 --2- 172.21.15.18:0/3214870932 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f7adc068480 0x7f7adc06a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.473+0000 7f7aef7fe640 1 --2- 172.21.15.18:0/3214870932 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f7adc068480 0x7f7adc06a990 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7ae40ad000 tx=0x7f7ae40a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.473+0000 7f8818da2640 1 --2- 172.21.15.18:0/2707780950 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f87f80683b0 0x7f87f806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.473+0000 7f8818da2640 1 --2- 172.21.15.18:0/2707780950 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f87f80683b0 0x7f87f806a8c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8808006fd0 tx=0x7f8808016040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.473+0000 7f87feffd640 1 -- 172.21.15.18:0/2707780950 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f87ec001040 con 0x7f88140d37c0 2024-04-17T19:53:26.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.473+0000 7f88117fa640 1 -- 172.21.15.18:0/2707780950 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f8800053a80 con 0x7f88140d37c0 2024-04-17T19:53:26.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.473+0000 7f88117fa640 1 --2- 172.21.15.18:0/2707780950 >> [v2:172.21.15.173:6800/4221907702,v1:172.21.15.173:6801/4221907702] conn(0x7f87f8071a00 0x7f87f8073e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.473+0000 7f88117fa640 1 -- 172.21.15.18:0/2707780950 --> [v2:172.21.15.173:6800/4221907702,v1:172.21.15.173:6801/4221907702] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f87f8074560 con 0x7f87f8071a00 2024-04-17T19:53:26.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.473+0000 7f6ed616b640 1 Processor -- start 2024-04-17T19:53:26.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.473+0000 7f6ed616b640 1 -- start start 2024-04-17T19:53:26.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.473+0000 7f88117fa640 1 -- 172.21.15.18:0/2707780950 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8800051c80 con 0x7f88140d37c0 2024-04-17T19:53:26.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.473+0000 7f88195a3640 1 --2- 172.21.15.18:0/2707780950 >> [v2:172.21.15.173:6800/4221907702,v1:172.21.15.173:6801/4221907702] conn(0x7f87f8071a00 0x7f87f8073e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.473+0000 7f88195a3640 1 --2- 172.21.15.18:0/2707780950 >> [v2:172.21.15.173:6800/4221907702,v1:172.21.15.173:6801/4221907702] conn(0x7f87f8071a00 0x7f87f8073e90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.473+0000 7f6ed616b640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6ec804f890 0x7f6ec80d4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.473+0000 7f6ed616b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ec80d9d00 0x7f6ec80d51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.473+0000 7f6ed616b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ec80e0220 0x7f6ec80d56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.473+0000 7f6ed616b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6ec80e07b0 con 0x7f6ec80d9d00 2024-04-17T19:53:26.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.473+0000 7f6ed5169640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6ec804f890 0x7f6ec80d4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.473+0000 7f6ed5169640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6ec804f890 0x7f6ec80d4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.18:60488/0 (socket says 172.21.15.18:60488) 2024-04-17T19:53:26.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.473+0000 7f6ed5169640 1 -- 172.21.15.18:0/3263188577 learned_addr learned my addr 172.21.15.18:0/3263188577 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:26.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.473+0000 7f6ed596a640 1 --2- 172.21.15.18:0/3263188577 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ec80e0220 0x7f6ec80d56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.473+0000 7f6ed616b640 1 -- 172.21.15.18:0/3263188577 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6ec80e0630 con 0x7f6ec80e0220 2024-04-17T19:53:26.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.473+0000 7f6ed616b640 1 -- 172.21.15.18:0/3263188577 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f6ec80060a0 con 0x7f6ec804f890 2024-04-17T19:53:26.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.477+0000 7f3d8624d640 1 --2- 172.21.15.18:0/4173289894 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f3d640683d0 0x7f3d6406a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.477+0000 7f0e7d0b3640 1 --2- 172.21.15.18:0/830578178 >> [v2:172.21.15.173:6808/761678552,v1:172.21.15.173:6809/761678552] conn(0x7f0e5c071bc0 0x7f0e5c074050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.477+0000 7f0e7d8b4640 1 --2- 172.21.15.18:0/830578178 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0e5c068400 0x7f0e5c06a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.477+0000 7f6ed4968640 1 --2- 172.21.15.18:0/3263188577 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ec80d9d00 0x7f6ec80d51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.477+0000 7f465d4d2640 1 -- 172.21.15.18:0/2191817949 shutdown_connections 2024-04-17T19:53:26.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.477+0000 7f465d4d2640 1 -- 172.21.15.18:0/2191817949 wait complete. 2024-04-17T19:53:26.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.477+0000 7f465d4d2640 1 Processor -- start 2024-04-17T19:53:26.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.477+0000 7f7ad5ffb640 1 --2- 172.21.15.18:0/3214870932 >> [v2:172.21.15.18:6816/1283678238,v1:172.21.15.18:6817/1283678238] conn(0x7f7af015d460 0x7f7af015d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.477+0000 7f7ad5ffb640 1 -- 172.21.15.18:0/3214870932 --> [v2:172.21.15.18:6816/1283678238,v1:172.21.15.18:6817/1283678238] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7af015e890 con 0x7f7af015d460 2024-04-17T19:53:26.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.477+0000 7f7aeeffd640 1 --2- 172.21.15.18:0/3214870932 >> [v2:172.21.15.18:6816/1283678238,v1:172.21.15.18:6817/1283678238] conn(0x7f7af015d460 0x7f7af015d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.477+0000 7f3d8624d640 1 --2- 172.21.15.18:0/4173289894 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f3d640683d0 0x7f3d6406a8e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3d78009fd0 tx=0x7f3d7800b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.477+0000 7f88117fa640 1 -- 172.21.15.18:0/2707780950 <== osd.5 v2:172.21.15.173:6800/4221907702 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f87f8074560 con 0x7f87f8071a00 2024-04-17T19:53:26.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.477+0000 7f0e7d0b3640 1 --2- 172.21.15.18:0/830578178 >> [v2:172.21.15.173:6808/761678552,v1:172.21.15.173:6809/761678552] conn(0x7f0e5c071bc0 0x7f0e5c074050 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.477+0000 7f0e7d8b4640 1 --2- 172.21.15.18:0/830578178 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0e5c068400 0x7f0e5c06a910 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0e68007fd0 tx=0x7f0e680079a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.477+0000 7f6ed596a640 1 -- 172.21.15.18:0/3263188577 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6ec804f890 msgr2=0x7f6ec80d4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.477+0000 7f6ed596a640 1 --2- 172.21.15.18:0/3263188577 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6ec804f890 0x7f6ec80d4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.477+0000 7f6ed596a640 1 -- 172.21.15.18:0/3263188577 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ec80d9d00 msgr2=0x7f6ec80d51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.477+0000 7f6ed596a640 1 --2- 172.21.15.18:0/3263188577 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ec80d9d00 0x7f6ec80d51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.477+0000 7f6ed596a640 1 -- 172.21.15.18:0/3263188577 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ec80db8f0 con 0x7f6ec80e0220 2024-04-17T19:53:26.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.477+0000 7f6ed4968640 1 --2- 172.21.15.18:0/3263188577 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ec80d9d00 0x7f6ec80d51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:53:26.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.477+0000 7f6ed596a640 1 --2- 172.21.15.18:0/3263188577 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ec80e0220 0x7f6ec80d56f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6ec800bdd0 tx=0x7f6ecc019240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.477+0000 7f6ec5ffb640 1 -- 172.21.15.18:0/3263188577 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ecc0b0040 con 0x7f6ec80e0220 2024-04-17T19:53:26.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.477+0000 7f6ed616b640 1 -- 172.21.15.18:0/3263188577 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ec80dbbd0 con 0x7f6ec80e0220 2024-04-17T19:53:26.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.477+0000 7f6ed616b640 1 -- 172.21.15.18:0/3263188577 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ec80dd280 con 0x7f6ec80e0220 2024-04-17T19:53:26.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.477+0000 7f6ec5ffb640 1 -- 172.21.15.18:0/3263188577 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ecc0bb070 con 0x7f6ec80e0220 2024-04-17T19:53:26.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.477+0000 7f6ec5ffb640 1 -- 172.21.15.18:0/3263188577 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ecc009400 con 0x7f6ec80e0220 2024-04-17T19:53:26.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.477+0000 7f6ed616b640 1 -- 172.21.15.18:0/3263188577 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6ec8005580 con 0x7f6ec80e0220 2024-04-17T19:53:26.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.481+0000 7f7aeeffd640 1 --2- 172.21.15.18:0/3214870932 >> [v2:172.21.15.18:6816/1283678238,v1:172.21.15.18:6817/1283678238] conn(0x7f7af015d460 0x7f7af015d870 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.481+0000 7f465d4d2640 1 -- start start 2024-04-17T19:53:26.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.481+0000 7f6ec5ffb640 1 -- 172.21.15.18:0/3263188577 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6ecc0b3070 con 0x7f6ec80e0220 2024-04-17T19:53:26.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.481+0000 7f6ec5ffb640 1 --2- 172.21.15.18:0/3263188577 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f6eb4068550 0x7f6eb406aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.481+0000 7f6ec5ffb640 1 -- 172.21.15.18:0/3263188577 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f6ecc120f20 con 0x7f6ec80e0220 2024-04-17T19:53:26.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.481+0000 7f7ad7fff640 1 -- 172.21.15.18:0/3214870932 <== osd.1 v2:172.21.15.18:6816/1283678238 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7af015e890 con 0x7f7af015d460 2024-04-17T19:53:26.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.481+0000 7f6ed5169640 1 --2- 172.21.15.18:0/3263188577 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f6eb4068550 0x7f6eb406aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.481+0000 7f6ec5ffb640 1 --2- 172.21.15.18:0/3263188577 >> [v2:172.21.15.173:6816/383724537,v1:172.21.15.173:6817/383724537] conn(0x7f6eb4071c20 0x7f6eb40740b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.481+0000 7f6ec5ffb640 1 -- 172.21.15.18:0/3263188577 --> [v2:172.21.15.173:6816/383724537,v1:172.21.15.173:6817/383724537] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6ecc007e50 con 0x7f6eb4071c20 2024-04-17T19:53:26.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.481+0000 7f6ec5ffb640 1 -- 172.21.15.18:0/3263188577 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6ecc1213b0 con 0x7f6ec80e0220 2024-04-17T19:53:26.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.481+0000 7f6ed5169640 1 --2- 172.21.15.18:0/3263188577 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f6eb4068550 0x7f6eb406aa60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6ed002dcc0 tx=0x7f6ed0074040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.481+0000 7f465d4d2640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f465806cd60 0x7f4658137710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.481+0000 7f465d4d2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46580b58e0 0x7f465813e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.481+0000 7f4657fff640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f465806cd60 0x7f4658137710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.481+0000 7f4657fff640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f465806cd60 0x7f4658137710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.18:60496/0 (socket says 172.21.15.18:60496) 2024-04-17T19:53:26.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.481+0000 7f46577fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46580b58e0 0x7f465813e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.481+0000 7f46577fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46580b58e0 0x7f465813e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49836/0 (socket says 172.21.15.18:49836) 2024-04-17T19:53:26.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.481+0000 7f4657fff640 1 -- 172.21.15.18:0/1145902288 learned_addr learned my addr 172.21.15.18:0/1145902288 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:26.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.481+0000 7f465d4d2640 1 --2- 172.21.15.18:0/1145902288 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f465815bbf0 0x7f465815c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.485+0000 7f6ed4968640 1 --2- 172.21.15.18:0/3263188577 >> [v2:172.21.15.173:6816/383724537,v1:172.21.15.173:6817/383724537] conn(0x7f6eb4071c20 0x7f6eb40740b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.485+0000 7f465d4d2640 1 -- 172.21.15.18:0/1145902288 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4658070da0 con 0x7f46580b58e0 2024-04-17T19:53:26.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.485+0000 7f465d4d2640 1 -- 172.21.15.18:0/1145902288 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f46580b5cf0 con 0x7f465815bbf0 2024-04-17T19:53:26.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.485+0000 7f465ccd1640 1 --2- 172.21.15.18:0/1145902288 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f465815bbf0 0x7f465815c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.485+0000 7f465d4d2640 1 -- 172.21.15.18:0/1145902288 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f465813c830 con 0x7f465806cd60 2024-04-17T19:53:26.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.485+0000 7f6ed4968640 1 --2- 172.21.15.18:0/3263188577 >> [v2:172.21.15.173:6816/383724537,v1:172.21.15.173:6817/383724537] conn(0x7f6eb4071c20 0x7f6eb40740b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.485+0000 7f4657fff640 1 -- 172.21.15.18:0/1145902288 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f465815bbf0 msgr2=0x7f465815c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.485+0000 7f4657fff640 1 --2- 172.21.15.18:0/1145902288 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f465815bbf0 0x7f465815c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.485+0000 7f4657fff640 1 -- 172.21.15.18:0/1145902288 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46580b58e0 msgr2=0x7f465813e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.485+0000 7f4657fff640 1 --2- 172.21.15.18:0/1145902288 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46580b58e0 0x7f465813e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.485+0000 7f4657fff640 1 -- 172.21.15.18:0/1145902288 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4658137c80 con 0x7f465806cd60 2024-04-17T19:53:26.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.485+0000 7f465ccd1640 1 --2- 172.21.15.18:0/1145902288 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f465815bbf0 0x7f465815c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:53:26.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.485+0000 7f4657fff640 1 --2- 172.21.15.18:0/1145902288 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f465806cd60 0x7f4658137710 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f465000c7d0 tx=0x7f465000cc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.485+0000 7f4654ff9640 1 -- 172.21.15.18:0/1145902288 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4650003b80 con 0x7f465806cd60 2024-04-17T19:53:26.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.485+0000 7f4654ff9640 1 -- 172.21.15.18:0/1145902288 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4650003d20 con 0x7f465806cd60 2024-04-17T19:53:26.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.485+0000 7f4654ff9640 1 -- 172.21.15.18:0/1145902288 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465000a9f0 con 0x7f465806cd60 2024-04-17T19:53:26.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.485+0000 7f465d4d2640 1 -- 172.21.15.18:0/1145902288 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4658137f60 con 0x7f465806cd60 2024-04-17T19:53:26.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.485+0000 7f465d4d2640 1 -- 172.21.15.18:0/1145902288 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4658138520 con 0x7f465806cd60 2024-04-17T19:53:26.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.485+0000 7f465d4d2640 1 -- 172.21.15.18:0/1145902288 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4658076150 con 0x7f465806cd60 2024-04-17T19:53:26.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.485+0000 7f6ec5ffb640 1 -- 172.21.15.18:0/3263188577 <== osd.7 v2:172.21.15.173:6816/383724537 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6ecc007e50 con 0x7f6eb4071c20 2024-04-17T19:53:26.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.485+0000 7f0e6e7fc640 1 -- 172.21.15.18:0/830578178 <== osd.6 v2:172.21.15.173:6808/761678552 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0e78125ec0 con 0x7f0e5c071bc0 2024-04-17T19:53:26.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.489+0000 7f4654ff9640 1 -- 172.21.15.18:0/1145902288 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f465000ab90 con 0x7f465806cd60 2024-04-17T19:53:26.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.489+0000 7f4654ff9640 1 --2- 172.21.15.18:0/1145902288 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f464406a5c0 0x7f464406cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.489+0000 7f4654ff9640 1 -- 172.21.15.18:0/1145902288 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f46500876b0 con 0x7f465806cd60 2024-04-17T19:53:26.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.489+0000 7f4654ff9640 1 --2- 172.21.15.18:0/1145902288 >> [v2:172.21.15.18:6800/2323038417,v1:172.21.15.18:6801/2323038417] conn(0x7f4644073d00 0x7f4644076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.489+0000 7f4654ff9640 1 -- 172.21.15.18:0/1145902288 --> [v2:172.21.15.18:6800/2323038417,v1:172.21.15.18:6801/2323038417] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4650015ec0 con 0x7f4644073d00 2024-04-17T19:53:26.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.489+0000 7f4654ff9640 1 -- 172.21.15.18:0/1145902288 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4650087aa0 con 0x7f465806cd60 2024-04-17T19:53:26.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.489+0000 7f465ccd1640 1 --2- 172.21.15.18:0/1145902288 >> [v2:172.21.15.18:6800/2323038417,v1:172.21.15.18:6801/2323038417] conn(0x7f4644073d00 0x7f4644076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.489+0000 7f465ccd1640 1 --2- 172.21.15.18:0/1145902288 >> [v2:172.21.15.18:6800/2323038417,v1:172.21.15.18:6801/2323038417] conn(0x7f4644073d00 0x7f4644076190 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.489+0000 7f46577fe640 1 --2- 172.21.15.18:0/1145902288 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f464406a5c0 0x7f464406cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.489+0000 7f4654ff9640 1 -- 172.21.15.18:0/1145902288 <== osd.0 v2:172.21.15.18:6800/2323038417 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4650015ec0 con 0x7f4644073d00 2024-04-17T19:53:26.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.489+0000 7f46577fe640 1 --2- 172.21.15.18:0/1145902288 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f464406a5c0 0x7f464406cad0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f46581f7af0 tx=0x7f464c00c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.493+0000 7f37e4f33640 1 -- 172.21.15.18:0/1139493767 --> [v2:172.21.15.18:6808/1212875862,v1:172.21.15.18:6809/1212875862] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f37d80ee080 con 0x7f37d80d2f20 2024-04-17T19:53:26.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.497+0000 7f37ceffd640 1 -- 172.21.15.18:0/1139493767 <== osd.2 v2:172.21.15.18:6808/1212875862 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f37d80ee080 con 0x7f37d80d2f20 2024-04-17T19:53:26.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.497+0000 7f37e4f33640 1 -- 172.21.15.18:0/1139493767 >> [v2:172.21.15.18:6808/1212875862,v1:172.21.15.18:6809/1212875862] conn(0x7f37d80d2f20 msgr2=0x7f37d8002910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.497+0000 7f37e4f33640 1 --2- 172.21.15.18:0/1139493767 >> [v2:172.21.15.18:6808/1212875862,v1:172.21.15.18:6809/1212875862] conn(0x7f37d80d2f20 0x7f37d8002910 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.497+0000 7f37e4f33640 1 -- 172.21.15.18:0/1139493767 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f37c00683b0 msgr2=0x7f37c006a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.497+0000 7f37e4f33640 1 --2- 172.21.15.18:0/1139493767 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f37c00683b0 0x7f37c006a8c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f37d4001060 tx=0x7f37d4007980 comp rx=0 tx=0).stop 2024-04-17T19:53:26.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.497+0000 7f37e4f33640 1 -- 172.21.15.18:0/1139493767 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37d80d2b10 msgr2=0x7f37d80d55f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.497+0000 7f37e4f33640 1 --2- 172.21.15.18:0/1139493767 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37d80d2b10 0x7f37d80d55f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f37e006aa50 tx=0x7f37e0069370 comp rx=0 tx=0).stop 2024-04-17T19:53:26.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.497+0000 7f37ded9d640 1 -- 172.21.15.18:0/1139493767 reap_dead start 2024-04-17T19:53:26.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.497+0000 7f37e4f33640 1 -- 172.21.15.18:0/1139493767 shutdown_connections 2024-04-17T19:53:26.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.497+0000 7f37e4f33640 1 -- 172.21.15.18:0/1139493767 >> 172.21.15.18:0/1139493767 conn(0x7f37d8055e20 msgr2=0x7f37d8050c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:26.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.497+0000 7f37e4f33640 1 -- 172.21.15.18:0/1139493767 shutdown_connections 2024-04-17T19:53:26.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.501+0000 7f37e4f33640 1 -- 172.21.15.18:0/1139493767 wait complete. 2024-04-17T19:53:26.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.497+0000 7f3d8724f640 1 -- 172.21.15.18:0/4173289894 --> [v2:172.21.15.18:6824/2428878428,v1:172.21.15.18:6825/2428878428] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3d800d0000 con 0x7f3d64071ba0 2024-04-17T19:53:26.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.497+0000 7f3d76ffd640 1 -- 172.21.15.18:0/4173289894 <== osd.3 v2:172.21.15.18:6824/2428878428 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3d800d0000 con 0x7f3d64071ba0 2024-04-17T19:53:26.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.501+0000 7f3d8724f640 1 -- 172.21.15.18:0/4173289894 >> [v2:172.21.15.18:6824/2428878428,v1:172.21.15.18:6825/2428878428] conn(0x7f3d64071ba0 msgr2=0x7f3d64074030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.501+0000 7f3d8724f640 1 --2- 172.21.15.18:0/4173289894 >> [v2:172.21.15.18:6824/2428878428,v1:172.21.15.18:6825/2428878428] conn(0x7f3d64071ba0 0x7f3d64074030 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.501+0000 7f3d8724f640 1 -- 172.21.15.18:0/4173289894 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f3d640683d0 msgr2=0x7f3d6406a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.501+0000 7f3d8724f640 1 --2- 172.21.15.18:0/4173289894 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f3d640683d0 0x7f3d6406a8e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3d78009fd0 tx=0x7f3d7800b040 comp rx=0 tx=0).stop 2024-04-17T19:53:26.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.501+0000 7f3d8724f640 1 -- 172.21.15.18:0/4173289894 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3d800ced50 msgr2=0x7f3d801612b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.501+0000 7f3d8724f640 1 --2- 172.21.15.18:0/4173289894 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3d800ced50 0x7f3d801612b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c01a9c0 tx=0x7f3d7c0190b0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.501+0000 7f3d86a4e640 1 -- 172.21.15.18:0/4173289894 reap_dead start 2024-04-17T19:53:26.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.501+0000 7f3d8724f640 1 -- 172.21.15.18:0/4173289894 shutdown_connections 2024-04-17T19:53:26.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.501+0000 7f3d8724f640 1 -- 172.21.15.18:0/4173289894 >> 172.21.15.18:0/4173289894 conn(0x7f3d800725d0 msgr2=0x7f3d8015c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:26.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.501+0000 7f3d8724f640 1 -- 172.21.15.18:0/4173289894 shutdown_connections 2024-04-17T19:53:26.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.501+0000 7f3d8724f640 1 -- 172.21.15.18:0/4173289894 wait complete. 2024-04-17T19:53:26.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.497+0000 7faf12aa3640 1 -- 172.21.15.18:0/670626683 --> [v2:172.21.15.173:6824/1421511819,v1:172.21.15.173:6825/1421511819] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7faef4002de0 con 0x7faef0071ba0 2024-04-17T19:53:26.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.497+0000 7faf027fc640 1 -- 172.21.15.18:0/670626683 <== osd.4 v2:172.21.15.173:6824/1421511819 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7faef4002de0 con 0x7faef0071ba0 2024-04-17T19:53:26.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.505+0000 7f87feffd640 1 -- 172.21.15.18:0/2707780950 --> [v2:172.21.15.173:6800/4221907702,v1:172.21.15.173:6801/4221907702] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f87ec002de0 con 0x7f87f8071a00 2024-04-17T19:53:26.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.505+0000 7f88117fa640 1 -- 172.21.15.18:0/2707780950 <== osd.5 v2:172.21.15.173:6800/4221907702 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f87ec002de0 con 0x7f87f8071a00 2024-04-17T19:53:26.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.505+0000 7f87feffd640 1 -- 172.21.15.18:0/2707780950 >> [v2:172.21.15.173:6800/4221907702,v1:172.21.15.173:6801/4221907702] conn(0x7f87f8071a00 msgr2=0x7f87f8073e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.505+0000 7f87feffd640 1 --2- 172.21.15.18:0/2707780950 >> [v2:172.21.15.173:6800/4221907702,v1:172.21.15.173:6801/4221907702] conn(0x7f87f8071a00 0x7f87f8073e90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.505+0000 7f87feffd640 1 -- 172.21.15.18:0/2707780950 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f87f80683b0 msgr2=0x7f87f806a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.505+0000 7f87feffd640 1 --2- 172.21.15.18:0/2707780950 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f87f80683b0 0x7f87f806a8c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8808006fd0 tx=0x7f8808016040 comp rx=0 tx=0).stop 2024-04-17T19:53:26.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.505+0000 7f87feffd640 1 -- 172.21.15.18:0/2707780950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88140d37c0 msgr2=0x7f8814152ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.505+0000 7f87feffd640 1 --2- 172.21.15.18:0/2707780950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88140d37c0 0x7f8814152ea0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f880000c400 tx=0x7f880000c8c0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.505+0000 7f88195a3640 1 -- 172.21.15.18:0/2707780950 reap_dead start 2024-04-17T19:53:26.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.505+0000 7f87feffd640 1 -- 172.21.15.18:0/2707780950 shutdown_connections 2024-04-17T19:53:26.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.505+0000 7f87feffd640 1 -- 172.21.15.18:0/2707780950 >> 172.21.15.18:0/2707780950 conn(0x7f88140b6cd0 msgr2=0x7f8814156800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:26.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.505+0000 7f87feffd640 1 -- 172.21.15.18:0/2707780950 shutdown_connections 2024-04-17T19:53:26.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.505+0000 7f87feffd640 1 -- 172.21.15.18:0/2707780950 wait complete. 2024-04-17T19:53:26.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.509+0000 7f7ad5ffb640 1 -- 172.21.15.18:0/3214870932 --> [v2:172.21.15.18:6816/1283678238,v1:172.21.15.18:6817/1283678238] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7af0076150 con 0x7f7af015d460 2024-04-17T19:53:26.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.509+0000 7f7ad7fff640 1 -- 172.21.15.18:0/3214870932 <== osd.1 v2:172.21.15.18:6816/1283678238 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7af0076150 con 0x7f7af015d460 2024-04-17T19:53:26.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.509+0000 7f7ad5ffb640 1 -- 172.21.15.18:0/3214870932 >> [v2:172.21.15.18:6816/1283678238,v1:172.21.15.18:6817/1283678238] conn(0x7f7af015d460 msgr2=0x7f7af015d870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.509+0000 7f7ad5ffb640 1 --2- 172.21.15.18:0/3214870932 >> [v2:172.21.15.18:6816/1283678238,v1:172.21.15.18:6817/1283678238] conn(0x7f7af015d460 0x7f7af015d870 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.509+0000 7f7ad5ffb640 1 -- 172.21.15.18:0/3214870932 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f7adc068480 msgr2=0x7f7adc06a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.509+0000 7f7ad5ffb640 1 --2- 172.21.15.18:0/3214870932 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f7adc068480 0x7f7adc06a990 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7ae40ad000 tx=0x7f7ae40a6000 comp rx=0 tx=0).stop 2024-04-17T19:53:26.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.509+0000 7f7ad5ffb640 1 -- 172.21.15.18:0/3214870932 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7af0153260 msgr2=0x7f7af0153670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.509+0000 7f7ad5ffb640 1 --2- 172.21.15.18:0/3214870932 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7af0153260 0x7f7af0153670 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7ae800ec80 tx=0x7f7ae800c490 comp rx=0 tx=0).stop 2024-04-17T19:53:26.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.509+0000 7f7aeffff640 1 -- 172.21.15.18:0/3214870932 reap_dead start 2024-04-17T19:53:26.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.509+0000 7f7ad5ffb640 1 -- 172.21.15.18:0/3214870932 shutdown_connections 2024-04-17T19:53:26.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.509+0000 7f7ad5ffb640 1 -- 172.21.15.18:0/3214870932 >> 172.21.15.18:0/3214870932 conn(0x7f7af00d4cf0 msgr2=0x7f7af0158610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:26.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.509+0000 7f7ad5ffb640 1 -- 172.21.15.18:0/3214870932 shutdown_connections 2024-04-17T19:53:26.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.509+0000 7f7ad5ffb640 1 -- 172.21.15.18:0/3214870932 wait complete. 2024-04-17T19:53:26.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.513+0000 7faf12aa3640 1 -- 172.21.15.18:0/670626683 >> [v2:172.21.15.173:6824/1421511819,v1:172.21.15.173:6825/1421511819] conn(0x7faef0071ba0 msgr2=0x7faef0074030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.513+0000 7faf12aa3640 1 --2- 172.21.15.18:0/670626683 >> [v2:172.21.15.173:6824/1421511819,v1:172.21.15.173:6825/1421511819] conn(0x7faef0071ba0 0x7faef0074030 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.513+0000 7faf12aa3640 1 -- 172.21.15.18:0/670626683 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7faef00683d0 msgr2=0x7faef006a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.513+0000 7faf12aa3640 1 --2- 172.21.15.18:0/670626683 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7faef00683d0 0x7faef006a8e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7faf04000f90 tx=0x7faf040a7070 comp rx=0 tx=0).stop 2024-04-17T19:53:26.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.513+0000 7faf12aa3640 1 -- 172.21.15.18:0/670626683 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faf0c0b6160 msgr2=0x7faf0c215c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.513+0000 7faf12aa3640 1 --2- 172.21.15.18:0/670626683 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faf0c0b6160 0x7faf0c215c90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7faefc000f70 tx=0x7faefc00c820 comp rx=0 tx=0).stop 2024-04-17T19:53:26.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.513+0000 7faf122a2640 1 -- 172.21.15.18:0/670626683 reap_dead start 2024-04-17T19:53:26.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.513+0000 7faf12aa3640 1 -- 172.21.15.18:0/670626683 shutdown_connections 2024-04-17T19:53:26.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.513+0000 7faf12aa3640 1 -- 172.21.15.18:0/670626683 >> 172.21.15.18:0/670626683 conn(0x7faf0c0727a0 msgr2=0x7faf0c16ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:26.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.513+0000 7faf12aa3640 1 -- 172.21.15.18:0/670626683 shutdown_connections 2024-04-17T19:53:26.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.513+0000 7faf12aa3640 1 -- 172.21.15.18:0/670626683 wait complete. 2024-04-17T19:53:26.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.517+0000 7f0e7fb18640 1 -- 172.21.15.18:0/830578178 --> [v2:172.21.15.173:6808/761678552,v1:172.21.15.173:6809/761678552] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0e60002de0 con 0x7f0e5c071bc0 2024-04-17T19:53:26.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.517+0000 7f0e6e7fc640 1 -- 172.21.15.18:0/830578178 <== osd.6 v2:172.21.15.173:6808/761678552 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0e60002de0 con 0x7f0e5c071bc0 2024-04-17T19:53:26.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.521+0000 7f465d4d2640 1 -- 172.21.15.18:0/1145902288 --> [v2:172.21.15.18:6800/2323038417,v1:172.21.15.18:6801/2323038417] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f46581389a0 con 0x7f4644073d00 2024-04-17T19:53:26.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.517+0000 7f6ed616b640 1 -- 172.21.15.18:0/3263188577 --> [v2:172.21.15.173:6816/383724537,v1:172.21.15.173:6817/383724537] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6ec8053670 con 0x7f6eb4071c20 2024-04-17T19:53:26.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.521+0000 7f6ec5ffb640 1 -- 172.21.15.18:0/3263188577 <== osd.7 v2:172.21.15.173:6816/383724537 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6ec8053670 con 0x7f6eb4071c20 2024-04-17T19:53:26.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.521+0000 7f6ed616b640 1 -- 172.21.15.18:0/3263188577 >> [v2:172.21.15.173:6816/383724537,v1:172.21.15.173:6817/383724537] conn(0x7f6eb4071c20 msgr2=0x7f6eb40740b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.521+0000 7f6ed616b640 1 --2- 172.21.15.18:0/3263188577 >> [v2:172.21.15.173:6816/383724537,v1:172.21.15.173:6817/383724537] conn(0x7f6eb4071c20 0x7f6eb40740b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.521+0000 7f6ed616b640 1 -- 172.21.15.18:0/3263188577 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f6eb4068550 msgr2=0x7f6eb406aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.521+0000 7f6ed616b640 1 --2- 172.21.15.18:0/3263188577 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f6eb4068550 0x7f6eb406aa60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6ed002dcc0 tx=0x7f6ed0074040 comp rx=0 tx=0).stop 2024-04-17T19:53:26.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.521+0000 7f6ed616b640 1 -- 172.21.15.18:0/3263188577 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ec80e0220 msgr2=0x7f6ec80d56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.521+0000 7f6ed616b640 1 --2- 172.21.15.18:0/3263188577 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ec80e0220 0x7f6ec80d56f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6ec800bdd0 tx=0x7f6ecc019240 comp rx=0 tx=0).stop 2024-04-17T19:53:26.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.521+0000 7f6ed596a640 1 -- 172.21.15.18:0/3263188577 reap_dead start 2024-04-17T19:53:26.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.521+0000 7f6ed616b640 1 -- 172.21.15.18:0/3263188577 shutdown_connections 2024-04-17T19:53:26.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.521+0000 7f6ed616b640 1 -- 172.21.15.18:0/3263188577 >> 172.21.15.18:0/3263188577 conn(0x7f6ec8054d00 msgr2=0x7f6ec80e1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:26.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.521+0000 7f6ed616b640 1 -- 172.21.15.18:0/3263188577 shutdown_connections 2024-04-17T19:53:26.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.521+0000 7f6ed616b640 1 -- 172.21.15.18:0/3263188577 wait complete. 2024-04-17T19:53:26.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.521+0000 7f4654ff9640 1 -- 172.21.15.18:0/1145902288 <== osd.0 v2:172.21.15.18:6800/2323038417 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f46581389a0 con 0x7f4644073d00 2024-04-17T19:53:26.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.521+0000 7f465d4d2640 1 -- 172.21.15.18:0/1145902288 >> [v2:172.21.15.18:6800/2323038417,v1:172.21.15.18:6801/2323038417] conn(0x7f4644073d00 msgr2=0x7f4644076190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.521+0000 7f465d4d2640 1 --2- 172.21.15.18:0/1145902288 >> [v2:172.21.15.18:6800/2323038417,v1:172.21.15.18:6801/2323038417] conn(0x7f4644073d00 0x7f4644076190 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.521+0000 7f465d4d2640 1 -- 172.21.15.18:0/1145902288 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f464406a5c0 msgr2=0x7f464406cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.521+0000 7f465d4d2640 1 --2- 172.21.15.18:0/1145902288 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f464406a5c0 0x7f464406cad0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f46581f7af0 tx=0x7f464c00c040 comp rx=0 tx=0).stop 2024-04-17T19:53:26.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.521+0000 7f465d4d2640 1 -- 172.21.15.18:0/1145902288 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f465806cd60 msgr2=0x7f4658137710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.521+0000 7f465d4d2640 1 --2- 172.21.15.18:0/1145902288 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f465806cd60 0x7f4658137710 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f465000c7d0 tx=0x7f465000cc90 comp rx=0 tx=0).stop 2024-04-17T19:53:26.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.521+0000 7f465ccd1640 1 -- 172.21.15.18:0/1145902288 reap_dead start 2024-04-17T19:53:26.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.521+0000 7f465d4d2640 1 -- 172.21.15.18:0/1145902288 shutdown_connections 2024-04-17T19:53:26.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.521+0000 7f465d4d2640 1 -- 172.21.15.18:0/1145902288 >> 172.21.15.18:0/1145902288 conn(0x7f46580727a0 msgr2=0x7f4658070630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:26.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.525+0000 7f0e7fb18640 1 -- 172.21.15.18:0/830578178 >> [v2:172.21.15.173:6808/761678552,v1:172.21.15.173:6809/761678552] conn(0x7f0e5c071bc0 msgr2=0x7f0e5c074050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.525+0000 7f0e7fb18640 1 --2- 172.21.15.18:0/830578178 >> [v2:172.21.15.173:6808/761678552,v1:172.21.15.173:6809/761678552] conn(0x7f0e5c071bc0 0x7f0e5c074050 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.525+0000 7f0e7fb18640 1 -- 172.21.15.18:0/830578178 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0e5c068400 msgr2=0x7f0e5c06a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.525+0000 7f0e7fb18640 1 --2- 172.21.15.18:0/830578178 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0e5c068400 0x7f0e5c06a910 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0e68007fd0 tx=0x7f0e680079a0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.525+0000 7f0e7fb18640 1 -- 172.21.15.18:0/830578178 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e700539f0 msgr2=0x7f0e70035f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.525+0000 7f0e7fb18640 1 --2- 172.21.15.18:0/830578178 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e700539f0 0x7f0e70035f00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0e7806b370 tx=0x7f0e78095540 comp rx=0 tx=0).stop 2024-04-17T19:53:26.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.529+0000 7f0e7e0b5640 1 -- 172.21.15.18:0/830578178 reap_dead start 2024-04-17T19:53:26.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.529+0000 7f465d4d2640 1 -- 172.21.15.18:0/1145902288 shutdown_connections 2024-04-17T19:53:26.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.529+0000 7f465d4d2640 1 -- 172.21.15.18:0/1145902288 wait complete. 2024-04-17T19:53:26.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.529+0000 7f0e7fb18640 1 -- 172.21.15.18:0/830578178 shutdown_connections 2024-04-17T19:53:26.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.529+0000 7f0e7fb18640 1 -- 172.21.15.18:0/830578178 >> 172.21.15.18:0/830578178 conn(0x7f0e70055e20 msgr2=0x7f0e70054550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:26.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.529+0000 7f0e7fb18640 1 -- 172.21.15.18:0/830578178 shutdown_connections 2024-04-17T19:53:26.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.529+0000 7f0e7fb18640 1 -- 172.21.15.18:0/830578178 wait complete. 2024-04-17T19:53:26.558 INFO:teuthology.orchestra.run.smithi018.stdout:64424509449 2024-04-17T19:53:26.558 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-17T19:53:26.559 INFO:teuthology.orchestra.run.smithi018.stdout:64424509449 2024-04-17T19:53:26.559 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-17T19:53:26.560 INFO:teuthology.orchestra.run.smithi018.stdout:64424509448 2024-04-17T19:53:26.560 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-17T19:53:26.561 INFO:teuthology.orchestra.run.smithi018.stdout:64424509449 2024-04-17T19:53:26.561 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-17T19:53:26.562 INFO:teuthology.orchestra.run.smithi018.stdout:64424509449 2024-04-17T19:53:26.562 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-17T19:53:26.563 INFO:teuthology.orchestra.run.smithi018.stdout:64424509450 2024-04-17T19:53:26.563 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-17T19:53:26.564 INFO:teuthology.orchestra.run.smithi018.stdout:60129542154 2024-04-17T19:53:26.564 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-17T19:53:26.565 INFO:teuthology.orchestra.run.smithi018.stdout:64424509449 2024-04-17T19:53:26.565 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-17T19:53:26.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.813+0000 7f59078d4640 1 Processor -- start 2024-04-17T19:53:26.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.813+0000 7f59078d4640 1 -- start start 2024-04-17T19:53:26.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.813+0000 7f59078d4640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f590015eda0 0x7f590015f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.813+0000 7f59078d4640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5900151a20 0x7f5900151e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.813+0000 7f59078d4640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f590015f6f0 con 0x7f59000cf420 2024-04-17T19:53:26.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.813+0000 7f59078d4640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f59000cf830 con 0x7f5900151a20 2024-04-17T19:53:26.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.813+0000 7f59078d4640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f59000cfa50 con 0x7f590015eda0 2024-04-17T19:53:26.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.813+0000 7f5905e71640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5900151a20 0x7f5900151e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.813+0000 7f5905e71640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5900151a20 0x7f5900151e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49840/0 (socket says 172.21.15.18:49840) 2024-04-17T19:53:26.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.813+0000 7f5905e71640 1 -- 172.21.15.18:0/533237521 learned_addr learned my addr 172.21.15.18:0/533237521 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:26.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.813+0000 7f5904e6f640 1 --2- 172.21.15.18:0/533237521 >> v2:172.21.15.173:3300/0 conn(0x7f590015eda0 0x7f590015f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.813+0000 7f5905e71640 1 -- 172.21.15.18:0/533237521 >> v2:172.21.15.173:3300/0 conn(0x7f590015eda0 msgr2=0x7f590015f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:26.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.813+0000 7f5905e71640 1 --2- 172.21.15.18:0/533237521 >> v2:172.21.15.173:3300/0 conn(0x7f590015eda0 0x7f590015f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.817+0000 7f5905e71640 1 -- 172.21.15.18:0/533237521 >> v1:172.21.15.18:6789/0 conn(0x7f59000cf420 legacy=0x7f59000afe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.817+0000 7f5905e71640 1 -- 172.21.15.18:0/533237521 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59000cfd30 con 0x7f5900151a20 2024-04-17T19:53:26.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.817+0000 7f5905e71640 1 --2- 172.21.15.18:0/533237521 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5900151a20 0x7f5900151e30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f590006ea10 tx=0x7f58f001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fac4367ee49e9112 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.817+0000 7f58f7fff640 1 -- 172.21.15.18:0/533237521 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f00b0070 con 0x7f5900151a20 2024-04-17T19:53:26.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.817+0000 7f58f7fff640 1 -- 172.21.15.18:0/533237521 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58f00ab600 con 0x7f5900151a20 2024-04-17T19:53:26.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.821+0000 7f58f7fff640 1 -- 172.21.15.18:0/533237521 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f00ab9d0 con 0x7f5900151a20 2024-04-17T19:53:26.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.821+0000 7f59078d4640 1 -- 172.21.15.18:0/533237521 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5900151a20 msgr2=0x7f5900151e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.821+0000 7f59078d4640 1 --2- 172.21.15.18:0/533237521 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5900151a20 0x7f5900151e30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f590006ea10 tx=0x7f58f001c520 comp rx=0 tx=0).stop 2024-04-17T19:53:26.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.821+0000 7fb913635640 1 Processor -- start 2024-04-17T19:53:26.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.821+0000 7f59078d4640 1 -- 172.21.15.18:0/533237521 shutdown_connections 2024-04-17T19:53:26.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.821+0000 7f59078d4640 1 --2- 172.21.15.18:0/533237521 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5900151a20 0x7f5900151e30 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.821+0000 7f59078d4640 1 --2- 172.21.15.18:0/533237521 >> v2:172.21.15.173:3300/0 conn(0x7f590015eda0 0x7f590015f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.821+0000 7f59078d4640 1 -- 172.21.15.18:0/533237521 >> 172.21.15.18:0/533237521 conn(0x7f5900072d70 msgr2=0x7f59000731b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:26.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.821+0000 7fb913635640 1 -- start start 2024-04-17T19:53:26.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.821+0000 7f59078d4640 1 -- 172.21.15.18:0/533237521 shutdown_connections 2024-04-17T19:53:26.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.821+0000 7f59078d4640 1 -- 172.21.15.18:0/533237521 wait complete. 2024-04-17T19:53:26.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.821+0000 7f08521d4640 1 Processor -- start 2024-04-17T19:53:26.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.821+0000 7fb913635640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb9040584b0 0x7fb90403d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.825+0000 7fb911bd2640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fb9040073c0 0x7fb90403d960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:51184/0 (socket says 172.21.15.18:51184) 2024-04-17T19:53:26.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.825+0000 7fb910bd0640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb9040584b0 0x7fb90403d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.825+0000 7fb911bd2640 1 -- 172.21.15.18:0/1539763631 learned_addr learned my addr 172.21.15.18:0/1539763631 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:26.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.825+0000 7fb913635640 1 -- 172.21.15.18:0/1539763631 --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb904007910 con 0x7fb9040073c0 2024-04-17T19:53:26.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.825+0000 7f59078d4640 1 Processor -- start 2024-04-17T19:53:26.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.821+0000 7f08521d4640 1 -- start start 2024-04-17T19:53:26.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.825+0000 7fb903fff640 1 -- 172.21.15.18:0/1539763631 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3277441381 0 0) 0x7fb904007910 con 0x7fb9040073c0 2024-04-17T19:53:26.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.825+0000 7fb913635640 1 -- 172.21.15.18:0/1539763631 --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb904007bf0 con 0x7fb904057620 2024-04-17T19:53:26.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.825+0000 7fb913635640 1 -- 172.21.15.18:0/1539763631 --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7fb90403cc20 con 0x7fb9040584b0 2024-04-17T19:53:26.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.825+0000 7fb903fff640 1 -- 172.21.15.18:0/1539763631 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8f8003530 con 0x7fb9040073c0 2024-04-17T19:53:26.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.825+0000 7fb903fff640 1 -- 172.21.15.18:0/1539763631 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1159769870 0 0) 0x7fb904007bf0 con 0x7fb904057620 2024-04-17T19:53:26.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.825+0000 7fb903fff640 1 -- 172.21.15.18:0/1539763631 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb904007910 con 0x7fb904057620 2024-04-17T19:53:26.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.825+0000 7fb903fff640 1 -- 172.21.15.18:0/1539763631 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 891655777 0 0) 0x7fb8f8003530 con 0x7fb9040073c0 2024-04-17T19:53:26.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.825+0000 7fb903fff640 1 -- 172.21.15.18:0/1539763631 >> v2:172.21.15.173:3300/0 conn(0x7fb9040584b0 msgr2=0x7fb90403d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:26.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.825+0000 7fb903fff640 1 --2- 172.21.15.18:0/1539763631 >> v2:172.21.15.173:3300/0 conn(0x7fb9040584b0 0x7fb90403d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.825+0000 7fb903fff640 1 -- 172.21.15.18:0/1539763631 >> v1:172.21.15.173:6789/0 conn(0x7fb904057620 legacy=0x7fb904057da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.825+0000 7fb903fff640 1 -- 172.21.15.18:0/1539763631 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb90403cf00 con 0x7fb9040073c0 2024-04-17T19:53:26.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.825+0000 7fb903fff640 1 -- 172.21.15.18:0/1539763631 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3208559991 0 0) 0x7fb90c076150 con 0x7fb9040073c0 2024-04-17T19:53:26.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.825+0000 7fb903fff640 1 -- 172.21.15.18:0/1539763631 >> v1:172.21.15.18:6789/0 conn(0x7fb9040073c0 legacy=0x7fb90403d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.825+0000 7fb903fff640 1 --2- 172.21.15.18:0/1539763631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8f8003b50 0x7fb8f8003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.825+0000 7fb903fff640 1 --2- 172.21.15.18:0/1539763631 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb8f8004810 0x7fb8f8004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.825+0000 7fb903fff640 1 --2- 172.21.15.18:0/1539763631 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8f8005160 0x7fb8f800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.825+0000 7fb903fff640 1 -- 172.21.15.18:0/1539763631 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb90403cc20 con 0x7fb8f8003b50 2024-04-17T19:53:26.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.825+0000 7fb903fff640 1 -- 172.21.15.18:0/1539763631 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f8014830 con 0x7fb8f8005160 2024-04-17T19:53:26.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.825+0000 7f08521d4640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f084c0c5120 0x7f084c0b10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.825+0000 7f08521d4640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f084c0b1df0 con 0x7f084c0b15e0 2024-04-17T19:53:26.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.825+0000 7f08521d4640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f084c0d1ac0 con 0x7f084c163710 2024-04-17T19:53:26.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.825+0000 7f08521d4640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f084c0d1870 con 0x7f084c0c5120 2024-04-17T19:53:26.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.825+0000 7fb903fff640 1 -- 172.21.15.18:0/1539763631 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fb8f8014a30 con 0x7fb8f8004810 2024-04-17T19:53:26.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.825+0000 7fb9113d1640 1 --2- 172.21.15.18:0/1539763631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8f8003b50 0x7fb8f8003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.825+0000 7f084affd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f084c0c5120 0x7f084c0b10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.825+0000 7f084affd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f084c0c5120 0x7f084c0b10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49870/0 (socket says 172.21.15.18:49870) 2024-04-17T19:53:26.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.825+0000 7f084affd640 1 -- 172.21.15.18:0/3426885094 learned_addr learned my addr 172.21.15.18:0/3426885094 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:26.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.825+0000 7fb910bd0640 1 --2- 172.21.15.18:0/1539763631 >> v2:172.21.15.173:3300/0 conn(0x7fb9040584b0 0x7fb90403d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:53:26.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.825+0000 7fb9113d1640 1 -- 172.21.15.18:0/1539763631 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb8f8004810 msgr2=0x7fb8f8004c20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-17T19:53:26.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.825+0000 7fb9113d1640 1 --2- 172.21.15.18:0/1539763631 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb8f8004810 0x7fb8f8004c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.825+0000 7fb9113d1640 1 -- 172.21.15.18:0/1539763631 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8f8005160 msgr2=0x7fb8f800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:26.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.825+0000 7f084affd640 1 -- 172.21.15.18:0/3426885094 >> v1:172.21.15.173:6789/0 conn(0x7f084c163710 legacy=0x7f084c0c4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:26.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.825+0000 7f084affd640 1 -- 172.21.15.18:0/3426885094 >> v1:172.21.15.18:6789/0 conn(0x7f084c0b15e0 legacy=0x7f084c0d0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.825+0000 7f084affd640 1 -- 172.21.15.18:0/3426885094 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f084c0d1da0 con 0x7f084c0c5120 2024-04-17T19:53:26.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.825+0000 7fb9113d1640 1 --2- 172.21.15.18:0/1539763631 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8f8005160 0x7fb8f800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.825+0000 7fb9113d1640 1 -- 172.21.15.18:0/1539763631 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb90403cf00 con 0x7fb8f8003b50 2024-04-17T19:53:26.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.825+0000 7f59078d4640 1 -- start start 2024-04-17T19:53:26.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.825+0000 7f59078d4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f59000cf420 0x7f590014c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.825+0000 7f59078d4640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5900151a20 0x7f59001593d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.825+0000 7fb911bd2640 1 -- 172.21.15.18:0/1539763631 reap_dead start 2024-04-17T19:53:26.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.825+0000 7f59078d4640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f590015eda0 0x7f590015bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.825+0000 7f16a8814640 1 Processor -- start 2024-04-17T19:53:26.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.825+0000 7f59078d4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f590006ff20 con 0x7f59000cf420 2024-04-17T19:53:26.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.825+0000 7f5904e6f640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5900151a20 0x7f59001593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.825+0000 7f5905e71640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f590015eda0 0x7f590015bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.825+0000 7f5905e71640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f590015eda0 0x7f590015bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.18:43990/0 (socket says 172.21.15.18:43990) 2024-04-17T19:53:26.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.825+0000 7f5905e71640 1 -- 172.21.15.18:0/2851973969 learned_addr learned my addr 172.21.15.18:0/2851973969 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:26.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.825+0000 7f59078d4640 1 -- 172.21.15.18:0/2851973969 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f590006fda0 con 0x7f590015eda0 2024-04-17T19:53:26.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.825+0000 7f59078d4640 1 -- 172.21.15.18:0/2851973969 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f59000700a0 con 0x7f5900151a20 2024-04-17T19:53:26.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.825+0000 7f16a8814640 1 -- start start 2024-04-17T19:53:26.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.829+0000 7f5904e6f640 1 -- 172.21.15.18:0/2851973969 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f590015eda0 msgr2=0x7f590015bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.829+0000 7f5904e6f640 1 --2- 172.21.15.18:0/2851973969 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f590015eda0 0x7f590015bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.829+0000 7f5904e6f640 1 -- 172.21.15.18:0/2851973969 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f59000cf420 msgr2=0x7f590014c6f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-17T19:53:26.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.829+0000 7f5904e6f640 1 --2- 172.21.15.18:0/2851973969 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f59000cf420 0x7f590014c6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.829+0000 7f5904e6f640 1 -- 172.21.15.18:0/2851973969 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f590014cc30 con 0x7f5900151a20 2024-04-17T19:53:26.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.829+0000 7f5904e6f640 1 --2- 172.21.15.18:0/2851973969 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5900151a20 0x7f59001593d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f58f800eb70 tx=0x7f58f800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.829+0000 7f58f5ffb640 1 -- 172.21.15.18:0/2851973969 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f8018020 con 0x7f5900151a20 2024-04-17T19:53:26.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.829+0000 7f59078d4640 1 -- 172.21.15.18:0/2851973969 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5900159fc0 con 0x7f5900151a20 2024-04-17T19:53:26.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.829+0000 7f59078d4640 1 -- 172.21.15.18:0/2851973969 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f590015a580 con 0x7f5900151a20 2024-04-17T19:53:26.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.829+0000 7f58f5ffb640 1 -- 172.21.15.18:0/2851973969 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58f800cd40 con 0x7f5900151a20 2024-04-17T19:53:26.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.829+0000 7f58f5ffb640 1 -- 172.21.15.18:0/2851973969 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58f80146a0 con 0x7f5900151a20 2024-04-17T19:53:26.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.829+0000 7fb9113d1640 1 --2- 172.21.15.18:0/1539763631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8f8003b50 0x7fb8f8003fa0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb9080018e0 tx=0x7fb90801c580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36b1199f6f4ec201 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.829+0000 7f16a8814640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f169c0eb8c0 0x7f169c0e7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.829+0000 7f16a8814640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f169c0067e0 0x7f169c006bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.829+0000 7f16a8814640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f169c038320 con 0x7f169c033a50 2024-04-17T19:53:26.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.829+0000 7f16a8814640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f169c006070 con 0x7f169c0eb8c0 2024-04-17T19:53:26.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.829+0000 7f16a8814640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f169c006350 con 0x7f169c0067e0 2024-04-17T19:53:26.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.829+0000 7f16a259c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f169c0eb8c0 0x7f169c0e7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.829+0000 7f16a259c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f169c0eb8c0 0x7f169c0e7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49884/0 (socket says 172.21.15.18:49884) 2024-04-17T19:53:26.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.829+0000 7f16a259c640 1 -- 172.21.15.18:0/3504463758 learned_addr learned my addr 172.21.15.18:0/3504463758 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:26.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.829+0000 7f16a2d9d640 1 --2- 172.21.15.18:0/3504463758 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f169c0067e0 0x7f169c006bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.829+0000 7fc13759e640 1 Processor -- start 2024-04-17T19:53:26.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.829+0000 7fc13759e640 1 -- start start 2024-04-17T19:53:26.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.829+0000 7f16a259c640 1 -- 172.21.15.18:0/3504463758 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f169c0067e0 msgr2=0x7f169c006bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:26.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.829+0000 7f16a259c640 1 --2- 172.21.15.18:0/3504463758 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f169c0067e0 0x7f169c006bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.829+0000 7f16a259c640 1 -- 172.21.15.18:0/3504463758 >> v1:172.21.15.18:6789/0 conn(0x7f169c033a50 legacy=0x7f169c033e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:26.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.829+0000 7f16a259c640 1 -- 172.21.15.18:0/3504463758 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f169c0ec0a0 con 0x7f169c0eb8c0 2024-04-17T19:53:26.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.829+0000 7fb903fff640 1 -- 172.21.15.18:0/1539763631 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb908001530 con 0x7fb8f8003b50 2024-04-17T19:53:26.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.829+0000 7fb903fff640 1 -- 172.21.15.18:0/1539763631 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9080052d0 con 0x7fb8f8003b50 2024-04-17T19:53:26.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.829+0000 7fb903fff640 1 -- 172.21.15.18:0/1539763631 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb908007260 con 0x7fb8f8003b50 2024-04-17T19:53:26.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.829+0000 7f084affd640 1 --2- 172.21.15.18:0/3426885094 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f084c0c5120 0x7f084c0b10a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0840009870 tx=0x7f084001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7cb3d1aa1074486 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.829+0000 7f084a7fc640 1 -- 172.21.15.18:0/3426885094 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08400ab650 con 0x7f084c0c5120 2024-04-17T19:53:26.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.829+0000 7f084a7fc640 1 -- 172.21.15.18:0/3426885094 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08400b0070 con 0x7f084c0c5120 2024-04-17T19:53:26.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.829+0000 7f59078d4640 1 -- 172.21.15.18:0/2851973969 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58e00052a0 con 0x7f5900151a20 2024-04-17T19:53:26.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.829+0000 7fb913635640 1 -- 172.21.15.18:0/1539763631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8f8003b50 msgr2=0x7fb8f8003fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.829+0000 7fb913635640 1 --2- 172.21.15.18:0/1539763631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8f8003b50 0x7fb8f8003fa0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb9080018e0 tx=0x7fb90801c580 comp rx=0 tx=0).stop 2024-04-17T19:53:26.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.833+0000 7f084a7fc640 1 -- 172.21.15.18:0/3426885094 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08400ab650 con 0x7f084c0c5120 2024-04-17T19:53:26.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.833+0000 7fb913635640 1 -- 172.21.15.18:0/1539763631 shutdown_connections 2024-04-17T19:53:26.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.833+0000 7fb913635640 1 --2- 172.21.15.18:0/1539763631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8f8003b50 0x7fb8f8003fa0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.833+0000 7fb913635640 1 -- 172.21.15.18:0/1539763631 >> 172.21.15.18:0/1539763631 conn(0x7fb90403ac60 msgr2=0x7fb90403b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:26.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.833+0000 7fb913635640 1 -- 172.21.15.18:0/1539763631 shutdown_connections 2024-04-17T19:53:26.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.833+0000 7fbed2202640 1 Processor -- start 2024-04-17T19:53:26.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.833+0000 7f08521d4640 1 -- 172.21.15.18:0/3426885094 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f084c0c5120 msgr2=0x7f084c0b10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.833+0000 7f08521d4640 1 --2- 172.21.15.18:0/3426885094 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f084c0c5120 0x7f084c0b10a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0840009870 tx=0x7f084001c4f0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.833+0000 7fbed2202640 1 -- start start 2024-04-17T19:53:26.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.833+0000 7f08521d4640 1 -- 172.21.15.18:0/3426885094 shutdown_connections 2024-04-17T19:53:26.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.833+0000 7f08521d4640 1 --2- 172.21.15.18:0/3426885094 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f084c0c5120 0x7f084c0b10a0 secure :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0840009870 tx=0x7f084001c4f0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.833+0000 7f08521d4640 1 -- 172.21.15.18:0/3426885094 >> 172.21.15.18:0/3426885094 conn(0x7f084c09aa70 msgr2=0x7f084c09ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:26.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.833+0000 7fc13759e640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc1380d1a90 0x7fc1380b5e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.833+0000 7fc13759e640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc1380b3390 0x7fc1380b37a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.833+0000 7fc13759e640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1380b25d0 con 0x7fc138160bd0 2024-04-17T19:53:26.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.833+0000 7fc13759e640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7fc1380d2270 con 0x7fc1380d1a90 2024-04-17T19:53:26.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.833+0000 7fc13759e640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fc1380b2f00 con 0x7fc1380b3390 2024-04-17T19:53:26.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.833+0000 7f08521d4640 1 -- 172.21.15.18:0/3426885094 shutdown_connections 2024-04-17T19:53:26.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.833+0000 7f58f5ffb640 1 -- 172.21.15.18:0/2851973969 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f58f801b020 con 0x7f5900151a20 2024-04-17T19:53:26.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.833+0000 7f58f5ffb640 1 --2- 172.21.15.18:0/2851973969 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f58e4068380 0x7f58e406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.833+0000 7f58f5ffb640 1 -- 172.21.15.18:0/2851973969 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f58f8087940 con 0x7f5900151a20 2024-04-17T19:53:26.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.833+0000 7f5905670640 1 --2- 172.21.15.18:0/2851973969 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f58e4068380 0x7f58e406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.833+0000 7f16a259c640 1 --2- 172.21.15.18:0/3504463758 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f169c0eb8c0 0x7f169c0e7be0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f16a4051840 tx=0x7f16a4098660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8219f36ae349916 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.833+0000 7f08521d4640 1 -- 172.21.15.18:0/3426885094 wait complete. 2024-04-17T19:53:26.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.833+0000 7fc136d9d640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fc138160bd0 0x7fc138160fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.18:33428/0 (socket says 172.21.15.18:33428) 2024-04-17T19:53:26.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.833+0000 7fc136d9d640 1 -- 172.21.15.18:0/2025373401 learned_addr learned my addr 172.21.15.18:0/2025373401 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:26.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.833+0000 7fc13659c640 1 --2- 172.21.15.18:0/2025373401 >> v2:172.21.15.173:3300/0 conn(0x7fc1380d1a90 0x7fc1380b5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.833+0000 7f16a159a640 1 -- 172.21.15.18:0/3504463758 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16a4127480 con 0x7f169c0eb8c0 2024-04-17T19:53:26.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.833+0000 7f16a159a640 1 -- 172.21.15.18:0/3504463758 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16a4123070 con 0x7f169c0eb8c0 2024-04-17T19:53:26.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.833+0000 7f5905670640 1 --2- 172.21.15.18:0/2851973969 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f58e4068380 0x7f58e406a890 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f58fc000f70 tx=0x7f58fc0079c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.833+0000 7f16a159a640 1 -- 172.21.15.18:0/3504463758 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16a4127480 con 0x7f169c0eb8c0 2024-04-17T19:53:26.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.833+0000 7fc13659c640 1 -- 172.21.15.18:0/2025373401 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc1380b3390 msgr2=0x7fc1380b37a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-17T19:53:26.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.833+0000 7fc13659c640 1 --2- 172.21.15.18:0/2025373401 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc1380b3390 0x7fc1380b37a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.833+0000 7fc13659c640 1 -- 172.21.15.18:0/2025373401 >> v1:172.21.15.173:6789/0 conn(0x7fc138160bd0 legacy=0x7fc138160fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:26.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.833+0000 7fc13659c640 1 -- 172.21.15.18:0/2025373401 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1380b28b0 con 0x7fc1380d1a90 2024-04-17T19:53:26.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.833+0000 7fb913635640 1 -- 172.21.15.18:0/1539763631 wait complete. 2024-04-17T19:53:26.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.833+0000 7fb913635640 1 Processor -- start 2024-04-17T19:53:26.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.833+0000 7fb913635640 1 -- start start 2024-04-17T19:53:26.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.833+0000 7fbed2202640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbecc0cf420 0x7fbecc0afe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.833+0000 7f16a8814640 1 -- 172.21.15.18:0/3504463758 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f169c0eb8c0 msgr2=0x7f169c0e7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.833+0000 7f16a8814640 1 --2- 172.21.15.18:0/3504463758 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f169c0eb8c0 0x7f169c0e7be0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f16a4051840 tx=0x7f16a4098660 comp rx=0 tx=0).stop 2024-04-17T19:53:26.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.833+0000 7f16a8814640 1 -- 172.21.15.18:0/3504463758 shutdown_connections 2024-04-17T19:53:26.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.833+0000 7f16a8814640 1 --2- 172.21.15.18:0/3504463758 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f169c0067e0 0x7f169c006bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.833+0000 7f16a8814640 1 --2- 172.21.15.18:0/3504463758 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f169c0eb8c0 0x7f169c0e7be0 secure :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f16a4051840 tx=0x7f16a4098660 comp rx=0 tx=0).stop 2024-04-17T19:53:26.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.833+0000 7f16a8814640 1 -- 172.21.15.18:0/3504463758 >> 172.21.15.18:0/3504463758 conn(0x7f169c054cd0 msgr2=0x7f169c0550e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:26.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.833+0000 7fbed2202640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fbecc151a20 0x7fbecc151e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.833+0000 7f08521d4640 1 Processor -- start 2024-04-17T19:53:26.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.833+0000 7fbecb7fe640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbecc0cf420 0x7fbecc0afe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.833+0000 7fbed2202640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbecc0cfa50 con 0x7fbecc15eda0 2024-04-17T19:53:26.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.833+0000 7fbecb7fe640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbecc0cf420 0x7fbecc0afe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.18:60528/0 (socket says 172.21.15.18:60528) 2024-04-17T19:53:26.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.833+0000 7fbecaffd640 1 --1- 172.21.15.18:0/729881627 >> v1:172.21.15.173:6789/0 conn(0x7fbecc15eda0 0x7fbecc15f1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.18:33444/0 (socket says 172.21.15.18:33444) 2024-04-17T19:53:26.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.833+0000 7fbecb7fe640 1 -- 172.21.15.18:0/729881627 learned_addr learned my addr 172.21.15.18:0/729881627 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:26.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.833+0000 7fbed2202640 1 -- 172.21.15.18:0/729881627 --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7fbecc0cf830 con 0x7fbecc151a20 2024-04-17T19:53:26.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.833+0000 7fbed2202640 1 -- 172.21.15.18:0/729881627 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fbecc0cfd30 con 0x7fbecc0cf420 2024-04-17T19:53:26.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.833+0000 7fbecbfff640 1 --2- 172.21.15.18:0/729881627 >> v2:172.21.15.173:3300/0 conn(0x7fbecc151a20 0x7fbecc151e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.833+0000 7f08521d4640 1 -- start start 2024-04-17T19:53:26.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7f16a8814640 1 -- 172.21.15.18:0/3504463758 shutdown_connections 2024-04-17T19:53:26.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7f16a8814640 1 -- 172.21.15.18:0/3504463758 wait complete. 2024-04-17T19:53:26.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7fb913635640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8f8003b50 0x7fb90418c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7fb913635640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb904052bd0 0x7fb9040d58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7fb913635640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9040e4eb0 0x7fb904189a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7fb911bd2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9040e4eb0 0x7fb904189a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7fb911bd2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9040e4eb0 0x7fb904189a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49890/0 (socket says 172.21.15.18:49890) 2024-04-17T19:53:26.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7fb911bd2640 1 -- 172.21.15.18:0/2661018469 learned_addr learned my addr 172.21.15.18:0/2661018469 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:26.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7fb913635640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb904006780 con 0x7fb9040e4eb0 2024-04-17T19:53:26.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7fb913635640 1 -- 172.21.15.18:0/2661018469 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb904006600 con 0x7fb8f8003b50 2024-04-17T19:53:26.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7fb913635640 1 -- 172.21.15.18:0/2661018469 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fb904006900 con 0x7fb904052bd0 2024-04-17T19:53:26.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7fc13659c640 1 --2- 172.21.15.18:0/2025373401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1380d1a90 0x7fc1380b5e70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc1280097c0 tx=0x7fc12801c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14182017276561e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7fb911bd2640 1 -- 172.21.15.18:0/2661018469 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb904052bd0 msgr2=0x7fb9040d58a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-17T19:53:26.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7fb911bd2640 1 --2- 172.21.15.18:0/2661018469 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb904052bd0 0x7fb9040d58a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7fb911bd2640 1 -- 172.21.15.18:0/2661018469 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8f8003b50 msgr2=0x7fb90418c770 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-17T19:53:26.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7fb911bd2640 1 --2- 172.21.15.18:0/2661018469 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8f8003b50 0x7fb90418c770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7fb911bd2640 1 -- 172.21.15.18:0/2661018469 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9040d5de0 con 0x7fb9040e4eb0 2024-04-17T19:53:26.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7fc13559a640 1 -- 172.21.15.18:0/2025373401 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1280b0070 con 0x7fc1380d1a90 2024-04-17T19:53:26.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7f08521d4640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f084c0b15e0 0x7f084c2011c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7f08521d4640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f084c163710 0x7f084c164080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7f08521d4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f084c162680 0x7f084c0cea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7f084b7fe640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f084c0b15e0 0x7f084c2011c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7f084bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f084c162680 0x7f084c0cea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7f084affd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f084c163710 0x7f084c164080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7f084b7fe640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f084c0b15e0 0x7f084c2011c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.18:60532/0 (socket says 172.21.15.18:60532) 2024-04-17T19:53:26.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7f084bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f084c162680 0x7f084c0cea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49900/0 (socket says 172.21.15.18:49900) 2024-04-17T19:53:26.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7f084b7fe640 1 -- 172.21.15.18:0/2669637640 learned_addr learned my addr 172.21.15.18:0/2669637640 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:26.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7f08521d4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f084c1717c0 con 0x7f084c162680 2024-04-17T19:53:26.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7f08521d4640 1 -- 172.21.15.18:0/2669637640 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f084c171640 con 0x7f084c163710 2024-04-17T19:53:26.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7f08521d4640 1 -- 172.21.15.18:0/2669637640 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f084c171940 con 0x7f084c0b15e0 2024-04-17T19:53:26.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7fc13559a640 1 -- 172.21.15.18:0/2025373401 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1280ab600 con 0x7fc1380d1a90 2024-04-17T19:53:26.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7fc13559a640 1 -- 172.21.15.18:0/2025373401 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1280ab9d0 con 0x7fc1380d1a90 2024-04-17T19:53:26.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7fb911bd2640 1 --2- 172.21.15.18:0/2661018469 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9040e4eb0 0x7fb904189a90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb90c051840 tx=0x7fb90c075b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7fc13759e640 1 -- 172.21.15.18:0/2025373401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1380d1a90 msgr2=0x7fc1380b5e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7fc13759e640 1 --2- 172.21.15.18:0/2025373401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1380d1a90 0x7fc1380b5e70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc1280097c0 tx=0x7fc12801c3f0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7fbeca7fc640 1 -- 172.21.15.18:0/729881627 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2448582481 0 0) 0x7fbecc0cfa50 con 0x7fbecc15eda0 2024-04-17T19:53:26.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7fbeca7fc640 1 -- 172.21.15.18:0/729881627 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbeb4003530 con 0x7fbecc15eda0 2024-04-17T19:53:26.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7fbecb7fe640 1 -- 172.21.15.18:0/729881627 >> v2:172.21.15.173:3300/0 conn(0x7fbecc151a20 msgr2=0x7fbecc151e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:26.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7fbecb7fe640 1 --2- 172.21.15.18:0/729881627 >> v2:172.21.15.173:3300/0 conn(0x7fbecc151a20 0x7fbecc151e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7fbecb7fe640 1 -- 172.21.15.18:0/729881627 >> v1:172.21.15.173:6789/0 conn(0x7fbecc15eda0 legacy=0x7fbecc15f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7fbecb7fe640 1 -- 172.21.15.18:0/729881627 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbecc0d0010 con 0x7fbecc0cf420 2024-04-17T19:53:26.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7f084bfff640 1 -- 172.21.15.18:0/2669637640 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f084c0b15e0 msgr2=0x7f084c2011c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7f084bfff640 1 --2- 172.21.15.18:0/2669637640 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f084c0b15e0 0x7f084c2011c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7f084bfff640 1 -- 172.21.15.18:0/2669637640 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f084c163710 msgr2=0x7f084c164080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7f084bfff640 1 --2- 172.21.15.18:0/2669637640 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f084c163710 0x7f084c164080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7f084bfff640 1 -- 172.21.15.18:0/2669637640 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f084c1fd410 con 0x7f084c162680 2024-04-17T19:53:26.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7fc13759e640 1 -- 172.21.15.18:0/2025373401 shutdown_connections 2024-04-17T19:53:26.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7fc13759e640 1 --2- 172.21.15.18:0/2025373401 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc1380b3390 0x7fc1380b37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7fc13759e640 1 --2- 172.21.15.18:0/2025373401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1380d1a90 0x7fc1380b5e70 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7fc13759e640 1 -- 172.21.15.18:0/2025373401 >> 172.21.15.18:0/2025373401 conn(0x7fc1380cf550 msgr2=0x7fc1380cf960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:26.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7fb901ffb640 1 -- 172.21.15.18:0/2661018469 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb90c092070 con 0x7fb9040e4eb0 2024-04-17T19:53:26.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7fb901ffb640 1 -- 172.21.15.18:0/2661018469 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb90c06d0d0 con 0x7fb9040e4eb0 2024-04-17T19:53:26.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7fb901ffb640 1 -- 172.21.15.18:0/2661018469 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb90c06d4a0 con 0x7fb9040e4eb0 2024-04-17T19:53:26.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7f16a8814640 1 Processor -- start 2024-04-17T19:53:26.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7fb913635640 1 -- 172.21.15.18:0/2661018469 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb90418d070 con 0x7fb9040e4eb0 2024-04-17T19:53:26.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7fbecb7fe640 1 --2- 172.21.15.18:0/729881627 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbecc0cf420 0x7fbecc0afe70 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbebc008120 tx=0x7fbebc01c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a21965655a3cb1a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7f084bfff640 1 --2- 172.21.15.18:0/2669637640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f084c162680 0x7f084c0cea80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f083c00c3c0 tx=0x7f083c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7fb913635640 1 -- 172.21.15.18:0/2661018469 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb90418d630 con 0x7fb9040e4eb0 2024-04-17T19:53:26.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.841+0000 7f0833fff640 1 -- 172.21.15.18:0/2669637640 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f083c0052d0 con 0x7f084c162680 2024-04-17T19:53:26.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.841+0000 7f08521d4640 1 -- 172.21.15.18:0/2669637640 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f084c1fd6f0 con 0x7f084c162680 2024-04-17T19:53:26.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.841+0000 7f08521d4640 1 -- 172.21.15.18:0/2669637640 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f084c1fdcb0 con 0x7f084c162680 2024-04-17T19:53:26.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.841+0000 7fc13759e640 1 -- 172.21.15.18:0/2025373401 shutdown_connections 2024-04-17T19:53:26.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.841+0000 7f0833fff640 1 -- 172.21.15.18:0/2669637640 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f083c005470 con 0x7f084c162680 2024-04-17T19:53:26.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.841+0000 7f0833fff640 1 -- 172.21.15.18:0/2669637640 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f083c007260 con 0x7f084c162680 2024-04-17T19:53:26.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.837+0000 7f16a8814640 1 -- start start 2024-04-17T19:53:26.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.841+0000 7f16a8814640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f169c0067e0 0x7f169c0e4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.841+0000 7f16a8814640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f169c033a50 0x7f169c046670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.841+0000 7f08521d4640 1 -- 172.21.15.18:0/2669637640 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f082c0052a0 con 0x7f084c162680 2024-04-17T19:53:26.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.841+0000 7f16a1d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f169c033a50 0x7f169c046670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.841+0000 7f16a1d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f169c033a50 0x7f169c046670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49912/0 (socket says 172.21.15.18:49912) 2024-04-17T19:53:26.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.841+0000 7f16a259c640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f169c0067e0 0x7f169c0e4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.841+0000 7f16a259c640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f169c0067e0 0x7f169c0e4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.18:60536/0 (socket says 172.21.15.18:60536) 2024-04-17T19:53:26.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.841+0000 7f16a1d9b640 1 -- 172.21.15.18:0/3115515640 learned_addr learned my addr 172.21.15.18:0/3115515640 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:26.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.841+0000 7fb901ffb640 1 -- 172.21.15.18:0/2661018469 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb90c06d640 con 0x7fb9040e4eb0 2024-04-17T19:53:26.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.841+0000 7fb901ffb640 1 --2- 172.21.15.18:0/2661018469 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fb8f00683d0 0x7fb8f006a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.841+0000 7f16a8814640 1 --2- 172.21.15.18:0/3115515640 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f169c0e4960 0x7f169c046bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.841+0000 7fc13759e640 1 -- 172.21.15.18:0/2025373401 wait complete. 2024-04-17T19:53:26.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.841+0000 7fb9113d1640 1 --2- 172.21.15.18:0/2661018469 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fb8f00683d0 0x7fb8f006a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.841+0000 7f16a8814640 1 -- 172.21.15.18:0/3115515640 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f169c0ebe50 con 0x7f169c033a50 2024-04-17T19:53:26.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.841+0000 7f16a8814640 1 -- 172.21.15.18:0/3115515640 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f169c0ebcd0 con 0x7f169c0e4960 2024-04-17T19:53:26.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.841+0000 7f16a8814640 1 -- 172.21.15.18:0/3115515640 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f169c0f4c00 con 0x7f169c0067e0 2024-04-17T19:53:26.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.841+0000 7f16a1d9b640 1 -- 172.21.15.18:0/3115515640 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f169c0067e0 msgr2=0x7f169c0e4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.841+0000 7f16a1d9b640 1 --2- 172.21.15.18:0/3115515640 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f169c0067e0 0x7f169c0e4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.841+0000 7f16a1d9b640 1 -- 172.21.15.18:0/3115515640 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f169c0e4960 msgr2=0x7f169c046bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-17T19:53:26.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.841+0000 7f16a1d9b640 1 --2- 172.21.15.18:0/3115515640 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f169c0e4960 0x7f169c046bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.841+0000 7f16a1d9b640 1 -- 172.21.15.18:0/3115515640 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f169c04eba0 con 0x7f169c033a50 2024-04-17T19:53:26.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.841+0000 7fb9113d1640 1 --2- 172.21.15.18:0/2661018469 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fb8f00683d0 0x7fb8f006a8e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb8f80057f0 tx=0x7fb9080012e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.841+0000 7f16a1d9b640 1 --2- 172.21.15.18:0/3115515640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f169c033a50 0x7f169c046670 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f169400b440 tx=0x7f169400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.841+0000 7fb913635640 1 -- 172.21.15.18:0/2661018469 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9040059d0 con 0x7fb9040e4eb0 2024-04-17T19:53:26.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.841+0000 7fc13759e640 1 Processor -- start 2024-04-17T19:53:26.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.841+0000 7fc13759e640 1 -- start start 2024-04-17T19:53:26.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.841+0000 7fb901ffb640 1 -- 172.21.15.18:0/2661018469 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fb90c0cf470 con 0x7fb9040e4eb0 2024-04-17T19:53:26.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.841+0000 7f0833fff640 1 -- 172.21.15.18:0/2669637640 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f083c007400 con 0x7f084c162680 2024-04-17T19:53:26.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.841+0000 7f0833fff640 1 --2- 172.21.15.18:0/2669637640 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0838068380 0x7f083806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.841+0000 7f0833fff640 1 -- 172.21.15.18:0/2669637640 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f083c0867d0 con 0x7f084c162680 2024-04-17T19:53:26.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.841+0000 7f084b7fe640 1 --2- 172.21.15.18:0/2669637640 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0838068380 0x7f083806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.845+0000 7f084b7fe640 1 --2- 172.21.15.18:0/2669637640 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0838068380 0x7f083806a890 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f084400e190 tx=0x7f084400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.845+0000 7fc13759e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1380b3390 0x7fc138200340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.845+0000 7fc13759e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1380d1a90 0x7fc138070cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.845+0000 7fc13759e640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc138160bd0 0x7fc138071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.845+0000 7fc13759e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc1380b6530 con 0x7fc1380d1a90 2024-04-17T19:53:26.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.845+0000 7fc13759e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc1380b63b0 con 0x7fc1380b3390 2024-04-17T19:53:26.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.845+0000 7fc13759e640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fc13816a780 con 0x7fc138160bd0 2024-04-17T19:53:26.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.845+0000 7fc135d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1380d1a90 0x7fc138070cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.845+0000 7fc135d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1380d1a90 0x7fc138070cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49914/0 (socket says 172.21.15.18:49914) 2024-04-17T19:53:26.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.845+0000 7fc135d9b640 1 -- 172.21.15.18:0/3542018136 learned_addr learned my addr 172.21.15.18:0/3542018136 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:26.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.845+0000 7fc13659c640 1 --2- 172.21.15.18:0/3542018136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1380b3390 0x7fc138200340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.845+0000 7fc136d9d640 1 --2- 172.21.15.18:0/3542018136 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc138160bd0 0x7fc138071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.845+0000 7fc135d9b640 1 -- 172.21.15.18:0/3542018136 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc138160bd0 msgr2=0x7fc138071200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.845+0000 7fc135d9b640 1 --2- 172.21.15.18:0/3542018136 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc138160bd0 0x7fc138071200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.845+0000 7fc135d9b640 1 -- 172.21.15.18:0/3542018136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1380b3390 msgr2=0x7fc138200340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.845+0000 7fc135d9b640 1 --2- 172.21.15.18:0/3542018136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1380b3390 0x7fc138200340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.845+0000 7fc135d9b640 1 -- 172.21.15.18:0/3542018136 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc13806d890 con 0x7fc1380d1a90 2024-04-17T19:53:26.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.845+0000 7fc13659c640 1 --2- 172.21.15.18:0/3542018136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1380b3390 0x7fc138200340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:53:26.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.845+0000 7fc135d9b640 1 --2- 172.21.15.18:0/3542018136 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1380d1a90 0x7fc138070cc0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc12c00b410 tx=0x7fc12c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.845+0000 7f08c9a4a640 1 Processor -- start 2024-04-17T19:53:26.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.845+0000 7f08c9a4a640 1 -- start start 2024-04-17T19:53:26.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.845+0000 7f08c9a4a640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f08c40b4c00 0x7f08c415b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.845+0000 7f08c8a48640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f08c40b4c00 0x7f08c415b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.845+0000 7f08c8a48640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f08c40b4c00 0x7f08c415b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49922/0 (socket says 172.21.15.18:49922) 2024-04-17T19:53:26.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.845+0000 7f08c9a4a640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f08c40cf950 0x7f08c40cfd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.849+0000 7f08c8a48640 1 -- 172.21.15.18:0/4170373760 learned_addr learned my addr 172.21.15.18:0/4170373760 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:26.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.849+0000 7f1692ffd640 1 -- 172.21.15.18:0/3115515640 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1694015020 con 0x7f169c033a50 2024-04-17T19:53:26.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.849+0000 7f08c9a4a640 1 -- 172.21.15.18:0/4170373760 --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08c415bcc0 con 0x7f08c4070420 2024-04-17T19:53:26.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.849+0000 7fc126ffd640 1 -- 172.21.15.18:0/3542018136 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc12c015020 con 0x7fc1380d1a90 2024-04-17T19:53:26.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.849+0000 7f08c9a4a640 1 -- 172.21.15.18:0/4170373760 --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f08c40cf190 con 0x7f08c40b4c00 2024-04-17T19:53:26.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.849+0000 7fc13759e640 1 -- 172.21.15.18:0/3542018136 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc13806db30 con 0x7fc1380d1a90 2024-04-17T19:53:26.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.849+0000 7fc13759e640 1 -- 172.21.15.18:0/3542018136 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc13806e0f0 con 0x7fc1380d1a90 2024-04-17T19:53:26.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.849+0000 7f08c9249640 1 --2- 172.21.15.18:0/4170373760 >> v2:172.21.15.173:3300/0 conn(0x7f08c40cf950 0x7f08c40cfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.849+0000 7f08c9a4a640 1 -- 172.21.15.18:0/4170373760 --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f08c40b5eb0 con 0x7f08c40cf950 2024-04-17T19:53:26.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.849+0000 7f0833fff640 1 -- 172.21.15.18:0/2669637640 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f083c0564a0 con 0x7f084c162680 2024-04-17T19:53:26.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.849+0000 7f08c37fe640 1 -- 172.21.15.18:0/4170373760 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2042536634 0 0) 0x7f08c415bcc0 con 0x7f08c4070420 2024-04-17T19:53:26.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.849+0000 7fc13759e640 1 -- 172.21.15.18:0/3542018136 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc138076150 con 0x7fc1380d1a90 2024-04-17T19:53:26.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.849+0000 7f58f5ffb640 1 -- 172.21.15.18:0/2851973969 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f58f8022030 con 0x7f5900151a20 2024-04-17T19:53:26.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.849+0000 7f16a8814640 1 -- 172.21.15.18:0/3115515640 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f169c044980 con 0x7f169c033a50 2024-04-17T19:53:26.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.849+0000 7f16a8814640 1 -- 172.21.15.18:0/3115515640 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f169c046200 con 0x7f169c033a50 2024-04-17T19:53:26.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.849+0000 7f16a8814640 1 -- 172.21.15.18:0/3115515640 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f169c0edb90 con 0x7f169c033a50 2024-04-17T19:53:26.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.849+0000 7f08c37fe640 1 -- 172.21.15.18:0/4170373760 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08b4005740 con 0x7f08c4070420 2024-04-17T19:53:26.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.849+0000 7f08c8a48640 1 -- 172.21.15.18:0/4170373760 >> v2:172.21.15.173:3300/0 conn(0x7f08c40cf950 msgr2=0x7f08c40cfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:26.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.849+0000 7f08c8a48640 1 --2- 172.21.15.18:0/4170373760 >> v2:172.21.15.173:3300/0 conn(0x7f08c40cf950 0x7f08c40cfd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.849+0000 7f08c8a48640 1 -- 172.21.15.18:0/4170373760 >> v1:172.21.15.173:6789/0 conn(0x7f08c4070420 legacy=0x7f08c4070830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.849+0000 7f08c8a48640 1 -- 172.21.15.18:0/4170373760 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08c40b6190 con 0x7f08c40b4c00 2024-04-17T19:53:26.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.849+0000 7fbeca7fc640 1 -- 172.21.15.18:0/729881627 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbebc00b040 con 0x7fbecc0cf420 2024-04-17T19:53:26.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.849+0000 7fbeca7fc640 1 -- 172.21.15.18:0/729881627 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbebc004230 con 0x7fbecc0cf420 2024-04-17T19:53:26.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.849+0000 7fbed2202640 1 -- 172.21.15.18:0/729881627 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbecc0cf420 msgr2=0x7fbecc0afe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.849+0000 7fbed2202640 1 --2- 172.21.15.18:0/729881627 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbecc0cf420 0x7fbecc0afe70 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbebc008120 tx=0x7fbebc01c820 comp rx=0 tx=0).stop 2024-04-17T19:53:26.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.849+0000 7fbed2202640 1 -- 172.21.15.18:0/729881627 shutdown_connections 2024-04-17T19:53:26.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.849+0000 7fbed2202640 1 --2- 172.21.15.18:0/729881627 >> v2:172.21.15.173:3300/0 conn(0x7fbecc151a20 0x7fbecc151e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.849+0000 7fbed2202640 1 --2- 172.21.15.18:0/729881627 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbecc0cf420 0x7fbecc0afe70 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.849+0000 7fbed2202640 1 -- 172.21.15.18:0/729881627 >> 172.21.15.18:0/729881627 conn(0x7fbecc072d70 msgr2=0x7fbecc0731b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:26.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.849+0000 7fbed2202640 1 -- 172.21.15.18:0/729881627 shutdown_connections 2024-04-17T19:53:26.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.849+0000 7f08c8a48640 1 --2- 172.21.15.18:0/4170373760 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08c40b4c00 0x7f08c415b780 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f08c40743c0 tx=0x7f08b801cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4c27aa944fef81a server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.849+0000 7fbed2202640 1 -- 172.21.15.18:0/729881627 wait complete. 2024-04-17T19:53:26.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.853+0000 7fbed2202640 1 Processor -- start 2024-04-17T19:53:26.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.853+0000 7f6ee3fff640 1 Processor -- start 2024-04-17T19:53:26.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.853+0000 7f6ee3fff640 1 -- start start 2024-04-17T19:53:26.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.853+0000 7f6ee3fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6edc050db0 0x7f6edc0511c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.853+0000 7f6ee3fff640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6edc0549f0 con 0x7f6edc0e79f0 2024-04-17T19:53:26.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.853+0000 7f6ee3fff640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6edc0354d0 con 0x7f6edc051700 2024-04-17T19:53:26.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.853+0000 7f6ee3fff640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f6edc009010 con 0x7f6edc050db0 2024-04-17T19:53:26.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.853+0000 7fbed2202640 1 -- start start 2024-04-17T19:53:26.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.853+0000 7f6ee37fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f6edc0e79f0 0x7f6edc0ee440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:51220/0 (socket says 172.21.15.18:51220) 2024-04-17T19:53:26.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.853+0000 7f6ee37fe640 1 -- 172.21.15.18:0/1846153874 learned_addr learned my addr 172.21.15.18:0/1846153874 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:26.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.853+0000 7f6ee2ffd640 1 --2- 172.21.15.18:0/1846153874 >> v2:172.21.15.18:3300/0 conn(0x7f6edc050db0 0x7f6edc0511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.853+0000 7f6ee1ffb640 1 -- 172.21.15.18:0/1846153874 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1523747125 0 0) 0x7f6edc0354d0 con 0x7f6edc051700 2024-04-17T19:53:26.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.853+0000 7f6ee1ffb640 1 -- 172.21.15.18:0/1846153874 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ecc003530 con 0x7f6edc051700 2024-04-17T19:53:26.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.853+0000 7f6ee2ffd640 1 -- 172.21.15.18:0/1846153874 >> v1:172.21.15.173:6789/0 conn(0x7f6edc051700 legacy=0x7f6edc0e72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.857+0000 7f6ee1ffb640 1 -- 172.21.15.18:0/1846153874 <== mon.1 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1556560120 0 0) 0x7f6ecc003530 con 0x7f6edc051700 2024-04-17T19:53:26.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.857+0000 7f6ee2ffd640 1 -- 172.21.15.18:0/1846153874 >> v1:172.21.15.18:6789/0 conn(0x7f6edc0e79f0 legacy=0x7f6edc0ee440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.857+0000 7f6ee2ffd640 1 -- 172.21.15.18:0/1846153874 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6edc007800 con 0x7f6edc050db0 2024-04-17T19:53:26.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.857+0000 7fb901ffb640 1 -- 172.21.15.18:0/2661018469 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb90c0d1ad0 con 0x7fb9040e4eb0 2024-04-17T19:53:26.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.857+0000 7f1692ffd640 1 -- 172.21.15.18:0/3115515640 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1694011890 con 0x7f169c033a50 2024-04-17T19:53:26.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.857+0000 7fbed2202640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbecc0cf420 0x7fbecc154dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.857+0000 7fbed2202640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbecc151a20 0x7fbecc152780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.857+0000 7fbed2202640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbecc15eda0 0x7fbecc152cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.857+0000 7fbed2202640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbecc06ff20 con 0x7fbecc15eda0 2024-04-17T19:53:26.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.857+0000 7fbed2202640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fbecc06fda0 con 0x7fbecc151a20 2024-04-17T19:53:26.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.857+0000 7fbed2202640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fbecc0700a0 con 0x7fbecc0cf420 2024-04-17T19:53:26.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.857+0000 7fbecaffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbecc151a20 0x7fbecc152780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.857+0000 7fbecbfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbecc15eda0 0x7fbecc152cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.857+0000 7fbecaffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbecc151a20 0x7fbecc152780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.18:44050/0 (socket says 172.21.15.18:44050) 2024-04-17T19:53:26.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.857+0000 7fbecaffd640 1 -- 172.21.15.18:0/810711245 learned_addr learned my addr 172.21.15.18:0/810711245 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:26.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.857+0000 7fbecb7fe640 1 --2- 172.21.15.18:0/810711245 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbecc0cf420 0x7fbecc154dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.857+0000 7fbecbfff640 1 -- 172.21.15.18:0/810711245 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbecc0cf420 msgr2=0x7fbecc154dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.857+0000 7fbecbfff640 1 --2- 172.21.15.18:0/810711245 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbecc0cf420 0x7fbecc154dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.857+0000 7fbecbfff640 1 -- 172.21.15.18:0/810711245 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbecc151a20 msgr2=0x7fbecc152780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.857+0000 7fbecbfff640 1 --2- 172.21.15.18:0/810711245 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbecc151a20 0x7fbecc152780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.857+0000 7fbecbfff640 1 -- 172.21.15.18:0/810711245 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbecc156ad0 con 0x7fbecc15eda0 2024-04-17T19:53:26.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.857+0000 7f1692ffd640 1 -- 172.21.15.18:0/3115515640 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1694011c40 con 0x7f169c033a50 2024-04-17T19:53:26.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.857+0000 7fbecb7fe640 1 --2- 172.21.15.18:0/810711245 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbecc0cf420 0x7fbecc154dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:53:26.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.857+0000 7f08c37fe640 1 -- 172.21.15.18:0/4170373760 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b80aa5f0 con 0x7f08c40b4c00 2024-04-17T19:53:26.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.857+0000 7fbecbfff640 1 --2- 172.21.15.18:0/810711245 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbecc15eda0 0x7fbecc152cc0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fbec4009dd0 tx=0x7fbec4008420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.857+0000 7fc126ffd640 1 -- 172.21.15.18:0/3542018136 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc12c011830 con 0x7fc1380d1a90 2024-04-17T19:53:26.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.857+0000 7fc126ffd640 1 -- 172.21.15.18:0/3542018136 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc12c011be0 con 0x7fc1380d1a90 2024-04-17T19:53:26.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.865+0000 7f1692ffd640 1 -- 172.21.15.18:0/3115515640 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1694018020 con 0x7f169c033a50 2024-04-17T19:53:26.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.865+0000 7f1692ffd640 1 --2- 172.21.15.18:0/3115515640 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f16840683b0 0x7f168406a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.865+0000 7f16a259c640 1 --2- 172.21.15.18:0/3115515640 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f16840683b0 0x7f168406a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.865+0000 7f1692ffd640 1 -- 172.21.15.18:0/3115515640 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f1694087550 con 0x7f169c033a50 2024-04-17T19:53:26.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.861+0000 7fbeb3fff640 1 -- 172.21.15.18:0/810711245 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec4008cc0 con 0x7fbecc15eda0 2024-04-17T19:53:26.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.861+0000 7fbed2202640 1 -- 172.21.15.18:0/810711245 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbecc156d90 con 0x7fbecc15eda0 2024-04-17T19:53:26.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.861+0000 7fbed2202640 1 -- 172.21.15.18:0/810711245 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbecc157350 con 0x7fbecc15eda0 2024-04-17T19:53:26.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.865+0000 7fbeb1ffb640 1 -- 172.21.15.18:0/810711245 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbecc0698e0 con 0x7fbecc15eda0 2024-04-17T19:53:26.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.861+0000 7f08c37fe640 1 -- 172.21.15.18:0/4170373760 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08b80af070 con 0x7f08c40b4c00 2024-04-17T19:53:26.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.861+0000 7f08c37fe640 1 -- 172.21.15.18:0/4170373760 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b80aa990 con 0x7f08c40b4c00 2024-04-17T19:53:26.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.861+0000 7f08c9a4a640 1 -- 172.21.15.18:0/4170373760 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08c40b4c00 msgr2=0x7f08c415b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.861+0000 7f08c9a4a640 1 --2- 172.21.15.18:0/4170373760 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08c40b4c00 0x7f08c415b780 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f08c40743c0 tx=0x7f08b801cf50 comp rx=0 tx=0).stop 2024-04-17T19:53:26.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.861+0000 7f08c9a4a640 1 -- 172.21.15.18:0/4170373760 shutdown_connections 2024-04-17T19:53:26.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.861+0000 7f08c9a4a640 1 --2- 172.21.15.18:0/4170373760 >> v2:172.21.15.173:3300/0 conn(0x7f08c40cf950 0x7f08c40cfd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.861+0000 7f08c9a4a640 1 --2- 172.21.15.18:0/4170373760 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08c40b4c00 0x7f08c415b780 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.861+0000 7f08c9a4a640 1 -- 172.21.15.18:0/4170373760 >> 172.21.15.18:0/4170373760 conn(0x7f08c40d11c0 msgr2=0x7f08c40d15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:26.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.861+0000 7f08c9a4a640 1 -- 172.21.15.18:0/4170373760 shutdown_connections 2024-04-17T19:53:26.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.861+0000 7f08c9a4a640 1 -- 172.21.15.18:0/4170373760 wait complete. 2024-04-17T19:53:26.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.861+0000 7f08c9a4a640 1 Processor -- start 2024-04-17T19:53:26.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.861+0000 7f08c9a4a640 1 -- start start 2024-04-17T19:53:26.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.865+0000 7f08c9a4a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08c4070420 0x7f08c414a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.865+0000 7f08c9a4a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f08c40b4c00 0x7f08c4143a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.861+0000 7fc126ffd640 1 -- 172.21.15.18:0/3542018136 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc12c018020 con 0x7fc1380d1a90 2024-04-17T19:53:26.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.861+0000 7fc126ffd640 1 --2- 172.21.15.18:0/3542018136 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fc118068380 0x7fc11806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.861+0000 7fc126ffd640 1 -- 172.21.15.18:0/3542018136 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fc12c087380 con 0x7fc1380d1a90 2024-04-17T19:53:26.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.861+0000 7fc13659c640 1 --2- 172.21.15.18:0/3542018136 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fc118068380 0x7fc11806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.861+0000 7fc13659c640 1 --2- 172.21.15.18:0/3542018136 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fc118068380 0x7fc11806a890 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc1280ad000 tx=0x7fc1280a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.861+0000 7f6ee2ffd640 1 --2- 172.21.15.18:0/1846153874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6edc050db0 0x7f6edc0511c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6ed40099a0 tx=0x7f6ed401c5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2f45f0227453783 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.865+0000 7f08c9a4a640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f08c40cf950 0x7f08c4158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.865+0000 7f08c9a4a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f08c40d0420 con 0x7f08c4070420 2024-04-17T19:53:26.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.865+0000 7f08c9a4a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f08c40d02a0 con 0x7f08c40b4c00 2024-04-17T19:53:26.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.865+0000 7f08c9a4a640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f08c40d05a0 con 0x7f08c40cf950 2024-04-17T19:53:26.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.865+0000 7f08c8a48640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08c4070420 0x7f08c414a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.865+0000 7f08c8a48640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08c4070420 0x7f08c414a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49954/0 (socket says 172.21.15.18:49954) 2024-04-17T19:53:26.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.865+0000 7f08c8a48640 1 -- 172.21.15.18:0/3384629412 learned_addr learned my addr 172.21.15.18:0/3384629412 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:26.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.865+0000 7f08c3fff640 1 --2- 172.21.15.18:0/3384629412 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f08c40b4c00 0x7f08c4143a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.865+0000 7f08c9249640 1 --2- 172.21.15.18:0/3384629412 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f08c40cf950 0x7f08c4158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.865+0000 7f08c8a48640 1 -- 172.21.15.18:0/3384629412 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f08c40cf950 msgr2=0x7f08c4158200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.865+0000 7f08c8a48640 1 --2- 172.21.15.18:0/3384629412 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f08c40cf950 0x7f08c4158200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.865+0000 7f08c8a48640 1 -- 172.21.15.18:0/3384629412 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f08c40b4c00 msgr2=0x7f08c4143a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.865+0000 7f08c8a48640 1 --2- 172.21.15.18:0/3384629412 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f08c40b4c00 0x7f08c4143a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.865+0000 7f08c8a48640 1 -- 172.21.15.18:0/3384629412 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08c414a620 con 0x7f08c4070420 2024-04-17T19:53:26.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.865+0000 7f16a259c640 1 --2- 172.21.15.18:0/3115515640 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f16840683b0 0x7f168406a8c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f169c055c50 tx=0x7f16a4123000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.865+0000 7f08c8a48640 1 --2- 172.21.15.18:0/3384629412 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08c4070420 0x7f08c414a0e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f08b8000c10 tx=0x7f08b8019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.869+0000 7f1692ffd640 1 -- 172.21.15.18:0/3115515640 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f169401f020 con 0x7f169c033a50 2024-04-17T19:53:26.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.873+0000 7f6ee1ffb640 1 -- 172.21.15.18:0/1846153874 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed40b1070 con 0x7f6edc050db0 2024-04-17T19:53:26.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.873+0000 7fc126ffd640 1 -- 172.21.15.18:0/3542018136 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc12c01f020 con 0x7fc1380d1a90 2024-04-17T19:53:26.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.873+0000 7f08c17fa640 1 -- 172.21.15.18:0/3384629412 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b8003b30 con 0x7f08c4070420 2024-04-17T19:53:26.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.873+0000 7f08c9a4a640 1 -- 172.21.15.18:0/3384629412 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08c40a9670 con 0x7f08c4070420 2024-04-17T19:53:26.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.873+0000 7f08c9a4a640 1 -- 172.21.15.18:0/3384629412 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08c40a9c30 con 0x7f08c4070420 2024-04-17T19:53:26.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.873+0000 7f6ee1ffb640 1 -- 172.21.15.18:0/1846153874 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ed40ac420 con 0x7f6edc050db0 2024-04-17T19:53:26.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.873+0000 7f6ee3fff640 1 -- 172.21.15.18:0/1846153874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6edc050db0 msgr2=0x7f6edc0511c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.873+0000 7f6ee1ffb640 1 -- 172.21.15.18:0/1846153874 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed40b1070 con 0x7f6edc050db0 2024-04-17T19:53:26.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.873+0000 7fbeb3fff640 1 -- 172.21.15.18:0/810711245 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbec4017410 con 0x7fbecc15eda0 2024-04-17T19:53:26.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.873+0000 7fbeb3fff640 1 -- 172.21.15.18:0/810711245 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec4025060 con 0x7fbecc15eda0 2024-04-17T19:53:26.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.873+0000 7f08c9a4a640 1 -- 172.21.15.18:0/3384629412 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08c4076150 con 0x7f08c4070420 2024-04-17T19:53:26.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.873+0000 7f6ee3fff640 1 --2- 172.21.15.18:0/1846153874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6edc050db0 0x7f6edc0511c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6ed40099a0 tx=0x7f6ed401c5c0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.873+0000 7f6ee3fff640 1 -- 172.21.15.18:0/1846153874 shutdown_connections 2024-04-17T19:53:26.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.873+0000 7f6ee3fff640 1 --2- 172.21.15.18:0/1846153874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6edc050db0 0x7f6edc0511c0 secure :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6ed40099a0 tx=0x7f6ed401c5c0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.873+0000 7f6ee3fff640 1 -- 172.21.15.18:0/1846153874 >> 172.21.15.18:0/1846153874 conn(0x7f6edc055e10 msgr2=0x7f6edc056220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:26.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.873+0000 7f08c17fa640 1 -- 172.21.15.18:0/3384629412 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08b80af020 con 0x7f08c4070420 2024-04-17T19:53:26.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.873+0000 7f08c17fa640 1 -- 172.21.15.18:0/3384629412 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b80c2060 con 0x7f08c4070420 2024-04-17T19:53:26.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.873+0000 7f6ee3fff640 1 -- 172.21.15.18:0/1846153874 shutdown_connections 2024-04-17T19:53:26.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.873+0000 7fbeb3fff640 1 -- 172.21.15.18:0/810711245 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbec4017800 con 0x7fbecc15eda0 2024-04-17T19:53:26.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.877+0000 7fbeb3fff640 1 --2- 172.21.15.18:0/810711245 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fbeb80683b0 0x7fbeb806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.877+0000 7fbeb3fff640 1 -- 172.21.15.18:0/810711245 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fbec40551b0 con 0x7fbecc15eda0 2024-04-17T19:53:26.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.873+0000 7f6ee3fff640 1 -- 172.21.15.18:0/1846153874 wait complete. 2024-04-17T19:53:26.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.877+0000 7f08c17fa640 1 -- 172.21.15.18:0/3384629412 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f08b80b33f0 con 0x7f08c4070420 2024-04-17T19:53:26.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.877+0000 7f08c17fa640 1 --2- 172.21.15.18:0/3384629412 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f08a8068380 0x7f08a806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.877+0000 7f6ee3fff640 1 Processor -- start 2024-04-17T19:53:26.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.877+0000 7f6ee3fff640 1 -- start start 2024-04-17T19:53:26.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.881+0000 7fbecb7fe640 1 --2- 172.21.15.18:0/810711245 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fbeb80683b0 0x7fbeb806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.881+0000 7f08c3fff640 1 --2- 172.21.15.18:0/3384629412 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f08a8068380 0x7f08a806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.881+0000 7f08c3fff640 1 --2- 172.21.15.18:0/3384629412 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f08a8068380 0x7f08a806a890 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f08c40d1680 tx=0x7f08b0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.881+0000 7fbecb7fe640 1 --2- 172.21.15.18:0/810711245 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fbeb80683b0 0x7fbeb806a8c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbebc0ae000 tx=0x7fbebc0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.881+0000 7f6ee3fff640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6edc051700 0x7f6edc0d2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.881+0000 7f6ee3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6edc0e79f0 0x7f6edc0e5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.881+0000 7f6ee3fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6edc0440a0 0x7f6edc0444b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.881+0000 7f6ee3fff640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6edc009760 con 0x7f6edc0e79f0 2024-04-17T19:53:26.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.881+0000 7f6ee3fff640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6edc0075b0 con 0x7f6edc0440a0 2024-04-17T19:53:26.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.881+0000 7f6ee3fff640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f6edc0098e0 con 0x7f6edc051700 2024-04-17T19:53:26.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.881+0000 7f6ee27fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6edc0e79f0 0x7f6edc0e5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.881+0000 7f6ee27fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6edc0e79f0 0x7f6edc0e5e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49962/0 (socket says 172.21.15.18:49962) 2024-04-17T19:53:26.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.881+0000 7f6ee27fc640 1 -- 172.21.15.18:0/540622234 learned_addr learned my addr 172.21.15.18:0/540622234 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:26.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.881+0000 7f6ee2ffd640 1 --2- 172.21.15.18:0/540622234 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6edc051700 0x7f6edc0d2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.881+0000 7f6ee37fe640 1 --2- 172.21.15.18:0/540622234 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6edc0440a0 0x7f6edc0444b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.881+0000 7f6ee27fc640 1 -- 172.21.15.18:0/540622234 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6edc051700 msgr2=0x7f6edc0d2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.881+0000 7f6ee27fc640 1 --2- 172.21.15.18:0/540622234 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6edc051700 0x7f6edc0d2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.881+0000 7f6ee27fc640 1 -- 172.21.15.18:0/540622234 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6edc0440a0 msgr2=0x7f6edc0444b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:26.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.881+0000 7f6ee27fc640 1 --2- 172.21.15.18:0/540622234 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6edc0440a0 0x7f6edc0444b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:26.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.881+0000 7f6ee27fc640 1 -- 172.21.15.18:0/540622234 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6edc056760 con 0x7f6edc0e79f0 2024-04-17T19:53:26.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.881+0000 7f6ee27fc640 1 --2- 172.21.15.18:0/540622234 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6edc0e79f0 0x7f6edc0e5e50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6ed800c7b0 tx=0x7f6ed800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.885+0000 7f08c17fa640 1 -- 172.21.15.18:0/3384629412 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f08b80eeda0 con 0x7f08c4070420 2024-04-17T19:53:26.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.885+0000 7fbeb3fff640 1 -- 172.21.15.18:0/810711245 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbec4057110 con 0x7fbecc15eda0 2024-04-17T19:53:26.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.885+0000 7f6ecb7fe640 1 -- 172.21.15.18:0/540622234 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed8017070 con 0x7f6edc0e79f0 2024-04-17T19:53:26.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.885+0000 7f6ee3fff640 1 -- 172.21.15.18:0/540622234 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6edc0449f0 con 0x7f6edc0e79f0 2024-04-17T19:53:26.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.885+0000 7f6ee3fff640 1 -- 172.21.15.18:0/540622234 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6edc04e970 con 0x7f6edc0e79f0 2024-04-17T19:53:26.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.885+0000 7f6ec97fa640 1 -- 172.21.15.18:0/540622234 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ec40052a0 con 0x7f6edc0e79f0 2024-04-17T19:53:26.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.897+0000 7f6ecb7fe640 1 -- 172.21.15.18:0/540622234 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ed800a640 con 0x7f6edc0e79f0 2024-04-17T19:53:26.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.897+0000 7f08c17fa640 1 -- 172.21.15.18:0/3384629412 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f08b8016110 con 0x7f08c4070420 2024-04-17T19:53:26.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.901+0000 7f6ecb7fe640 1 -- 172.21.15.18:0/540622234 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed8021060 con 0x7f6edc0e79f0 2024-04-17T19:53:26.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.901+0000 7f6ecb7fe640 1 -- 172.21.15.18:0/540622234 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6ed801a070 con 0x7f6edc0e79f0 2024-04-17T19:53:26.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.901+0000 7f6ecb7fe640 1 --2- 172.21.15.18:0/540622234 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f6ed00683b0 0x7f6ed006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:26.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.901+0000 7f6ecb7fe640 1 -- 172.21.15.18:0/540622234 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f6ed8086700 con 0x7f6edc0e79f0 2024-04-17T19:53:26.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.901+0000 7f6ee2ffd640 1 --2- 172.21.15.18:0/540622234 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f6ed00683b0 0x7f6ed006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:26.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.901+0000 7f6ee2ffd640 1 --2- 172.21.15.18:0/540622234 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f6ed00683b0 0x7f6ed006a8c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6ed40ae000 tx=0x7f6ed40a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:26.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:26.905+0000 7f6ecb7fe640 1 -- 172.21.15.18:0/540622234 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6edc0449f0 con 0x7f6edc0e79f0 2024-04-17T19:53:27.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.165+0000 7f16a8814640 1 -- 172.21.15.18:0/3115515640 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f169c005550 con 0x7f169c033a50 2024-04-17T19:53:27.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.165+0000 7f1692ffd640 1 -- 172.21.15.18:0/3115515640 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f169400d040 con 0x7f169c033a50 2024-04-17T19:53:27.165 INFO:teuthology.orchestra.run.smithi018.stdout:64424509448 2024-04-17T19:53:27.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.173+0000 7f1690ff9640 1 -- 172.21.15.18:0/3115515640 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f16840683b0 msgr2=0x7f168406a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:27.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.173+0000 7f1690ff9640 1 --2- 172.21.15.18:0/3115515640 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f16840683b0 0x7f168406a8c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f169c055c50 tx=0x7f16a4123000 comp rx=0 tx=0).stop 2024-04-17T19:53:27.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.173+0000 7f1690ff9640 1 -- 172.21.15.18:0/3115515640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f169c033a50 msgr2=0x7f169c046670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:27.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.173+0000 7f1690ff9640 1 --2- 172.21.15.18:0/3115515640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f169c033a50 0x7f169c046670 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f169400b440 tx=0x7f169400b900 comp rx=0 tx=0).stop 2024-04-17T19:53:27.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.173+0000 7f1690ff9640 1 -- 172.21.15.18:0/3115515640 shutdown_connections 2024-04-17T19:53:27.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.173+0000 7f1690ff9640 1 --2- 172.21.15.18:0/3115515640 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f16840683b0 0x7f168406a8c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:27.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.173+0000 7f1690ff9640 1 --2- 172.21.15.18:0/3115515640 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f169c0e4960 0x7f169c046bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:27.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.173+0000 7f1690ff9640 1 --2- 172.21.15.18:0/3115515640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f169c033a50 0x7f169c046670 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:27.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.173+0000 7f1690ff9640 1 --2- 172.21.15.18:0/3115515640 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f169c0067e0 0x7f169c0e4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:27.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.173+0000 7f1690ff9640 1 -- 172.21.15.18:0/3115515640 >> 172.21.15.18:0/3115515640 conn(0x7f169c054cd0 msgr2=0x7f169c035350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:27.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.173+0000 7f1690ff9640 1 -- 172.21.15.18:0/3115515640 shutdown_connections 2024-04-17T19:53:27.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.173+0000 7f1690ff9640 1 -- 172.21.15.18:0/3115515640 wait complete. 2024-04-17T19:53:27.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.173+0000 7f08521d4640 1 -- 172.21.15.18:0/2669637640 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f082c005860 con 0x7f084c162680 2024-04-17T19:53:27.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.177+0000 7f0833fff640 1 -- 172.21.15.18:0/2669637640 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f083c05a7a0 con 0x7f084c162680 2024-04-17T19:53:27.175 INFO:teuthology.orchestra.run.smithi018.stdout:64424509448 2024-04-17T19:53:27.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.181+0000 7f0831ffb640 1 -- 172.21.15.18:0/2669637640 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0838068380 msgr2=0x7f083806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:27.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.181+0000 7f0831ffb640 1 --2- 172.21.15.18:0/2669637640 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0838068380 0x7f083806a890 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f084400e190 tx=0x7f084400b040 comp rx=0 tx=0).stop 2024-04-17T19:53:27.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.181+0000 7f0831ffb640 1 -- 172.21.15.18:0/2669637640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f084c162680 msgr2=0x7f084c0cea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:27.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.181+0000 7f0831ffb640 1 --2- 172.21.15.18:0/2669637640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f084c162680 0x7f084c0cea80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f083c00c3c0 tx=0x7f083c00c880 comp rx=0 tx=0).stop 2024-04-17T19:53:27.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.181+0000 7f0831ffb640 1 -- 172.21.15.18:0/2669637640 shutdown_connections 2024-04-17T19:53:27.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.181+0000 7f0831ffb640 1 --2- 172.21.15.18:0/2669637640 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0838068380 0x7f083806a890 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:27.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.181+0000 7f0831ffb640 1 --2- 172.21.15.18:0/2669637640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f084c162680 0x7f084c0cea80 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:27.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.181+0000 7f0831ffb640 1 --2- 172.21.15.18:0/2669637640 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f084c163710 0x7f084c164080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:27.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.181+0000 7f0831ffb640 1 --2- 172.21.15.18:0/2669637640 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f084c0b15e0 0x7f084c2011c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:27.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.181+0000 7f0831ffb640 1 -- 172.21.15.18:0/2669637640 >> 172.21.15.18:0/2669637640 conn(0x7f084c09aa70 msgr2=0x7f084c0c4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:27.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.181+0000 7f0831ffb640 1 -- 172.21.15.18:0/2669637640 shutdown_connections 2024-04-17T19:53:27.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.181+0000 7f0831ffb640 1 -- 172.21.15.18:0/2669637640 wait complete. 2024-04-17T19:53:27.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.185+0000 7f59078d4640 1 -- 172.21.15.18:0/2851973969 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f58e0005860 con 0x7f5900151a20 2024-04-17T19:53:27.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.185+0000 7f58f5ffb640 1 -- 172.21.15.18:0/2851973969 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f58f8010040 con 0x7f5900151a20 2024-04-17T19:53:27.180 INFO:teuthology.orchestra.run.smithi018.stdout:60129542153 2024-04-17T19:53:27.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.189+0000 7f58eb7fe640 1 -- 172.21.15.18:0/2851973969 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f58e4068380 msgr2=0x7f58e406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:27.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.189+0000 7f58eb7fe640 1 --2- 172.21.15.18:0/2851973969 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f58e4068380 0x7f58e406a890 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f58fc000f70 tx=0x7f58fc0079c0 comp rx=0 tx=0).stop 2024-04-17T19:53:27.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.189+0000 7f58eb7fe640 1 -- 172.21.15.18:0/2851973969 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5900151a20 msgr2=0x7f59001593d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:27.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.189+0000 7f58eb7fe640 1 --2- 172.21.15.18:0/2851973969 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5900151a20 0x7f59001593d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f58f800eb70 tx=0x7f58f800c490 comp rx=0 tx=0).stop 2024-04-17T19:53:27.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.189+0000 7f58eb7fe640 1 -- 172.21.15.18:0/2851973969 shutdown_connections 2024-04-17T19:53:27.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.189+0000 7f58eb7fe640 1 --2- 172.21.15.18:0/2851973969 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f58e4068380 0x7f58e406a890 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:27.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.189+0000 7f58eb7fe640 1 --2- 172.21.15.18:0/2851973969 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f590015eda0 0x7f590015bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:27.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.189+0000 7f58eb7fe640 1 --2- 172.21.15.18:0/2851973969 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5900151a20 0x7f59001593d0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:27.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.189+0000 7f58eb7fe640 1 --2- 172.21.15.18:0/2851973969 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f59000cf420 0x7f590014c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:27.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.189+0000 7f58eb7fe640 1 -- 172.21.15.18:0/2851973969 >> 172.21.15.18:0/2851973969 conn(0x7f5900072d70 msgr2=0x7f59000afc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:27.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.189+0000 7f58eb7fe640 1 -- 172.21.15.18:0/2851973969 shutdown_connections 2024-04-17T19:53:27.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.189+0000 7f58eb7fe640 1 -- 172.21.15.18:0/2851973969 wait complete. 2024-04-17T19:53:27.199 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.2 2024-04-17T19:53:27.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.201+0000 7fb913635640 1 -- 172.21.15.18:0/2661018469 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fb90400da30 con 0x7fb9040e4eb0 2024-04-17T19:53:27.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.201+0000 7fc13759e640 1 -- 172.21.15.18:0/3542018136 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fc1380d0e60 con 0x7fc1380d1a90 2024-04-17T19:53:27.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.205+0000 7fb901ffb640 1 -- 172.21.15.18:0/2661018469 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb90c0d13d0 con 0x7fb9040e4eb0 2024-04-17T19:53:27.200 INFO:teuthology.orchestra.run.smithi018.stdout:64424509449 2024-04-17T19:53:27.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.201+0000 7fc126ffd640 1 -- 172.21.15.18:0/3542018136 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc12c00f2e0 con 0x7fc1380d1a90 2024-04-17T19:53:27.202 INFO:teuthology.orchestra.run.smithi018.stdout:64424509448 2024-04-17T19:53:27.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.205+0000 7fc124ff9640 1 -- 172.21.15.18:0/3542018136 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fc118068380 msgr2=0x7fc11806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:27.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.205+0000 7fc124ff9640 1 --2- 172.21.15.18:0/3542018136 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fc118068380 0x7fc11806a890 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc1280ad000 tx=0x7fc1280a6000 comp rx=0 tx=0).stop 2024-04-17T19:53:27.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.205+0000 7fc124ff9640 1 -- 172.21.15.18:0/3542018136 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1380d1a90 msgr2=0x7fc138070cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:27.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.205+0000 7fc124ff9640 1 --2- 172.21.15.18:0/3542018136 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1380d1a90 0x7fc138070cc0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc12c00b410 tx=0x7fc12c00b8d0 comp rx=0 tx=0).stop 2024-04-17T19:53:27.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.209+0000 7fc124ff9640 1 -- 172.21.15.18:0/3542018136 shutdown_connections 2024-04-17T19:53:27.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.209+0000 7fc124ff9640 1 --2- 172.21.15.18:0/3542018136 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fc118068380 0x7fc11806a890 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:27.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.209+0000 7fc124ff9640 1 --2- 172.21.15.18:0/3542018136 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc138160bd0 0x7fc138071200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:27.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.209+0000 7fc124ff9640 1 --2- 172.21.15.18:0/3542018136 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1380d1a90 0x7fc138070cc0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:27.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.209+0000 7fc124ff9640 1 --2- 172.21.15.18:0/3542018136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1380b3390 0x7fc138200340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:27.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.209+0000 7fc124ff9640 1 -- 172.21.15.18:0/3542018136 >> 172.21.15.18:0/3542018136 conn(0x7fc1380cf550 msgr2=0x7fc1380cddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:27.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.209+0000 7fc124ff9640 1 -- 172.21.15.18:0/3542018136 shutdown_connections 2024-04-17T19:53:27.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.209+0000 7fc124ff9640 1 -- 172.21.15.18:0/3542018136 wait complete. 2024-04-17T19:53:27.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.209+0000 7fb913635640 1 -- 172.21.15.18:0/2661018469 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fb8f00683d0 msgr2=0x7fb8f006a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:27.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.209+0000 7fb913635640 1 --2- 172.21.15.18:0/2661018469 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fb8f00683d0 0x7fb8f006a8e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb8f80057f0 tx=0x7fb9080012e0 comp rx=0 tx=0).stop 2024-04-17T19:53:27.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.209+0000 7fb913635640 1 -- 172.21.15.18:0/2661018469 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9040e4eb0 msgr2=0x7fb904189a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:27.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.209+0000 7fb913635640 1 --2- 172.21.15.18:0/2661018469 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9040e4eb0 0x7fb904189a90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb90c051840 tx=0x7fb90c075b70 comp rx=0 tx=0).stop 2024-04-17T19:53:27.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.209+0000 7fb913635640 1 -- 172.21.15.18:0/2661018469 shutdown_connections 2024-04-17T19:53:27.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.209+0000 7fb913635640 1 --2- 172.21.15.18:0/2661018469 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fb8f00683d0 0x7fb8f006a8e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:27.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.209+0000 7fb913635640 1 --2- 172.21.15.18:0/2661018469 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9040e4eb0 0x7fb904189a90 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:27.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.209+0000 7fb913635640 1 --2- 172.21.15.18:0/2661018469 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb904052bd0 0x7fb9040d58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:27.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.209+0000 7fb913635640 1 --2- 172.21.15.18:0/2661018469 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8f8003b50 0x7fb90418c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:27.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.209+0000 7fb913635640 1 -- 172.21.15.18:0/2661018469 >> 172.21.15.18:0/2661018469 conn(0x7fb90403ac60 msgr2=0x7fb90403b940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:27.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.209+0000 7fb913635640 1 -- 172.21.15.18:0/2661018469 shutdown_connections 2024-04-17T19:53:27.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.209+0000 7fb913635640 1 -- 172.21.15.18:0/2661018469 wait complete. 2024-04-17T19:53:27.209 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.5 2024-04-17T19:53:27.210 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.6 2024-04-17T19:53:27.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.213+0000 7fbeb1ffb640 1 -- 172.21.15.18:0/810711245 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fbecc068210 con 0x7fbecc15eda0 2024-04-17T19:53:27.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.213+0000 7fbeb3fff640 1 -- 172.21.15.18:0/810711245 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbec405b410 con 0x7fbecc15eda0 2024-04-17T19:53:27.211 INFO:teuthology.orchestra.run.smithi018.stdout:64424509448 2024-04-17T19:53:27.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.217+0000 7fbeb1ffb640 1 -- 172.21.15.18:0/810711245 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fbeb80683b0 msgr2=0x7fbeb806a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:27.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.217+0000 7fbeb1ffb640 1 --2- 172.21.15.18:0/810711245 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fbeb80683b0 0x7fbeb806a8c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbebc0ae000 tx=0x7fbebc0a7000 comp rx=0 tx=0).stop 2024-04-17T19:53:27.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.217+0000 7fbeb1ffb640 1 -- 172.21.15.18:0/810711245 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbecc15eda0 msgr2=0x7fbecc152cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:27.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.217+0000 7fbeb1ffb640 1 --2- 172.21.15.18:0/810711245 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbecc15eda0 0x7fbecc152cc0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fbec4009dd0 tx=0x7fbec4008420 comp rx=0 tx=0).stop 2024-04-17T19:53:27.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.217+0000 7fbeb1ffb640 1 -- 172.21.15.18:0/810711245 shutdown_connections 2024-04-17T19:53:27.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.217+0000 7fbeb1ffb640 1 --2- 172.21.15.18:0/810711245 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fbeb80683b0 0x7fbeb806a8c0 secure :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbebc0ae000 tx=0x7fbebc0a7000 comp rx=0 tx=0).stop 2024-04-17T19:53:27.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.217+0000 7fbeb1ffb640 1 --2- 172.21.15.18:0/810711245 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbecc15eda0 0x7fbecc152cc0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:27.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.217+0000 7fbeb1ffb640 1 --2- 172.21.15.18:0/810711245 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbecc151a20 0x7fbecc152780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:27.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.217+0000 7fbeb1ffb640 1 --2- 172.21.15.18:0/810711245 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbecc0cf420 0x7fbecc154dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:27.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.217+0000 7fbeb1ffb640 1 -- 172.21.15.18:0/810711245 >> 172.21.15.18:0/810711245 conn(0x7fbecc072d70 msgr2=0x7fbecc166610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:27.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.217+0000 7fbeb1ffb640 1 -- 172.21.15.18:0/810711245 shutdown_connections 2024-04-17T19:53:27.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.217+0000 7fbeb1ffb640 1 -- 172.21.15.18:0/810711245 wait complete. 2024-04-17T19:53:27.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.229+0000 7f08c9a4a640 1 -- 172.21.15.18:0/3384629412 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f08c415a1a0 con 0x7f08c4070420 2024-04-17T19:53:27.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.229+0000 7f08c17fa640 1 -- 172.21.15.18:0/3384629412 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f08b80f0d00 con 0x7f08c4070420 2024-04-17T19:53:27.227 INFO:teuthology.orchestra.run.smithi018.stdout:64424509447 2024-04-17T19:53:27.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.229+0000 7f6ec97fa640 1 -- 172.21.15.18:0/540622234 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f6ec4005860 con 0x7f6edc0e79f0 2024-04-17T19:53:27.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.233+0000 7f6ecb7fe640 1 -- 172.21.15.18:0/540622234 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6ed80563a0 con 0x7f6edc0e79f0 2024-04-17T19:53:27.228 INFO:teuthology.orchestra.run.smithi018.stdout:64424509448 2024-04-17T19:53:27.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.233+0000 7f08c9a4a640 1 -- 172.21.15.18:0/3384629412 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f08a8068380 msgr2=0x7f08a806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:27.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.233+0000 7f08c9a4a640 1 --2- 172.21.15.18:0/3384629412 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f08a8068380 0x7f08a806a890 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f08c40d1680 tx=0x7f08b0009040 comp rx=0 tx=0).stop 2024-04-17T19:53:27.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.233+0000 7f08c9a4a640 1 -- 172.21.15.18:0/3384629412 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08c4070420 msgr2=0x7f08c414a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:27.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.233+0000 7f08c9a4a640 1 --2- 172.21.15.18:0/3384629412 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08c4070420 0x7f08c414a0e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f08b8000c10 tx=0x7f08b8019290 comp rx=0 tx=0).stop 2024-04-17T19:53:27.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.233+0000 7f08c9a4a640 1 -- 172.21.15.18:0/3384629412 shutdown_connections 2024-04-17T19:53:27.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.233+0000 7f08c9a4a640 1 --2- 172.21.15.18:0/3384629412 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f08a8068380 0x7f08a806a890 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:27.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.233+0000 7f08c9a4a640 1 --2- 172.21.15.18:0/3384629412 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f08c40cf950 0x7f08c4158200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:27.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.233+0000 7f08c9a4a640 1 --2- 172.21.15.18:0/3384629412 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f08c40b4c00 0x7f08c4143a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:27.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.233+0000 7f08c9a4a640 1 --2- 172.21.15.18:0/3384629412 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08c4070420 0x7f08c414a0e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:27.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.233+0000 7f08c9a4a640 1 -- 172.21.15.18:0/3384629412 >> 172.21.15.18:0/3384629412 conn(0x7f08c40d11c0 msgr2=0x7f08c40b3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:27.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.233+0000 7f08c9a4a640 1 -- 172.21.15.18:0/3384629412 shutdown_connections 2024-04-17T19:53:27.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.233+0000 7f08c9a4a640 1 -- 172.21.15.18:0/3384629412 wait complete. 2024-04-17T19:53:27.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.233+0000 7f6ec97fa640 1 -- 172.21.15.18:0/540622234 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f6ed00683b0 msgr2=0x7f6ed006a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:27.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.233+0000 7f6ec97fa640 1 --2- 172.21.15.18:0/540622234 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f6ed00683b0 0x7f6ed006a8c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6ed40ae000 tx=0x7f6ed40a7000 comp rx=0 tx=0).stop 2024-04-17T19:53:27.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.233+0000 7f6ec97fa640 1 -- 172.21.15.18:0/540622234 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6edc0e79f0 msgr2=0x7f6edc0e5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:27.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.233+0000 7f6ec97fa640 1 --2- 172.21.15.18:0/540622234 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6edc0e79f0 0x7f6edc0e5e50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6ed800c7b0 tx=0x7f6ed800cc70 comp rx=0 tx=0).stop 2024-04-17T19:53:27.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.233+0000 7f6ec97fa640 1 -- 172.21.15.18:0/540622234 shutdown_connections 2024-04-17T19:53:27.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.233+0000 7f6ec97fa640 1 --2- 172.21.15.18:0/540622234 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f6ed00683b0 0x7f6ed006a8c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:27.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.233+0000 7f6ec97fa640 1 --2- 172.21.15.18:0/540622234 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6edc0440a0 0x7f6edc0444b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:27.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.233+0000 7f6ec97fa640 1 --2- 172.21.15.18:0/540622234 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6edc0e79f0 0x7f6edc0e5e50 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:27.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.233+0000 7f6ec97fa640 1 --2- 172.21.15.18:0/540622234 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6edc051700 0x7f6edc0d2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:27.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.233+0000 7f6ec97fa640 1 -- 172.21.15.18:0/540622234 >> 172.21.15.18:0/540622234 conn(0x7f6edc055e10 msgr2=0x7f6edc04bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:27.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.233+0000 7f6ec97fa640 1 -- 172.21.15.18:0/540622234 shutdown_connections 2024-04-17T19:53:27.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:27.237+0000 7f6ec97fa640 1 -- 172.21.15.18:0/540622234 wait complete. 2024-04-17T19:53:27.233 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.4 2024-04-17T19:53:27.237 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.7 2024-04-17T19:53:27.247 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.3 2024-04-17T19:53:27.252 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.1 2024-04-17T19:53:27.256 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.0 2024-04-17T19:53:28.200 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-17T19:53:28.210 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-17T19:53:28.211 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-17T19:53:28.234 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-17T19:53:28.238 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-17T19:53:28.248 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-17T19:53:28.253 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-17T19:53:28.257 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-17T19:53:28.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.417+0000 7f58cb24a640 1 Processor -- start 2024-04-17T19:53:28.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.417+0000 7f58cb24a640 1 -- start start 2024-04-17T19:53:28.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.421+0000 7f58cb24a640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58c415eda0 0x7f58c415f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:28.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.421+0000 7f58cb24a640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f58c4151a20 0x7f58c4151e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:28.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.421+0000 7f58cb24a640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58c415f6f0 con 0x7f58c40cf420 2024-04-17T19:53:28.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.421+0000 7f58cb24a640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f58c40cf830 con 0x7f58c4151a20 2024-04-17T19:53:28.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.421+0000 7f58cb24a640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f58c40cfa50 con 0x7f58c415eda0 2024-04-17T19:53:28.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.421+0000 7f58c8fe6640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f58c40cf420 0x7f58c40afe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:51226/0 (socket says 172.21.15.18:51226) 2024-04-17T19:53:28.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.421+0000 7f58c3fff640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58c415eda0 0x7f58c415f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:28.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.421+0000 7f58c8fe6640 1 -- 172.21.15.18:0/3954220271 learned_addr learned my addr 172.21.15.18:0/3954220271 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:28.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.421+0000 7f58c97e7640 1 --2- 172.21.15.18:0/3954220271 >> v2:172.21.15.173:3300/0 conn(0x7f58c4151a20 0x7f58c4151e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:28.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.421+0000 7f58c3fff640 1 -- 172.21.15.18:0/3954220271 >> v2:172.21.15.173:3300/0 conn(0x7f58c4151a20 msgr2=0x7f58c4151e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:28.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.421+0000 7f58c3fff640 1 --2- 172.21.15.18:0/3954220271 >> v2:172.21.15.173:3300/0 conn(0x7f58c4151a20 0x7f58c4151e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.421+0000 7f58c3fff640 1 -- 172.21.15.18:0/3954220271 >> v1:172.21.15.18:6789/0 conn(0x7f58c40cf420 legacy=0x7f58c40afe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:28.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.421+0000 7f58c3fff640 1 -- 172.21.15.18:0/3954220271 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58c40cfd30 con 0x7f58c415eda0 2024-04-17T19:53:28.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.425+0000 7f58c3fff640 1 --2- 172.21.15.18:0/3954220271 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58c415eda0 0x7f58c415f1b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f58bc009990 tx=0x7f58bc01ed90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7315f2217f69e84 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:28.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.425+0000 7f58c37fe640 1 -- 172.21.15.18:0/3954220271 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58bc0b4070 con 0x7f58c415eda0 2024-04-17T19:53:28.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.425+0000 7f58c37fe640 1 -- 172.21.15.18:0/3954220271 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58bc0a7c60 con 0x7f58c415eda0 2024-04-17T19:53:28.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.429+0000 7f58cb24a640 1 -- 172.21.15.18:0/3954220271 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58c415eda0 msgr2=0x7f58c415f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:28.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.429+0000 7f58cb24a640 1 --2- 172.21.15.18:0/3954220271 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58c415eda0 0x7f58c415f1b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f58bc009990 tx=0x7f58bc01ed90 comp rx=0 tx=0).stop 2024-04-17T19:53:28.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.429+0000 7f58cb24a640 1 -- 172.21.15.18:0/3954220271 shutdown_connections 2024-04-17T19:53:28.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.429+0000 7f58cb24a640 1 --2- 172.21.15.18:0/3954220271 >> v2:172.21.15.173:3300/0 conn(0x7f58c4151a20 0x7f58c4151e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.429+0000 7f58cb24a640 1 --2- 172.21.15.18:0/3954220271 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58c415eda0 0x7f58c415f1b0 secure :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f58bc009990 tx=0x7f58bc01ed90 comp rx=0 tx=0).stop 2024-04-17T19:53:28.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.429+0000 7f58cb24a640 1 -- 172.21.15.18:0/3954220271 >> 172.21.15.18:0/3954220271 conn(0x7f58c4072d70 msgr2=0x7f58c40731b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:28.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.429+0000 7f58cb24a640 1 -- 172.21.15.18:0/3954220271 shutdown_connections 2024-04-17T19:53:28.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.429+0000 7f58cb24a640 1 -- 172.21.15.18:0/3954220271 wait complete. 2024-04-17T19:53:28.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.433+0000 7f58cb24a640 1 Processor -- start 2024-04-17T19:53:28.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.433+0000 7f58cb24a640 1 -- start start 2024-04-17T19:53:28.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.433+0000 7f58cb24a640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58c40cf420 0x7f58c414c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:28.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.433+0000 7f58cb24a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58c4151a20 0x7f58c4208ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:28.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.433+0000 7f58cb24a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58c4209410 0x7f58c415bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:28.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.437+0000 7f58cb24a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f58c406ff20 con 0x7f58c4209410 2024-04-17T19:53:28.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.437+0000 7f58cb24a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f58c406fda0 con 0x7f58c4151a20 2024-04-17T19:53:28.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.437+0000 7f58cb24a640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f58c40700a0 con 0x7f58c40cf420 2024-04-17T19:53:28.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.437+0000 7f58c3fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58c4151a20 0x7f58c4208ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:28.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.437+0000 7f58c3fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58c4151a20 0x7f58c4208ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.18:44088/0 (socket says 172.21.15.18:44088) 2024-04-17T19:53:28.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.437+0000 7f58c3fff640 1 -- 172.21.15.18:0/3657735223 learned_addr learned my addr 172.21.15.18:0/3657735223 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:28.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.437+0000 7f58c97e7640 1 --2- 172.21.15.18:0/3657735223 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58c4209410 0x7f58c415bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:28.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.437+0000 7f58c8fe6640 1 --2- 172.21.15.18:0/3657735223 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58c40cf420 0x7f58c414c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:28.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.437+0000 7f58c97e7640 1 -- 172.21.15.18:0/3657735223 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58c40cf420 msgr2=0x7f58c414c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:28.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.437+0000 7f58c97e7640 1 --2- 172.21.15.18:0/3657735223 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58c40cf420 0x7f58c414c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.437+0000 7f58c97e7640 1 -- 172.21.15.18:0/3657735223 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58c4151a20 msgr2=0x7f58c4208ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:28.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.437+0000 7f58c97e7640 1 --2- 172.21.15.18:0/3657735223 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58c4151a20 0x7f58c4208ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.437+0000 7f58c97e7640 1 -- 172.21.15.18:0/3657735223 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58c4156470 con 0x7f58c4209410 2024-04-17T19:53:28.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.437+0000 7f58c97e7640 1 --2- 172.21.15.18:0/3657735223 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58c4209410 0x7f58c415bdd0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f58b400f6a0 tx=0x7f58b400fb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:28.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.437+0000 7f58c17fa640 1 -- 172.21.15.18:0/3657735223 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b4017070 con 0x7f58c4209410 2024-04-17T19:53:28.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.437+0000 7f58cb24a640 1 -- 172.21.15.18:0/3657735223 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58c4156750 con 0x7f58c4209410 2024-04-17T19:53:28.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.437+0000 7f58cb24a640 1 -- 172.21.15.18:0/3657735223 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58c4156d10 con 0x7f58c4209410 2024-04-17T19:53:28.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.437+0000 7f58c17fa640 1 -- 172.21.15.18:0/3657735223 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58b400d9e0 con 0x7f58c4209410 2024-04-17T19:53:28.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.437+0000 7f58c17fa640 1 -- 172.21.15.18:0/3657735223 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b400ddd0 con 0x7f58c4209410 2024-04-17T19:53:28.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.437+0000 7f58cb24a640 1 -- 172.21.15.18:0/3657735223 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58c40698e0 con 0x7f58c4209410 2024-04-17T19:53:28.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.441+0000 7f58c17fa640 1 -- 172.21.15.18:0/3657735223 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f58b401a070 con 0x7f58c4209410 2024-04-17T19:53:28.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.441+0000 7f58c17fa640 1 --2- 172.21.15.18:0/3657735223 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f58b0068450 0x7f58b006a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:28.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.441+0000 7f58c17fa640 1 -- 172.21.15.18:0/3657735223 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f58b4086e50 con 0x7f58c4209410 2024-04-17T19:53:28.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.441+0000 7f58c8fe6640 1 --2- 172.21.15.18:0/3657735223 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f58b0068450 0x7f58b006a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:28.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.441+0000 7f58c8fe6640 1 --2- 172.21.15.18:0/3657735223 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f58b0068450 0x7f58b006a960 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f58b8000f70 tx=0x7f58b8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:28.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.449+0000 7f58c17fa640 1 -- 172.21.15.18:0/3657735223 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f58b4056a60 con 0x7f58c4209410 2024-04-17T19:53:28.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.465+0000 7f87b7f93640 1 Processor -- start 2024-04-17T19:53:28.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.465+0000 7f87b7f93640 1 -- start start 2024-04-17T19:53:28.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.465+0000 7f87b7f93640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f87b0170410 0x7f87b00cf030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:28.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.465+0000 7f87b7f93640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87b00b43d0 con 0x7f87b00cf570 2024-04-17T19:53:28.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.465+0000 7f87b7f93640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87b00b46b0 con 0x7f87b016f8f0 2024-04-17T19:53:28.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.465+0000 7f87b7f93640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f87b00afe20 con 0x7f87b0170410 2024-04-17T19:53:28.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.469+0000 7f87b6530640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f87b00cf570 0x7f87b00cf980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:51232/0 (socket says 172.21.15.18:51232) 2024-04-17T19:53:28.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.469+0000 7f87b6530640 1 -- 172.21.15.18:0/1906659464 learned_addr learned my addr 172.21.15.18:0/1906659464 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:28.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.469+0000 7f87b552e640 1 --2- 172.21.15.18:0/1906659464 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f87b0170410 0x7f87b00cf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:28.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.469+0000 7f87b4d2d640 1 -- 172.21.15.18:0/1906659464 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2418672213 0 0) 0x7f87b00b43d0 con 0x7f87b00cf570 2024-04-17T19:53:28.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.469+0000 7f87b4d2d640 1 -- 172.21.15.18:0/1906659464 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f879c003510 con 0x7f87b00cf570 2024-04-17T19:53:28.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.469+0000 7f87b4d2d640 1 -- 172.21.15.18:0/1906659464 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1518787339 0 0) 0x7f87b00b46b0 con 0x7f87b016f8f0 2024-04-17T19:53:28.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.469+0000 7f87b4d2d640 1 -- 172.21.15.18:0/1906659464 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f87b00b43d0 con 0x7f87b016f8f0 2024-04-17T19:53:28.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.469+0000 7f87b4d2d640 1 -- 172.21.15.18:0/1906659464 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1992302977 0 0) 0x7f879c003510 con 0x7f87b00cf570 2024-04-17T19:53:28.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.469+0000 7f87b4d2d640 1 -- 172.21.15.18:0/1906659464 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f87b0170410 msgr2=0x7f87b00cf030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:28.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.469+0000 7f87b4d2d640 1 --2- 172.21.15.18:0/1906659464 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f87b0170410 0x7f87b00cf030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.469+0000 7f87b4d2d640 1 -- 172.21.15.18:0/1906659464 >> v1:172.21.15.173:6789/0 conn(0x7f87b016f8f0 legacy=0x7f87b016fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:28.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.469+0000 7f87b4d2d640 1 -- 172.21.15.18:0/1906659464 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87b00b4990 con 0x7f87b00cf570 2024-04-17T19:53:28.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.469+0000 7f87b4d2d640 1 -- 172.21.15.18:0/1906659464 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3208559991 0 0) 0x7f87a8001a00 con 0x7f87b00cf570 2024-04-17T19:53:28.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.469+0000 7f87b4d2d640 1 -- 172.21.15.18:0/1906659464 >> v1:172.21.15.18:6789/0 conn(0x7f87b00cf570 legacy=0x7f87b00cf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:28.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.469+0000 7f87b4d2d640 1 --2- 172.21.15.18:0/1906659464 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f879c003ce0 0x7f879c0040f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:28.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.469+0000 7f87b4d2d640 1 --2- 172.21.15.18:0/1906659464 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f879c0046f0 0x7f879c008e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:28.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.469+0000 7f87b4d2d640 1 --2- 172.21.15.18:0/1906659464 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f879c009350 0x7f879c00b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:28.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.469+0000 7f87b4d2d640 1 -- 172.21.15.18:0/1906659464 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f87b00afe20 con 0x7f879c009350 2024-04-17T19:53:28.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.469+0000 7f87b4d2d640 1 -- 172.21.15.18:0/1906659464 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f879c00c0a0 con 0x7f879c003ce0 2024-04-17T19:53:28.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.469+0000 7f87b4d2d640 1 -- 172.21.15.18:0/1906659464 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f879c00c2a0 con 0x7f879c0046f0 2024-04-17T19:53:28.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.469+0000 7f87b5d2f640 1 --2- 172.21.15.18:0/1906659464 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f879c003ce0 0x7f879c0040f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:28.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.469+0000 7f87b552e640 1 --2- 172.21.15.18:0/1906659464 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f879c0046f0 0x7f879c008e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:28.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.469+0000 7f87b6530640 1 --2- 172.21.15.18:0/1906659464 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f879c009350 0x7f879c00b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:28.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.469+0000 7f87b5d2f640 1 -- 172.21.15.18:0/1906659464 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f879c0046f0 msgr2=0x7f879c008e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:28.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.469+0000 7f87b5d2f640 1 --2- 172.21.15.18:0/1906659464 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f879c0046f0 0x7f879c008e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.469+0000 7f87b5d2f640 1 -- 172.21.15.18:0/1906659464 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f879c009350 msgr2=0x7f879c00b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:28.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.469+0000 7f87b5d2f640 1 --2- 172.21.15.18:0/1906659464 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f879c009350 0x7f879c00b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.469+0000 7f87b5d2f640 1 -- 172.21.15.18:0/1906659464 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87b00b4990 con 0x7f879c003ce0 2024-04-17T19:53:28.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.473+0000 7f87b5d2f640 1 --2- 172.21.15.18:0/1906659464 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f879c003ce0 0x7f879c0040f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f87b00ce500 tx=0x7f87a001c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0b1ba8d65d8c5c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:28.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.473+0000 7f57e313e640 1 Processor -- start 2024-04-17T19:53:28.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.473+0000 7f57e313e640 1 -- start start 2024-04-17T19:53:28.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.473+0000 7f87b4d2d640 1 -- 172.21.15.18:0/1906659464 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a00af070 con 0x7f879c003ce0 2024-04-17T19:53:28.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.473+0000 7f87b4d2d640 1 -- 172.21.15.18:0/1906659464 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87a00052f0 con 0x7f879c003ce0 2024-04-17T19:53:28.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.473+0000 7f87b4d2d640 1 -- 172.21.15.18:0/1906659464 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a0001520 con 0x7f879c003ce0 2024-04-17T19:53:28.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.473+0000 7f87b7f93640 1 -- 172.21.15.18:0/1906659464 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f879c003ce0 msgr2=0x7f879c0040f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:28.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.473+0000 7f87b7f93640 1 --2- 172.21.15.18:0/1906659464 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f879c003ce0 0x7f879c0040f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f87b00ce500 tx=0x7f87a001c560 comp rx=0 tx=0).stop 2024-04-17T19:53:28.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.473+0000 7f87b6530640 1 -- 172.21.15.18:0/1906659464 reap_dead start 2024-04-17T19:53:28.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.473+0000 7f87b7f93640 1 -- 172.21.15.18:0/1906659464 shutdown_connections 2024-04-17T19:53:28.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.473+0000 7f87b7f93640 1 -- 172.21.15.18:0/1906659464 >> 172.21.15.18:0/1906659464 conn(0x7f87b0072d70 msgr2=0x7f87b00731b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:28.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.473+0000 7f87b7f93640 1 -- 172.21.15.18:0/1906659464 shutdown_connections 2024-04-17T19:53:28.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.473+0000 7f87b7f93640 1 -- 172.21.15.18:0/1906659464 wait complete. 2024-04-17T19:53:28.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.477+0000 7f57e313e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f57dc0b4e00 0x7f57dc0b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:28.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.473+0000 7f06d0cf2640 1 Processor -- start 2024-04-17T19:53:28.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.473+0000 7f06d0cf2640 1 -- start start 2024-04-17T19:53:28.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.473+0000 7f06d0cf2640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f06cc16bf20 0x7f06cc0b39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:28.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.477+0000 7f06d0cf2640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06cc0b54e0 con 0x7f06cc06d470 2024-04-17T19:53:28.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.477+0000 7f06d0cf2640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06cc0b5760 con 0x7f06cc170460 2024-04-17T19:53:28.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.477+0000 7f06d0cf2640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f06cc16c330 con 0x7f06cc16bf20 2024-04-17T19:53:28.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.477+0000 7f06cbfff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f06cc06d470 0x7f06cc0b5c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:51236/0 (socket says 172.21.15.18:51236) 2024-04-17T19:53:28.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.477+0000 7f06cbfff640 1 -- 172.21.15.18:0/2549622202 learned_addr learned my addr 172.21.15.18:0/2549622202 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:28.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.477+0000 7f06cb7fe640 1 --2- 172.21.15.18:0/2549622202 >> v2:172.21.15.173:3300/0 conn(0x7f06cc16bf20 0x7f06cc0b39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:28.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.477+0000 7f06cb7fe640 1 -- 172.21.15.18:0/2549622202 >> v1:172.21.15.173:6789/0 conn(0x7f06cc170460 legacy=0x7f06cc06cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:28.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.477+0000 7f57e213c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f57dc0b4e00 0x7f57dc0b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:28.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.477+0000 7f57e213c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f57dc0b4e00 0x7f57dc0b3aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49988/0 (socket says 172.21.15.18:49988) 2024-04-17T19:53:28.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.477+0000 7f57e213c640 1 -- 172.21.15.18:0/3762637966 learned_addr learned my addr 172.21.15.18:0/3762637966 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:28.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.477+0000 7f06cb7fe640 1 -- 172.21.15.18:0/2549622202 >> v1:172.21.15.18:6789/0 conn(0x7f06cc06d470 legacy=0x7f06cc0b5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:28.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.477+0000 7f06cb7fe640 1 -- 172.21.15.18:0/2549622202 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06cc0ccd30 con 0x7f06cc16bf20 2024-04-17T19:53:28.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.477+0000 7f57e313e640 1 -- 172.21.15.18:0/3762637966 --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57dc15ca00 con 0x7f57dc06eda0 2024-04-17T19:53:28.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.477+0000 7f57e313e640 1 -- 172.21.15.18:0/3762637966 --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57dc15cce0 con 0x7f57dc073150 2024-04-17T19:53:28.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.477+0000 7f57e313e640 1 -- 172.21.15.18:0/3762637966 --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f57dc06e910 con 0x7f57dc0b4e00 2024-04-17T19:53:28.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.477+0000 7f57e113a640 1 -- 172.21.15.18:0/3762637966 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1491407429 0 0) 0x7f57dc15ca00 con 0x7f57dc06eda0 2024-04-17T19:53:28.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.477+0000 7f57e113a640 1 -- 172.21.15.18:0/3762637966 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57c8003530 con 0x7f57dc06eda0 2024-04-17T19:53:28.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.477+0000 7f57e113a640 1 -- 172.21.15.18:0/3762637966 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3294245380 0 0) 0x7f57dc15cce0 con 0x7f57dc073150 2024-04-17T19:53:28.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.477+0000 7f57e113a640 1 -- 172.21.15.18:0/3762637966 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57dc15ca00 con 0x7f57dc073150 2024-04-17T19:53:28.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.477+0000 7f87b7f93640 1 Processor -- start 2024-04-17T19:53:28.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.477+0000 7f87b7f93640 1 -- start start 2024-04-17T19:53:28.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.477+0000 7f06cb7fe640 1 --2- 172.21.15.18:0/2549622202 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06cc16bf20 0x7f06cc0b39c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f06c0009c20 tx=0x7f06c001c210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2342d869664b68b server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:28.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.481+0000 7f87b7f93640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f879c003ce0 0x7f87b0163d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:28.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.477+0000 7f57e213c640 1 -- 172.21.15.18:0/3762637966 >> v1:172.21.15.173:6789/0 conn(0x7f57dc073150 legacy=0x7f57dc073560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:28.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.477+0000 7f57e213c640 1 -- 172.21.15.18:0/3762637966 >> v1:172.21.15.18:6789/0 conn(0x7f57dc06eda0 legacy=0x7f57dc06f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:28.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.477+0000 7f57e213c640 1 -- 172.21.15.18:0/3762637966 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57dc15cfc0 con 0x7f57dc0b4e00 2024-04-17T19:53:28.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.481+0000 7f87b7f93640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87b00a9cc0 0x7f87b016ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:28.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.481+0000 7f87b7f93640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f87b016ef50 0x7f87b0160ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:28.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.481+0000 7f87b7f93640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f87b00b5470 con 0x7f87b00a9cc0 2024-04-17T19:53:28.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.481+0000 7f87b7f93640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f87b00b4f50 con 0x7f879c003ce0 2024-04-17T19:53:28.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.481+0000 7f87b5d2f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f879c003ce0 0x7f87b0163d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:28.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.481+0000 7f87b7f93640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f87b00b55f0 con 0x7f87b016ef50 2024-04-17T19:53:28.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.481+0000 7f87b552e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87b00a9cc0 0x7f87b016ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:28.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.481+0000 7f87b5d2f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f879c003ce0 0x7f87b0163d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.18:44120/0 (socket says 172.21.15.18:44120) 2024-04-17T19:53:28.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.481+0000 7f87b5d2f640 1 -- 172.21.15.18:0/2888609018 learned_addr learned my addr 172.21.15.18:0/2888609018 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:28.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.481+0000 7f57e213c640 1 --2- 172.21.15.18:0/3762637966 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57dc0b4e00 0x7f57dc0b3aa0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f57d8009870 tx=0x7f57d801e700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=442da16b8ecbf81b server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:28.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.481+0000 7f87b6530640 1 --2- 172.21.15.18:0/2888609018 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f87b016ef50 0x7f87b0160ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:28.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.481+0000 7f06ca7fc640 1 -- 172.21.15.18:0/2549622202 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c00092d0 con 0x7f06cc16bf20 2024-04-17T19:53:28.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.481+0000 7f06ca7fc640 1 -- 172.21.15.18:0/2549622202 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06c00a4810 con 0x7f06cc16bf20 2024-04-17T19:53:28.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.481+0000 7f87b552e640 1 -- 172.21.15.18:0/2888609018 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f87b016ef50 msgr2=0x7f87b0160ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:28.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.481+0000 7f87b552e640 1 --2- 172.21.15.18:0/2888609018 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f87b016ef50 0x7f87b0160ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.481+0000 7f87b552e640 1 -- 172.21.15.18:0/2888609018 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f879c003ce0 msgr2=0x7f87b0163d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:28.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.481+0000 7f87b552e640 1 --2- 172.21.15.18:0/2888609018 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f879c003ce0 0x7f87b0163d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.481+0000 7f87b552e640 1 -- 172.21.15.18:0/2888609018 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87b00cf340 con 0x7f87b00a9cc0 2024-04-17T19:53:28.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.481+0000 7f87b552e640 1 --2- 172.21.15.18:0/2888609018 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87b00a9cc0 0x7f87b016ea10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f87b016f850 tx=0x7f87ac009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:28.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.481+0000 7f87a67fc640 1 -- 172.21.15.18:0/2888609018 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87ac009230 con 0x7f87b00a9cc0 2024-04-17T19:53:28.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.481+0000 7f06d0cf2640 1 -- 172.21.15.18:0/2549622202 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06cc16bf20 msgr2=0x7f06cc0b39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:28.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.481+0000 7f06d0cf2640 1 --2- 172.21.15.18:0/2549622202 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06cc16bf20 0x7f06cc0b39c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f06c0009c20 tx=0x7f06c001c210 comp rx=0 tx=0).stop 2024-04-17T19:53:28.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.481+0000 7f57e113a640 1 -- 172.21.15.18:0/3762637966 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57dc0700d0 con 0x7f57dc0b4e00 2024-04-17T19:53:28.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.481+0000 7f57e113a640 1 -- 172.21.15.18:0/3762637966 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57d80a86f0 con 0x7f57dc0b4e00 2024-04-17T19:53:28.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.481+0000 7f06d0cf2640 1 -- 172.21.15.18:0/2549622202 shutdown_connections 2024-04-17T19:53:28.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.481+0000 7f06d0cf2640 1 --2- 172.21.15.18:0/2549622202 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06cc16bf20 0x7f06cc0b39c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.481+0000 7f06d0cf2640 1 -- 172.21.15.18:0/2549622202 >> 172.21.15.18:0/2549622202 conn(0x7f06cc0727a0 msgr2=0x7f06cc072bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:28.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.481+0000 7f57e113a640 1 -- 172.21.15.18:0/3762637966 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d80a8ac0 con 0x7f57dc0b4e00 2024-04-17T19:53:28.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.481+0000 7f87a67fc640 1 -- 172.21.15.18:0/2888609018 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87ac007680 con 0x7f87b00a9cc0 2024-04-17T19:53:28.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.481+0000 7f87a67fc640 1 -- 172.21.15.18:0/2888609018 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87ac007a30 con 0x7f87b00a9cc0 2024-04-17T19:53:28.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.481+0000 7f06d0cf2640 1 -- 172.21.15.18:0/2549622202 shutdown_connections 2024-04-17T19:53:28.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.481+0000 7f06d0cf2640 1 -- 172.21.15.18:0/2549622202 wait complete. 2024-04-17T19:53:28.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.481+0000 7f4d90f04640 1 Processor -- start 2024-04-17T19:53:28.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.481+0000 7f4d90f04640 1 -- start start 2024-04-17T19:53:28.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.481+0000 7f87b7f93640 1 -- 172.21.15.18:0/2888609018 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87b008b550 con 0x7f87b00a9cc0 2024-04-17T19:53:28.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.485+0000 7f87b7f93640 1 -- 172.21.15.18:0/2888609018 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87b016e200 con 0x7f87b00a9cc0 2024-04-17T19:53:28.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.485+0000 7f57e313e640 1 -- 172.21.15.18:0/3762637966 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57dc0b4e00 msgr2=0x7f57dc0b3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:28.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.485+0000 7f57e313e640 1 --2- 172.21.15.18:0/3762637966 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57dc0b4e00 0x7f57dc0b3aa0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f57d8009870 tx=0x7f57d801e700 comp rx=0 tx=0).stop 2024-04-17T19:53:28.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.485+0000 7f57e313e640 1 -- 172.21.15.18:0/3762637966 shutdown_connections 2024-04-17T19:53:28.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.485+0000 7f57e313e640 1 --2- 172.21.15.18:0/3762637966 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57dc0b4e00 0x7f57dc0b3aa0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.485+0000 7f57e313e640 1 -- 172.21.15.18:0/3762637966 >> 172.21.15.18:0/3762637966 conn(0x7f57dc072630 msgr2=0x7f57dc072a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:28.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.485+0000 7f57e313e640 1 -- 172.21.15.18:0/3762637966 shutdown_connections 2024-04-17T19:53:28.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.485+0000 7f57e313e640 1 -- 172.21.15.18:0/3762637966 wait complete. 2024-04-17T19:53:28.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.485+0000 7f87b7f93640 1 -- 172.21.15.18:0/2888609018 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87b00698e0 con 0x7f87b00a9cc0 2024-04-17T19:53:28.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.485+0000 7f87a67fc640 1 -- 172.21.15.18:0/2888609018 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f87ac007bd0 con 0x7f87b00a9cc0 2024-04-17T19:53:28.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.485+0000 7f4d90f04640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4d840e0a40 0x7f4d84050bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:28.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.485+0000 7f4d90f04640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4d84051100 0x7f4d84034860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:28.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.485+0000 7f4d90f04640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f4d84034da0 0x7f4d840351b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:28.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.485+0000 7f4d8a59c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4d840e0a40 0x7f4d84050bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:28.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.485+0000 7f4d8a59c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4d840e0a40 0x7f4d84050bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50002/0 (socket says 172.21.15.18:50002) 2024-04-17T19:53:28.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.485+0000 7f4d8a59c640 1 -- 172.21.15.18:0/673807019 learned_addr learned my addr 172.21.15.18:0/673807019 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:28.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.485+0000 7f4d90f04640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f4d840e0e50 con 0x7f4d840e0a40 2024-04-17T19:53:28.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.485+0000 7f4d90f04640 1 -- 172.21.15.18:0/673807019 --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f4d840e1a80 con 0x7f4d84034da0 2024-04-17T19:53:28.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.485+0000 7f4d90f04640 1 -- 172.21.15.18:0/673807019 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f4d84051510 con 0x7f4d84051100 2024-04-17T19:53:28.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.485+0000 7f4d89d9b640 1 --2- 172.21.15.18:0/673807019 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4d84051100 0x7f4d84034860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:28.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.485+0000 7f4d8ad9d640 1 --2- 172.21.15.18:0/673807019 >> v2:172.21.15.173:3300/0 conn(0x7f4d84034da0 0x7f4d840351b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:28.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.485+0000 7f4d8a59c640 1 -- 172.21.15.18:0/673807019 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4d84051100 msgr2=0x7f4d84034860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:28.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.485+0000 7f4d8a59c640 1 --2- 172.21.15.18:0/673807019 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4d84051100 0x7f4d84034860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.485+0000 7f4d8a59c640 1 -- 172.21.15.18:0/673807019 >> v2:172.21.15.173:3300/0 conn(0x7f4d84034da0 msgr2=0x7f4d840351b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:28.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.485+0000 7f4d8a59c640 1 --2- 172.21.15.18:0/673807019 >> v2:172.21.15.173:3300/0 conn(0x7f4d84034da0 0x7f4d840351b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.485+0000 7f4d8a59c640 1 -- 172.21.15.18:0/673807019 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d84054d90 con 0x7f4d840e0a40 2024-04-17T19:53:28.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.485+0000 7f06d0cf2640 1 Processor -- start 2024-04-17T19:53:28.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.485+0000 7f06d0cf2640 1 -- start start 2024-04-17T19:53:28.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.485+0000 7f57e313e640 1 Processor -- start 2024-04-17T19:53:28.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.489+0000 7f06d0cf2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06cc16bf20 0x7f06cc0c5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:28.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.489+0000 7f06cb7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06cc16bf20 0x7f06cc0c5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:28.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.489+0000 7f06cb7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06cc16bf20 0x7f06cc0c5930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50014/0 (socket says 172.21.15.18:50014) 2024-04-17T19:53:28.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.489+0000 7f06d0cf2640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06cc170460 0x7f06cc213b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:28.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.485+0000 7f57e313e640 1 -- start start 2024-04-17T19:53:28.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.489+0000 7f57e313e640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f57dc06eda0 0x7f57dc13a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:28.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.489+0000 7f57e313e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57dc073150 0x7f57dc155980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:28.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.489+0000 7f4d8a59c640 1 --2- 172.21.15.18:0/673807019 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d840e0a40 0x7f4d84050bc0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4d840e5120 tx=0x7f4d7c01e730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd97824a757b2c69 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:28.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.489+0000 7f57e313e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57dc0b4e00 0x7f57dc13f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:28.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.489+0000 7f06cb7fe640 1 -- 172.21.15.18:0/179830842 learned_addr learned my addr 172.21.15.18:0/179830842 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:28.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.489+0000 7f57e313e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f57dc0cec50 con 0x7f57dc0b4e00 2024-04-17T19:53:28.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.489+0000 7f57e293d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57dc0b4e00 0x7f57dc13f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:28.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.489+0000 7f57e293d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57dc0b4e00 0x7f57dc13f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50024/0 (socket says 172.21.15.18:50024) 2024-04-17T19:53:28.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.489+0000 7f57e293d640 1 -- 172.21.15.18:0/2295794345 learned_addr learned my addr 172.21.15.18:0/2295794345 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:28.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.489+0000 7f57e313e640 1 -- 172.21.15.18:0/2295794345 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f57dc0cead0 con 0x7f57dc073150 2024-04-17T19:53:28.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.489+0000 7f57e313e640 1 -- 172.21.15.18:0/2295794345 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f57dc0cedd0 con 0x7f57dc06eda0 2024-04-17T19:53:28.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.489+0000 7f57e193b640 1 --2- 172.21.15.18:0/2295794345 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57dc073150 0x7f57dc155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:28.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.489+0000 7f06caffd640 1 --2- 172.21.15.18:0/179830842 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06cc170460 0x7f06cc213b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:28.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.489+0000 7f06d0cf2640 1 --2- 172.21.15.18:0/179830842 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f06cc214060 0x7f06cc087020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:28.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.489+0000 7f06d0cf2640 1 -- 172.21.15.18:0/179830842 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f06cc177f50 con 0x7f06cc16bf20 2024-04-17T19:53:28.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.489+0000 7f06d0cf2640 1 -- 172.21.15.18:0/179830842 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f06cc177dd0 con 0x7f06cc170460 2024-04-17T19:53:28.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.489+0000 7f57e293d640 1 -- 172.21.15.18:0/2295794345 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f57dc06eda0 msgr2=0x7f57dc13a140 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-17T19:53:28.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.489+0000 7f57e293d640 1 --2- 172.21.15.18:0/2295794345 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f57dc06eda0 0x7f57dc13a140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.489+0000 7f57e293d640 1 -- 172.21.15.18:0/2295794345 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57dc073150 msgr2=0x7f57dc155980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:28.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.489+0000 7f57e293d640 1 --2- 172.21.15.18:0/2295794345 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57dc073150 0x7f57dc155980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.489+0000 7f57e293d640 1 -- 172.21.15.18:0/2295794345 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57dc1fd320 con 0x7f57dc0b4e00 2024-04-17T19:53:28.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.489+0000 7f06cbfff640 1 --2- 172.21.15.18:0/179830842 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f06cc214060 0x7f06cc087020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:28.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.489+0000 7f57e293d640 1 --2- 172.21.15.18:0/2295794345 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57dc0b4e00 0x7f57dc13f640 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f57d400c7b0 tx=0x7f57d400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:28.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.489+0000 7f06d0cf2640 1 -- 172.21.15.18:0/179830842 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f06cc1780d0 con 0x7f06cc214060 2024-04-17T19:53:28.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.485+0000 7f87a67fc640 1 --2- 172.21.15.18:0/2888609018 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f87940683b0 0x7f879406a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:28.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.485+0000 7f87a67fc640 1 -- 172.21.15.18:0/2888609018 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f87ac086780 con 0x7f87b00a9cc0 2024-04-17T19:53:28.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.485+0000 7f87b5d2f640 1 --2- 172.21.15.18:0/2888609018 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f87940683b0 0x7f879406a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:28.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.489+0000 7f87b5d2f640 1 --2- 172.21.15.18:0/2888609018 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f87940683b0 0x7f879406a8c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f87a001c390 tx=0x7f87a00a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:28.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.489+0000 7f06cb7fe640 1 -- 172.21.15.18:0/179830842 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f06cc214060 msgr2=0x7f06cc087020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:28.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.489+0000 7f06cb7fe640 1 --2- 172.21.15.18:0/179830842 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f06cc214060 0x7f06cc087020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.489+0000 7f06cb7fe640 1 -- 172.21.15.18:0/179830842 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06cc170460 msgr2=0x7f06cc213b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:28.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.489+0000 7f06cb7fe640 1 --2- 172.21.15.18:0/179830842 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06cc170460 0x7f06cc213b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.489+0000 7f06cb7fe640 1 -- 172.21.15.18:0/179830842 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06cc167c30 con 0x7f06cc16bf20 2024-04-17T19:53:28.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.493+0000 7f06cb7fe640 1 --2- 172.21.15.18:0/179830842 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06cc16bf20 0x7f06cc0c5930 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f06c001a050 tx=0x7f06c00192d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:28.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.497+0000 7f87a67fc640 1 -- 172.21.15.18:0/2888609018 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f87ac056300 con 0x7f87b00a9cc0 2024-04-17T19:53:28.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.497+0000 7f4d8959a640 1 -- 172.21.15.18:0/673807019 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d7c0aa610 con 0x7f4d840e0a40 2024-04-17T19:53:28.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.497+0000 7f06b3fff640 1 -- 172.21.15.18:0/179830842 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c00b9070 con 0x7f06cc16bf20 2024-04-17T19:53:28.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.497+0000 7f06d0cf2640 1 -- 172.21.15.18:0/179830842 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06cc167f10 con 0x7f06cc16bf20 2024-04-17T19:53:28.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.497+0000 7f06d0cf2640 1 -- 172.21.15.18:0/179830842 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06cc1684d0 con 0x7f06cc16bf20 2024-04-17T19:53:28.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.497+0000 7f4d8959a640 1 -- 172.21.15.18:0/673807019 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d7c0aa7b0 con 0x7f4d840e0a40 2024-04-17T19:53:28.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.497+0000 7f06b3fff640 1 -- 172.21.15.18:0/179830842 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06c0000e50 con 0x7f06cc16bf20 2024-04-17T19:53:28.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.497+0000 7f06b3fff640 1 -- 172.21.15.18:0/179830842 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c00a4be0 con 0x7f06cc16bf20 2024-04-17T19:53:28.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.497+0000 7f4d90f04640 1 -- 172.21.15.18:0/673807019 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d840e0a40 msgr2=0x7f4d84050bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:28.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.497+0000 7f4d90f04640 1 --2- 172.21.15.18:0/673807019 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d840e0a40 0x7f4d84050bc0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4d840e5120 tx=0x7f4d7c01e730 comp rx=0 tx=0).stop 2024-04-17T19:53:28.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.497+0000 7f57d2ffd640 1 -- 172.21.15.18:0/2295794345 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d4017070 con 0x7f57dc0b4e00 2024-04-17T19:53:28.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.501+0000 7f4d90f04640 1 -- 172.21.15.18:0/673807019 shutdown_connections 2024-04-17T19:53:28.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.501+0000 7f4d90f04640 1 --2- 172.21.15.18:0/673807019 >> v2:172.21.15.173:3300/0 conn(0x7f4d84034da0 0x7f4d840351b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.501+0000 7f4d90f04640 1 --2- 172.21.15.18:0/673807019 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4d84051100 0x7f4d84034860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.501+0000 7f4d90f04640 1 --2- 172.21.15.18:0/673807019 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d840e0a40 0x7f4d84050bc0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.501+0000 7f4d90f04640 1 -- 172.21.15.18:0/673807019 >> 172.21.15.18:0/673807019 conn(0x7f4d84055e10 msgr2=0x7f4d84056220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:28.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.501+0000 7f57e313e640 1 -- 172.21.15.18:0/2295794345 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57dc1fd600 con 0x7f57dc0b4e00 2024-04-17T19:53:28.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.501+0000 7f4d90f04640 1 -- 172.21.15.18:0/673807019 shutdown_connections 2024-04-17T19:53:28.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.501+0000 7f57e313e640 1 -- 172.21.15.18:0/2295794345 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57dc154590 con 0x7f57dc0b4e00 2024-04-17T19:53:28.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.501+0000 7f57d2ffd640 1 -- 172.21.15.18:0/2295794345 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57d4003db0 con 0x7f57dc0b4e00 2024-04-17T19:53:28.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.501+0000 7f57e313e640 1 -- 172.21.15.18:0/2295794345 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57dc156340 con 0x7f57dc0b4e00 2024-04-17T19:53:28.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.501+0000 7f57d2ffd640 1 -- 172.21.15.18:0/2295794345 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d4021060 con 0x7f57dc0b4e00 2024-04-17T19:53:28.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.501+0000 7f4d90f04640 1 -- 172.21.15.18:0/673807019 wait complete. 2024-04-17T19:53:28.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.501+0000 7f06b3fff640 1 -- 172.21.15.18:0/179830842 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f06c00bc070 con 0x7f06cc16bf20 2024-04-17T19:53:28.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.501+0000 7f06b3fff640 1 --2- 172.21.15.18:0/179830842 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f06b80683b0 0x7f06b806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:28.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.501+0000 7f06caffd640 1 --2- 172.21.15.18:0/179830842 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f06b80683b0 0x7f06b806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:28.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.501+0000 7f4d90f04640 1 Processor -- start 2024-04-17T19:53:28.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.501+0000 7f4d90f04640 1 -- start start 2024-04-17T19:53:28.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.501+0000 7f06caffd640 1 --2- 172.21.15.18:0/179830842 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f06b80683b0 0x7f06b806a8c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f06cc0b0970 tx=0x7f06bc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:28.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.505+0000 7f06b3fff640 1 -- 172.21.15.18:0/179830842 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f06c00ee140 con 0x7f06cc16bf20 2024-04-17T19:53:28.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.505+0000 7f4d90f04640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d84034da0 0x7f4d84039f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:28.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.505+0000 7f4d90f04640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d84051100 0x7f4d841896a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:28.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.505+0000 7f4d89d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d84051100 0x7f4d841896a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:28.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.505+0000 7f4d89d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d84051100 0x7f4d841896a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50038/0 (socket says 172.21.15.18:50038) 2024-04-17T19:53:28.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.505+0000 7f4d89d9b640 1 -- 172.21.15.18:0/857989781 learned_addr learned my addr 172.21.15.18:0/857989781 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:28.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.505+0000 7f4d8a59c640 1 --2- 172.21.15.18:0/857989781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d84034da0 0x7f4d84039f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:28.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.505+0000 7f4d90f04640 1 --2- 172.21.15.18:0/857989781 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4d840e0a40 0x7f4d840d98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:28.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.505+0000 7f4d90f04640 1 -- 172.21.15.18:0/857989781 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4d840daf90 con 0x7f4d84051100 2024-04-17T19:53:28.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.505+0000 7f4d90f04640 1 -- 172.21.15.18:0/857989781 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4d840dae10 con 0x7f4d84034da0 2024-04-17T19:53:28.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.505+0000 7f4d90f04640 1 -- 172.21.15.18:0/857989781 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f4d840518a0 con 0x7f4d840e0a40 2024-04-17T19:53:28.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.505+0000 7f4d8ad9d640 1 --2- 172.21.15.18:0/857989781 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4d840e0a40 0x7f4d840d98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:28.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.505+0000 7f57d2ffd640 1 -- 172.21.15.18:0/2295794345 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f57d401a070 con 0x7f57dc0b4e00 2024-04-17T19:53:28.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.505+0000 7f4d89d9b640 1 -- 172.21.15.18:0/857989781 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4d840e0a40 msgr2=0x7f4d840d98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:28.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.505+0000 7f4d89d9b640 1 --2- 172.21.15.18:0/857989781 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4d840e0a40 0x7f4d840d98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.505+0000 7f4d89d9b640 1 -- 172.21.15.18:0/857989781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d84034da0 msgr2=0x7f4d84039f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:28.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.505+0000 7f4d89d9b640 1 --2- 172.21.15.18:0/857989781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d84034da0 0x7f4d84039f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.505+0000 7f4d89d9b640 1 -- 172.21.15.18:0/857989781 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d8418d660 con 0x7f4d84051100 2024-04-17T19:53:28.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.505+0000 7f4d89d9b640 1 --2- 172.21.15.18:0/857989781 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d84051100 0x7f4d841896a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4d8000d800 tx=0x7f4d8000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:28.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.505+0000 7f57d2ffd640 1 --2- 172.21.15.18:0/2295794345 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f57c0068380 0x7f57c006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:28.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.509+0000 7f57e213c640 1 --2- 172.21.15.18:0/2295794345 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f57c0068380 0x7f57c006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:28.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.509+0000 7f57d2ffd640 1 -- 172.21.15.18:0/2295794345 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f57d4054790 con 0x7f57dc0b4e00 2024-04-17T19:53:28.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.509+0000 7f4d7affd640 1 -- 172.21.15.18:0/857989781 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d80018030 con 0x7f4d84051100 2024-04-17T19:53:28.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.509+0000 7f4d90f04640 1 -- 172.21.15.18:0/857989781 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d8418d940 con 0x7f4d84051100 2024-04-17T19:53:28.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.509+0000 7f4d90f04640 1 -- 172.21.15.18:0/857989781 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d8418df00 con 0x7f4d84051100 2024-04-17T19:53:28.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.509+0000 7f57e213c640 1 --2- 172.21.15.18:0/2295794345 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f57c0068380 0x7f57c006a890 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f57d80b1000 tx=0x7f57d8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:28.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.509+0000 7f06d0cf2640 1 -- 172.21.15.18:0/179830842 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06ac0052a0 con 0x7f06cc16bf20 2024-04-17T19:53:28.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.509+0000 7f4d90f04640 1 -- 172.21.15.18:0/857989781 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d840059d0 con 0x7f4d84051100 2024-04-17T19:53:28.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.509+0000 7f3558e7d640 1 Processor -- start 2024-04-17T19:53:28.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.509+0000 7f3558e7d640 1 -- start start 2024-04-17T19:53:28.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.513+0000 7f3558e7d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f35540d05c0 0x7f35540d09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:28.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.513+0000 7f355259c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f35540d05c0 0x7f35540d09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:28.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.513+0000 7f355259c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f35540d05c0 0x7f35540d09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50050/0 (socket says 172.21.15.18:50050) 2024-04-17T19:53:28.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.513+0000 7f3552d9d640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f355406cb70 0x7f355406cf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:51242/0 (socket says 172.21.15.18:51242) 2024-04-17T19:53:28.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.513+0000 7f354bfff640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f355415fbf0 0x7f3554160000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.18:33496/0 (socket says 172.21.15.18:33496) 2024-04-17T19:53:28.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.513+0000 7f355259c640 1 -- 172.21.15.18:0/3690349966 learned_addr learned my addr 172.21.15.18:0/3690349966 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:28.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.513+0000 7f3558e7d640 1 -- 172.21.15.18:0/3690349966 --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f355406bdf0 con 0x7f355406cb70 2024-04-17T19:53:28.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.513+0000 7f3558e7d640 1 -- 172.21.15.18:0/3690349966 --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f355406d690 con 0x7f355415fbf0 2024-04-17T19:53:28.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.513+0000 7f3558e7d640 1 -- 172.21.15.18:0/3690349966 --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f355406c6e0 con 0x7f35540d05c0 2024-04-17T19:53:28.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.513+0000 7f355259c640 1 -- 172.21.15.18:0/3690349966 >> v1:172.21.15.173:6789/0 conn(0x7f355415fbf0 legacy=0x7f3554160000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:28.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.513+0000 7f3551d9b640 1 -- 172.21.15.18:0/3690349966 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4128601155 0 0) 0x7f355406d690 con 0x7f355415fbf0 2024-04-17T19:53:28.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.513+0000 7f355259c640 1 -- 172.21.15.18:0/3690349966 >> v1:172.21.15.18:6789/0 conn(0x7f355406cb70 legacy=0x7f355406cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:28.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.513+0000 7f355259c640 1 -- 172.21.15.18:0/3690349966 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f355406c090 con 0x7f35540d05c0 2024-04-17T19:53:28.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.517+0000 7f355259c640 1 --2- 172.21.15.18:0/3690349966 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f35540d05c0 0x7f35540d09d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f355406c860 tx=0x7f354401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80d529fe521d6d1d server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:28.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.517+0000 7f57d2ffd640 1 -- 172.21.15.18:0/2295794345 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f57d40566f0 con 0x7f57dc0b4e00 2024-04-17T19:53:28.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.517+0000 7f4d7affd640 1 -- 172.21.15.18:0/857989781 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d80009640 con 0x7f4d84051100 2024-04-17T19:53:28.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.517+0000 7f4d7affd640 1 -- 172.21.15.18:0/857989781 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d800097f0 con 0x7f4d84051100 2024-04-17T19:53:28.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.521+0000 7fe1c759e640 1 Processor -- start 2024-04-17T19:53:28.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.521+0000 7fe1c759e640 1 -- start start 2024-04-17T19:53:28.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.521+0000 7fe1c759e640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe1c00523f0 0x7fe1c00389f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:28.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.521+0000 7fe1c759e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe1c003c480 0x7fe1c00551c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:28.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.521+0000 7fe1c759e640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1c00e1df0 con 0x7fe1c0038f30 2024-04-17T19:53:28.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.521+0000 7fe1c6d9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe1c003c480 0x7fe1c00551c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:28.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.521+0000 7fe1c6d9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe1c003c480 0x7fe1c00551c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50060/0 (socket says 172.21.15.18:50060) 2024-04-17T19:53:28.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.521+0000 7fe1c6d9d640 1 -- 172.21.15.18:0/683345197 learned_addr learned my addr 172.21.15.18:0/683345197 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:28.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.521+0000 7fe1c759e640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fe1c003afe0 con 0x7fe1c003c480 2024-04-17T19:53:28.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.521+0000 7fe1c759e640 1 -- 172.21.15.18:0/683345197 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fe1c0039340 con 0x7fe1c00523f0 2024-04-17T19:53:28.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.521+0000 7fe1c659c640 1 --2- 172.21.15.18:0/683345197 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe1c00523f0 0x7fe1c00389f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:28.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.521+0000 7fe1c559a640 1 -- 172.21.15.18:0/683345197 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1487815623 0 0) 0x7fe1c00e1df0 con 0x7fe1c0038f30 2024-04-17T19:53:28.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.521+0000 7fe1c559a640 1 -- 172.21.15.18:0/683345197 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1b0003530 con 0x7fe1c0038f30 2024-04-17T19:53:28.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.525+0000 7fe1c659c640 1 -- 172.21.15.18:0/683345197 >> v2:172.21.15.18:3300/0 conn(0x7fe1c003c480 msgr2=0x7fe1c00551c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:28.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.525+0000 7fe1c659c640 1 --2- 172.21.15.18:0/683345197 >> v2:172.21.15.18:3300/0 conn(0x7fe1c003c480 0x7fe1c00551c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.525+0000 7fe1c659c640 1 -- 172.21.15.18:0/683345197 >> v1:172.21.15.173:6789/0 conn(0x7fe1c0038f30 legacy=0x7fe1c0054ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:28.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.525+0000 7fe1c659c640 1 -- 172.21.15.18:0/683345197 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1c0055fe0 con 0x7fe1c00523f0 2024-04-17T19:53:28.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.525+0000 7f06b3fff640 1 -- 172.21.15.18:0/179830842 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f06c00c3070 con 0x7f06cc16bf20 2024-04-17T19:53:28.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.525+0000 7f4d7affd640 1 -- 172.21.15.18:0/857989781 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4d8001b070 con 0x7f4d84051100 2024-04-17T19:53:28.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.529+0000 7f4d7affd640 1 --2- 172.21.15.18:0/857989781 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f4d6c0683b0 0x7f4d6c06a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:28.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.529+0000 7f4d7affd640 1 -- 172.21.15.18:0/857989781 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f4d80087350 con 0x7f4d84051100 2024-04-17T19:53:28.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.529+0000 7f4d8a59c640 1 --2- 172.21.15.18:0/857989781 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f4d6c0683b0 0x7f4d6c06a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:28.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.529+0000 7f4d8a59c640 1 --2- 172.21.15.18:0/857989781 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f4d6c0683b0 0x7f4d6c06a8c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c0b1000 tx=0x7f4d7c0b4040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:28.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.525+0000 7fe1c659c640 1 --2- 172.21.15.18:0/683345197 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe1c00523f0 0x7fe1c00389f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe1b80097c0 tx=0x7fe1b801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11c079561fba68b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:28.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.525+0000 7fe1c559a640 1 -- 172.21.15.18:0/683345197 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b80aa600 con 0x7fe1c00523f0 2024-04-17T19:53:28.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.525+0000 7fe1c559a640 1 -- 172.21.15.18:0/683345197 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1b80af070 con 0x7fe1c00523f0 2024-04-17T19:53:28.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.525+0000 7fe1c559a640 1 -- 172.21.15.18:0/683345197 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b80aa600 con 0x7fe1c00523f0 2024-04-17T19:53:28.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.529+0000 7fe1c759e640 1 -- 172.21.15.18:0/683345197 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe1c00523f0 msgr2=0x7fe1c00389f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:28.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.529+0000 7fe1c759e640 1 --2- 172.21.15.18:0/683345197 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe1c00523f0 0x7fe1c00389f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe1b80097c0 tx=0x7fe1b801c4a0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.529+0000 7fe1c759e640 1 -- 172.21.15.18:0/683345197 shutdown_connections 2024-04-17T19:53:28.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.529+0000 7fe1c759e640 1 --2- 172.21.15.18:0/683345197 >> v2:172.21.15.18:3300/0 conn(0x7fe1c003c480 0x7fe1c00551c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.529+0000 7fe1c759e640 1 --2- 172.21.15.18:0/683345197 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe1c00523f0 0x7fe1c00389f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.533+0000 7fe1c759e640 1 -- 172.21.15.18:0/683345197 >> 172.21.15.18:0/683345197 conn(0x7fe1c00539f0 msgr2=0x7fe1c0053e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:28.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.533+0000 7fe1c759e640 1 -- 172.21.15.18:0/683345197 shutdown_connections 2024-04-17T19:53:28.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.533+0000 7fe1c759e640 1 -- 172.21.15.18:0/683345197 wait complete. 2024-04-17T19:53:28.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.529+0000 7f3551d9b640 1 -- 172.21.15.18:0/3690349966 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35440ab650 con 0x7f35540d05c0 2024-04-17T19:53:28.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.529+0000 7f3551d9b640 1 -- 172.21.15.18:0/3690349966 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35440b0070 con 0x7f35540d05c0 2024-04-17T19:53:28.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.529+0000 7f3551d9b640 1 -- 172.21.15.18:0/3690349966 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35440aba10 con 0x7f35540d05c0 2024-04-17T19:53:28.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.529+0000 7f3558e7d640 1 -- 172.21.15.18:0/3690349966 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f35540d05c0 msgr2=0x7f35540d09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:28.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.529+0000 7f3558e7d640 1 --2- 172.21.15.18:0/3690349966 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f35540d05c0 0x7f35540d09d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f355406c860 tx=0x7f354401c540 comp rx=0 tx=0).stop 2024-04-17T19:53:28.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.529+0000 7f3558e7d640 1 -- 172.21.15.18:0/3690349966 shutdown_connections 2024-04-17T19:53:28.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.529+0000 7f3558e7d640 1 --2- 172.21.15.18:0/3690349966 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f35540d05c0 0x7f35540d09d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.529+0000 7f3558e7d640 1 -- 172.21.15.18:0/3690349966 >> 172.21.15.18:0/3690349966 conn(0x7f35540b3910 msgr2=0x7f35540d12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:28.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.533+0000 7f3558e7d640 1 -- 172.21.15.18:0/3690349966 shutdown_connections 2024-04-17T19:53:28.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.533+0000 7f4d7affd640 1 -- 172.21.15.18:0/857989781 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4d80022070 con 0x7f4d84051100 2024-04-17T19:53:28.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.533+0000 7fe1c759e640 1 Processor -- start 2024-04-17T19:53:28.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.537+0000 7fe1c759e640 1 -- start start 2024-04-17T19:53:28.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.533+0000 7f3558e7d640 1 -- 172.21.15.18:0/3690349966 wait complete. 2024-04-17T19:53:28.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.537+0000 7f3558e7d640 1 Processor -- start 2024-04-17T19:53:28.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.537+0000 7f90422a4640 1 Processor -- start 2024-04-17T19:53:28.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.537+0000 7fe1c759e640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe1c0038f30 0x7fe1c004f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:28.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.537+0000 7fe1c759e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1c003c480 0x7fe1c00ebe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:28.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.537+0000 7fe1c759e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe1c00523f0 0x7fe1c00e4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:28.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.537+0000 7fe1c759e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c00365d0 con 0x7fe1c003c480 2024-04-17T19:53:28.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.537+0000 7fe1c759e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c00398b0 con 0x7fe1c00523f0 2024-04-17T19:53:28.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.537+0000 7fe1c759e640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fe1c0052800 con 0x7fe1c0038f30 2024-04-17T19:53:28.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.537+0000 7fe1c5d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1c003c480 0x7fe1c00ebe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:28.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.537+0000 7fe1c5d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1c003c480 0x7fe1c00ebe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50074/0 (socket says 172.21.15.18:50074) 2024-04-17T19:53:28.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.537+0000 7fe1c5d9b640 1 -- 172.21.15.18:0/2515001738 learned_addr learned my addr 172.21.15.18:0/2515001738 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:28.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.537+0000 7fe1c659c640 1 --2- 172.21.15.18:0/2515001738 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe1c0038f30 0x7fe1c004f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:28.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.537+0000 7fe1c6d9d640 1 --2- 172.21.15.18:0/2515001738 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe1c00523f0 0x7fe1c00e4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:28.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.537+0000 7fe1c5d9b640 1 -- 172.21.15.18:0/2515001738 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe1c0038f30 msgr2=0x7fe1c004f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:28.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.537+0000 7fe1c5d9b640 1 --2- 172.21.15.18:0/2515001738 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe1c0038f30 0x7fe1c004f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.537+0000 7fe1c5d9b640 1 -- 172.21.15.18:0/2515001738 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe1c00523f0 msgr2=0x7fe1c00e4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:28.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.537+0000 7fe1c5d9b640 1 --2- 172.21.15.18:0/2515001738 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe1c00523f0 0x7fe1c00e4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.537+0000 7fe1c5d9b640 1 -- 172.21.15.18:0/2515001738 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1c00e3b10 con 0x7fe1c003c480 2024-04-17T19:53:28.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.537+0000 7fe1c5d9b640 1 --2- 172.21.15.18:0/2515001738 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1c003c480 0x7fe1c00ebe60 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc00c3c0 tx=0x7fe1bc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:28.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.537+0000 7fe1b6ffd640 1 -- 172.21.15.18:0/2515001738 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc017070 con 0x7fe1c003c480 2024-04-17T19:53:28.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.537+0000 7fe1c759e640 1 -- 172.21.15.18:0/2515001738 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1c00e3df0 con 0x7fe1c003c480 2024-04-17T19:53:28.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.537+0000 7fe1c759e640 1 -- 172.21.15.18:0/2515001738 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1c00cc840 con 0x7fe1c003c480 2024-04-17T19:53:28.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.537+0000 7f3558e7d640 1 -- start start 2024-04-17T19:53:28.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.537+0000 7f3558e7d640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f355406cb70 0x7f355415a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:28.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.537+0000 7f3558e7d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35540d05c0 0x7f35542084a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:28.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.537+0000 7f3558e7d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f355415fbf0 0x7f355414de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:28.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.537+0000 7f3558e7d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f35540cdcd0 con 0x7f355415fbf0 2024-04-17T19:53:28.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.537+0000 7f3558e7d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f35540cdb50 con 0x7f35540d05c0 2024-04-17T19:53:28.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.537+0000 7f3558e7d640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f35540cde50 con 0x7f355406cb70 2024-04-17T19:53:28.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.537+0000 7f90422a4640 1 -- start start 2024-04-17T19:53:28.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.537+0000 7f354bfff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35540d05c0 0x7f35542084a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:28.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.541+0000 7f354bfff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35540d05c0 0x7f35542084a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.18:44176/0 (socket says 172.21.15.18:44176) 2024-04-17T19:53:28.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.541+0000 7f354bfff640 1 -- 172.21.15.18:0/2171473806 learned_addr learned my addr 172.21.15.18:0/2171473806 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:28.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.541+0000 7f3552d9d640 1 --2- 172.21.15.18:0/2171473806 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f355415fbf0 0x7f355414de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:28.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.541+0000 7f355259c640 1 --2- 172.21.15.18:0/2171473806 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f355406cb70 0x7f355415a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:28.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.541+0000 7f354bfff640 1 -- 172.21.15.18:0/2171473806 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f355406cb70 msgr2=0x7f355415a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:28.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.541+0000 7f354bfff640 1 --2- 172.21.15.18:0/2171473806 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f355406cb70 0x7f355415a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.541+0000 7f354bfff640 1 -- 172.21.15.18:0/2171473806 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f355415fbf0 msgr2=0x7f355414de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:28.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.541+0000 7f354bfff640 1 --2- 172.21.15.18:0/2171473806 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f355415fbf0 0x7f355414de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.541+0000 7f354bfff640 1 -- 172.21.15.18:0/2171473806 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3554172da0 con 0x7f35540d05c0 2024-04-17T19:53:28.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.541+0000 7f354bfff640 1 --2- 172.21.15.18:0/2171473806 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35540d05c0 0x7f35542084a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f353c00c410 tx=0x7f353c00c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:28.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.541+0000 7fe1b6ffd640 1 -- 172.21.15.18:0/2515001738 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1bc0052d0 con 0x7fe1c003c480 2024-04-17T19:53:28.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.541+0000 7fe1b6ffd640 1 -- 172.21.15.18:0/2515001738 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc003840 con 0x7fe1c003c480 2024-04-17T19:53:28.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.537+0000 7f90422a4640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f90340eb8f0 0x7f90340e7c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:28.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.537+0000 7f90422a4640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9034038350 con 0x7f9034033a80 2024-04-17T19:53:28.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.537+0000 7f90422a4640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90340ec0d0 con 0x7f9034006810 2024-04-17T19:53:28.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.537+0000 7f90422a4640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f90340060a0 con 0x7f90340eb8f0 2024-04-17T19:53:28.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.541+0000 7f9040aa1640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f9034033a80 0x7f9034033e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:51248/0 (socket says 172.21.15.18:51248) 2024-04-17T19:53:28.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.541+0000 7f9040aa1640 1 -- 172.21.15.18:0/294800394 learned_addr learned my addr 172.21.15.18:0/294800394 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:28.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.541+0000 7f90412a2640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f90340eb8f0 0x7f90340e7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:28.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.541+0000 7f90412a2640 1 -- 172.21.15.18:0/294800394 >> v1:172.21.15.173:6789/0 conn(0x7f9034006810 legacy=0x7f9034006c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:28.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.541+0000 7f90412a2640 1 -- 172.21.15.18:0/294800394 >> v1:172.21.15.18:6789/0 conn(0x7f9034033a80 legacy=0x7f9034033e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:28.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.541+0000 7f90412a2640 1 -- 172.21.15.18:0/294800394 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90340ec3b0 con 0x7f90340eb8f0 2024-04-17T19:53:28.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.541+0000 7fe1b6ffd640 1 -- 172.21.15.18:0/2515001738 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe1bc01a070 con 0x7fe1c003c480 2024-04-17T19:53:28.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.541+0000 7fe1b6ffd640 1 --2- 172.21.15.18:0/2515001738 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fe1a8068450 0x7fe1a806a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:28.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.541+0000 7fe1b6ffd640 1 -- 172.21.15.18:0/2515001738 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fe1bc0860c0 con 0x7fe1c003c480 2024-04-17T19:53:28.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.545+0000 7fe1c659c640 1 --2- 172.21.15.18:0/2515001738 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fe1a8068450 0x7fe1a806a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:28.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.545+0000 7fe1c759e640 1 -- 172.21.15.18:0/2515001738 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1ac0052a0 con 0x7fe1c003c480 2024-04-17T19:53:28.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.545+0000 7f354affd640 1 -- 172.21.15.18:0/2171473806 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f353c0074e0 con 0x7f35540d05c0 2024-04-17T19:53:28.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.545+0000 7f354affd640 1 -- 172.21.15.18:0/2171473806 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f353c0047f0 con 0x7f35540d05c0 2024-04-17T19:53:28.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.545+0000 7f354affd640 1 -- 172.21.15.18:0/2171473806 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f353c007680 con 0x7f35540d05c0 2024-04-17T19:53:28.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.545+0000 7fe1c659c640 1 --2- 172.21.15.18:0/2515001738 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fe1a8068450 0x7fe1a806a960 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe1b80ae000 tx=0x7fe1b80b5040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:28.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.545+0000 7f90412a2640 1 --2- 172.21.15.18:0/294800394 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f90340eb8f0 0x7f90340e7c10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f902c0097f0 tx=0x7f902c01c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbe734e8a0eb5449 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:28.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.545+0000 7f9033fff640 1 -- 172.21.15.18:0/294800394 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f902c0b0070 con 0x7f90340eb8f0 2024-04-17T19:53:28.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.545+0000 7f9033fff640 1 -- 172.21.15.18:0/294800394 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f902c0ab600 con 0x7f90340eb8f0 2024-04-17T19:53:28.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.545+0000 7f3558e7d640 1 -- 172.21.15.18:0/2171473806 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f355414ef90 con 0x7f35540d05c0 2024-04-17T19:53:28.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.545+0000 7f3558e7d640 1 -- 172.21.15.18:0/2171473806 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3554172ac0 con 0x7f35540d05c0 2024-04-17T19:53:28.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.545+0000 7f9033fff640 1 -- 172.21.15.18:0/294800394 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f902c0ab9d0 con 0x7f90340eb8f0 2024-04-17T19:53:28.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.545+0000 7f90422a4640 1 -- 172.21.15.18:0/294800394 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f90340eb8f0 msgr2=0x7f90340e7c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:28.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.545+0000 7f90422a4640 1 --2- 172.21.15.18:0/294800394 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f90340eb8f0 0x7f90340e7c10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f902c0097f0 tx=0x7f902c01c4e0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.545+0000 7f90422a4640 1 -- 172.21.15.18:0/294800394 shutdown_connections 2024-04-17T19:53:28.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.545+0000 7f90422a4640 1 --2- 172.21.15.18:0/294800394 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f90340eb8f0 0x7f90340e7c10 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.545+0000 7f90422a4640 1 -- 172.21.15.18:0/294800394 >> 172.21.15.18:0/294800394 conn(0x7f9034054d00 msgr2=0x7f9034055110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:28.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.545+0000 7f90422a4640 1 -- 172.21.15.18:0/294800394 shutdown_connections 2024-04-17T19:53:28.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.545+0000 7f90422a4640 1 -- 172.21.15.18:0/294800394 wait complete. 2024-04-17T19:53:28.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.549+0000 7f90422a4640 1 Processor -- start 2024-04-17T19:53:28.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.549+0000 7f90422a4640 1 -- start start 2024-04-17T19:53:28.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.549+0000 7f354affd640 1 -- 172.21.15.18:0/2171473806 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f353c011070 con 0x7f35540d05c0 2024-04-17T19:53:28.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.549+0000 7f354affd640 1 --2- 172.21.15.18:0/2171473806 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f35340683d0 0x7f353406a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:28.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.549+0000 7f354affd640 1 -- 172.21.15.18:0/2171473806 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f353c086750 con 0x7f35540d05c0 2024-04-17T19:53:28.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.549+0000 7f355259c640 1 --2- 172.21.15.18:0/2171473806 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f35340683d0 0x7f353406a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:28.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.549+0000 7f90422a4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9034006810 0x7f90340ea530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:28.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.549+0000 7f90422a4640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9034033a80 0x7f90340e4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:28.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.549+0000 7f90422a4640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f90340eb8f0 0x7f90340e4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:28.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.549+0000 7f90422a4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f90340f5dc0 con 0x7f9034006810 2024-04-17T19:53:28.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.549+0000 7f90422a4640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f90340f5c40 con 0x7f9034033a80 2024-04-17T19:53:28.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.549+0000 7f90422a4640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f90340f5f40 con 0x7f90340eb8f0 2024-04-17T19:53:28.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.549+0000 7f9041aa3640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f90340eb8f0 0x7f90340e4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:28.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.549+0000 7f9041aa3640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f90340eb8f0 0x7f90340e4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.18:60676/0 (socket says 172.21.15.18:60676) 2024-04-17T19:53:28.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.549+0000 7f9041aa3640 1 -- 172.21.15.18:0/387367611 learned_addr learned my addr 172.21.15.18:0/387367611 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:28.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.549+0000 7f355259c640 1 --2- 172.21.15.18:0/2171473806 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f35340683d0 0x7f353406a8e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f35440af000 tx=0x7f3544008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:28.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.549+0000 7f9040aa1640 1 --2- 172.21.15.18:0/387367611 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9034033a80 0x7f90340e4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:28.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.549+0000 7f90412a2640 1 --2- 172.21.15.18:0/387367611 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9034006810 0x7f90340ea530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:28.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.549+0000 7f9041aa3640 1 -- 172.21.15.18:0/387367611 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9034033a80 msgr2=0x7f90340e4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:28.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.549+0000 7f9041aa3640 1 --2- 172.21.15.18:0/387367611 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9034033a80 0x7f90340e4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.549+0000 7f9041aa3640 1 -- 172.21.15.18:0/387367611 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9034006810 msgr2=0x7f90340ea530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:28.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.549+0000 7f9041aa3640 1 --2- 172.21.15.18:0/387367611 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9034006810 0x7f90340ea530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.549+0000 7f9041aa3640 1 -- 172.21.15.18:0/387367611 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90340e8b20 con 0x7f90340eb8f0 2024-04-17T19:53:28.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.553+0000 7f9041aa3640 1 --2- 172.21.15.18:0/387367611 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f90340eb8f0 0x7f90340e4db0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f903c000b70 tx=0x7f903c075b70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:28.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.553+0000 7f9031ffb640 1 -- 172.21.15.18:0/387367611 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f903c0743c0 con 0x7f90340eb8f0 2024-04-17T19:53:28.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.553+0000 7f90422a4640 1 -- 172.21.15.18:0/387367611 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90340e8e00 con 0x7f90340eb8f0 2024-04-17T19:53:28.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.553+0000 7f90422a4640 1 -- 172.21.15.18:0/387367611 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f90340e93c0 con 0x7f90340eb8f0 2024-04-17T19:53:28.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.553+0000 7f9031ffb640 1 -- 172.21.15.18:0/387367611 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f903c093400 con 0x7f90340eb8f0 2024-04-17T19:53:28.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.553+0000 7f9031ffb640 1 -- 172.21.15.18:0/387367611 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f903c0937b0 con 0x7f90340eb8f0 2024-04-17T19:53:28.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.553+0000 7f90422a4640 1 -- 172.21.15.18:0/387367611 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9034005580 con 0x7f90340eb8f0 2024-04-17T19:53:28.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.553+0000 7fe1b6ffd640 1 -- 172.21.15.18:0/2515001738 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe1bc055c40 con 0x7fe1c003c480 2024-04-17T19:53:28.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.553+0000 7f9031ffb640 1 -- 172.21.15.18:0/387367611 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f903c09c3f0 con 0x7f90340eb8f0 2024-04-17T19:53:28.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.557+0000 7f3558e7d640 1 -- 172.21.15.18:0/2171473806 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3554155e90 con 0x7f35540d05c0 2024-04-17T19:53:28.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.565+0000 7f9031ffb640 1 --2- 172.21.15.18:0/387367611 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f9028068470 0x7f902806a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:28.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.565+0000 7f9031ffb640 1 -- 172.21.15.18:0/387367611 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f903c102750 con 0x7f90340eb8f0 2024-04-17T19:53:28.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.565+0000 7f90412a2640 1 --2- 172.21.15.18:0/387367611 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f9028068470 0x7f902806a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:28.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.565+0000 7f90412a2640 1 --2- 172.21.15.18:0/387367611 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f9028068470 0x7f902806a980 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f902c0ad000 tx=0x7f902c0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:28.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.569+0000 7f9031ffb640 1 -- 172.21.15.18:0/387367611 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f903c0a2080 con 0x7f90340eb8f0 2024-04-17T19:53:28.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.573+0000 7f354affd640 1 -- 172.21.15.18:0/2171473806 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f353c056ab0 con 0x7f35540d05c0 2024-04-17T19:53:28.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.757+0000 7f58cb24a640 1 -- 172.21.15.18:0/3657735223 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f58c40008e0 con 0x7f58c4209410 2024-04-17T19:53:28.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.761+0000 7f58c17fa640 1 -- 172.21.15.18:0/3657735223 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f58b405ad60 con 0x7f58c4209410 2024-04-17T19:53:28.759 INFO:teuthology.orchestra.run.smithi018.stdout:64424509450 2024-04-17T19:53:28.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.761+0000 7f58aaffd640 1 -- 172.21.15.18:0/3657735223 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f58b0068450 msgr2=0x7f58b006a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:28.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.761+0000 7f58aaffd640 1 --2- 172.21.15.18:0/3657735223 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f58b0068450 0x7f58b006a960 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f58b8000f70 tx=0x7f58b8009040 comp rx=0 tx=0).stop 2024-04-17T19:53:28.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.765+0000 7f58aaffd640 1 -- 172.21.15.18:0/3657735223 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58c4209410 msgr2=0x7f58c415bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:28.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.765+0000 7f58aaffd640 1 --2- 172.21.15.18:0/3657735223 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58c4209410 0x7f58c415bdd0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f58b400f6a0 tx=0x7f58b400fb60 comp rx=0 tx=0).stop 2024-04-17T19:53:28.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.765+0000 7f58aaffd640 1 -- 172.21.15.18:0/3657735223 shutdown_connections 2024-04-17T19:53:28.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.765+0000 7f58aaffd640 1 --2- 172.21.15.18:0/3657735223 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f58b0068450 0x7f58b006a960 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.765+0000 7f58aaffd640 1 --2- 172.21.15.18:0/3657735223 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58c4209410 0x7f58c415bdd0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.765+0000 7f58aaffd640 1 --2- 172.21.15.18:0/3657735223 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f58c4151a20 0x7f58c4208ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.765+0000 7f58aaffd640 1 --2- 172.21.15.18:0/3657735223 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58c40cf420 0x7f58c414c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.765+0000 7f58aaffd640 1 -- 172.21.15.18:0/3657735223 >> 172.21.15.18:0/3657735223 conn(0x7f58c4072d70 msgr2=0x7f58c415dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:28.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.765+0000 7f58aaffd640 1 -- 172.21.15.18:0/3657735223 shutdown_connections 2024-04-17T19:53:28.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.765+0000 7f58aaffd640 1 -- 172.21.15.18:0/3657735223 wait complete. 2024-04-17T19:53:28.787 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509450 for osd.2 2024-04-17T19:53:28.788 DEBUG:teuthology.parallel:result is None 2024-04-17T19:53:28.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.825+0000 7f87b7f93640 1 -- 172.21.15.18:0/2888609018 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f87b00b0410 con 0x7f87b00a9cc0 2024-04-17T19:53:28.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.825+0000 7f87a67fc640 1 -- 172.21.15.18:0/2888609018 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f87ac05a600 con 0x7f87b00a9cc0 2024-04-17T19:53:28.822 INFO:teuthology.orchestra.run.smithi018.stdout:60129542154 2024-04-17T19:53:28.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.829+0000 7f87b7f93640 1 -- 172.21.15.18:0/2888609018 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f87940683b0 msgr2=0x7f879406a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:28.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.829+0000 7f87b7f93640 1 --2- 172.21.15.18:0/2888609018 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f87940683b0 0x7f879406a8c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f87a001c390 tx=0x7f87a00a7000 comp rx=0 tx=0).stop 2024-04-17T19:53:28.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.829+0000 7f87b7f93640 1 -- 172.21.15.18:0/2888609018 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87b00a9cc0 msgr2=0x7f87b016ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:28.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.829+0000 7f87b7f93640 1 --2- 172.21.15.18:0/2888609018 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87b00a9cc0 0x7f87b016ea10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f87b016f850 tx=0x7f87ac009920 comp rx=0 tx=0).stop 2024-04-17T19:53:28.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.829+0000 7f87b7f93640 1 -- 172.21.15.18:0/2888609018 shutdown_connections 2024-04-17T19:53:28.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.829+0000 7f87b7f93640 1 --2- 172.21.15.18:0/2888609018 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f87940683b0 0x7f879406a8c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.829+0000 7f87b7f93640 1 --2- 172.21.15.18:0/2888609018 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f87b016ef50 0x7f87b0160ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.829+0000 7f87b7f93640 1 --2- 172.21.15.18:0/2888609018 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87b00a9cc0 0x7f87b016ea10 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.829+0000 7f87b7f93640 1 --2- 172.21.15.18:0/2888609018 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f879c003ce0 0x7f87b0163d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.829+0000 7f87b7f93640 1 -- 172.21.15.18:0/2888609018 >> 172.21.15.18:0/2888609018 conn(0x7f87b0072d70 msgr2=0x7f87b00b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:28.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.829+0000 7f87b7f93640 1 -- 172.21.15.18:0/2888609018 shutdown_connections 2024-04-17T19:53:28.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.829+0000 7f87b7f93640 1 -- 172.21.15.18:0/2888609018 wait complete. 2024-04-17T19:53:28.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.849+0000 7f3558e7d640 1 -- 172.21.15.18:0/2171473806 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f3554069950 con 0x7f35540d05c0 2024-04-17T19:53:28.846 INFO:teuthology.orchestra.run.smithi018.stdout:64424509450 2024-04-17T19:53:28.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.849+0000 7f354affd640 1 -- 172.21.15.18:0/2171473806 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f353c0563b0 con 0x7f35540d05c0 2024-04-17T19:53:28.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.853+0000 7f3558e7d640 1 -- 172.21.15.18:0/2171473806 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f35340683d0 msgr2=0x7f353406a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:28.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.853+0000 7f3558e7d640 1 --2- 172.21.15.18:0/2171473806 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f35340683d0 0x7f353406a8e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f35440af000 tx=0x7f3544008040 comp rx=0 tx=0).stop 2024-04-17T19:53:28.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.853+0000 7f3558e7d640 1 -- 172.21.15.18:0/2171473806 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35540d05c0 msgr2=0x7f35542084a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:28.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.853+0000 7f3558e7d640 1 --2- 172.21.15.18:0/2171473806 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35540d05c0 0x7f35542084a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f353c00c410 tx=0x7f353c00c8d0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.853+0000 7f3558e7d640 1 -- 172.21.15.18:0/2171473806 shutdown_connections 2024-04-17T19:53:28.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.853+0000 7f3558e7d640 1 --2- 172.21.15.18:0/2171473806 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f35340683d0 0x7f353406a8e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.853+0000 7f3558e7d640 1 --2- 172.21.15.18:0/2171473806 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f355415fbf0 0x7f355414de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.853+0000 7f3558e7d640 1 --2- 172.21.15.18:0/2171473806 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f35540d05c0 0x7f35542084a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.853+0000 7f3558e7d640 1 --2- 172.21.15.18:0/2171473806 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f355406cb70 0x7f355415a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.853+0000 7f3558e7d640 1 -- 172.21.15.18:0/2171473806 >> 172.21.15.18:0/2171473806 conn(0x7f35540b3910 msgr2=0x7f355414cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:28.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.853+0000 7f3558e7d640 1 -- 172.21.15.18:0/2171473806 shutdown_connections 2024-04-17T19:53:28.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.853+0000 7f3558e7d640 1 -- 172.21.15.18:0/2171473806 wait complete. 2024-04-17T19:53:28.851 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.6 2024-04-17T19:53:28.851 DEBUG:teuthology.parallel:result is None 2024-04-17T19:53:28.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.861+0000 7f57e313e640 1 -- 172.21.15.18:0/2295794345 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f57dc0698e0 con 0x7f57dc0b4e00 2024-04-17T19:53:28.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.861+0000 7f57d2ffd640 1 -- 172.21.15.18:0/2295794345 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f57d405a9f0 con 0x7f57dc0b4e00 2024-04-17T19:53:28.859 INFO:teuthology.orchestra.run.smithi018.stdout:64424509450 2024-04-17T19:53:28.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.865+0000 7f57e313e640 1 -- 172.21.15.18:0/2295794345 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f57c0068380 msgr2=0x7f57c006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:28.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.865+0000 7f57e313e640 1 --2- 172.21.15.18:0/2295794345 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f57c0068380 0x7f57c006a890 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f57d80b1000 tx=0x7f57d8008040 comp rx=0 tx=0).stop 2024-04-17T19:53:28.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.865+0000 7f57e313e640 1 -- 172.21.15.18:0/2295794345 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57dc0b4e00 msgr2=0x7f57dc13f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:28.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.865+0000 7f57e313e640 1 --2- 172.21.15.18:0/2295794345 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57dc0b4e00 0x7f57dc13f640 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f57d400c7b0 tx=0x7f57d400cc70 comp rx=0 tx=0).stop 2024-04-17T19:53:28.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.865+0000 7f57e313e640 1 -- 172.21.15.18:0/2295794345 shutdown_connections 2024-04-17T19:53:28.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.865+0000 7f57e313e640 1 --2- 172.21.15.18:0/2295794345 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f57c0068380 0x7f57c006a890 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.865+0000 7f57e313e640 1 --2- 172.21.15.18:0/2295794345 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57dc0b4e00 0x7f57dc13f640 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.865+0000 7f57e313e640 1 --2- 172.21.15.18:0/2295794345 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57dc073150 0x7f57dc155980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.865+0000 7f57e313e640 1 --2- 172.21.15.18:0/2295794345 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f57dc06eda0 0x7f57dc13a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.865+0000 7f57e313e640 1 -- 172.21.15.18:0/2295794345 >> 172.21.15.18:0/2295794345 conn(0x7f57dc072630 msgr2=0x7f57dc06f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:28.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.865+0000 7f57e313e640 1 -- 172.21.15.18:0/2295794345 shutdown_connections 2024-04-17T19:53:28.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.865+0000 7f57e313e640 1 -- 172.21.15.18:0/2295794345 wait complete. 2024-04-17T19:53:28.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.865+0000 7f06d0cf2640 1 -- 172.21.15.18:0/179830842 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f06ac005860 con 0x7f06cc16bf20 2024-04-17T19:53:28.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.865+0000 7f06b3fff640 1 -- 172.21.15.18:0/179830842 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f06c0016300 con 0x7f06cc16bf20 2024-04-17T19:53:28.864 INFO:teuthology.orchestra.run.smithi018.stdout:64424509450 2024-04-17T19:53:28.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.869+0000 7f06d0cf2640 1 -- 172.21.15.18:0/179830842 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f06b80683b0 msgr2=0x7f06b806a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:28.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.869+0000 7f06d0cf2640 1 --2- 172.21.15.18:0/179830842 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f06b80683b0 0x7f06b806a8c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f06cc0b0970 tx=0x7f06bc009040 comp rx=0 tx=0).stop 2024-04-17T19:53:28.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.869+0000 7f06d0cf2640 1 -- 172.21.15.18:0/179830842 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06cc16bf20 msgr2=0x7f06cc0c5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:28.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.869+0000 7f06d0cf2640 1 --2- 172.21.15.18:0/179830842 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06cc16bf20 0x7f06cc0c5930 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f06c001a050 tx=0x7f06c00192d0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.869+0000 7f06d0cf2640 1 -- 172.21.15.18:0/179830842 shutdown_connections 2024-04-17T19:53:28.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.869+0000 7f06d0cf2640 1 --2- 172.21.15.18:0/179830842 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f06b80683b0 0x7f06b806a8c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.869+0000 7f06d0cf2640 1 --2- 172.21.15.18:0/179830842 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f06cc214060 0x7f06cc087020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.869+0000 7f06d0cf2640 1 --2- 172.21.15.18:0/179830842 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06cc170460 0x7f06cc213b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.869+0000 7f06d0cf2640 1 --2- 172.21.15.18:0/179830842 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06cc16bf20 0x7f06cc0c5930 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.869+0000 7f06d0cf2640 1 -- 172.21.15.18:0/179830842 >> 172.21.15.18:0/179830842 conn(0x7f06cc0727a0 msgr2=0x7f06cc16b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:28.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.869+0000 7f06d0cf2640 1 -- 172.21.15.18:0/179830842 shutdown_connections 2024-04-17T19:53:28.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.869+0000 7f06d0cf2640 1 -- 172.21.15.18:0/179830842 wait complete. 2024-04-17T19:53:28.869 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509450 for osd.3 2024-04-17T19:53:28.869 DEBUG:teuthology.parallel:result is None 2024-04-17T19:53:28.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.873+0000 7fe1c759e640 1 -- 172.21.15.18:0/2515001738 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fe1ac005590 con 0x7fe1c003c480 2024-04-17T19:53:28.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.873+0000 7fe1b6ffd640 1 -- 172.21.15.18:0/2515001738 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe1bc059f40 con 0x7fe1c003c480 2024-04-17T19:53:28.870 INFO:teuthology.orchestra.run.smithi018.stdout:64424509449 2024-04-17T19:53:28.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.877+0000 7f4d90f04640 1 -- 172.21.15.18:0/857989781 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f4d840354d0 con 0x7f4d84051100 2024-04-17T19:53:28.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.877+0000 7f4d7affd640 1 -- 172.21.15.18:0/857989781 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4d80056ed0 con 0x7f4d84051100 2024-04-17T19:53:28.872 INFO:teuthology.orchestra.run.smithi018.stdout:64424509451 2024-04-17T19:53:28.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.877+0000 7fe1c759e640 1 -- 172.21.15.18:0/2515001738 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fe1a8068450 msgr2=0x7fe1a806a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:28.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.877+0000 7fe1c759e640 1 --2- 172.21.15.18:0/2515001738 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fe1a8068450 0x7fe1a806a960 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe1b80ae000 tx=0x7fe1b80b5040 comp rx=0 tx=0).stop 2024-04-17T19:53:28.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.877+0000 7fe1c759e640 1 -- 172.21.15.18:0/2515001738 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1c003c480 msgr2=0x7fe1c00ebe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:28.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.877+0000 7fe1c759e640 1 --2- 172.21.15.18:0/2515001738 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1c003c480 0x7fe1c00ebe60 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc00c3c0 tx=0x7fe1bc00c880 comp rx=0 tx=0).stop 2024-04-17T19:53:28.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.877+0000 7fe1c759e640 1 -- 172.21.15.18:0/2515001738 shutdown_connections 2024-04-17T19:53:28.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.877+0000 7fe1c759e640 1 --2- 172.21.15.18:0/2515001738 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fe1a8068450 0x7fe1a806a960 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.877+0000 7fe1c759e640 1 --2- 172.21.15.18:0/2515001738 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe1c00523f0 0x7fe1c00e4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.877+0000 7fe1c759e640 1 --2- 172.21.15.18:0/2515001738 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1c003c480 0x7fe1c00ebe60 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.877+0000 7fe1c759e640 1 --2- 172.21.15.18:0/2515001738 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe1c0038f30 0x7fe1c004f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.877+0000 7fe1c759e640 1 -- 172.21.15.18:0/2515001738 >> 172.21.15.18:0/2515001738 conn(0x7fe1c00539f0 msgr2=0x7fe1c0008d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:28.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.877+0000 7fe1c759e640 1 -- 172.21.15.18:0/2515001738 shutdown_connections 2024-04-17T19:53:28.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.877+0000 7fe1c759e640 1 -- 172.21.15.18:0/2515001738 wait complete. 2024-04-17T19:53:28.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.881+0000 7f4d90f04640 1 -- 172.21.15.18:0/857989781 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f4d6c0683b0 msgr2=0x7f4d6c06a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:28.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.881+0000 7f4d90f04640 1 --2- 172.21.15.18:0/857989781 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f4d6c0683b0 0x7f4d6c06a8c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c0b1000 tx=0x7f4d7c0b4040 comp rx=0 tx=0).stop 2024-04-17T19:53:28.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.881+0000 7f4d90f04640 1 -- 172.21.15.18:0/857989781 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d84051100 msgr2=0x7f4d841896a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:28.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.881+0000 7f4d90f04640 1 --2- 172.21.15.18:0/857989781 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d84051100 0x7f4d841896a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4d8000d800 tx=0x7f4d8000dcc0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.881+0000 7f4d90f04640 1 -- 172.21.15.18:0/857989781 shutdown_connections 2024-04-17T19:53:28.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.881+0000 7f4d90f04640 1 --2- 172.21.15.18:0/857989781 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f4d6c0683b0 0x7f4d6c06a8c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.881+0000 7f4d90f04640 1 --2- 172.21.15.18:0/857989781 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4d840e0a40 0x7f4d840d98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.881+0000 7f4d90f04640 1 --2- 172.21.15.18:0/857989781 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d84051100 0x7f4d841896a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.881+0000 7f4d90f04640 1 --2- 172.21.15.18:0/857989781 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d84034da0 0x7f4d84039f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.881+0000 7f4d90f04640 1 -- 172.21.15.18:0/857989781 >> 172.21.15.18:0/857989781 conn(0x7f4d84055e10 msgr2=0x7f4d84008990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:28.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.881+0000 7f4d90f04640 1 -- 172.21.15.18:0/857989781 shutdown_connections 2024-04-17T19:53:28.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.881+0000 7f4d90f04640 1 -- 172.21.15.18:0/857989781 wait complete. 2024-04-17T19:53:28.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.881+0000 7f90422a4640 1 -- 172.21.15.18:0/387367611 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f90340e88b0 con 0x7f90340eb8f0 2024-04-17T19:53:28.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.885+0000 7f9031ffb640 1 -- 172.21.15.18:0/387367611 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f903c08f030 con 0x7f90340eb8f0 2024-04-17T19:53:28.880 INFO:teuthology.orchestra.run.smithi018.stdout:64424509450 2024-04-17T19:53:28.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.885+0000 7f90422a4640 1 -- 172.21.15.18:0/387367611 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f9028068470 msgr2=0x7f902806a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:28.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.885+0000 7f90422a4640 1 --2- 172.21.15.18:0/387367611 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f9028068470 0x7f902806a980 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f902c0ad000 tx=0x7f902c0a6000 comp rx=0 tx=0).stop 2024-04-17T19:53:28.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.885+0000 7f90422a4640 1 -- 172.21.15.18:0/387367611 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f90340eb8f0 msgr2=0x7f90340e4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:28.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.885+0000 7f90422a4640 1 --2- 172.21.15.18:0/387367611 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f90340eb8f0 0x7f90340e4db0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f903c000b70 tx=0x7f903c075b70 comp rx=0 tx=0).stop 2024-04-17T19:53:28.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.889+0000 7f90422a4640 1 -- 172.21.15.18:0/387367611 shutdown_connections 2024-04-17T19:53:28.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.889+0000 7f90422a4640 1 --2- 172.21.15.18:0/387367611 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f9028068470 0x7f902806a980 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.889+0000 7f90422a4640 1 --2- 172.21.15.18:0/387367611 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f90340eb8f0 0x7f90340e4db0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.889+0000 7f90422a4640 1 --2- 172.21.15.18:0/387367611 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9034033a80 0x7f90340e4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.889+0000 7f90422a4640 1 --2- 172.21.15.18:0/387367611 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9034006810 0x7f90340ea530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:28.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.889+0000 7f90422a4640 1 -- 172.21.15.18:0/387367611 >> 172.21.15.18:0/387367611 conn(0x7f9034054d00 msgr2=0x7f9034047420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:28.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.889+0000 7f90422a4640 1 -- 172.21.15.18:0/387367611 shutdown_connections 2024-04-17T19:53:28.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:28.889+0000 7f90422a4640 1 -- 172.21.15.18:0/387367611 wait complete. 2024-04-17T19:53:28.889 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509450 for osd.5 2024-04-17T19:53:28.889 DEBUG:teuthology.parallel:result is None 2024-04-17T19:53:28.902 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509450 for osd.4 2024-04-17T19:53:28.902 DEBUG:teuthology.parallel:result is None 2024-04-17T19:53:28.907 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509451 for osd.7 2024-04-17T19:53:28.908 DEBUG:teuthology.parallel:result is None 2024-04-17T19:53:28.908 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509449 for osd.1 2024-04-17T19:53:28.908 DEBUG:teuthology.parallel:result is None 2024-04-17T19:53:28.912 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509450 for osd.0 2024-04-17T19:53:28.912 DEBUG:teuthology.parallel:result is None 2024-04-17T19:53:28.912 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-17T19:53:28.912 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T19:53:29.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.093+0000 7f6ee8c73640 1 Processor -- start 2024-04-17T19:53:29.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.093+0000 7f6ee8c73640 1 -- start start 2024-04-17T19:53:29.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.093+0000 7f6ee8c73640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6ee40d3b80 0x7f6ee40cff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:29.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.093+0000 7f6ee8c73640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6ee40d0450 0x7f6ee41631c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:29.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.093+0000 7f6ee8c73640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f6ee4163700 0x7f6ee4163b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:29.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.093+0000 7f6ee8c73640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f6ee40d3f90 con 0x7f6ee40d3b80 2024-04-17T19:53:29.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.093+0000 7f6ee8c73640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f6ee4164050 con 0x7f6ee4163700 2024-04-17T19:53:29.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.093+0000 7f6ee8c73640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f6ee4160be0 con 0x7f6ee40d0450 2024-04-17T19:53:29.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.093+0000 7f6ee259c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6ee40d3b80 0x7f6ee40cff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:29.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.093+0000 7f6ee259c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6ee40d3b80 0x7f6ee40cff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50118/0 (socket says 172.21.15.18:50118) 2024-04-17T19:53:29.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.093+0000 7f6ee259c640 1 -- 172.21.15.18:0/1878005743 learned_addr learned my addr 172.21.15.18:0/1878005743 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:29.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.093+0000 7f6ee2d9d640 1 --2- 172.21.15.18:0/1878005743 >> v2:172.21.15.173:3300/0 conn(0x7f6ee4163700 0x7f6ee4163b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:29.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.093+0000 7f6ee1d9b640 1 --2- 172.21.15.18:0/1878005743 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6ee40d0450 0x7f6ee41631c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:29.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.093+0000 7f6ee259c640 1 -- 172.21.15.18:0/1878005743 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6ee40d0450 msgr2=0x7f6ee41631c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:29.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.093+0000 7f6ee259c640 1 --2- 172.21.15.18:0/1878005743 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6ee40d0450 0x7f6ee41631c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:29.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.093+0000 7f6ee259c640 1 -- 172.21.15.18:0/1878005743 >> v2:172.21.15.173:3300/0 conn(0x7f6ee4163700 msgr2=0x7f6ee4163b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:29.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.093+0000 7f6ee259c640 1 --2- 172.21.15.18:0/1878005743 >> v2:172.21.15.173:3300/0 conn(0x7f6ee4163700 0x7f6ee4163b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:29.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.097+0000 7f6ee259c640 1 -- 172.21.15.18:0/1878005743 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ee40d0860 con 0x7f6ee40d3b80 2024-04-17T19:53:29.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.097+0000 7f6ee259c640 1 --2- 172.21.15.18:0/1878005743 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ee40d3b80 0x7f6ee40cff10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6ee408e100 tx=0x7f6ed401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31a8f61350c3d260 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:29.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.097+0000 7f6ee159a640 1 -- 172.21.15.18:0/1878005743 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed40b1070 con 0x7f6ee40d3b80 2024-04-17T19:53:29.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.097+0000 7f6ee159a640 1 -- 172.21.15.18:0/1878005743 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ed40ac630 con 0x7f6ee40d3b80 2024-04-17T19:53:29.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.097+0000 7f6ee159a640 1 -- 172.21.15.18:0/1878005743 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed40a8050 con 0x7f6ee40d3b80 2024-04-17T19:53:29.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.097+0000 7f6ee8c73640 1 -- 172.21.15.18:0/1878005743 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ee40d3b80 msgr2=0x7f6ee40cff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:29.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.097+0000 7f6ee8c73640 1 --2- 172.21.15.18:0/1878005743 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ee40d3b80 0x7f6ee40cff10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6ee408e100 tx=0x7f6ed401c520 comp rx=0 tx=0).stop 2024-04-17T19:53:29.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.097+0000 7f6ee8c73640 1 -- 172.21.15.18:0/1878005743 shutdown_connections 2024-04-17T19:53:29.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.097+0000 7f6ee8c73640 1 --2- 172.21.15.18:0/1878005743 >> v2:172.21.15.173:3300/0 conn(0x7f6ee4163700 0x7f6ee4163b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:29.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.097+0000 7f6ee8c73640 1 --2- 172.21.15.18:0/1878005743 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6ee40d0450 0x7f6ee41631c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:29.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.097+0000 7f6ee8c73640 1 --2- 172.21.15.18:0/1878005743 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ee40d3b80 0x7f6ee40cff10 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:29.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.097+0000 7f6ee8c73640 1 -- 172.21.15.18:0/1878005743 >> 172.21.15.18:0/1878005743 conn(0x7f6ee40d4ed0 msgr2=0x7f6ee40d52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:29.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.097+0000 7f6ee8c73640 1 -- 172.21.15.18:0/1878005743 shutdown_connections 2024-04-17T19:53:29.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.097+0000 7f6ee8c73640 1 -- 172.21.15.18:0/1878005743 wait complete. 2024-04-17T19:53:29.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.101+0000 7f6ee8c73640 1 Processor -- start 2024-04-17T19:53:29.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.101+0000 7f6ee8c73640 1 -- start start 2024-04-17T19:53:29.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.101+0000 7f6ee8c73640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6ee40d0450 0x7f6ee414eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:29.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.101+0000 7f6ee8c73640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ee40d3b80 0x7f6ee4161dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:29.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.101+0000 7f6ee8c73640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ee4163700 0x7f6ee4162300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:29.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.101+0000 7f6ee8c73640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee415fdd0 con 0x7f6ee4163700 2024-04-17T19:53:29.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.101+0000 7f6ee8c73640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee40d4a50 con 0x7f6ee40d3b80 2024-04-17T19:53:29.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.101+0000 7f6ee8c73640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f6ee415ff50 con 0x7f6ee40d0450 2024-04-17T19:53:29.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.101+0000 7f6ee2d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ee4163700 0x7f6ee4162300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:29.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.101+0000 7f6ee2d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ee4163700 0x7f6ee4162300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50134/0 (socket says 172.21.15.18:50134) 2024-04-17T19:53:29.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.101+0000 7f6ee2d9d640 1 -- 172.21.15.18:0/2699004273 learned_addr learned my addr 172.21.15.18:0/2699004273 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:29.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.101+0000 7f6ee1d9b640 1 --2- 172.21.15.18:0/2699004273 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ee40d3b80 0x7f6ee4161dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:29.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.101+0000 7f6ee259c640 1 --2- 172.21.15.18:0/2699004273 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6ee40d0450 0x7f6ee414eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:29.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.101+0000 7f6ee2d9d640 1 -- 172.21.15.18:0/2699004273 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6ee40d0450 msgr2=0x7f6ee414eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:29.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.101+0000 7f6ee2d9d640 1 --2- 172.21.15.18:0/2699004273 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6ee40d0450 0x7f6ee414eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:29.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.101+0000 7f6ee2d9d640 1 -- 172.21.15.18:0/2699004273 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ee40d3b80 msgr2=0x7f6ee4161dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:29.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.101+0000 7f6ee2d9d640 1 --2- 172.21.15.18:0/2699004273 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ee40d3b80 0x7f6ee4161dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:29.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.101+0000 7f6ee2d9d640 1 -- 172.21.15.18:0/2699004273 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ee4150ce0 con 0x7f6ee4163700 2024-04-17T19:53:29.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.101+0000 7f6ee259c640 1 --2- 172.21.15.18:0/2699004273 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6ee40d0450 0x7f6ee414eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:53:29.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.101+0000 7f6ee2d9d640 1 --2- 172.21.15.18:0/2699004273 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ee4163700 0x7f6ee4162300 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6edc007d70 tx=0x7f6edc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:29.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.101+0000 7f6ed2ffd640 1 -- 172.21.15.18:0/2699004273 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6edc014420 con 0x7f6ee4163700 2024-04-17T19:53:29.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.101+0000 7f6ed2ffd640 1 -- 172.21.15.18:0/2699004273 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6edc019070 con 0x7f6ee4163700 2024-04-17T19:53:29.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.101+0000 7f6ed2ffd640 1 -- 172.21.15.18:0/2699004273 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6edc014820 con 0x7f6ee4163700 2024-04-17T19:53:29.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.101+0000 7f6ee8c73640 1 -- 172.21.15.18:0/2699004273 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ee41584c0 con 0x7f6ee4163700 2024-04-17T19:53:29.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.101+0000 7f6ee8c73640 1 -- 172.21.15.18:0/2699004273 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ee4150f50 con 0x7f6ee4163700 2024-04-17T19:53:29.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.105+0000 7f6ee8c73640 1 -- 172.21.15.18:0/2699004273 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ee41508a0 con 0x7f6ee4163700 2024-04-17T19:53:29.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.105+0000 7f6ed2ffd640 1 -- 172.21.15.18:0/2699004273 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6edc0149c0 con 0x7f6ee4163700 2024-04-17T19:53:29.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.105+0000 7f6ed2ffd640 1 --2- 172.21.15.18:0/2699004273 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f6ec4068380 0x7f6ec406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:29.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.105+0000 7f6ed2ffd640 1 -- 172.21.15.18:0/2699004273 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f6edc087520 con 0x7f6ee4163700 2024-04-17T19:53:29.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.105+0000 7f6ee259c640 1 --2- 172.21.15.18:0/2699004273 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f6ec4068380 0x7f6ec406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:29.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.105+0000 7f6ee259c640 1 --2- 172.21.15.18:0/2699004273 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f6ec4068380 0x7f6ec406a890 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6ed40ae000 tx=0x7f6ed4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:29.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.109+0000 7f6ed2ffd640 1 -- 172.21.15.18:0/2699004273 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6ee41508a0 con 0x7f6ee4163700 2024-04-17T19:53:29.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.265+0000 7f6ee8c73640 1 -- 172.21.15.18:0/2699004273 --> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6ee4069950 con 0x7f6ec4068380 2024-04-17T19:53:29.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.289+0000 7f6ed2ffd640 1 -- 172.21.15.18:0/2699004273 <== mgr.4104 v2:172.21.15.18:6832/751466605 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f6ee4069950 con 0x7f6ec4068380 2024-04-17T19:53:29.287 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:53:29.289 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-17T19:53:29.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.293+0000 7f6ee8c73640 1 -- 172.21.15.18:0/2699004273 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f6ec4068380 msgr2=0x7f6ec406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:29.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.293+0000 7f6ee8c73640 1 --2- 172.21.15.18:0/2699004273 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f6ec4068380 0x7f6ec406a890 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6ed40ae000 tx=0x7f6ed4008040 comp rx=0 tx=0).stop 2024-04-17T19:53:29.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.293+0000 7f6ee8c73640 1 -- 172.21.15.18:0/2699004273 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ee4163700 msgr2=0x7f6ee4162300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:29.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.293+0000 7f6ee8c73640 1 --2- 172.21.15.18:0/2699004273 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ee4163700 0x7f6ee4162300 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6edc007d70 tx=0x7f6edc00e4b0 comp rx=0 tx=0).stop 2024-04-17T19:53:29.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.293+0000 7f6ee8c73640 1 -- 172.21.15.18:0/2699004273 shutdown_connections 2024-04-17T19:53:29.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.293+0000 7f6ee8c73640 1 --2- 172.21.15.18:0/2699004273 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f6ec4068380 0x7f6ec406a890 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:29.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.293+0000 7f6ee8c73640 1 --2- 172.21.15.18:0/2699004273 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ee4163700 0x7f6ee4162300 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:29.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.293+0000 7f6ee8c73640 1 --2- 172.21.15.18:0/2699004273 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ee40d3b80 0x7f6ee4161dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:29.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.293+0000 7f6ee8c73640 1 --2- 172.21.15.18:0/2699004273 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6ee40d0450 0x7f6ee414eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:29.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.293+0000 7f6ee8c73640 1 -- 172.21.15.18:0/2699004273 >> 172.21.15.18:0/2699004273 conn(0x7f6ee40d4ed0 msgr2=0x7f6ee4160120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:29.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.293+0000 7f6ee8c73640 1 -- 172.21.15.18:0/2699004273 shutdown_connections 2024-04-17T19:53:29.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.293+0000 7f6ee8c73640 1 -- 172.21.15.18:0/2699004273 wait complete. 2024-04-17T19:53:29.309 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-04-17T19:53:28.349982+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236256,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738464,"statfs":{"total":773094113280,"available":772852187136,"internally_reserved":0,"allocated":3514368,"data_stored":2072296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":238276148},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004116"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.867881+0000","last_change":"2024-04-17T19:53:04.461184+0000","last_active":"2024-04-17T19:53:11.867881+0000","last_peered":"2024-04-17T19:53:11.867881+0000","last_clean":"2024-04-17T19:53:11.867881+0000","last_became_active":"2024-04-17T19:53:04.460006+0000","last_became_peered":"2024-04-17T19:53:04.460006+0000","last_unstale":"2024-04-17T19:53:11.867881+0000","last_undegraded":"2024-04-17T19:53:11.867881+0000","last_fullsized":"2024-04-17T19:53:11.867881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:23:02.868468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.495714+0000","last_change":"2024-04-17T19:53:05.474006+0000","last_active":"2024-04-17T19:53:10.495714+0000","last_peered":"2024-04-17T19:53:10.495714+0000","last_clean":"2024-04-17T19:53:10.495714+0000","last_became_active":"2024-04-17T19:53:05.467848+0000","last_became_peered":"2024-04-17T19:53:05.467848+0000","last_unstale":"2024-04-17T19:53:10.495714+0000","last_undegraded":"2024-04-17T19:53:10.495714+0000","last_fullsized":"2024-04-17T19:53:10.495714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:05:21.173050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.779378+0000","last_change":"2024-04-17T19:53:09.559397+0000","last_active":"2024-04-17T19:53:10.779378+0000","last_peered":"2024-04-17T19:53:10.779378+0000","last_clean":"2024-04-17T19:53:10.779378+0000","last_became_active":"2024-04-17T19:53:09.558504+0000","last_became_peered":"2024-04-17T19:53:09.558504+0000","last_unstale":"2024-04-17T19:53:10.779378+0000","last_undegraded":"2024-04-17T19:53:10.779378+0000","last_fullsized":"2024-04-17T19:53:10.779378+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:06:18.745394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.496229+0000","last_change":"2024-04-17T19:53:04.484961+0000","last_active":"2024-04-17T19:53:10.496229+0000","last_peered":"2024-04-17T19:53:10.496229+0000","last_clean":"2024-04-17T19:53:10.496229+0000","last_became_active":"2024-04-17T19:53:04.468291+0000","last_became_peered":"2024-04-17T19:53:04.468291+0000","last_unstale":"2024-04-17T19:53:10.496229+0000","last_undegraded":"2024-04-17T19:53:10.496229+0000","last_fullsized":"2024-04-17T19:53:10.496229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:06:00.469757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.494707+0000","last_change":"2024-04-17T19:53:05.475578+0000","last_active":"2024-04-17T19:53:10.494707+0000","last_peered":"2024-04-17T19:53:10.494707+0000","last_clean":"2024-04-17T19:53:10.494707+0000","last_became_active":"2024-04-17T19:53:05.473678+0000","last_became_peered":"2024-04-17T19:53:05.473678+0000","last_unstale":"2024-04-17T19:53:10.494707+0000","last_undegraded":"2024-04-17T19:53:10.494707+0000","last_fullsized":"2024-04-17T19:53:10.494707+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:47:05.354826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.863354+0000","last_change":"2024-04-17T19:53:09.545180+0000","last_active":"2024-04-17T19:53:11.863354+0000","last_peered":"2024-04-17T19:53:11.863354+0000","last_clean":"2024-04-17T19:53:11.863354+0000","last_became_active":"2024-04-17T19:53:09.544580+0000","last_became_peered":"2024-04-17T19:53:09.544580+0000","last_unstale":"2024-04-17T19:53:11.863354+0000","last_undegraded":"2024-04-17T19:53:11.863354+0000","last_fullsized":"2024-04-17T19:53:11.863354+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:02:44.844970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.529583+0000","last_change":"2024-04-17T19:53:04.468009+0000","last_active":"2024-04-17T19:53:10.529583+0000","last_peered":"2024-04-17T19:53:10.529583+0000","last_clean":"2024-04-17T19:53:10.529583+0000","last_became_active":"2024-04-17T19:53:04.467568+0000","last_became_peered":"2024-04-17T19:53:04.467568+0000","last_unstale":"2024-04-17T19:53:10.529583+0000","last_undegraded":"2024-04-17T19:53:10.529583+0000","last_fullsized":"2024-04-17T19:53:10.529583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:18:11.256327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.528343+0000","last_change":"2024-04-17T19:53:05.464961+0000","last_active":"2024-04-17T19:53:11.528343+0000","last_peered":"2024-04-17T19:53:11.528343+0000","last_clean":"2024-04-17T19:53:11.528343+0000","last_became_active":"2024-04-17T19:53:05.464601+0000","last_became_peered":"2024-04-17T19:53:05.464601+0000","last_unstale":"2024-04-17T19:53:11.528343+0000","last_undegraded":"2024-04-17T19:53:11.528343+0000","last_fullsized":"2024-04-17T19:53:11.528343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:12:03.449509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.863767+0000","last_change":"2024-04-17T19:53:09.529447+0000","last_active":"2024-04-17T19:53:11.863767+0000","last_peered":"2024-04-17T19:53:11.863767+0000","last_clean":"2024-04-17T19:53:11.863767+0000","last_became_active":"2024-04-17T19:53:09.528285+0000","last_became_peered":"2024-04-17T19:53:09.528285+0000","last_unstale":"2024-04-17T19:53:11.863767+0000","last_undegraded":"2024-04-17T19:53:11.863767+0000","last_fullsized":"2024-04-17T19:53:11.863767+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:47:09.400433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.529734+0000","last_change":"2024-04-17T19:53:04.467639+0000","last_active":"2024-04-17T19:53:10.529734+0000","last_peered":"2024-04-17T19:53:10.529734+0000","last_clean":"2024-04-17T19:53:10.529734+0000","last_became_active":"2024-04-17T19:53:04.467004+0000","last_became_peered":"2024-04-17T19:53:04.467004+0000","last_unstale":"2024-04-17T19:53:10.529734+0000","last_undegraded":"2024-04-17T19:53:10.529734+0000","last_fullsized":"2024-04-17T19:53:10.529734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:38:40.499868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.492819+0000","last_change":"2024-04-17T19:53:05.468179+0000","last_active":"2024-04-17T19:53:10.492819+0000","last_peered":"2024-04-17T19:53:10.492819+0000","last_clean":"2024-04-17T19:53:10.492819+0000","last_became_active":"2024-04-17T19:53:05.467217+0000","last_became_peered":"2024-04-17T19:53:05.467217+0000","last_unstale":"2024-04-17T19:53:10.492819+0000","last_undegraded":"2024-04-17T19:53:10.492819+0000","last_fullsized":"2024-04-17T19:53:10.492819+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:29:50.290114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.863352+0000","last_change":"2024-04-17T19:53:09.549722+0000","last_active":"2024-04-17T19:53:11.863352+0000","last_peered":"2024-04-17T19:53:11.863352+0000","last_clean":"2024-04-17T19:53:11.863352+0000","last_became_active":"2024-04-17T19:53:09.548876+0000","last_became_peered":"2024-04-17T19:53:09.548876+0000","last_unstale":"2024-04-17T19:53:11.863352+0000","last_undegraded":"2024-04-17T19:53:11.863352+0000","last_fullsized":"2024-04-17T19:53:11.863352+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:15:49.773156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.491904+0000","last_change":"2024-04-17T19:53:05.475996+0000","last_active":"2024-04-17T19:53:10.491904+0000","last_peered":"2024-04-17T19:53:10.491904+0000","last_clean":"2024-04-17T19:53:10.491904+0000","last_became_active":"2024-04-17T19:53:05.475517+0000","last_became_peered":"2024-04-17T19:53:05.475517+0000","last_unstale":"2024-04-17T19:53:10.491904+0000","last_undegraded":"2024-04-17T19:53:10.491904+0000","last_fullsized":"2024-04-17T19:53:10.491904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:39:47.272961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.492869+0000","last_change":"2024-04-17T19:53:04.465884+0000","last_active":"2024-04-17T19:53:10.492869+0000","last_peered":"2024-04-17T19:53:10.492869+0000","last_clean":"2024-04-17T19:53:10.492869+0000","last_became_active":"2024-04-17T19:53:04.465108+0000","last_became_peered":"2024-04-17T19:53:04.465108+0000","last_unstale":"2024-04-17T19:53:10.492869+0000","last_undegraded":"2024-04-17T19:53:10.492869+0000","last_fullsized":"2024-04-17T19:53:10.492869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:23:02.868468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.492043+0000","last_change":"2024-04-17T19:53:09.545287+0000","last_active":"2024-04-17T19:53:10.492043+0000","last_peered":"2024-04-17T19:53:10.492043+0000","last_clean":"2024-04-17T19:53:10.492043+0000","last_became_active":"2024-04-17T19:53:09.544328+0000","last_became_peered":"2024-04-17T19:53:09.544328+0000","last_unstale":"2024-04-17T19:53:10.492043+0000","last_undegraded":"2024-04-17T19:53:10.492043+0000","last_fullsized":"2024-04-17T19:53:10.492043+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:47:26.887721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.779852+0000","last_change":"2024-04-17T19:53:05.496585+0000","last_active":"2024-04-17T19:53:10.779852+0000","last_peered":"2024-04-17T19:53:10.779852+0000","last_clean":"2024-04-17T19:53:10.779852+0000","last_became_active":"2024-04-17T19:53:05.495800+0000","last_became_peered":"2024-04-17T19:53:05.495800+0000","last_unstale":"2024-04-17T19:53:10.779852+0000","last_undegraded":"2024-04-17T19:53:10.779852+0000","last_fullsized":"2024-04-17T19:53:10.779852+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:18:12.267644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.496900+0000","last_change":"2024-04-17T19:53:04.479274+0000","last_active":"2024-04-17T19:53:10.496900+0000","last_peered":"2024-04-17T19:53:10.496900+0000","last_clean":"2024-04-17T19:53:10.496900+0000","last_became_active":"2024-04-17T19:53:04.478425+0000","last_became_peered":"2024-04-17T19:53:04.478425+0000","last_unstale":"2024-04-17T19:53:10.496900+0000","last_undegraded":"2024-04-17T19:53:10.496900+0000","last_fullsized":"2024-04-17T19:53:10.496900+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:16:15.623557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.529101+0000","last_change":"2024-04-17T19:53:09.526995+0000","last_active":"2024-04-17T19:53:10.529101+0000","last_peered":"2024-04-17T19:53:10.529101+0000","last_clean":"2024-04-17T19:53:10.529101+0000","last_became_active":"2024-04-17T19:53:09.525577+0000","last_became_peered":"2024-04-17T19:53:09.525577+0000","last_unstale":"2024-04-17T19:53:10.529101+0000","last_undegraded":"2024-04-17T19:53:10.529101+0000","last_fullsized":"2024-04-17T19:53:10.529101+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:52:59.924361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.866027+0000","last_change":"2024-04-17T19:53:05.463312+0000","last_active":"2024-04-17T19:53:11.866027+0000","last_peered":"2024-04-17T19:53:11.866027+0000","last_clean":"2024-04-17T19:53:11.866027+0000","last_became_active":"2024-04-17T19:53:05.462415+0000","last_became_peered":"2024-04-17T19:53:05.462415+0000","last_unstale":"2024-04-17T19:53:11.866027+0000","last_undegraded":"2024-04-17T19:53:11.866027+0000","last_fullsized":"2024-04-17T19:53:11.866027+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:27:51.520335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.867287+0000","last_change":"2024-04-17T19:53:04.471150+0000","last_active":"2024-04-17T19:53:11.867287+0000","last_peered":"2024-04-17T19:53:11.867287+0000","last_clean":"2024-04-17T19:53:11.867287+0000","last_became_active":"2024-04-17T19:53:04.470258+0000","last_became_peered":"2024-04-17T19:53:04.470258+0000","last_unstale":"2024-04-17T19:53:11.867287+0000","last_undegraded":"2024-04-17T19:53:11.867287+0000","last_fullsized":"2024-04-17T19:53:11.867287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:06:00.469757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.780980+0000","last_change":"2024-04-17T19:53:09.565387+0000","last_active":"2024-04-17T19:53:10.780980+0000","last_peered":"2024-04-17T19:53:10.780980+0000","last_clean":"2024-04-17T19:53:10.780980+0000","last_became_active":"2024-04-17T19:53:09.564134+0000","last_became_peered":"2024-04-17T19:53:09.564134+0000","last_unstale":"2024-04-17T19:53:10.780980+0000","last_undegraded":"2024-04-17T19:53:10.780980+0000","last_fullsized":"2024-04-17T19:53:10.780980+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:21:01.809464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.491285+0000","last_change":"2024-04-17T19:53:05.468962+0000","last_active":"2024-04-17T19:53:10.491285+0000","last_peered":"2024-04-17T19:53:10.491285+0000","last_clean":"2024-04-17T19:53:10.491285+0000","last_became_active":"2024-04-17T19:53:05.466996+0000","last_became_peered":"2024-04-17T19:53:05.466996+0000","last_unstale":"2024-04-17T19:53:10.491285+0000","last_undegraded":"2024-04-17T19:53:10.491285+0000","last_fullsized":"2024-04-17T19:53:10.491285+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:04:55.125411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.528304+0000","last_change":"2024-04-17T19:53:04.472916+0000","last_active":"2024-04-17T19:53:10.528304+0000","last_peered":"2024-04-17T19:53:10.528304+0000","last_clean":"2024-04-17T19:53:10.528304+0000","last_became_active":"2024-04-17T19:53:04.468136+0000","last_became_peered":"2024-04-17T19:53:04.468136+0000","last_unstale":"2024-04-17T19:53:10.528304+0000","last_undegraded":"2024-04-17T19:53:10.528304+0000","last_fullsized":"2024-04-17T19:53:10.528304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:23:02.868468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.864193+0000","last_change":"2024-04-17T19:53:09.558352+0000","last_active":"2024-04-17T19:53:11.864193+0000","last_peered":"2024-04-17T19:53:11.864193+0000","last_clean":"2024-04-17T19:53:11.864193+0000","last_became_active":"2024-04-17T19:53:09.557871+0000","last_became_peered":"2024-04-17T19:53:09.557871+0000","last_unstale":"2024-04-17T19:53:11.864193+0000","last_undegraded":"2024-04-17T19:53:11.864193+0000","last_fullsized":"2024-04-17T19:53:11.864193+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:34:07.690034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.867320+0000","last_change":"2024-04-17T19:53:05.467799+0000","last_active":"2024-04-17T19:53:11.867320+0000","last_peered":"2024-04-17T19:53:11.867320+0000","last_clean":"2024-04-17T19:53:11.867320+0000","last_became_active":"2024-04-17T19:53:05.465048+0000","last_became_peered":"2024-04-17T19:53:05.465048+0000","last_unstale":"2024-04-17T19:53:11.867320+0000","last_undegraded":"2024-04-17T19:53:11.867320+0000","last_fullsized":"2024-04-17T19:53:11.867320+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:19:09.456602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.494989+0000","last_change":"2024-04-17T19:53:04.469594+0000","last_active":"2024-04-17T19:53:10.494989+0000","last_peered":"2024-04-17T19:53:10.494989+0000","last_clean":"2024-04-17T19:53:10.494989+0000","last_became_active":"2024-04-17T19:53:04.469119+0000","last_became_peered":"2024-04-17T19:53:04.469119+0000","last_unstale":"2024-04-17T19:53:10.494989+0000","last_undegraded":"2024-04-17T19:53:10.494989+0000","last_fullsized":"2024-04-17T19:53:10.494989+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:40:30.547343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.863355+0000","last_change":"2024-04-17T19:53:09.527277+0000","last_active":"2024-04-17T19:53:11.863355+0000","last_peered":"2024-04-17T19:53:11.863355+0000","last_clean":"2024-04-17T19:53:11.863355+0000","last_became_active":"2024-04-17T19:53:09.526436+0000","last_became_peered":"2024-04-17T19:53:09.526436+0000","last_unstale":"2024-04-17T19:53:11.863355+0000","last_undegraded":"2024-04-17T19:53:11.863355+0000","last_fullsized":"2024-04-17T19:53:11.863355+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:54:31.569576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.867699+0000","last_change":"2024-04-17T19:53:05.443712+0000","last_active":"2024-04-17T19:53:11.867699+0000","last_peered":"2024-04-17T19:53:11.867699+0000","last_clean":"2024-04-17T19:53:11.867699+0000","last_became_active":"2024-04-17T19:53:05.442881+0000","last_became_peered":"2024-04-17T19:53:05.442881+0000","last_unstale":"2024-04-17T19:53:11.867699+0000","last_undegraded":"2024-04-17T19:53:11.867699+0000","last_fullsized":"2024-04-17T19:53:11.867699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:20:57.763858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.867688+0000","last_change":"2024-04-17T19:53:04.465717+0000","last_active":"2024-04-17T19:53:11.867688+0000","last_peered":"2024-04-17T19:53:11.867688+0000","last_clean":"2024-04-17T19:53:11.867688+0000","last_became_active":"2024-04-17T19:53:04.464701+0000","last_became_peered":"2024-04-17T19:53:04.464701+0000","last_unstale":"2024-04-17T19:53:11.867688+0000","last_undegraded":"2024-04-17T19:53:11.867688+0000","last_fullsized":"2024-04-17T19:53:11.867688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:18:11.256327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.866220+0000","last_change":"2024-04-17T19:53:09.530585+0000","last_active":"2024-04-17T19:53:11.866220+0000","last_peered":"2024-04-17T19:53:11.866220+0000","last_clean":"2024-04-17T19:53:11.866220+0000","last_became_active":"2024-04-17T19:53:09.529345+0000","last_became_peered":"2024-04-17T19:53:09.529345+0000","last_unstale":"2024-04-17T19:53:11.866220+0000","last_undegraded":"2024-04-17T19:53:11.866220+0000","last_fullsized":"2024-04-17T19:53:11.866220+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:01:38.507428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.497866+0000","last_change":"2024-04-17T19:53:05.452177+0000","last_active":"2024-04-17T19:53:10.497866+0000","last_peered":"2024-04-17T19:53:10.497866+0000","last_clean":"2024-04-17T19:53:10.497866+0000","last_became_active":"2024-04-17T19:53:05.451272+0000","last_became_peered":"2024-04-17T19:53:05.451272+0000","last_unstale":"2024-04-17T19:53:10.497866+0000","last_undegraded":"2024-04-17T19:53:10.497866+0000","last_fullsized":"2024-04-17T19:53:10.497866+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:51:17.675125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.493390+0000","last_change":"2024-04-17T19:53:04.471944+0000","last_active":"2024-04-17T19:53:10.493390+0000","last_peered":"2024-04-17T19:53:10.493390+0000","last_clean":"2024-04-17T19:53:10.493390+0000","last_became_active":"2024-04-17T19:53:04.471458+0000","last_became_peered":"2024-04-17T19:53:04.471458+0000","last_unstale":"2024-04-17T19:53:10.493390+0000","last_undegraded":"2024-04-17T19:53:10.493390+0000","last_fullsized":"2024-04-17T19:53:10.493390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:12:02.438192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.495688+0000","last_change":"2024-04-17T19:53:09.549998+0000","last_active":"2024-04-17T19:53:10.495688+0000","last_peered":"2024-04-17T19:53:10.495688+0000","last_clean":"2024-04-17T19:53:10.495688+0000","last_became_active":"2024-04-17T19:53:09.548136+0000","last_became_peered":"2024-04-17T19:53:09.548136+0000","last_unstale":"2024-04-17T19:53:10.495688+0000","last_undegraded":"2024-04-17T19:53:10.495688+0000","last_fullsized":"2024-04-17T19:53:10.495688+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:02:14.459968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.863519+0000","last_change":"2024-04-17T19:53:05.472884+0000","last_active":"2024-04-17T19:53:11.863519+0000","last_peered":"2024-04-17T19:53:11.863519+0000","last_clean":"2024-04-17T19:53:11.863519+0000","last_became_active":"2024-04-17T19:53:05.472513+0000","last_became_peered":"2024-04-17T19:53:05.472513+0000","last_unstale":"2024-04-17T19:53:11.863519+0000","last_undegraded":"2024-04-17T19:53:11.863519+0000","last_fullsized":"2024-04-17T19:53:11.863519+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:21:37.163564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.493966+0000","last_change":"2024-04-17T19:53:04.487713+0000","last_active":"2024-04-17T19:53:10.493966+0000","last_peered":"2024-04-17T19:53:10.493966+0000","last_clean":"2024-04-17T19:53:10.493966+0000","last_became_active":"2024-04-17T19:53:04.487005+0000","last_became_peered":"2024-04-17T19:53:04.487005+0000","last_unstale":"2024-04-17T19:53:10.493966+0000","last_undegraded":"2024-04-17T19:53:10.493966+0000","last_fullsized":"2024-04-17T19:53:10.493966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:53:36.130201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.496249+0000","last_change":"2024-04-17T19:53:09.547824+0000","last_active":"2024-04-17T19:53:10.496249+0000","last_peered":"2024-04-17T19:53:10.496249+0000","last_clean":"2024-04-17T19:53:10.496249+0000","last_became_active":"2024-04-17T19:53:09.545636+0000","last_became_peered":"2024-04-17T19:53:09.545636+0000","last_unstale":"2024-04-17T19:53:10.496249+0000","last_undegraded":"2024-04-17T19:53:10.496249+0000","last_fullsized":"2024-04-17T19:53:10.496249+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:06:17.885652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.529514+0000","last_change":"2024-04-17T19:53:05.465820+0000","last_active":"2024-04-17T19:53:10.529514+0000","last_peered":"2024-04-17T19:53:10.529514+0000","last_clean":"2024-04-17T19:53:10.529514+0000","last_became_active":"2024-04-17T19:53:05.464376+0000","last_became_peered":"2024-04-17T19:53:05.464376+0000","last_unstale":"2024-04-17T19:53:10.529514+0000","last_undegraded":"2024-04-17T19:53:10.529514+0000","last_fullsized":"2024-04-17T19:53:10.529514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:53:13.956259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.492409+0000","last_change":"2024-04-17T19:53:04.464706+0000","last_active":"2024-04-17T19:53:10.492409+0000","last_peered":"2024-04-17T19:53:10.492409+0000","last_clean":"2024-04-17T19:53:10.492409+0000","last_became_active":"2024-04-17T19:53:04.464109+0000","last_became_peered":"2024-04-17T19:53:04.464109+0000","last_unstale":"2024-04-17T19:53:10.492409+0000","last_undegraded":"2024-04-17T19:53:10.492409+0000","last_fullsized":"2024-04-17T19:53:10.492409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:38:40.499868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.497647+0000","last_change":"2024-04-17T19:53:09.553078+0000","last_active":"2024-04-17T19:53:10.497647+0000","last_peered":"2024-04-17T19:53:10.497647+0000","last_clean":"2024-04-17T19:53:10.497647+0000","last_became_active":"2024-04-17T19:53:09.548806+0000","last_became_peered":"2024-04-17T19:53:09.548806+0000","last_unstale":"2024-04-17T19:53:10.497647+0000","last_undegraded":"2024-04-17T19:53:10.497647+0000","last_fullsized":"2024-04-17T19:53:10.497647+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:33:37.250066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.493540+0000","last_change":"2024-04-17T19:53:05.476631+0000","last_active":"2024-04-17T19:53:10.493540+0000","last_peered":"2024-04-17T19:53:10.493540+0000","last_clean":"2024-04-17T19:53:10.493540+0000","last_became_active":"2024-04-17T19:53:05.474164+0000","last_became_peered":"2024-04-17T19:53:05.474164+0000","last_unstale":"2024-04-17T19:53:10.493540+0000","last_undegraded":"2024-04-17T19:53:10.493540+0000","last_fullsized":"2024-04-17T19:53:10.493540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:53:13.956259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.779561+0000","last_change":"2024-04-17T19:53:04.486117+0000","last_active":"2024-04-17T19:53:10.779561+0000","last_peered":"2024-04-17T19:53:10.779561+0000","last_clean":"2024-04-17T19:53:10.779561+0000","last_became_active":"2024-04-17T19:53:04.485424+0000","last_became_peered":"2024-04-17T19:53:04.485424+0000","last_unstale":"2024-04-17T19:53:10.779561+0000","last_undegraded":"2024-04-17T19:53:10.779561+0000","last_fullsized":"2024-04-17T19:53:10.779561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:21:45.875274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.496364+0000","last_change":"2024-04-17T19:53:09.549846+0000","last_active":"2024-04-17T19:53:10.496364+0000","last_peered":"2024-04-17T19:53:10.496364+0000","last_clean":"2024-04-17T19:53:10.496364+0000","last_became_active":"2024-04-17T19:53:09.548070+0000","last_became_peered":"2024-04-17T19:53:09.548070+0000","last_unstale":"2024-04-17T19:53:10.496364+0000","last_undegraded":"2024-04-17T19:53:10.496364+0000","last_fullsized":"2024-04-17T19:53:10.496364+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:05.469665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.495415+0000","last_change":"2024-04-17T19:53:05.469993+0000","last_active":"2024-04-17T19:53:10.495415+0000","last_peered":"2024-04-17T19:53:10.495415+0000","last_clean":"2024-04-17T19:53:10.495415+0000","last_became_active":"2024-04-17T19:53:05.468241+0000","last_became_peered":"2024-04-17T19:53:05.468241+0000","last_unstale":"2024-04-17T19:53:10.495415+0000","last_undegraded":"2024-04-17T19:53:10.495415+0000","last_fullsized":"2024-04-17T19:53:10.495415+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:39:15.005822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.491765+0000","last_change":"2024-04-17T19:53:04.484259+0000","last_active":"2024-04-17T19:53:10.491765+0000","last_peered":"2024-04-17T19:53:10.491765+0000","last_clean":"2024-04-17T19:53:10.491765+0000","last_became_active":"2024-04-17T19:53:04.483882+0000","last_became_peered":"2024-04-17T19:53:04.483882+0000","last_unstale":"2024-04-17T19:53:10.491765+0000","last_undegraded":"2024-04-17T19:53:10.491765+0000","last_fullsized":"2024-04-17T19:53:10.491765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:18:11.256327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.495038+0000","last_change":"2024-04-17T19:53:09.559932+0000","last_active":"2024-04-17T19:53:10.495038+0000","last_peered":"2024-04-17T19:53:10.495038+0000","last_clean":"2024-04-17T19:53:10.495038+0000","last_became_active":"2024-04-17T19:53:09.558888+0000","last_became_peered":"2024-04-17T19:53:09.558888+0000","last_unstale":"2024-04-17T19:53:10.495038+0000","last_undegraded":"2024-04-17T19:53:10.495038+0000","last_fullsized":"2024-04-17T19:53:10.495038+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:22:59.388953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.866936+0000","last_change":"2024-04-17T19:53:05.463658+0000","last_active":"2024-04-17T19:53:11.866936+0000","last_peered":"2024-04-17T19:53:11.866936+0000","last_clean":"2024-04-17T19:53:11.866936+0000","last_became_active":"2024-04-17T19:53:05.462437+0000","last_became_peered":"2024-04-17T19:53:05.462437+0000","last_unstale":"2024-04-17T19:53:11.866936+0000","last_undegraded":"2024-04-17T19:53:11.866936+0000","last_fullsized":"2024-04-17T19:53:11.866936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:06:14.699788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.492615+0000","last_change":"2024-04-17T19:53:04.459172+0000","last_active":"2024-04-17T19:53:10.492615+0000","last_peered":"2024-04-17T19:53:10.492615+0000","last_clean":"2024-04-17T19:53:10.492615+0000","last_became_active":"2024-04-17T19:53:04.458798+0000","last_became_peered":"2024-04-17T19:53:04.458798+0000","last_unstale":"2024-04-17T19:53:10.492615+0000","last_undegraded":"2024-04-17T19:53:10.492615+0000","last_fullsized":"2024-04-17T19:53:10.492615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:21:36.152247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":177,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.527066+0000","last_change":"2024-04-17T19:52:54.651873+0000","last_active":"2024-04-17T19:53:11.527066+0000","last_peered":"2024-04-17T19:53:11.527066+0000","last_clean":"2024-04-17T19:53:11.527066+0000","last_became_active":"2024-04-17T19:52:54.649700+0000","last_became_peered":"2024-04-17T19:52:54.649700+0000","last_unstale":"2024-04-17T19:53:11.527066+0000","last_undegraded":"2024-04-17T19:53:11.527066+0000","last_fullsized":"2024-04-17T19:53:11.527066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:52:53.245174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:52:53.245174+0000","last_clean_scrub_stamp":"2024-04-17T19:52:53.245174+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:26:16.094093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.493284+0000","last_change":"2024-04-17T19:53:09.520288+0000","last_active":"2024-04-17T19:53:10.493284+0000","last_peered":"2024-04-17T19:53:10.493284+0000","last_clean":"2024-04-17T19:53:10.493284+0000","last_became_active":"2024-04-17T19:53:09.519226+0000","last_became_peered":"2024-04-17T19:53:09.519226+0000","last_unstale":"2024-04-17T19:53:10.493284+0000","last_undegraded":"2024-04-17T19:53:10.493284+0000","last_fullsized":"2024-04-17T19:53:10.493284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:35:04.617369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.492930+0000","last_change":"2024-04-17T19:53:05.475968+0000","last_active":"2024-04-17T19:53:10.492930+0000","last_peered":"2024-04-17T19:53:10.492930+0000","last_clean":"2024-04-17T19:53:10.492930+0000","last_became_active":"2024-04-17T19:53:05.475600+0000","last_became_peered":"2024-04-17T19:53:05.475600+0000","last_unstale":"2024-04-17T19:53:10.492930+0000","last_undegraded":"2024-04-17T19:53:10.492930+0000","last_fullsized":"2024-04-17T19:53:10.492930+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:34:03.644428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.497904+0000","last_change":"2024-04-17T19:53:04.457214+0000","last_active":"2024-04-17T19:53:10.497904+0000","last_peered":"2024-04-17T19:53:10.497904+0000","last_clean":"2024-04-17T19:53:10.497904+0000","last_became_active":"2024-04-17T19:53:04.453473+0000","last_became_peered":"2024-04-17T19:53:04.453473+0000","last_unstale":"2024-04-17T19:53:10.497904+0000","last_undegraded":"2024-04-17T19:53:10.497904+0000","last_fullsized":"2024-04-17T19:53:10.497904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:14:03.008171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.863346+0000","last_change":"2024-04-17T19:53:09.548981+0000","last_active":"2024-04-17T19:53:11.863346+0000","last_peered":"2024-04-17T19:53:11.863346+0000","last_clean":"2024-04-17T19:53:11.863346+0000","last_became_active":"2024-04-17T19:53:09.548575+0000","last_became_peered":"2024-04-17T19:53:09.548575+0000","last_unstale":"2024-04-17T19:53:11.863346+0000","last_undegraded":"2024-04-17T19:53:11.863346+0000","last_fullsized":"2024-04-17T19:53:11.863346+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:05:25.218656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.529559+0000","last_change":"2024-04-17T19:53:05.464697+0000","last_active":"2024-04-17T19:53:10.529559+0000","last_peered":"2024-04-17T19:53:10.529559+0000","last_clean":"2024-04-17T19:53:10.529559+0000","last_became_active":"2024-04-17T19:53:05.463935+0000","last_became_peered":"2024-04-17T19:53:05.463935+0000","last_unstale":"2024-04-17T19:53:10.529559+0000","last_undegraded":"2024-04-17T19:53:10.529559+0000","last_fullsized":"2024-04-17T19:53:10.529559+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:15:45.727550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.494522+0000","last_change":"2024-04-17T19:53:04.475555+0000","last_active":"2024-04-17T19:53:10.494522+0000","last_peered":"2024-04-17T19:53:10.494522+0000","last_clean":"2024-04-17T19:53:10.494522+0000","last_became_active":"2024-04-17T19:53:04.467881+0000","last_became_peered":"2024-04-17T19:53:04.467881+0000","last_unstale":"2024-04-17T19:53:10.494522+0000","last_undegraded":"2024-04-17T19:53:10.494522+0000","last_fullsized":"2024-04-17T19:53:10.494522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:22:17.837334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.494205+0000","last_change":"2024-04-17T19:53:09.535560+0000","last_active":"2024-04-17T19:53:10.494205+0000","last_peered":"2024-04-17T19:53:10.494205+0000","last_clean":"2024-04-17T19:53:10.494205+0000","last_became_active":"2024-04-17T19:53:09.534631+0000","last_became_peered":"2024-04-17T19:53:09.534631+0000","last_unstale":"2024-04-17T19:53:10.494205+0000","last_undegraded":"2024-04-17T19:53:10.494205+0000","last_fullsized":"2024-04-17T19:53:10.494205+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:30:27.062045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.530016+0000","last_change":"2024-04-17T19:53:05.460324+0000","last_active":"2024-04-17T19:53:10.530016+0000","last_peered":"2024-04-17T19:53:10.530016+0000","last_clean":"2024-04-17T19:53:10.530016+0000","last_became_active":"2024-04-17T19:53:05.459941+0000","last_became_peered":"2024-04-17T19:53:05.459941+0000","last_unstale":"2024-04-17T19:53:10.530016+0000","last_undegraded":"2024-04-17T19:53:10.530016+0000","last_fullsized":"2024-04-17T19:53:10.530016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:34:03.644428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.867646+0000","last_change":"2024-04-17T19:53:04.467765+0000","last_active":"2024-04-17T19:53:11.867646+0000","last_peered":"2024-04-17T19:53:11.867646+0000","last_clean":"2024-04-17T19:53:11.867646+0000","last_became_active":"2024-04-17T19:53:04.466753+0000","last_became_peered":"2024-04-17T19:53:04.466753+0000","last_unstale":"2024-04-17T19:53:11.867646+0000","last_undegraded":"2024-04-17T19:53:11.867646+0000","last_fullsized":"2024-04-17T19:53:11.867646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:53:36.130201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.491139+0000","last_change":"2024-04-17T19:53:09.519632+0000","last_active":"2024-04-17T19:53:10.491139+0000","last_peered":"2024-04-17T19:53:10.491139+0000","last_clean":"2024-04-17T19:53:10.491139+0000","last_became_active":"2024-04-17T19:53:09.518979+0000","last_became_peered":"2024-04-17T19:53:09.518979+0000","last_unstale":"2024-04-17T19:53:10.491139+0000","last_undegraded":"2024-04-17T19:53:10.491139+0000","last_fullsized":"2024-04-17T19:53:10.491139+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:07:11.268705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.864298+0000","last_change":"2024-04-17T19:53:05.464583+0000","last_active":"2024-04-17T19:53:11.864298+0000","last_peered":"2024-04-17T19:53:11.864298+0000","last_clean":"2024-04-17T19:53:11.864298+0000","last_became_active":"2024-04-17T19:53:05.464158+0000","last_became_peered":"2024-04-17T19:53:05.464158+0000","last_unstale":"2024-04-17T19:53:11.864298+0000","last_undegraded":"2024-04-17T19:53:11.864298+0000","last_fullsized":"2024-04-17T19:53:11.864298+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:38:41.511185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.530315+0000","last_change":"2024-04-17T19:53:04.477502+0000","last_active":"2024-04-17T19:53:10.530315+0000","last_peered":"2024-04-17T19:53:10.530315+0000","last_clean":"2024-04-17T19:53:10.530315+0000","last_became_active":"2024-04-17T19:53:04.477162+0000","last_became_peered":"2024-04-17T19:53:04.477162+0000","last_unstale":"2024-04-17T19:53:10.530315+0000","last_undegraded":"2024-04-17T19:53:10.530315+0000","last_fullsized":"2024-04-17T19:53:10.530315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:21:36.152247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.528690+0000","last_change":"2024-04-17T19:53:09.533476+0000","last_active":"2024-04-17T19:53:11.528690+0000","last_peered":"2024-04-17T19:53:11.528690+0000","last_clean":"2024-04-17T19:53:11.528690+0000","last_became_active":"2024-04-17T19:53:09.532715+0000","last_became_peered":"2024-04-17T19:53:09.532715+0000","last_unstale":"2024-04-17T19:53:11.528690+0000","last_undegraded":"2024-04-17T19:53:11.528690+0000","last_fullsized":"2024-04-17T19:53:11.528690+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:38:45.556791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.491188+0000","last_change":"2024-04-17T19:53:05.473330+0000","last_active":"2024-04-17T19:53:10.491188+0000","last_peered":"2024-04-17T19:53:10.491188+0000","last_clean":"2024-04-17T19:53:10.491188+0000","last_became_active":"2024-04-17T19:53:05.468223+0000","last_became_peered":"2024-04-17T19:53:05.468223+0000","last_unstale":"2024-04-17T19:53:10.491188+0000","last_undegraded":"2024-04-17T19:53:10.491188+0000","last_fullsized":"2024-04-17T19:53:10.491188+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:01:34.461822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.866359+0000","last_change":"2024-04-17T19:53:04.461896+0000","last_active":"2024-04-17T19:53:11.866359+0000","last_peered":"2024-04-17T19:53:11.866359+0000","last_clean":"2024-04-17T19:53:11.866359+0000","last_became_active":"2024-04-17T19:53:04.460919+0000","last_became_peered":"2024-04-17T19:53:04.460919+0000","last_unstale":"2024-04-17T19:53:11.866359+0000","last_undegraded":"2024-04-17T19:53:11.866359+0000","last_fullsized":"2024-04-17T19:53:11.866359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:22:17.837334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.495547+0000","last_change":"2024-04-17T19:53:09.547397+0000","last_active":"2024-04-17T19:53:10.495547+0000","last_peered":"2024-04-17T19:53:10.495547+0000","last_clean":"2024-04-17T19:53:10.495547+0000","last_became_active":"2024-04-17T19:53:09.546048+0000","last_became_peered":"2024-04-17T19:53:09.546048+0000","last_unstale":"2024-04-17T19:53:10.495547+0000","last_undegraded":"2024-04-17T19:53:10.495547+0000","last_fullsized":"2024-04-17T19:53:10.495547+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:58:59.810415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.528039+0000","last_change":"2024-04-17T19:53:05.474322+0000","last_active":"2024-04-17T19:53:11.528039+0000","last_peered":"2024-04-17T19:53:11.528039+0000","last_clean":"2024-04-17T19:53:11.528039+0000","last_became_active":"2024-04-17T19:53:05.473892+0000","last_became_peered":"2024-04-17T19:53:05.473892+0000","last_unstale":"2024-04-17T19:53:11.528039+0000","last_undegraded":"2024-04-17T19:53:11.528039+0000","last_fullsized":"2024-04-17T19:53:11.528039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:18:12.267644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.528714+0000","last_change":"2024-04-17T19:53:04.460138+0000","last_active":"2024-04-17T19:53:10.528714+0000","last_peered":"2024-04-17T19:53:10.528714+0000","last_clean":"2024-04-17T19:53:10.528714+0000","last_became_active":"2024-04-17T19:53:04.459663+0000","last_became_peered":"2024-04-17T19:53:04.459663+0000","last_unstale":"2024-04-17T19:53:10.528714+0000","last_undegraded":"2024-04-17T19:53:10.528714+0000","last_fullsized":"2024-04-17T19:53:10.528714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:06:00.469757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.494889+0000","last_change":"2024-04-17T19:53:09.533802+0000","last_active":"2024-04-17T19:53:10.494889+0000","last_peered":"2024-04-17T19:53:10.494889+0000","last_clean":"2024-04-17T19:53:10.494889+0000","last_became_active":"2024-04-17T19:53:09.532504+0000","last_became_peered":"2024-04-17T19:53:09.532504+0000","last_unstale":"2024-04-17T19:53:10.494889+0000","last_undegraded":"2024-04-17T19:53:10.494889+0000","last_fullsized":"2024-04-17T19:53:10.494889+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:04:59.171017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.492057+0000","last_change":"2024-04-17T19:53:05.467855+0000","last_active":"2024-04-17T19:53:10.492057+0000","last_peered":"2024-04-17T19:53:10.492057+0000","last_clean":"2024-04-17T19:53:10.492057+0000","last_became_active":"2024-04-17T19:53:05.467349+0000","last_became_peered":"2024-04-17T19:53:05.467349+0000","last_unstale":"2024-04-17T19:53:10.492057+0000","last_undegraded":"2024-04-17T19:53:10.492057+0000","last_fullsized":"2024-04-17T19:53:10.492057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:52:55.878755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.492398+0000","last_change":"2024-04-17T19:53:04.465826+0000","last_active":"2024-04-17T19:53:10.492398+0000","last_peered":"2024-04-17T19:53:10.492398+0000","last_clean":"2024-04-17T19:53:10.492398+0000","last_became_active":"2024-04-17T19:53:04.465333+0000","last_became_peered":"2024-04-17T19:53:04.465333+0000","last_unstale":"2024-04-17T19:53:10.492398+0000","last_undegraded":"2024-04-17T19:53:10.492398+0000","last_fullsized":"2024-04-17T19:53:10.492398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:25:21.542158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.497344+0000","last_change":"2024-04-17T19:53:09.550127+0000","last_active":"2024-04-17T19:53:10.497344+0000","last_peered":"2024-04-17T19:53:10.497344+0000","last_clean":"2024-04-17T19:53:10.497344+0000","last_became_active":"2024-04-17T19:53:09.548109+0000","last_became_peered":"2024-04-17T19:53:09.548109+0000","last_unstale":"2024-04-17T19:53:10.497344+0000","last_undegraded":"2024-04-17T19:53:10.497344+0000","last_fullsized":"2024-04-17T19:53:10.497344+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:03:47.252621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.496697+0000","last_change":"2024-04-17T19:53:05.455185+0000","last_active":"2024-04-17T19:53:10.496697+0000","last_peered":"2024-04-17T19:53:10.496697+0000","last_clean":"2024-04-17T19:53:10.496697+0000","last_became_active":"2024-04-17T19:53:05.454358+0000","last_became_peered":"2024-04-17T19:53:05.454358+0000","last_unstale":"2024-04-17T19:53:10.496697+0000","last_undegraded":"2024-04-17T19:53:10.496697+0000","last_fullsized":"2024-04-17T19:53:10.496697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:26:54.093651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.780019+0000","last_change":"2024-04-17T19:53:04.474288+0000","last_active":"2024-04-17T19:53:10.780019+0000","last_peered":"2024-04-17T19:53:10.780019+0000","last_clean":"2024-04-17T19:53:10.780019+0000","last_became_active":"2024-04-17T19:53:04.473389+0000","last_became_peered":"2024-04-17T19:53:04.473389+0000","last_unstale":"2024-04-17T19:53:10.780019+0000","last_undegraded":"2024-04-17T19:53:10.780019+0000","last_fullsized":"2024-04-17T19:53:10.780019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:31:27.754909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.492763+0000","last_change":"2024-04-17T19:53:09.524630+0000","last_active":"2024-04-17T19:53:10.492763+0000","last_peered":"2024-04-17T19:53:10.492763+0000","last_clean":"2024-04-17T19:53:10.492763+0000","last_became_active":"2024-04-17T19:53:09.521522+0000","last_became_peered":"2024-04-17T19:53:09.521522+0000","last_unstale":"2024-04-17T19:53:10.492763+0000","last_undegraded":"2024-04-17T19:53:10.492763+0000","last_fullsized":"2024-04-17T19:53:10.492763+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:59:47.402073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.529373+0000","last_change":"2024-04-17T19:53:05.455865+0000","last_active":"2024-04-17T19:53:10.529373+0000","last_peered":"2024-04-17T19:53:10.529373+0000","last_clean":"2024-04-17T19:53:10.529373+0000","last_became_active":"2024-04-17T19:53:05.455429+0000","last_became_peered":"2024-04-17T19:53:05.455429+0000","last_unstale":"2024-04-17T19:53:10.529373+0000","last_undegraded":"2024-04-17T19:53:10.529373+0000","last_fullsized":"2024-04-17T19:53:10.529373+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:01:34.461822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'10","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:20.688890+0000","last_change":"2024-04-17T19:53:04.460295+0000","last_active":"2024-04-17T19:53:20.688890+0000","last_peered":"2024-04-17T19:53:20.688890+0000","last_clean":"2024-04-17T19:53:20.688890+0000","last_became_active":"2024-04-17T19:53:04.459855+0000","last_became_peered":"2024-04-17T19:53:04.459855+0000","last_unstale":"2024-04-17T19:53:20.688890+0000","last_undegraded":"2024-04-17T19:53:20.688890+0000","last_fullsized":"2024-04-17T19:53:20.688890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:21:45.875274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.866367+0000","last_change":"2024-04-17T19:53:09.530008+0000","last_active":"2024-04-17T19:53:11.866367+0000","last_peered":"2024-04-17T19:53:11.866367+0000","last_clean":"2024-04-17T19:53:11.866367+0000","last_became_active":"2024-04-17T19:53:09.528987+0000","last_became_peered":"2024-04-17T19:53:09.528987+0000","last_unstale":"2024-04-17T19:53:11.866367+0000","last_undegraded":"2024-04-17T19:53:11.866367+0000","last_fullsized":"2024-04-17T19:53:11.866367+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:34:07.690034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.491729+0000","last_change":"2024-04-17T19:53:05.472755+0000","last_active":"2024-04-17T19:53:10.491729+0000","last_peered":"2024-04-17T19:53:10.491729+0000","last_clean":"2024-04-17T19:53:10.491729+0000","last_became_active":"2024-04-17T19:53:05.468432+0000","last_became_peered":"2024-04-17T19:53:05.468432+0000","last_unstale":"2024-04-17T19:53:10.491729+0000","last_undegraded":"2024-04-17T19:53:10.491729+0000","last_fullsized":"2024-04-17T19:53:10.491729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:30:23.016439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.780569+0000","last_change":"2024-04-17T19:53:04.474378+0000","last_active":"2024-04-17T19:53:10.780569+0000","last_peered":"2024-04-17T19:53:10.780569+0000","last_clean":"2024-04-17T19:53:10.780569+0000","last_became_active":"2024-04-17T19:53:04.473458+0000","last_became_peered":"2024-04-17T19:53:04.473458+0000","last_unstale":"2024-04-17T19:53:10.780569+0000","last_undegraded":"2024-04-17T19:53:10.780569+0000","last_fullsized":"2024-04-17T19:53:10.780569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:16:30.888573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.863832+0000","last_change":"2024-04-17T19:53:09.558527+0000","last_active":"2024-04-17T19:53:11.863832+0000","last_peered":"2024-04-17T19:53:11.863832+0000","last_clean":"2024-04-17T19:53:11.863832+0000","last_became_active":"2024-04-17T19:53:09.557653+0000","last_became_peered":"2024-04-17T19:53:09.557653+0000","last_unstale":"2024-04-17T19:53:11.863832+0000","last_undegraded":"2024-04-17T19:53:11.863832+0000","last_fullsized":"2024-04-17T19:53:11.863832+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:01:38.507428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.495008+0000","last_change":"2024-04-17T19:53:05.467990+0000","last_active":"2024-04-17T19:53:10.495008+0000","last_peered":"2024-04-17T19:53:10.495008+0000","last_clean":"2024-04-17T19:53:10.495008+0000","last_became_active":"2024-04-17T19:53:05.461293+0000","last_became_peered":"2024-04-17T19:53:05.461293+0000","last_unstale":"2024-04-17T19:53:10.495008+0000","last_undegraded":"2024-04-17T19:53:10.495008+0000","last_fullsized":"2024-04-17T19:53:10.495008+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:01:34.461822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.530046+0000","last_change":"2024-04-17T19:53:04.472928+0000","last_active":"2024-04-17T19:53:10.530046+0000","last_peered":"2024-04-17T19:53:10.530046+0000","last_clean":"2024-04-17T19:53:10.530046+0000","last_became_active":"2024-04-17T19:53:04.467986+0000","last_became_peered":"2024-04-17T19:53:04.467986+0000","last_unstale":"2024-04-17T19:53:10.530046+0000","last_undegraded":"2024-04-17T19:53:10.530046+0000","last_fullsized":"2024-04-17T19:53:10.530046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:53:36.130201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.779233+0000","last_change":"2024-04-17T19:53:09.560792+0000","last_active":"2024-04-17T19:53:10.779233+0000","last_peered":"2024-04-17T19:53:10.779233+0000","last_clean":"2024-04-17T19:53:10.779233+0000","last_became_active":"2024-04-17T19:53:09.558779+0000","last_became_peered":"2024-04-17T19:53:09.558779+0000","last_unstale":"2024-04-17T19:53:10.779233+0000","last_undegraded":"2024-04-17T19:53:10.779233+0000","last_fullsized":"2024-04-17T19:53:10.779233+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:13:52.775623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.864234+0000","last_change":"2024-04-17T19:53:05.459934+0000","last_active":"2024-04-17T19:53:11.864234+0000","last_peered":"2024-04-17T19:53:11.864234+0000","last_clean":"2024-04-17T19:53:11.864234+0000","last_became_active":"2024-04-17T19:53:05.459538+0000","last_became_peered":"2024-04-17T19:53:05.459538+0000","last_unstale":"2024-04-17T19:53:11.864234+0000","last_undegraded":"2024-04-17T19:53:11.864234+0000","last_fullsized":"2024-04-17T19:53:11.864234+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:25:22.553475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.529342+0000","last_change":"2024-04-17T19:53:04.460345+0000","last_active":"2024-04-17T19:53:11.529342+0000","last_peered":"2024-04-17T19:53:11.529342+0000","last_clean":"2024-04-17T19:53:11.529342+0000","last_became_active":"2024-04-17T19:53:04.459787+0000","last_became_peered":"2024-04-17T19:53:04.459787+0000","last_unstale":"2024-04-17T19:53:11.529342+0000","last_undegraded":"2024-04-17T19:53:11.529342+0000","last_fullsized":"2024-04-17T19:53:11.529342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:16:30.888573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.866660+0000","last_change":"2024-04-17T19:53:09.557144+0000","last_active":"2024-04-17T19:53:11.866660+0000","last_peered":"2024-04-17T19:53:11.866660+0000","last_clean":"2024-04-17T19:53:11.866660+0000","last_became_active":"2024-04-17T19:53:09.555953+0000","last_became_peered":"2024-04-17T19:53:09.555953+0000","last_unstale":"2024-04-17T19:53:11.866660+0000","last_undegraded":"2024-04-17T19:53:11.866660+0000","last_fullsized":"2024-04-17T19:53:11.866660+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:10:36.885109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.867320+0000","last_change":"2024-04-17T19:53:09.536930+0000","last_active":"2024-04-17T19:53:11.867320+0000","last_peered":"2024-04-17T19:53:11.867320+0000","last_clean":"2024-04-17T19:53:11.867320+0000","last_became_active":"2024-04-17T19:53:09.535559+0000","last_became_peered":"2024-04-17T19:53:09.535559+0000","last_unstale":"2024-04-17T19:53:11.867320+0000","last_undegraded":"2024-04-17T19:53:11.867320+0000","last_fullsized":"2024-04-17T19:53:11.867320+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:29:54.335720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.867019+0000","last_change":"2024-04-17T19:53:05.440653+0000","last_active":"2024-04-17T19:53:11.867019+0000","last_peered":"2024-04-17T19:53:11.867019+0000","last_clean":"2024-04-17T19:53:11.867019+0000","last_became_active":"2024-04-17T19:53:05.439793+0000","last_became_peered":"2024-04-17T19:53:05.439793+0000","last_unstale":"2024-04-17T19:53:11.867019+0000","last_undegraded":"2024-04-17T19:53:11.867019+0000","last_fullsized":"2024-04-17T19:53:11.867019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:10:21.772873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.491426+0000","last_change":"2024-04-17T19:53:04.461705+0000","last_active":"2024-04-17T19:53:10.491426+0000","last_peered":"2024-04-17T19:53:10.491426+0000","last_clean":"2024-04-17T19:53:10.491426+0000","last_became_active":"2024-04-17T19:53:04.461020+0000","last_became_peered":"2024-04-17T19:53:04.461020+0000","last_unstale":"2024-04-17T19:53:10.491426+0000","last_undegraded":"2024-04-17T19:53:10.491426+0000","last_fullsized":"2024-04-17T19:53:10.491426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:53:36.130201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.494505+0000","last_change":"2024-04-17T19:53:09.535147+0000","last_active":"2024-04-17T19:53:10.494505+0000","last_peered":"2024-04-17T19:53:10.494505+0000","last_clean":"2024-04-17T19:53:10.494505+0000","last_became_active":"2024-04-17T19:53:09.534655+0000","last_became_peered":"2024-04-17T19:53:09.534655+0000","last_unstale":"2024-04-17T19:53:10.494505+0000","last_undegraded":"2024-04-17T19:53:10.494505+0000","last_fullsized":"2024-04-17T19:53:10.494505+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:06:37.779654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.494234+0000","last_change":"2024-04-17T19:53:05.455848+0000","last_active":"2024-04-17T19:53:10.494234+0000","last_peered":"2024-04-17T19:53:10.494234+0000","last_clean":"2024-04-17T19:53:10.494234+0000","last_became_active":"2024-04-17T19:53:05.452844+0000","last_became_peered":"2024-04-17T19:53:05.452844+0000","last_unstale":"2024-04-17T19:53:10.494234+0000","last_undegraded":"2024-04-17T19:53:10.494234+0000","last_fullsized":"2024-04-17T19:53:10.494234+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:54:27.523970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.496158+0000","last_change":"2024-04-17T19:53:04.470824+0000","last_active":"2024-04-17T19:53:10.496158+0000","last_peered":"2024-04-17T19:53:10.496158+0000","last_clean":"2024-04-17T19:53:10.496158+0000","last_became_active":"2024-04-17T19:53:04.469777+0000","last_became_peered":"2024-04-17T19:53:04.469777+0000","last_unstale":"2024-04-17T19:53:10.496158+0000","last_undegraded":"2024-04-17T19:53:10.496158+0000","last_fullsized":"2024-04-17T19:53:10.496158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:30:04.861958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.492143+0000","last_change":"2024-04-17T19:53:04.469785+0000","last_active":"2024-04-17T19:53:10.492143+0000","last_peered":"2024-04-17T19:53:10.492143+0000","last_clean":"2024-04-17T19:53:10.492143+0000","last_became_active":"2024-04-17T19:53:04.469297+0000","last_became_peered":"2024-04-17T19:53:04.469297+0000","last_unstale":"2024-04-17T19:53:10.492143+0000","last_undegraded":"2024-04-17T19:53:10.492143+0000","last_fullsized":"2024-04-17T19:53:10.492143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:50:02.697725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.866551+0000","last_change":"2024-04-17T19:53:05.460191+0000","last_active":"2024-04-17T19:53:11.866551+0000","last_peered":"2024-04-17T19:53:11.866551+0000","last_clean":"2024-04-17T19:53:11.866551+0000","last_became_active":"2024-04-17T19:53:05.459616+0000","last_became_peered":"2024-04-17T19:53:05.459616+0000","last_unstale":"2024-04-17T19:53:11.866551+0000","last_undegraded":"2024-04-17T19:53:11.866551+0000","last_fullsized":"2024-04-17T19:53:11.866551+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:12:15.307126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.867060+0000","last_change":"2024-04-17T19:53:09.557279+0000","last_active":"2024-04-17T19:53:11.867060+0000","last_peered":"2024-04-17T19:53:11.867060+0000","last_clean":"2024-04-17T19:53:11.867060+0000","last_became_active":"2024-04-17T19:53:09.556190+0000","last_became_peered":"2024-04-17T19:53:09.556190+0000","last_unstale":"2024-04-17T19:53:11.867060+0000","last_undegraded":"2024-04-17T19:53:11.867060+0000","last_fullsized":"2024-04-17T19:53:11.867060+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:40:02.858481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.495230+0000","last_change":"2024-04-17T19:53:04.487292+0000","last_active":"2024-04-17T19:53:10.495230+0000","last_peered":"2024-04-17T19:53:10.495230+0000","last_clean":"2024-04-17T19:53:10.495230+0000","last_became_active":"2024-04-17T19:53:04.486707+0000","last_became_peered":"2024-04-17T19:53:04.486707+0000","last_unstale":"2024-04-17T19:53:10.495230+0000","last_undegraded":"2024-04-17T19:53:10.495230+0000","last_fullsized":"2024-04-17T19:53:10.495230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:48:50.049562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.527598+0000","last_change":"2024-04-17T19:53:05.449319+0000","last_active":"2024-04-17T19:53:11.527598+0000","last_peered":"2024-04-17T19:53:11.527598+0000","last_clean":"2024-04-17T19:53:11.527598+0000","last_became_active":"2024-04-17T19:53:05.448374+0000","last_became_peered":"2024-04-17T19:53:05.448374+0000","last_unstale":"2024-04-17T19:53:11.527598+0000","last_undegraded":"2024-04-17T19:53:11.527598+0000","last_fullsized":"2024-04-17T19:53:11.527598+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:21:37.163564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.780524+0000","last_change":"2024-04-17T19:53:09.561127+0000","last_active":"2024-04-17T19:53:10.780524+0000","last_peered":"2024-04-17T19:53:10.780524+0000","last_clean":"2024-04-17T19:53:10.780524+0000","last_became_active":"2024-04-17T19:53:09.560076+0000","last_became_peered":"2024-04-17T19:53:09.560076+0000","last_unstale":"2024-04-17T19:53:10.780524+0000","last_undegraded":"2024-04-17T19:53:10.780524+0000","last_fullsized":"2024-04-17T19:53:10.780524+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:25:20.343613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.863628+0000","last_change":"2024-04-17T19:53:05.472665+0000","last_active":"2024-04-17T19:53:11.863628+0000","last_peered":"2024-04-17T19:53:11.863628+0000","last_clean":"2024-04-17T19:53:11.863628+0000","last_became_active":"2024-04-17T19:53:05.472324+0000","last_became_peered":"2024-04-17T19:53:05.472324+0000","last_unstale":"2024-04-17T19:53:11.863628+0000","last_undegraded":"2024-04-17T19:53:11.863628+0000","last_fullsized":"2024-04-17T19:53:11.863628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:50:03.709043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.779246+0000","last_change":"2024-04-17T19:53:05.477190+0000","last_active":"2024-04-17T19:53:10.779246+0000","last_peered":"2024-04-17T19:53:10.779246+0000","last_clean":"2024-04-17T19:53:10.779246+0000","last_became_active":"2024-04-17T19:53:05.475823+0000","last_became_peered":"2024-04-17T19:53:05.475823+0000","last_unstale":"2024-04-17T19:53:10.779246+0000","last_undegraded":"2024-04-17T19:53:10.779246+0000","last_fullsized":"2024-04-17T19:53:10.779246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:53:37.141518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.491805+0000","last_change":"2024-04-17T19:53:05.453565+0000","last_active":"2024-04-17T19:53:10.491805+0000","last_peered":"2024-04-17T19:53:10.491805+0000","last_clean":"2024-04-17T19:53:10.491805+0000","last_became_active":"2024-04-17T19:53:05.453142+0000","last_became_peered":"2024-04-17T19:53:05.453142+0000","last_unstale":"2024-04-17T19:53:10.491805+0000","last_undegraded":"2024-04-17T19:53:10.491805+0000","last_fullsized":"2024-04-17T19:53:10.491805+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:39:58.812875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.494369+0000","last_change":"2024-04-17T19:53:05.476450+0000","last_active":"2024-04-17T19:53:10.494369+0000","last_peered":"2024-04-17T19:53:10.494369+0000","last_clean":"2024-04-17T19:53:10.494369+0000","last_became_active":"2024-04-17T19:53:05.473931+0000","last_became_peered":"2024-04-17T19:53:05.473931+0000","last_unstale":"2024-04-17T19:53:10.494369+0000","last_undegraded":"2024-04-17T19:53:10.494369+0000","last_fullsized":"2024-04-17T19:53:10.494369+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:10:21.772873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.497745+0000","last_change":"2024-04-17T19:53:05.469653+0000","last_active":"2024-04-17T19:53:10.497745+0000","last_peered":"2024-04-17T19:53:10.497745+0000","last_clean":"2024-04-17T19:53:10.497745+0000","last_became_active":"2024-04-17T19:53:05.467838+0000","last_became_peered":"2024-04-17T19:53:05.467838+0000","last_unstale":"2024-04-17T19:53:10.497745+0000","last_undegraded":"2024-04-17T19:53:10.497745+0000","last_fullsized":"2024-04-17T19:53:10.497745+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:38:51.699072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.496163+0000","last_change":"2024-04-17T19:53:05.462678+0000","last_active":"2024-04-17T19:53:10.496163+0000","last_peered":"2024-04-17T19:53:10.496163+0000","last_clean":"2024-04-17T19:53:10.496163+0000","last_became_active":"2024-04-17T19:53:05.461829+0000","last_became_peered":"2024-04-17T19:53:05.461829+0000","last_unstale":"2024-04-17T19:53:10.496163+0000","last_undegraded":"2024-04-17T19:53:10.496163+0000","last_fullsized":"2024-04-17T19:53:10.496163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:03:53.876774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.864168+0000","last_change":"2024-04-17T19:53:05.465993+0000","last_active":"2024-04-17T19:53:11.864168+0000","last_peered":"2024-04-17T19:53:11.864168+0000","last_clean":"2024-04-17T19:53:11.864168+0000","last_became_active":"2024-04-17T19:53:05.465547+0000","last_became_peered":"2024-04-17T19:53:05.465547+0000","last_unstale":"2024-04-17T19:53:11.864168+0000","last_undegraded":"2024-04-17T19:53:11.864168+0000","last_fullsized":"2024-04-17T19:53:11.864168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:12:03.449509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.494257+0000","last_change":"2024-04-17T19:53:05.477188+0000","last_active":"2024-04-17T19:53:10.494257+0000","last_peered":"2024-04-17T19:53:10.494257+0000","last_clean":"2024-04-17T19:53:10.494257+0000","last_became_active":"2024-04-17T19:53:05.474798+0000","last_became_peered":"2024-04-17T19:53:05.474798+0000","last_unstale":"2024-04-17T19:53:10.494257+0000","last_undegraded":"2024-04-17T19:53:10.494257+0000","last_fullsized":"2024-04-17T19:53:10.494257+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:15:45.727550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.491362+0000","last_change":"2024-04-17T19:53:05.484009+0000","last_active":"2024-04-17T19:53:10.491362+0000","last_peered":"2024-04-17T19:53:10.491362+0000","last_clean":"2024-04-17T19:53:10.491362+0000","last_became_active":"2024-04-17T19:53:05.483664+0000","last_became_peered":"2024-04-17T19:53:05.483664+0000","last_unstale":"2024-04-17T19:53:10.491362+0000","last_undegraded":"2024-04-17T19:53:10.491362+0000","last_fullsized":"2024-04-17T19:53:10.491362+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:47:05.354826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.494973+0000","last_change":"2024-04-17T19:53:05.466532+0000","last_active":"2024-04-17T19:53:10.494973+0000","last_peered":"2024-04-17T19:53:10.494973+0000","last_clean":"2024-04-17T19:53:10.494973+0000","last_became_active":"2024-04-17T19:53:05.465302+0000","last_became_peered":"2024-04-17T19:53:05.465302+0000","last_unstale":"2024-04-17T19:53:10.494973+0000","last_undegraded":"2024-04-17T19:53:10.494973+0000","last_fullsized":"2024-04-17T19:53:10.494973+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:27:51.520335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.527637+0000","last_change":"2024-04-17T19:53:05.456313+0000","last_active":"2024-04-17T19:53:11.527637+0000","last_peered":"2024-04-17T19:53:11.527637+0000","last_clean":"2024-04-17T19:53:11.527637+0000","last_became_active":"2024-04-17T19:53:05.455862+0000","last_became_peered":"2024-04-17T19:53:05.455862+0000","last_unstale":"2024-04-17T19:53:11.527637+0000","last_undegraded":"2024-04-17T19:53:11.527637+0000","last_fullsized":"2024-04-17T19:53:11.527637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:23:03.879786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.866381+0000","last_change":"2024-04-17T19:53:05.465083+0000","last_active":"2024-04-17T19:53:11.866381+0000","last_peered":"2024-04-17T19:53:11.866381+0000","last_clean":"2024-04-17T19:53:11.866381+0000","last_became_active":"2024-04-17T19:53:05.463806+0000","last_became_peered":"2024-04-17T19:53:05.463806+0000","last_unstale":"2024-04-17T19:53:11.866381+0000","last_undegraded":"2024-04-17T19:53:11.866381+0000","last_fullsized":"2024-04-17T19:53:11.866381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:25:16.298007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.529357+0000","last_change":"2024-04-17T19:53:05.464340+0000","last_active":"2024-04-17T19:53:10.529357+0000","last_peered":"2024-04-17T19:53:10.529357+0000","last_clean":"2024-04-17T19:53:10.529357+0000","last_became_active":"2024-04-17T19:53:05.463286+0000","last_became_peered":"2024-04-17T19:53:05.463286+0000","last_unstale":"2024-04-17T19:53:10.529357+0000","last_undegraded":"2024-04-17T19:53:10.529357+0000","last_fullsized":"2024-04-17T19:53:10.529357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:54:27.523970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.493221+0000","last_change":"2024-04-17T19:53:05.475791+0000","last_active":"2024-04-17T19:53:10.493221+0000","last_peered":"2024-04-17T19:53:10.493221+0000","last_clean":"2024-04-17T19:53:10.493221+0000","last_became_active":"2024-04-17T19:53:05.475372+0000","last_became_peered":"2024-04-17T19:53:05.475372+0000","last_unstale":"2024-04-17T19:53:10.493221+0000","last_undegraded":"2024-04-17T19:53:10.493221+0000","last_fullsized":"2024-04-17T19:53:10.493221+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:10:32.839503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.781055+0000","last_change":"2024-04-17T19:53:05.496650+0000","last_active":"2024-04-17T19:53:10.781055+0000","last_peered":"2024-04-17T19:53:10.781055+0000","last_clean":"2024-04-17T19:53:10.781055+0000","last_became_active":"2024-04-17T19:53:05.495881+0000","last_became_peered":"2024-04-17T19:53:05.495881+0000","last_unstale":"2024-04-17T19:53:10.781055+0000","last_undegraded":"2024-04-17T19:53:10.781055+0000","last_fullsized":"2024-04-17T19:53:10.781055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:23:03.879786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.494848+0000","last_change":"2024-04-17T19:53:05.461335+0000","last_active":"2024-04-17T19:53:10.494848+0000","last_peered":"2024-04-17T19:53:10.494848+0000","last_clean":"2024-04-17T19:53:10.494848+0000","last_became_active":"2024-04-17T19:53:05.460831+0000","last_became_peered":"2024-04-17T19:53:05.460831+0000","last_unstale":"2024-04-17T19:53:10.494848+0000","last_undegraded":"2024-04-17T19:53:10.494848+0000","last_fullsized":"2024-04-17T19:53:10.494848+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:22:55.343347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.491071+0000","last_change":"2024-04-17T19:53:05.473875+0000","last_active":"2024-04-17T19:53:10.491071+0000","last_peered":"2024-04-17T19:53:10.491071+0000","last_clean":"2024-04-17T19:53:10.491071+0000","last_became_active":"2024-04-17T19:53:05.467366+0000","last_became_peered":"2024-04-17T19:53:05.467366+0000","last_unstale":"2024-04-17T19:53:10.491071+0000","last_undegraded":"2024-04-17T19:53:10.491071+0000","last_fullsized":"2024-04-17T19:53:10.491071+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:05:21.173050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.493287+0000","last_change":"2024-04-17T19:53:05.467405+0000","last_active":"2024-04-17T19:53:10.493287+0000","last_peered":"2024-04-17T19:53:10.493287+0000","last_clean":"2024-04-17T19:53:10.493287+0000","last_became_active":"2024-04-17T19:53:05.466427+0000","last_became_peered":"2024-04-17T19:53:05.466427+0000","last_unstale":"2024-04-17T19:53:10.493287+0000","last_undegraded":"2024-04-17T19:53:10.493287+0000","last_fullsized":"2024-04-17T19:53:10.493287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:19:09.456602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.496615+0000","last_change":"2024-04-17T19:53:05.465968+0000","last_active":"2024-04-17T19:53:10.496615+0000","last_peered":"2024-04-17T19:53:10.496615+0000","last_clean":"2024-04-17T19:53:10.496615+0000","last_became_active":"2024-04-17T19:53:05.465145+0000","last_became_peered":"2024-04-17T19:53:05.465145+0000","last_unstale":"2024-04-17T19:53:10.496615+0000","last_undegraded":"2024-04-17T19:53:10.496615+0000","last_fullsized":"2024-04-17T19:53:10.496615+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:47:46.099722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.495836+0000","last_change":"2024-04-17T19:53:05.463993+0000","last_active":"2024-04-17T19:53:10.495836+0000","last_peered":"2024-04-17T19:53:10.495836+0000","last_clean":"2024-04-17T19:53:10.495836+0000","last_became_active":"2024-04-17T19:53:05.463172+0000","last_became_peered":"2024-04-17T19:53:05.463172+0000","last_unstale":"2024-04-17T19:53:10.495836+0000","last_undegraded":"2024-04-17T19:53:10.495836+0000","last_fullsized":"2024-04-17T19:53:10.495836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:29:50.457953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.529222+0000","last_change":"2024-04-17T19:53:05.471782+0000","last_active":"2024-04-17T19:53:10.529222+0000","last_peered":"2024-04-17T19:53:10.529222+0000","last_clean":"2024-04-17T19:53:10.529222+0000","last_became_active":"2024-04-17T19:53:05.471347+0000","last_became_peered":"2024-04-17T19:53:05.471347+0000","last_unstale":"2024-04-17T19:53:10.529222+0000","last_undegraded":"2024-04-17T19:53:10.529222+0000","last_fullsized":"2024-04-17T19:53:10.529222+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:42:22.878631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.529347+0000","last_change":"2024-04-17T19:53:05.460256+0000","last_active":"2024-04-17T19:53:10.529347+0000","last_peered":"2024-04-17T19:53:10.529347+0000","last_clean":"2024-04-17T19:53:10.529347+0000","last_became_active":"2024-04-17T19:53:05.459869+0000","last_became_peered":"2024-04-17T19:53:05.459869+0000","last_unstale":"2024-04-17T19:53:10.529347+0000","last_undegraded":"2024-04-17T19:53:10.529347+0000","last_fullsized":"2024-04-17T19:53:10.529347+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:47:05.354826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.529487+0000","last_change":"2024-04-17T19:53:05.467331+0000","last_active":"2024-04-17T19:53:10.529487+0000","last_peered":"2024-04-17T19:53:10.529487+0000","last_clean":"2024-04-17T19:53:10.529487+0000","last_became_active":"2024-04-17T19:53:05.467015+0000","last_became_peered":"2024-04-17T19:53:05.467015+0000","last_unstale":"2024-04-17T19:53:10.529487+0000","last_undegraded":"2024-04-17T19:53:10.529487+0000","last_fullsized":"2024-04-17T19:53:10.529487+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:10:32.839503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.529339+0000","last_change":"2024-04-17T19:53:05.462631+0000","last_active":"2024-04-17T19:53:11.529339+0000","last_peered":"2024-04-17T19:53:11.529339+0000","last_clean":"2024-04-17T19:53:11.529339+0000","last_became_active":"2024-04-17T19:53:05.462217+0000","last_became_peered":"2024-04-17T19:53:05.462217+0000","last_unstale":"2024-04-17T19:53:11.529339+0000","last_undegraded":"2024-04-17T19:53:11.529339+0000","last_fullsized":"2024-04-17T19:53:11.529339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:50:03.709043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.493026+0000","last_change":"2024-04-17T19:53:05.467941+0000","last_active":"2024-04-17T19:53:10.493026+0000","last_peered":"2024-04-17T19:53:10.493026+0000","last_clean":"2024-04-17T19:53:10.493026+0000","last_became_active":"2024-04-17T19:53:05.467093+0000","last_became_peered":"2024-04-17T19:53:05.467093+0000","last_unstale":"2024-04-17T19:53:10.493026+0000","last_undegraded":"2024-04-17T19:53:10.493026+0000","last_fullsized":"2024-04-17T19:53:10.493026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:12:15.307126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.528642+0000","last_change":"2024-04-17T19:53:05.465748+0000","last_active":"2024-04-17T19:53:10.528642+0000","last_peered":"2024-04-17T19:53:10.528642+0000","last_clean":"2024-04-17T19:53:10.528642+0000","last_became_active":"2024-04-17T19:53:05.465436+0000","last_became_peered":"2024-04-17T19:53:05.465436+0000","last_unstale":"2024-04-17T19:53:10.528642+0000","last_undegraded":"2024-04-17T19:53:10.528642+0000","last_fullsized":"2024-04-17T19:53:10.528642+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:02:40.799364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.863626+0000","last_change":"2024-04-17T19:53:05.458098+0000","last_active":"2024-04-17T19:53:11.863626+0000","last_peered":"2024-04-17T19:53:11.863626+0000","last_clean":"2024-04-17T19:53:11.863626+0000","last_became_active":"2024-04-17T19:53:05.457656+0000","last_became_peered":"2024-04-17T19:53:05.457656+0000","last_unstale":"2024-04-17T19:53:11.863626+0000","last_undegraded":"2024-04-17T19:53:11.863626+0000","last_fullsized":"2024-04-17T19:53:11.863626+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:40:31.558660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.529015+0000","last_change":"2024-04-17T19:53:05.477086+0000","last_active":"2024-04-17T19:53:10.529015+0000","last_peered":"2024-04-17T19:53:10.529015+0000","last_clean":"2024-04-17T19:53:10.529015+0000","last_became_active":"2024-04-17T19:53:05.476734+0000","last_became_peered":"2024-04-17T19:53:05.476734+0000","last_unstale":"2024-04-17T19:53:10.529015+0000","last_undegraded":"2024-04-17T19:53:10.529015+0000","last_fullsized":"2024-04-17T19:53:10.529015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:10:21.772873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.863461+0000","last_change":"2024-04-17T19:53:05.458378+0000","last_active":"2024-04-17T19:53:11.863461+0000","last_peered":"2024-04-17T19:53:11.863461+0000","last_clean":"2024-04-17T19:53:11.863461+0000","last_became_active":"2024-04-17T19:53:05.457210+0000","last_became_peered":"2024-04-17T19:53:05.457210+0000","last_unstale":"2024-04-17T19:53:11.863461+0000","last_undegraded":"2024-04-17T19:53:11.863461+0000","last_fullsized":"2024-04-17T19:53:11.863461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:23:03.879786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.494175+0000","last_change":"2024-04-17T19:53:05.455054+0000","last_active":"2024-04-17T19:53:10.494175+0000","last_peered":"2024-04-17T19:53:10.494175+0000","last_clean":"2024-04-17T19:53:10.494175+0000","last_became_active":"2024-04-17T19:53:05.454065+0000","last_became_peered":"2024-04-17T19:53:05.454065+0000","last_unstale":"2024-04-17T19:53:10.494175+0000","last_undegraded":"2024-04-17T19:53:10.494175+0000","last_fullsized":"2024-04-17T19:53:10.494175+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:42:22.878631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.496956+0000","last_change":"2024-04-17T19:53:05.456675+0000","last_active":"2024-04-17T19:53:10.496956+0000","last_peered":"2024-04-17T19:53:10.496956+0000","last_clean":"2024-04-17T19:53:10.496956+0000","last_became_active":"2024-04-17T19:53:05.455779+0000","last_became_peered":"2024-04-17T19:53:05.455779+0000","last_unstale":"2024-04-17T19:53:10.496956+0000","last_undegraded":"2024-04-17T19:53:10.496956+0000","last_fullsized":"2024-04-17T19:53:10.496956+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:02:40.799364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.529904+0000","last_change":"2024-04-17T19:53:05.461773+0000","last_active":"2024-04-17T19:53:10.529904+0000","last_peered":"2024-04-17T19:53:10.529904+0000","last_clean":"2024-04-17T19:53:10.529904+0000","last_became_active":"2024-04-17T19:53:05.461324+0000","last_became_peered":"2024-04-17T19:53:05.461324+0000","last_unstale":"2024-04-17T19:53:10.529904+0000","last_undegraded":"2024-04-17T19:53:10.529904+0000","last_fullsized":"2024-04-17T19:53:10.529904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:05:21.173050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509451,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":110409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":884736,"data_stored":700745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509450,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":114799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31468,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340372,"statfs":{"total":96636764160,"available":96604540928,"internally_reserved":0,"allocated":286720,"data_stored":110867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509450,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":294912,"data_stored":114127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32040,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339800,"statfs":{"total":96636764160,"available":96603955200,"internally_reserved":0,"allocated":880640,"data_stored":700723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":290816,"data_stored":110341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542154,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":110285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T19:53:29.314 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T19:53:29.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.517+0000 7f2dc1ad4640 1 Processor -- start 2024-04-17T19:53:29.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.517+0000 7f2dc1ad4640 1 -- start start 2024-04-17T19:53:29.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.517+0000 7f2dc1ad4640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f2dbc0ced70 0x7f2dbc0b6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:29.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.517+0000 7f2dc1ad4640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2dbc0cd260 0x7f2dbc16a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:29.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.517+0000 7f2dc1ad4640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2dbc0cf180 con 0x7f2dbc0b6d90 2024-04-17T19:53:29.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.517+0000 7f2dc1ad4640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f2dbc0b2c70 con 0x7f2dbc0cd260 2024-04-17T19:53:29.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.517+0000 7f2dc1ad4640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f2dbc0ce4d0 con 0x7f2dbc0ced70 2024-04-17T19:53:29.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.517+0000 7f2dbbfff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2dbc0cd260 0x7f2dbc16a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:29.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.517+0000 7f2dbbfff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2dbc0cd260 0x7f2dbc16a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50144/0 (socket says 172.21.15.18:50144) 2024-04-17T19:53:29.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.517+0000 7f2dbbfff640 1 -- 172.21.15.18:0/462824942 learned_addr learned my addr 172.21.15.18:0/462824942 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:29.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.517+0000 7f2dbaffd640 1 --1- 172.21.15.18:0/462824942 >> v1:172.21.15.18:6789/0 conn(0x7f2dbc0b6d90 0x7f2dbc0ccb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:51260/0 (socket says 172.21.15.18:51260) 2024-04-17T19:53:29.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.517+0000 7f2dbb7fe640 1 --2- 172.21.15.18:0/462824942 >> v2:172.21.15.173:3300/0 conn(0x7f2dbc0ced70 0x7f2dbc0b6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:29.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.517+0000 7f2dbbfff640 1 -- 172.21.15.18:0/462824942 >> v2:172.21.15.173:3300/0 conn(0x7f2dbc0ced70 msgr2=0x7f2dbc0b6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:29.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.517+0000 7f2dbbfff640 1 --2- 172.21.15.18:0/462824942 >> v2:172.21.15.173:3300/0 conn(0x7f2dbc0ced70 0x7f2dbc0b6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:29.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.517+0000 7f2dbbfff640 1 -- 172.21.15.18:0/462824942 >> v1:172.21.15.18:6789/0 conn(0x7f2dbc0b6d90 legacy=0x7f2dbc0ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:29.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.517+0000 7f2dbbfff640 1 -- 172.21.15.18:0/462824942 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dbc0b71a0 con 0x7f2dbc0cd260 2024-04-17T19:53:29.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.517+0000 7f2dba7fc640 1 -- 172.21.15.18:0/462824942 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3435926869 0 0) 0x7f2db0001120 con 0x7f2dbc0b6d90 2024-04-17T19:53:29.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.517+0000 7f2dbb7fe640 1 --2- 172.21.15.18:0/462824942 >> v2:172.21.15.173:3300/0 conn(0x7f2dbc0ced70 0x7f2dbc0b6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:53:29.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.521+0000 7f2dbbfff640 1 --2- 172.21.15.18:0/462824942 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2dbc0cd260 0x7f2dbc16a190 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc0733f0 tx=0x7f2db401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38ef811184480142 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:29.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.521+0000 7f2dba7fc640 1 -- 172.21.15.18:0/462824942 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db40a56c0 con 0x7f2dbc0cd260 2024-04-17T19:53:29.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.521+0000 7f2dba7fc640 1 -- 172.21.15.18:0/462824942 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2db40a5860 con 0x7f2dbc0cd260 2024-04-17T19:53:29.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.521+0000 7f2dba7fc640 1 -- 172.21.15.18:0/462824942 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db40a5c30 con 0x7f2dbc0cd260 2024-04-17T19:53:29.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.521+0000 7f2dc1ad4640 1 -- 172.21.15.18:0/462824942 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2dbc0cd260 msgr2=0x7f2dbc16a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:29.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.521+0000 7f2dc1ad4640 1 --2- 172.21.15.18:0/462824942 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2dbc0cd260 0x7f2dbc16a190 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc0733f0 tx=0x7f2db401c9f0 comp rx=0 tx=0).stop 2024-04-17T19:53:29.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.521+0000 7f2dc1ad4640 1 -- 172.21.15.18:0/462824942 shutdown_connections 2024-04-17T19:53:29.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.521+0000 7f2dc1ad4640 1 --2- 172.21.15.18:0/462824942 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2dbc0cd260 0x7f2dbc16a190 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:29.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.521+0000 7f2dc1ad4640 1 --2- 172.21.15.18:0/462824942 >> v2:172.21.15.173:3300/0 conn(0x7f2dbc0ced70 0x7f2dbc0b6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:29.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.521+0000 7f2dc1ad4640 1 -- 172.21.15.18:0/462824942 >> 172.21.15.18:0/462824942 conn(0x7f2dbc09aa70 msgr2=0x7f2dbc09ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:29.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.521+0000 7f2dc1ad4640 1 -- 172.21.15.18:0/462824942 shutdown_connections 2024-04-17T19:53:29.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.521+0000 7f2dc1ad4640 1 -- 172.21.15.18:0/462824942 wait complete. 2024-04-17T19:53:29.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.521+0000 7f2dc1ad4640 1 Processor -- start 2024-04-17T19:53:29.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.525+0000 7f2dc1ad4640 1 -- start start 2024-04-17T19:53:29.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.525+0000 7f2dc1ad4640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2dbc0b6d90 0x7f2dbc1578d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:29.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.525+0000 7f2dc1ad4640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2dbc0cd260 0x7f2dbc0ca610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:29.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.525+0000 7f2dc1ad4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2dbc0ced70 0x7f2dbc0c5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:29.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.525+0000 7f2dc1ad4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2dbc0d0c30 con 0x7f2dbc0ced70 2024-04-17T19:53:29.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.525+0000 7f2dc1ad4640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2dbc0b33e0 con 0x7f2dbc0cd260 2024-04-17T19:53:29.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.525+0000 7f2dc1ad4640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f2dbc0d0db0 con 0x7f2dbc0b6d90 2024-04-17T19:53:29.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.525+0000 7f2dbbfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2dbc0ced70 0x7f2dbc0c5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:29.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.525+0000 7f2dbbfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2dbc0ced70 0x7f2dbc0c5620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50156/0 (socket says 172.21.15.18:50156) 2024-04-17T19:53:29.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.525+0000 7f2dbbfff640 1 -- 172.21.15.18:0/4002381978 learned_addr learned my addr 172.21.15.18:0/4002381978 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:29.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.525+0000 7f2dbaffd640 1 --2- 172.21.15.18:0/4002381978 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2dbc0cd260 0x7f2dbc0ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:29.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.525+0000 7f2dbb7fe640 1 --2- 172.21.15.18:0/4002381978 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2dbc0b6d90 0x7f2dbc1578d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:29.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.525+0000 7f2dbbfff640 1 -- 172.21.15.18:0/4002381978 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2dbc0b6d90 msgr2=0x7f2dbc1578d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:29.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.525+0000 7f2dbbfff640 1 --2- 172.21.15.18:0/4002381978 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2dbc0b6d90 0x7f2dbc1578d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:29.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.525+0000 7f2dbbfff640 1 -- 172.21.15.18:0/4002381978 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2dbc0cd260 msgr2=0x7f2dbc0ca610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:29.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.525+0000 7f2dbbfff640 1 --2- 172.21.15.18:0/4002381978 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2dbc0cd260 0x7f2dbc0ca610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:29.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.525+0000 7f2dbbfff640 1 -- 172.21.15.18:0/4002381978 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dbc1581c0 con 0x7f2dbc0ced70 2024-04-17T19:53:29.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.525+0000 7f2dbb7fe640 1 --2- 172.21.15.18:0/4002381978 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2dbc0b6d90 0x7f2dbc1578d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:53:29.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.525+0000 7f2dbbfff640 1 --2- 172.21.15.18:0/4002381978 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2dbc0ced70 0x7f2dbc0c5620 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2db40af040 tx=0x7f2db4019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:29.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.525+0000 7f2da3fff640 1 -- 172.21.15.18:0/4002381978 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db4009510 con 0x7f2dbc0ced70 2024-04-17T19:53:29.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.525+0000 7f2da3fff640 1 -- 172.21.15.18:0/4002381978 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2db40be070 con 0x7f2dbc0ced70 2024-04-17T19:53:29.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.525+0000 7f2dc1ad4640 1 -- 172.21.15.18:0/4002381978 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dbc1584a0 con 0x7f2dbc0ced70 2024-04-17T19:53:29.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.525+0000 7f2da3fff640 1 -- 172.21.15.18:0/4002381978 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db40b88b0 con 0x7f2dbc0ced70 2024-04-17T19:53:29.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.525+0000 7f2dc1ad4640 1 -- 172.21.15.18:0/4002381978 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dbc0c6160 con 0x7f2dbc0ced70 2024-04-17T19:53:29.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.525+0000 7f2dc1ad4640 1 -- 172.21.15.18:0/4002381978 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dbc0cb070 con 0x7f2dbc0ced70 2024-04-17T19:53:29.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.529+0000 7f2da3fff640 1 -- 172.21.15.18:0/4002381978 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2db40b8a50 con 0x7f2dbc0ced70 2024-04-17T19:53:29.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.529+0000 7f2da3fff640 1 --2- 172.21.15.18:0/4002381978 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f2da8068380 0x7f2da806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:29.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.529+0000 7f2da3fff640 1 -- 172.21.15.18:0/4002381978 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f2db4121e00 con 0x7f2dbc0ced70 2024-04-17T19:53:29.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.529+0000 7f2dbb7fe640 1 --2- 172.21.15.18:0/4002381978 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f2da8068380 0x7f2da806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:29.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.529+0000 7f2dbb7fe640 1 --2- 172.21.15.18:0/4002381978 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f2da8068380 0x7f2da806a890 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2dac0097a0 tx=0x7f2dac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:29.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.533+0000 7f2da3fff640 1 -- 172.21.15.18:0/4002381978 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2dbc0b71a0 con 0x7f2dbc0ced70 2024-04-17T19:53:29.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.685+0000 7f2dc1ad4640 1 -- 172.21.15.18:0/4002381978 --> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2dbc0c7280 con 0x7f2da8068380 2024-04-17T19:53:29.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.701+0000 7f2da3fff640 1 -- 172.21.15.18:0/4002381978 <== mgr.4104 v2:172.21.15.18:6832/751466605 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f2dbc0c7280 con 0x7f2da8068380 2024-04-17T19:53:29.701 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:53:29.703 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-17T19:53:29.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.709+0000 7f2dc1ad4640 1 -- 172.21.15.18:0/4002381978 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f2da8068380 msgr2=0x7f2da806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:29.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.709+0000 7f2dc1ad4640 1 --2- 172.21.15.18:0/4002381978 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f2da8068380 0x7f2da806a890 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2dac0097a0 tx=0x7f2dac008040 comp rx=0 tx=0).stop 2024-04-17T19:53:29.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.709+0000 7f2dc1ad4640 1 -- 172.21.15.18:0/4002381978 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2dbc0ced70 msgr2=0x7f2dbc0c5620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:29.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.709+0000 7f2dc1ad4640 1 --2- 172.21.15.18:0/4002381978 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2dbc0ced70 0x7f2dbc0c5620 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2db40af040 tx=0x7f2db4019790 comp rx=0 tx=0).stop 2024-04-17T19:53:29.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.709+0000 7f2dc1ad4640 1 -- 172.21.15.18:0/4002381978 shutdown_connections 2024-04-17T19:53:29.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.709+0000 7f2dc1ad4640 1 --2- 172.21.15.18:0/4002381978 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f2da8068380 0x7f2da806a890 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:29.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.709+0000 7f2dc1ad4640 1 --2- 172.21.15.18:0/4002381978 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2dbc0ced70 0x7f2dbc0c5620 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:29.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.709+0000 7f2dc1ad4640 1 --2- 172.21.15.18:0/4002381978 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2dbc0cd260 0x7f2dbc0ca610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:29.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.709+0000 7f2dc1ad4640 1 --2- 172.21.15.18:0/4002381978 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2dbc0b6d90 0x7f2dbc1578d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:29.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.709+0000 7f2dc1ad4640 1 -- 172.21.15.18:0/4002381978 >> 172.21.15.18:0/4002381978 conn(0x7f2dbc09aa70 msgr2=0x7f2dbc070050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:29.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.709+0000 7f2dc1ad4640 1 -- 172.21.15.18:0/4002381978 shutdown_connections 2024-04-17T19:53:29.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.709+0000 7f2dc1ad4640 1 -- 172.21.15.18:0/4002381978 wait complete. 2024-04-17T19:53:29.722 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-04-17T19:53:28.349982+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236256,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738464,"statfs":{"total":773094113280,"available":772852187136,"internally_reserved":0,"allocated":3514368,"data_stored":2072296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":238276148},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004116"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.867881+0000","last_change":"2024-04-17T19:53:04.461184+0000","last_active":"2024-04-17T19:53:11.867881+0000","last_peered":"2024-04-17T19:53:11.867881+0000","last_clean":"2024-04-17T19:53:11.867881+0000","last_became_active":"2024-04-17T19:53:04.460006+0000","last_became_peered":"2024-04-17T19:53:04.460006+0000","last_unstale":"2024-04-17T19:53:11.867881+0000","last_undegraded":"2024-04-17T19:53:11.867881+0000","last_fullsized":"2024-04-17T19:53:11.867881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:23:02.868468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.495714+0000","last_change":"2024-04-17T19:53:05.474006+0000","last_active":"2024-04-17T19:53:10.495714+0000","last_peered":"2024-04-17T19:53:10.495714+0000","last_clean":"2024-04-17T19:53:10.495714+0000","last_became_active":"2024-04-17T19:53:05.467848+0000","last_became_peered":"2024-04-17T19:53:05.467848+0000","last_unstale":"2024-04-17T19:53:10.495714+0000","last_undegraded":"2024-04-17T19:53:10.495714+0000","last_fullsized":"2024-04-17T19:53:10.495714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:05:21.173050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.779378+0000","last_change":"2024-04-17T19:53:09.559397+0000","last_active":"2024-04-17T19:53:10.779378+0000","last_peered":"2024-04-17T19:53:10.779378+0000","last_clean":"2024-04-17T19:53:10.779378+0000","last_became_active":"2024-04-17T19:53:09.558504+0000","last_became_peered":"2024-04-17T19:53:09.558504+0000","last_unstale":"2024-04-17T19:53:10.779378+0000","last_undegraded":"2024-04-17T19:53:10.779378+0000","last_fullsized":"2024-04-17T19:53:10.779378+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:06:18.745394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.496229+0000","last_change":"2024-04-17T19:53:04.484961+0000","last_active":"2024-04-17T19:53:10.496229+0000","last_peered":"2024-04-17T19:53:10.496229+0000","last_clean":"2024-04-17T19:53:10.496229+0000","last_became_active":"2024-04-17T19:53:04.468291+0000","last_became_peered":"2024-04-17T19:53:04.468291+0000","last_unstale":"2024-04-17T19:53:10.496229+0000","last_undegraded":"2024-04-17T19:53:10.496229+0000","last_fullsized":"2024-04-17T19:53:10.496229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:06:00.469757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.494707+0000","last_change":"2024-04-17T19:53:05.475578+0000","last_active":"2024-04-17T19:53:10.494707+0000","last_peered":"2024-04-17T19:53:10.494707+0000","last_clean":"2024-04-17T19:53:10.494707+0000","last_became_active":"2024-04-17T19:53:05.473678+0000","last_became_peered":"2024-04-17T19:53:05.473678+0000","last_unstale":"2024-04-17T19:53:10.494707+0000","last_undegraded":"2024-04-17T19:53:10.494707+0000","last_fullsized":"2024-04-17T19:53:10.494707+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:47:05.354826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.863354+0000","last_change":"2024-04-17T19:53:09.545180+0000","last_active":"2024-04-17T19:53:11.863354+0000","last_peered":"2024-04-17T19:53:11.863354+0000","last_clean":"2024-04-17T19:53:11.863354+0000","last_became_active":"2024-04-17T19:53:09.544580+0000","last_became_peered":"2024-04-17T19:53:09.544580+0000","last_unstale":"2024-04-17T19:53:11.863354+0000","last_undegraded":"2024-04-17T19:53:11.863354+0000","last_fullsized":"2024-04-17T19:53:11.863354+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:02:44.844970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.529583+0000","last_change":"2024-04-17T19:53:04.468009+0000","last_active":"2024-04-17T19:53:10.529583+0000","last_peered":"2024-04-17T19:53:10.529583+0000","last_clean":"2024-04-17T19:53:10.529583+0000","last_became_active":"2024-04-17T19:53:04.467568+0000","last_became_peered":"2024-04-17T19:53:04.467568+0000","last_unstale":"2024-04-17T19:53:10.529583+0000","last_undegraded":"2024-04-17T19:53:10.529583+0000","last_fullsized":"2024-04-17T19:53:10.529583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:18:11.256327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.528343+0000","last_change":"2024-04-17T19:53:05.464961+0000","last_active":"2024-04-17T19:53:11.528343+0000","last_peered":"2024-04-17T19:53:11.528343+0000","last_clean":"2024-04-17T19:53:11.528343+0000","last_became_active":"2024-04-17T19:53:05.464601+0000","last_became_peered":"2024-04-17T19:53:05.464601+0000","last_unstale":"2024-04-17T19:53:11.528343+0000","last_undegraded":"2024-04-17T19:53:11.528343+0000","last_fullsized":"2024-04-17T19:53:11.528343+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:12:03.449509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.863767+0000","last_change":"2024-04-17T19:53:09.529447+0000","last_active":"2024-04-17T19:53:11.863767+0000","last_peered":"2024-04-17T19:53:11.863767+0000","last_clean":"2024-04-17T19:53:11.863767+0000","last_became_active":"2024-04-17T19:53:09.528285+0000","last_became_peered":"2024-04-17T19:53:09.528285+0000","last_unstale":"2024-04-17T19:53:11.863767+0000","last_undegraded":"2024-04-17T19:53:11.863767+0000","last_fullsized":"2024-04-17T19:53:11.863767+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:47:09.400433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.529734+0000","last_change":"2024-04-17T19:53:04.467639+0000","last_active":"2024-04-17T19:53:10.529734+0000","last_peered":"2024-04-17T19:53:10.529734+0000","last_clean":"2024-04-17T19:53:10.529734+0000","last_became_active":"2024-04-17T19:53:04.467004+0000","last_became_peered":"2024-04-17T19:53:04.467004+0000","last_unstale":"2024-04-17T19:53:10.529734+0000","last_undegraded":"2024-04-17T19:53:10.529734+0000","last_fullsized":"2024-04-17T19:53:10.529734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:38:40.499868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.492819+0000","last_change":"2024-04-17T19:53:05.468179+0000","last_active":"2024-04-17T19:53:10.492819+0000","last_peered":"2024-04-17T19:53:10.492819+0000","last_clean":"2024-04-17T19:53:10.492819+0000","last_became_active":"2024-04-17T19:53:05.467217+0000","last_became_peered":"2024-04-17T19:53:05.467217+0000","last_unstale":"2024-04-17T19:53:10.492819+0000","last_undegraded":"2024-04-17T19:53:10.492819+0000","last_fullsized":"2024-04-17T19:53:10.492819+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:29:50.290114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.863352+0000","last_change":"2024-04-17T19:53:09.549722+0000","last_active":"2024-04-17T19:53:11.863352+0000","last_peered":"2024-04-17T19:53:11.863352+0000","last_clean":"2024-04-17T19:53:11.863352+0000","last_became_active":"2024-04-17T19:53:09.548876+0000","last_became_peered":"2024-04-17T19:53:09.548876+0000","last_unstale":"2024-04-17T19:53:11.863352+0000","last_undegraded":"2024-04-17T19:53:11.863352+0000","last_fullsized":"2024-04-17T19:53:11.863352+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:15:49.773156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.491904+0000","last_change":"2024-04-17T19:53:05.475996+0000","last_active":"2024-04-17T19:53:10.491904+0000","last_peered":"2024-04-17T19:53:10.491904+0000","last_clean":"2024-04-17T19:53:10.491904+0000","last_became_active":"2024-04-17T19:53:05.475517+0000","last_became_peered":"2024-04-17T19:53:05.475517+0000","last_unstale":"2024-04-17T19:53:10.491904+0000","last_undegraded":"2024-04-17T19:53:10.491904+0000","last_fullsized":"2024-04-17T19:53:10.491904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:39:47.272961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.492869+0000","last_change":"2024-04-17T19:53:04.465884+0000","last_active":"2024-04-17T19:53:10.492869+0000","last_peered":"2024-04-17T19:53:10.492869+0000","last_clean":"2024-04-17T19:53:10.492869+0000","last_became_active":"2024-04-17T19:53:04.465108+0000","last_became_peered":"2024-04-17T19:53:04.465108+0000","last_unstale":"2024-04-17T19:53:10.492869+0000","last_undegraded":"2024-04-17T19:53:10.492869+0000","last_fullsized":"2024-04-17T19:53:10.492869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:23:02.868468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.492043+0000","last_change":"2024-04-17T19:53:09.545287+0000","last_active":"2024-04-17T19:53:10.492043+0000","last_peered":"2024-04-17T19:53:10.492043+0000","last_clean":"2024-04-17T19:53:10.492043+0000","last_became_active":"2024-04-17T19:53:09.544328+0000","last_became_peered":"2024-04-17T19:53:09.544328+0000","last_unstale":"2024-04-17T19:53:10.492043+0000","last_undegraded":"2024-04-17T19:53:10.492043+0000","last_fullsized":"2024-04-17T19:53:10.492043+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:47:26.887721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.779852+0000","last_change":"2024-04-17T19:53:05.496585+0000","last_active":"2024-04-17T19:53:10.779852+0000","last_peered":"2024-04-17T19:53:10.779852+0000","last_clean":"2024-04-17T19:53:10.779852+0000","last_became_active":"2024-04-17T19:53:05.495800+0000","last_became_peered":"2024-04-17T19:53:05.495800+0000","last_unstale":"2024-04-17T19:53:10.779852+0000","last_undegraded":"2024-04-17T19:53:10.779852+0000","last_fullsized":"2024-04-17T19:53:10.779852+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:18:12.267644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.496900+0000","last_change":"2024-04-17T19:53:04.479274+0000","last_active":"2024-04-17T19:53:10.496900+0000","last_peered":"2024-04-17T19:53:10.496900+0000","last_clean":"2024-04-17T19:53:10.496900+0000","last_became_active":"2024-04-17T19:53:04.478425+0000","last_became_peered":"2024-04-17T19:53:04.478425+0000","last_unstale":"2024-04-17T19:53:10.496900+0000","last_undegraded":"2024-04-17T19:53:10.496900+0000","last_fullsized":"2024-04-17T19:53:10.496900+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:16:15.623557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.529101+0000","last_change":"2024-04-17T19:53:09.526995+0000","last_active":"2024-04-17T19:53:10.529101+0000","last_peered":"2024-04-17T19:53:10.529101+0000","last_clean":"2024-04-17T19:53:10.529101+0000","last_became_active":"2024-04-17T19:53:09.525577+0000","last_became_peered":"2024-04-17T19:53:09.525577+0000","last_unstale":"2024-04-17T19:53:10.529101+0000","last_undegraded":"2024-04-17T19:53:10.529101+0000","last_fullsized":"2024-04-17T19:53:10.529101+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:52:59.924361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.866027+0000","last_change":"2024-04-17T19:53:05.463312+0000","last_active":"2024-04-17T19:53:11.866027+0000","last_peered":"2024-04-17T19:53:11.866027+0000","last_clean":"2024-04-17T19:53:11.866027+0000","last_became_active":"2024-04-17T19:53:05.462415+0000","last_became_peered":"2024-04-17T19:53:05.462415+0000","last_unstale":"2024-04-17T19:53:11.866027+0000","last_undegraded":"2024-04-17T19:53:11.866027+0000","last_fullsized":"2024-04-17T19:53:11.866027+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:27:51.520335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.867287+0000","last_change":"2024-04-17T19:53:04.471150+0000","last_active":"2024-04-17T19:53:11.867287+0000","last_peered":"2024-04-17T19:53:11.867287+0000","last_clean":"2024-04-17T19:53:11.867287+0000","last_became_active":"2024-04-17T19:53:04.470258+0000","last_became_peered":"2024-04-17T19:53:04.470258+0000","last_unstale":"2024-04-17T19:53:11.867287+0000","last_undegraded":"2024-04-17T19:53:11.867287+0000","last_fullsized":"2024-04-17T19:53:11.867287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:06:00.469757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.780980+0000","last_change":"2024-04-17T19:53:09.565387+0000","last_active":"2024-04-17T19:53:10.780980+0000","last_peered":"2024-04-17T19:53:10.780980+0000","last_clean":"2024-04-17T19:53:10.780980+0000","last_became_active":"2024-04-17T19:53:09.564134+0000","last_became_peered":"2024-04-17T19:53:09.564134+0000","last_unstale":"2024-04-17T19:53:10.780980+0000","last_undegraded":"2024-04-17T19:53:10.780980+0000","last_fullsized":"2024-04-17T19:53:10.780980+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:21:01.809464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.491285+0000","last_change":"2024-04-17T19:53:05.468962+0000","last_active":"2024-04-17T19:53:10.491285+0000","last_peered":"2024-04-17T19:53:10.491285+0000","last_clean":"2024-04-17T19:53:10.491285+0000","last_became_active":"2024-04-17T19:53:05.466996+0000","last_became_peered":"2024-04-17T19:53:05.466996+0000","last_unstale":"2024-04-17T19:53:10.491285+0000","last_undegraded":"2024-04-17T19:53:10.491285+0000","last_fullsized":"2024-04-17T19:53:10.491285+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:04:55.125411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.528304+0000","last_change":"2024-04-17T19:53:04.472916+0000","last_active":"2024-04-17T19:53:10.528304+0000","last_peered":"2024-04-17T19:53:10.528304+0000","last_clean":"2024-04-17T19:53:10.528304+0000","last_became_active":"2024-04-17T19:53:04.468136+0000","last_became_peered":"2024-04-17T19:53:04.468136+0000","last_unstale":"2024-04-17T19:53:10.528304+0000","last_undegraded":"2024-04-17T19:53:10.528304+0000","last_fullsized":"2024-04-17T19:53:10.528304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:23:02.868468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.864193+0000","last_change":"2024-04-17T19:53:09.558352+0000","last_active":"2024-04-17T19:53:11.864193+0000","last_peered":"2024-04-17T19:53:11.864193+0000","last_clean":"2024-04-17T19:53:11.864193+0000","last_became_active":"2024-04-17T19:53:09.557871+0000","last_became_peered":"2024-04-17T19:53:09.557871+0000","last_unstale":"2024-04-17T19:53:11.864193+0000","last_undegraded":"2024-04-17T19:53:11.864193+0000","last_fullsized":"2024-04-17T19:53:11.864193+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:34:07.690034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.867320+0000","last_change":"2024-04-17T19:53:05.467799+0000","last_active":"2024-04-17T19:53:11.867320+0000","last_peered":"2024-04-17T19:53:11.867320+0000","last_clean":"2024-04-17T19:53:11.867320+0000","last_became_active":"2024-04-17T19:53:05.465048+0000","last_became_peered":"2024-04-17T19:53:05.465048+0000","last_unstale":"2024-04-17T19:53:11.867320+0000","last_undegraded":"2024-04-17T19:53:11.867320+0000","last_fullsized":"2024-04-17T19:53:11.867320+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:19:09.456602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.494989+0000","last_change":"2024-04-17T19:53:04.469594+0000","last_active":"2024-04-17T19:53:10.494989+0000","last_peered":"2024-04-17T19:53:10.494989+0000","last_clean":"2024-04-17T19:53:10.494989+0000","last_became_active":"2024-04-17T19:53:04.469119+0000","last_became_peered":"2024-04-17T19:53:04.469119+0000","last_unstale":"2024-04-17T19:53:10.494989+0000","last_undegraded":"2024-04-17T19:53:10.494989+0000","last_fullsized":"2024-04-17T19:53:10.494989+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:40:30.547343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.863355+0000","last_change":"2024-04-17T19:53:09.527277+0000","last_active":"2024-04-17T19:53:11.863355+0000","last_peered":"2024-04-17T19:53:11.863355+0000","last_clean":"2024-04-17T19:53:11.863355+0000","last_became_active":"2024-04-17T19:53:09.526436+0000","last_became_peered":"2024-04-17T19:53:09.526436+0000","last_unstale":"2024-04-17T19:53:11.863355+0000","last_undegraded":"2024-04-17T19:53:11.863355+0000","last_fullsized":"2024-04-17T19:53:11.863355+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:54:31.569576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.867699+0000","last_change":"2024-04-17T19:53:05.443712+0000","last_active":"2024-04-17T19:53:11.867699+0000","last_peered":"2024-04-17T19:53:11.867699+0000","last_clean":"2024-04-17T19:53:11.867699+0000","last_became_active":"2024-04-17T19:53:05.442881+0000","last_became_peered":"2024-04-17T19:53:05.442881+0000","last_unstale":"2024-04-17T19:53:11.867699+0000","last_undegraded":"2024-04-17T19:53:11.867699+0000","last_fullsized":"2024-04-17T19:53:11.867699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:20:57.763858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.867688+0000","last_change":"2024-04-17T19:53:04.465717+0000","last_active":"2024-04-17T19:53:11.867688+0000","last_peered":"2024-04-17T19:53:11.867688+0000","last_clean":"2024-04-17T19:53:11.867688+0000","last_became_active":"2024-04-17T19:53:04.464701+0000","last_became_peered":"2024-04-17T19:53:04.464701+0000","last_unstale":"2024-04-17T19:53:11.867688+0000","last_undegraded":"2024-04-17T19:53:11.867688+0000","last_fullsized":"2024-04-17T19:53:11.867688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:18:11.256327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.866220+0000","last_change":"2024-04-17T19:53:09.530585+0000","last_active":"2024-04-17T19:53:11.866220+0000","last_peered":"2024-04-17T19:53:11.866220+0000","last_clean":"2024-04-17T19:53:11.866220+0000","last_became_active":"2024-04-17T19:53:09.529345+0000","last_became_peered":"2024-04-17T19:53:09.529345+0000","last_unstale":"2024-04-17T19:53:11.866220+0000","last_undegraded":"2024-04-17T19:53:11.866220+0000","last_fullsized":"2024-04-17T19:53:11.866220+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:01:38.507428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.497866+0000","last_change":"2024-04-17T19:53:05.452177+0000","last_active":"2024-04-17T19:53:10.497866+0000","last_peered":"2024-04-17T19:53:10.497866+0000","last_clean":"2024-04-17T19:53:10.497866+0000","last_became_active":"2024-04-17T19:53:05.451272+0000","last_became_peered":"2024-04-17T19:53:05.451272+0000","last_unstale":"2024-04-17T19:53:10.497866+0000","last_undegraded":"2024-04-17T19:53:10.497866+0000","last_fullsized":"2024-04-17T19:53:10.497866+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:51:17.675125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.493390+0000","last_change":"2024-04-17T19:53:04.471944+0000","last_active":"2024-04-17T19:53:10.493390+0000","last_peered":"2024-04-17T19:53:10.493390+0000","last_clean":"2024-04-17T19:53:10.493390+0000","last_became_active":"2024-04-17T19:53:04.471458+0000","last_became_peered":"2024-04-17T19:53:04.471458+0000","last_unstale":"2024-04-17T19:53:10.493390+0000","last_undegraded":"2024-04-17T19:53:10.493390+0000","last_fullsized":"2024-04-17T19:53:10.493390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:12:02.438192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.495688+0000","last_change":"2024-04-17T19:53:09.549998+0000","last_active":"2024-04-17T19:53:10.495688+0000","last_peered":"2024-04-17T19:53:10.495688+0000","last_clean":"2024-04-17T19:53:10.495688+0000","last_became_active":"2024-04-17T19:53:09.548136+0000","last_became_peered":"2024-04-17T19:53:09.548136+0000","last_unstale":"2024-04-17T19:53:10.495688+0000","last_undegraded":"2024-04-17T19:53:10.495688+0000","last_fullsized":"2024-04-17T19:53:10.495688+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:02:14.459968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.863519+0000","last_change":"2024-04-17T19:53:05.472884+0000","last_active":"2024-04-17T19:53:11.863519+0000","last_peered":"2024-04-17T19:53:11.863519+0000","last_clean":"2024-04-17T19:53:11.863519+0000","last_became_active":"2024-04-17T19:53:05.472513+0000","last_became_peered":"2024-04-17T19:53:05.472513+0000","last_unstale":"2024-04-17T19:53:11.863519+0000","last_undegraded":"2024-04-17T19:53:11.863519+0000","last_fullsized":"2024-04-17T19:53:11.863519+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:21:37.163564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.493966+0000","last_change":"2024-04-17T19:53:04.487713+0000","last_active":"2024-04-17T19:53:10.493966+0000","last_peered":"2024-04-17T19:53:10.493966+0000","last_clean":"2024-04-17T19:53:10.493966+0000","last_became_active":"2024-04-17T19:53:04.487005+0000","last_became_peered":"2024-04-17T19:53:04.487005+0000","last_unstale":"2024-04-17T19:53:10.493966+0000","last_undegraded":"2024-04-17T19:53:10.493966+0000","last_fullsized":"2024-04-17T19:53:10.493966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:53:36.130201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.496249+0000","last_change":"2024-04-17T19:53:09.547824+0000","last_active":"2024-04-17T19:53:10.496249+0000","last_peered":"2024-04-17T19:53:10.496249+0000","last_clean":"2024-04-17T19:53:10.496249+0000","last_became_active":"2024-04-17T19:53:09.545636+0000","last_became_peered":"2024-04-17T19:53:09.545636+0000","last_unstale":"2024-04-17T19:53:10.496249+0000","last_undegraded":"2024-04-17T19:53:10.496249+0000","last_fullsized":"2024-04-17T19:53:10.496249+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:06:17.885652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.529514+0000","last_change":"2024-04-17T19:53:05.465820+0000","last_active":"2024-04-17T19:53:10.529514+0000","last_peered":"2024-04-17T19:53:10.529514+0000","last_clean":"2024-04-17T19:53:10.529514+0000","last_became_active":"2024-04-17T19:53:05.464376+0000","last_became_peered":"2024-04-17T19:53:05.464376+0000","last_unstale":"2024-04-17T19:53:10.529514+0000","last_undegraded":"2024-04-17T19:53:10.529514+0000","last_fullsized":"2024-04-17T19:53:10.529514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:53:13.956259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.492409+0000","last_change":"2024-04-17T19:53:04.464706+0000","last_active":"2024-04-17T19:53:10.492409+0000","last_peered":"2024-04-17T19:53:10.492409+0000","last_clean":"2024-04-17T19:53:10.492409+0000","last_became_active":"2024-04-17T19:53:04.464109+0000","last_became_peered":"2024-04-17T19:53:04.464109+0000","last_unstale":"2024-04-17T19:53:10.492409+0000","last_undegraded":"2024-04-17T19:53:10.492409+0000","last_fullsized":"2024-04-17T19:53:10.492409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:38:40.499868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.497647+0000","last_change":"2024-04-17T19:53:09.553078+0000","last_active":"2024-04-17T19:53:10.497647+0000","last_peered":"2024-04-17T19:53:10.497647+0000","last_clean":"2024-04-17T19:53:10.497647+0000","last_became_active":"2024-04-17T19:53:09.548806+0000","last_became_peered":"2024-04-17T19:53:09.548806+0000","last_unstale":"2024-04-17T19:53:10.497647+0000","last_undegraded":"2024-04-17T19:53:10.497647+0000","last_fullsized":"2024-04-17T19:53:10.497647+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:33:37.250066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.493540+0000","last_change":"2024-04-17T19:53:05.476631+0000","last_active":"2024-04-17T19:53:10.493540+0000","last_peered":"2024-04-17T19:53:10.493540+0000","last_clean":"2024-04-17T19:53:10.493540+0000","last_became_active":"2024-04-17T19:53:05.474164+0000","last_became_peered":"2024-04-17T19:53:05.474164+0000","last_unstale":"2024-04-17T19:53:10.493540+0000","last_undegraded":"2024-04-17T19:53:10.493540+0000","last_fullsized":"2024-04-17T19:53:10.493540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:53:13.956259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.779561+0000","last_change":"2024-04-17T19:53:04.486117+0000","last_active":"2024-04-17T19:53:10.779561+0000","last_peered":"2024-04-17T19:53:10.779561+0000","last_clean":"2024-04-17T19:53:10.779561+0000","last_became_active":"2024-04-17T19:53:04.485424+0000","last_became_peered":"2024-04-17T19:53:04.485424+0000","last_unstale":"2024-04-17T19:53:10.779561+0000","last_undegraded":"2024-04-17T19:53:10.779561+0000","last_fullsized":"2024-04-17T19:53:10.779561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:21:45.875274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.496364+0000","last_change":"2024-04-17T19:53:09.549846+0000","last_active":"2024-04-17T19:53:10.496364+0000","last_peered":"2024-04-17T19:53:10.496364+0000","last_clean":"2024-04-17T19:53:10.496364+0000","last_became_active":"2024-04-17T19:53:09.548070+0000","last_became_peered":"2024-04-17T19:53:09.548070+0000","last_unstale":"2024-04-17T19:53:10.496364+0000","last_undegraded":"2024-04-17T19:53:10.496364+0000","last_fullsized":"2024-04-17T19:53:10.496364+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:05.469665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.495415+0000","last_change":"2024-04-17T19:53:05.469993+0000","last_active":"2024-04-17T19:53:10.495415+0000","last_peered":"2024-04-17T19:53:10.495415+0000","last_clean":"2024-04-17T19:53:10.495415+0000","last_became_active":"2024-04-17T19:53:05.468241+0000","last_became_peered":"2024-04-17T19:53:05.468241+0000","last_unstale":"2024-04-17T19:53:10.495415+0000","last_undegraded":"2024-04-17T19:53:10.495415+0000","last_fullsized":"2024-04-17T19:53:10.495415+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:39:15.005822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.491765+0000","last_change":"2024-04-17T19:53:04.484259+0000","last_active":"2024-04-17T19:53:10.491765+0000","last_peered":"2024-04-17T19:53:10.491765+0000","last_clean":"2024-04-17T19:53:10.491765+0000","last_became_active":"2024-04-17T19:53:04.483882+0000","last_became_peered":"2024-04-17T19:53:04.483882+0000","last_unstale":"2024-04-17T19:53:10.491765+0000","last_undegraded":"2024-04-17T19:53:10.491765+0000","last_fullsized":"2024-04-17T19:53:10.491765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:18:11.256327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.495038+0000","last_change":"2024-04-17T19:53:09.559932+0000","last_active":"2024-04-17T19:53:10.495038+0000","last_peered":"2024-04-17T19:53:10.495038+0000","last_clean":"2024-04-17T19:53:10.495038+0000","last_became_active":"2024-04-17T19:53:09.558888+0000","last_became_peered":"2024-04-17T19:53:09.558888+0000","last_unstale":"2024-04-17T19:53:10.495038+0000","last_undegraded":"2024-04-17T19:53:10.495038+0000","last_fullsized":"2024-04-17T19:53:10.495038+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:22:59.388953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.866936+0000","last_change":"2024-04-17T19:53:05.463658+0000","last_active":"2024-04-17T19:53:11.866936+0000","last_peered":"2024-04-17T19:53:11.866936+0000","last_clean":"2024-04-17T19:53:11.866936+0000","last_became_active":"2024-04-17T19:53:05.462437+0000","last_became_peered":"2024-04-17T19:53:05.462437+0000","last_unstale":"2024-04-17T19:53:11.866936+0000","last_undegraded":"2024-04-17T19:53:11.866936+0000","last_fullsized":"2024-04-17T19:53:11.866936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:06:14.699788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.492615+0000","last_change":"2024-04-17T19:53:04.459172+0000","last_active":"2024-04-17T19:53:10.492615+0000","last_peered":"2024-04-17T19:53:10.492615+0000","last_clean":"2024-04-17T19:53:10.492615+0000","last_became_active":"2024-04-17T19:53:04.458798+0000","last_became_peered":"2024-04-17T19:53:04.458798+0000","last_unstale":"2024-04-17T19:53:10.492615+0000","last_undegraded":"2024-04-17T19:53:10.492615+0000","last_fullsized":"2024-04-17T19:53:10.492615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:21:36.152247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":177,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.527066+0000","last_change":"2024-04-17T19:52:54.651873+0000","last_active":"2024-04-17T19:53:11.527066+0000","last_peered":"2024-04-17T19:53:11.527066+0000","last_clean":"2024-04-17T19:53:11.527066+0000","last_became_active":"2024-04-17T19:52:54.649700+0000","last_became_peered":"2024-04-17T19:52:54.649700+0000","last_unstale":"2024-04-17T19:53:11.527066+0000","last_undegraded":"2024-04-17T19:53:11.527066+0000","last_fullsized":"2024-04-17T19:53:11.527066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:52:53.245174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:52:53.245174+0000","last_clean_scrub_stamp":"2024-04-17T19:52:53.245174+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:26:16.094093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.493284+0000","last_change":"2024-04-17T19:53:09.520288+0000","last_active":"2024-04-17T19:53:10.493284+0000","last_peered":"2024-04-17T19:53:10.493284+0000","last_clean":"2024-04-17T19:53:10.493284+0000","last_became_active":"2024-04-17T19:53:09.519226+0000","last_became_peered":"2024-04-17T19:53:09.519226+0000","last_unstale":"2024-04-17T19:53:10.493284+0000","last_undegraded":"2024-04-17T19:53:10.493284+0000","last_fullsized":"2024-04-17T19:53:10.493284+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:35:04.617369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.492930+0000","last_change":"2024-04-17T19:53:05.475968+0000","last_active":"2024-04-17T19:53:10.492930+0000","last_peered":"2024-04-17T19:53:10.492930+0000","last_clean":"2024-04-17T19:53:10.492930+0000","last_became_active":"2024-04-17T19:53:05.475600+0000","last_became_peered":"2024-04-17T19:53:05.475600+0000","last_unstale":"2024-04-17T19:53:10.492930+0000","last_undegraded":"2024-04-17T19:53:10.492930+0000","last_fullsized":"2024-04-17T19:53:10.492930+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:34:03.644428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.497904+0000","last_change":"2024-04-17T19:53:04.457214+0000","last_active":"2024-04-17T19:53:10.497904+0000","last_peered":"2024-04-17T19:53:10.497904+0000","last_clean":"2024-04-17T19:53:10.497904+0000","last_became_active":"2024-04-17T19:53:04.453473+0000","last_became_peered":"2024-04-17T19:53:04.453473+0000","last_unstale":"2024-04-17T19:53:10.497904+0000","last_undegraded":"2024-04-17T19:53:10.497904+0000","last_fullsized":"2024-04-17T19:53:10.497904+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:14:03.008171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.863346+0000","last_change":"2024-04-17T19:53:09.548981+0000","last_active":"2024-04-17T19:53:11.863346+0000","last_peered":"2024-04-17T19:53:11.863346+0000","last_clean":"2024-04-17T19:53:11.863346+0000","last_became_active":"2024-04-17T19:53:09.548575+0000","last_became_peered":"2024-04-17T19:53:09.548575+0000","last_unstale":"2024-04-17T19:53:11.863346+0000","last_undegraded":"2024-04-17T19:53:11.863346+0000","last_fullsized":"2024-04-17T19:53:11.863346+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:05:25.218656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.529559+0000","last_change":"2024-04-17T19:53:05.464697+0000","last_active":"2024-04-17T19:53:10.529559+0000","last_peered":"2024-04-17T19:53:10.529559+0000","last_clean":"2024-04-17T19:53:10.529559+0000","last_became_active":"2024-04-17T19:53:05.463935+0000","last_became_peered":"2024-04-17T19:53:05.463935+0000","last_unstale":"2024-04-17T19:53:10.529559+0000","last_undegraded":"2024-04-17T19:53:10.529559+0000","last_fullsized":"2024-04-17T19:53:10.529559+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:15:45.727550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.494522+0000","last_change":"2024-04-17T19:53:04.475555+0000","last_active":"2024-04-17T19:53:10.494522+0000","last_peered":"2024-04-17T19:53:10.494522+0000","last_clean":"2024-04-17T19:53:10.494522+0000","last_became_active":"2024-04-17T19:53:04.467881+0000","last_became_peered":"2024-04-17T19:53:04.467881+0000","last_unstale":"2024-04-17T19:53:10.494522+0000","last_undegraded":"2024-04-17T19:53:10.494522+0000","last_fullsized":"2024-04-17T19:53:10.494522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:22:17.837334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.494205+0000","last_change":"2024-04-17T19:53:09.535560+0000","last_active":"2024-04-17T19:53:10.494205+0000","last_peered":"2024-04-17T19:53:10.494205+0000","last_clean":"2024-04-17T19:53:10.494205+0000","last_became_active":"2024-04-17T19:53:09.534631+0000","last_became_peered":"2024-04-17T19:53:09.534631+0000","last_unstale":"2024-04-17T19:53:10.494205+0000","last_undegraded":"2024-04-17T19:53:10.494205+0000","last_fullsized":"2024-04-17T19:53:10.494205+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:30:27.062045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.530016+0000","last_change":"2024-04-17T19:53:05.460324+0000","last_active":"2024-04-17T19:53:10.530016+0000","last_peered":"2024-04-17T19:53:10.530016+0000","last_clean":"2024-04-17T19:53:10.530016+0000","last_became_active":"2024-04-17T19:53:05.459941+0000","last_became_peered":"2024-04-17T19:53:05.459941+0000","last_unstale":"2024-04-17T19:53:10.530016+0000","last_undegraded":"2024-04-17T19:53:10.530016+0000","last_fullsized":"2024-04-17T19:53:10.530016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:34:03.644428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.867646+0000","last_change":"2024-04-17T19:53:04.467765+0000","last_active":"2024-04-17T19:53:11.867646+0000","last_peered":"2024-04-17T19:53:11.867646+0000","last_clean":"2024-04-17T19:53:11.867646+0000","last_became_active":"2024-04-17T19:53:04.466753+0000","last_became_peered":"2024-04-17T19:53:04.466753+0000","last_unstale":"2024-04-17T19:53:11.867646+0000","last_undegraded":"2024-04-17T19:53:11.867646+0000","last_fullsized":"2024-04-17T19:53:11.867646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:53:36.130201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.491139+0000","last_change":"2024-04-17T19:53:09.519632+0000","last_active":"2024-04-17T19:53:10.491139+0000","last_peered":"2024-04-17T19:53:10.491139+0000","last_clean":"2024-04-17T19:53:10.491139+0000","last_became_active":"2024-04-17T19:53:09.518979+0000","last_became_peered":"2024-04-17T19:53:09.518979+0000","last_unstale":"2024-04-17T19:53:10.491139+0000","last_undegraded":"2024-04-17T19:53:10.491139+0000","last_fullsized":"2024-04-17T19:53:10.491139+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:07:11.268705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.864298+0000","last_change":"2024-04-17T19:53:05.464583+0000","last_active":"2024-04-17T19:53:11.864298+0000","last_peered":"2024-04-17T19:53:11.864298+0000","last_clean":"2024-04-17T19:53:11.864298+0000","last_became_active":"2024-04-17T19:53:05.464158+0000","last_became_peered":"2024-04-17T19:53:05.464158+0000","last_unstale":"2024-04-17T19:53:11.864298+0000","last_undegraded":"2024-04-17T19:53:11.864298+0000","last_fullsized":"2024-04-17T19:53:11.864298+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:38:41.511185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.530315+0000","last_change":"2024-04-17T19:53:04.477502+0000","last_active":"2024-04-17T19:53:10.530315+0000","last_peered":"2024-04-17T19:53:10.530315+0000","last_clean":"2024-04-17T19:53:10.530315+0000","last_became_active":"2024-04-17T19:53:04.477162+0000","last_became_peered":"2024-04-17T19:53:04.477162+0000","last_unstale":"2024-04-17T19:53:10.530315+0000","last_undegraded":"2024-04-17T19:53:10.530315+0000","last_fullsized":"2024-04-17T19:53:10.530315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:21:36.152247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.528690+0000","last_change":"2024-04-17T19:53:09.533476+0000","last_active":"2024-04-17T19:53:11.528690+0000","last_peered":"2024-04-17T19:53:11.528690+0000","last_clean":"2024-04-17T19:53:11.528690+0000","last_became_active":"2024-04-17T19:53:09.532715+0000","last_became_peered":"2024-04-17T19:53:09.532715+0000","last_unstale":"2024-04-17T19:53:11.528690+0000","last_undegraded":"2024-04-17T19:53:11.528690+0000","last_fullsized":"2024-04-17T19:53:11.528690+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:38:45.556791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.491188+0000","last_change":"2024-04-17T19:53:05.473330+0000","last_active":"2024-04-17T19:53:10.491188+0000","last_peered":"2024-04-17T19:53:10.491188+0000","last_clean":"2024-04-17T19:53:10.491188+0000","last_became_active":"2024-04-17T19:53:05.468223+0000","last_became_peered":"2024-04-17T19:53:05.468223+0000","last_unstale":"2024-04-17T19:53:10.491188+0000","last_undegraded":"2024-04-17T19:53:10.491188+0000","last_fullsized":"2024-04-17T19:53:10.491188+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:01:34.461822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.866359+0000","last_change":"2024-04-17T19:53:04.461896+0000","last_active":"2024-04-17T19:53:11.866359+0000","last_peered":"2024-04-17T19:53:11.866359+0000","last_clean":"2024-04-17T19:53:11.866359+0000","last_became_active":"2024-04-17T19:53:04.460919+0000","last_became_peered":"2024-04-17T19:53:04.460919+0000","last_unstale":"2024-04-17T19:53:11.866359+0000","last_undegraded":"2024-04-17T19:53:11.866359+0000","last_fullsized":"2024-04-17T19:53:11.866359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:22:17.837334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.495547+0000","last_change":"2024-04-17T19:53:09.547397+0000","last_active":"2024-04-17T19:53:10.495547+0000","last_peered":"2024-04-17T19:53:10.495547+0000","last_clean":"2024-04-17T19:53:10.495547+0000","last_became_active":"2024-04-17T19:53:09.546048+0000","last_became_peered":"2024-04-17T19:53:09.546048+0000","last_unstale":"2024-04-17T19:53:10.495547+0000","last_undegraded":"2024-04-17T19:53:10.495547+0000","last_fullsized":"2024-04-17T19:53:10.495547+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:58:59.810415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.528039+0000","last_change":"2024-04-17T19:53:05.474322+0000","last_active":"2024-04-17T19:53:11.528039+0000","last_peered":"2024-04-17T19:53:11.528039+0000","last_clean":"2024-04-17T19:53:11.528039+0000","last_became_active":"2024-04-17T19:53:05.473892+0000","last_became_peered":"2024-04-17T19:53:05.473892+0000","last_unstale":"2024-04-17T19:53:11.528039+0000","last_undegraded":"2024-04-17T19:53:11.528039+0000","last_fullsized":"2024-04-17T19:53:11.528039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:18:12.267644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.528714+0000","last_change":"2024-04-17T19:53:04.460138+0000","last_active":"2024-04-17T19:53:10.528714+0000","last_peered":"2024-04-17T19:53:10.528714+0000","last_clean":"2024-04-17T19:53:10.528714+0000","last_became_active":"2024-04-17T19:53:04.459663+0000","last_became_peered":"2024-04-17T19:53:04.459663+0000","last_unstale":"2024-04-17T19:53:10.528714+0000","last_undegraded":"2024-04-17T19:53:10.528714+0000","last_fullsized":"2024-04-17T19:53:10.528714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:06:00.469757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.494889+0000","last_change":"2024-04-17T19:53:09.533802+0000","last_active":"2024-04-17T19:53:10.494889+0000","last_peered":"2024-04-17T19:53:10.494889+0000","last_clean":"2024-04-17T19:53:10.494889+0000","last_became_active":"2024-04-17T19:53:09.532504+0000","last_became_peered":"2024-04-17T19:53:09.532504+0000","last_unstale":"2024-04-17T19:53:10.494889+0000","last_undegraded":"2024-04-17T19:53:10.494889+0000","last_fullsized":"2024-04-17T19:53:10.494889+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:04:59.171017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.492057+0000","last_change":"2024-04-17T19:53:05.467855+0000","last_active":"2024-04-17T19:53:10.492057+0000","last_peered":"2024-04-17T19:53:10.492057+0000","last_clean":"2024-04-17T19:53:10.492057+0000","last_became_active":"2024-04-17T19:53:05.467349+0000","last_became_peered":"2024-04-17T19:53:05.467349+0000","last_unstale":"2024-04-17T19:53:10.492057+0000","last_undegraded":"2024-04-17T19:53:10.492057+0000","last_fullsized":"2024-04-17T19:53:10.492057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:52:55.878755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.492398+0000","last_change":"2024-04-17T19:53:04.465826+0000","last_active":"2024-04-17T19:53:10.492398+0000","last_peered":"2024-04-17T19:53:10.492398+0000","last_clean":"2024-04-17T19:53:10.492398+0000","last_became_active":"2024-04-17T19:53:04.465333+0000","last_became_peered":"2024-04-17T19:53:04.465333+0000","last_unstale":"2024-04-17T19:53:10.492398+0000","last_undegraded":"2024-04-17T19:53:10.492398+0000","last_fullsized":"2024-04-17T19:53:10.492398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:25:21.542158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.497344+0000","last_change":"2024-04-17T19:53:09.550127+0000","last_active":"2024-04-17T19:53:10.497344+0000","last_peered":"2024-04-17T19:53:10.497344+0000","last_clean":"2024-04-17T19:53:10.497344+0000","last_became_active":"2024-04-17T19:53:09.548109+0000","last_became_peered":"2024-04-17T19:53:09.548109+0000","last_unstale":"2024-04-17T19:53:10.497344+0000","last_undegraded":"2024-04-17T19:53:10.497344+0000","last_fullsized":"2024-04-17T19:53:10.497344+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:03:47.252621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.496697+0000","last_change":"2024-04-17T19:53:05.455185+0000","last_active":"2024-04-17T19:53:10.496697+0000","last_peered":"2024-04-17T19:53:10.496697+0000","last_clean":"2024-04-17T19:53:10.496697+0000","last_became_active":"2024-04-17T19:53:05.454358+0000","last_became_peered":"2024-04-17T19:53:05.454358+0000","last_unstale":"2024-04-17T19:53:10.496697+0000","last_undegraded":"2024-04-17T19:53:10.496697+0000","last_fullsized":"2024-04-17T19:53:10.496697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:26:54.093651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.780019+0000","last_change":"2024-04-17T19:53:04.474288+0000","last_active":"2024-04-17T19:53:10.780019+0000","last_peered":"2024-04-17T19:53:10.780019+0000","last_clean":"2024-04-17T19:53:10.780019+0000","last_became_active":"2024-04-17T19:53:04.473389+0000","last_became_peered":"2024-04-17T19:53:04.473389+0000","last_unstale":"2024-04-17T19:53:10.780019+0000","last_undegraded":"2024-04-17T19:53:10.780019+0000","last_fullsized":"2024-04-17T19:53:10.780019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:31:27.754909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.492763+0000","last_change":"2024-04-17T19:53:09.524630+0000","last_active":"2024-04-17T19:53:10.492763+0000","last_peered":"2024-04-17T19:53:10.492763+0000","last_clean":"2024-04-17T19:53:10.492763+0000","last_became_active":"2024-04-17T19:53:09.521522+0000","last_became_peered":"2024-04-17T19:53:09.521522+0000","last_unstale":"2024-04-17T19:53:10.492763+0000","last_undegraded":"2024-04-17T19:53:10.492763+0000","last_fullsized":"2024-04-17T19:53:10.492763+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:59:47.402073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.529373+0000","last_change":"2024-04-17T19:53:05.455865+0000","last_active":"2024-04-17T19:53:10.529373+0000","last_peered":"2024-04-17T19:53:10.529373+0000","last_clean":"2024-04-17T19:53:10.529373+0000","last_became_active":"2024-04-17T19:53:05.455429+0000","last_became_peered":"2024-04-17T19:53:05.455429+0000","last_unstale":"2024-04-17T19:53:10.529373+0000","last_undegraded":"2024-04-17T19:53:10.529373+0000","last_fullsized":"2024-04-17T19:53:10.529373+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:01:34.461822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'10","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:20.688890+0000","last_change":"2024-04-17T19:53:04.460295+0000","last_active":"2024-04-17T19:53:20.688890+0000","last_peered":"2024-04-17T19:53:20.688890+0000","last_clean":"2024-04-17T19:53:20.688890+0000","last_became_active":"2024-04-17T19:53:04.459855+0000","last_became_peered":"2024-04-17T19:53:04.459855+0000","last_unstale":"2024-04-17T19:53:20.688890+0000","last_undegraded":"2024-04-17T19:53:20.688890+0000","last_fullsized":"2024-04-17T19:53:20.688890+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:21:45.875274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.866367+0000","last_change":"2024-04-17T19:53:09.530008+0000","last_active":"2024-04-17T19:53:11.866367+0000","last_peered":"2024-04-17T19:53:11.866367+0000","last_clean":"2024-04-17T19:53:11.866367+0000","last_became_active":"2024-04-17T19:53:09.528987+0000","last_became_peered":"2024-04-17T19:53:09.528987+0000","last_unstale":"2024-04-17T19:53:11.866367+0000","last_undegraded":"2024-04-17T19:53:11.866367+0000","last_fullsized":"2024-04-17T19:53:11.866367+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:34:07.690034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.491729+0000","last_change":"2024-04-17T19:53:05.472755+0000","last_active":"2024-04-17T19:53:10.491729+0000","last_peered":"2024-04-17T19:53:10.491729+0000","last_clean":"2024-04-17T19:53:10.491729+0000","last_became_active":"2024-04-17T19:53:05.468432+0000","last_became_peered":"2024-04-17T19:53:05.468432+0000","last_unstale":"2024-04-17T19:53:10.491729+0000","last_undegraded":"2024-04-17T19:53:10.491729+0000","last_fullsized":"2024-04-17T19:53:10.491729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:30:23.016439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.780569+0000","last_change":"2024-04-17T19:53:04.474378+0000","last_active":"2024-04-17T19:53:10.780569+0000","last_peered":"2024-04-17T19:53:10.780569+0000","last_clean":"2024-04-17T19:53:10.780569+0000","last_became_active":"2024-04-17T19:53:04.473458+0000","last_became_peered":"2024-04-17T19:53:04.473458+0000","last_unstale":"2024-04-17T19:53:10.780569+0000","last_undegraded":"2024-04-17T19:53:10.780569+0000","last_fullsized":"2024-04-17T19:53:10.780569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:16:30.888573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.863832+0000","last_change":"2024-04-17T19:53:09.558527+0000","last_active":"2024-04-17T19:53:11.863832+0000","last_peered":"2024-04-17T19:53:11.863832+0000","last_clean":"2024-04-17T19:53:11.863832+0000","last_became_active":"2024-04-17T19:53:09.557653+0000","last_became_peered":"2024-04-17T19:53:09.557653+0000","last_unstale":"2024-04-17T19:53:11.863832+0000","last_undegraded":"2024-04-17T19:53:11.863832+0000","last_fullsized":"2024-04-17T19:53:11.863832+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:01:38.507428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.495008+0000","last_change":"2024-04-17T19:53:05.467990+0000","last_active":"2024-04-17T19:53:10.495008+0000","last_peered":"2024-04-17T19:53:10.495008+0000","last_clean":"2024-04-17T19:53:10.495008+0000","last_became_active":"2024-04-17T19:53:05.461293+0000","last_became_peered":"2024-04-17T19:53:05.461293+0000","last_unstale":"2024-04-17T19:53:10.495008+0000","last_undegraded":"2024-04-17T19:53:10.495008+0000","last_fullsized":"2024-04-17T19:53:10.495008+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:01:34.461822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.530046+0000","last_change":"2024-04-17T19:53:04.472928+0000","last_active":"2024-04-17T19:53:10.530046+0000","last_peered":"2024-04-17T19:53:10.530046+0000","last_clean":"2024-04-17T19:53:10.530046+0000","last_became_active":"2024-04-17T19:53:04.467986+0000","last_became_peered":"2024-04-17T19:53:04.467986+0000","last_unstale":"2024-04-17T19:53:10.530046+0000","last_undegraded":"2024-04-17T19:53:10.530046+0000","last_fullsized":"2024-04-17T19:53:10.530046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:53:36.130201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.779233+0000","last_change":"2024-04-17T19:53:09.560792+0000","last_active":"2024-04-17T19:53:10.779233+0000","last_peered":"2024-04-17T19:53:10.779233+0000","last_clean":"2024-04-17T19:53:10.779233+0000","last_became_active":"2024-04-17T19:53:09.558779+0000","last_became_peered":"2024-04-17T19:53:09.558779+0000","last_unstale":"2024-04-17T19:53:10.779233+0000","last_undegraded":"2024-04-17T19:53:10.779233+0000","last_fullsized":"2024-04-17T19:53:10.779233+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:13:52.775623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.864234+0000","last_change":"2024-04-17T19:53:05.459934+0000","last_active":"2024-04-17T19:53:11.864234+0000","last_peered":"2024-04-17T19:53:11.864234+0000","last_clean":"2024-04-17T19:53:11.864234+0000","last_became_active":"2024-04-17T19:53:05.459538+0000","last_became_peered":"2024-04-17T19:53:05.459538+0000","last_unstale":"2024-04-17T19:53:11.864234+0000","last_undegraded":"2024-04-17T19:53:11.864234+0000","last_fullsized":"2024-04-17T19:53:11.864234+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:25:22.553475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.529342+0000","last_change":"2024-04-17T19:53:04.460345+0000","last_active":"2024-04-17T19:53:11.529342+0000","last_peered":"2024-04-17T19:53:11.529342+0000","last_clean":"2024-04-17T19:53:11.529342+0000","last_became_active":"2024-04-17T19:53:04.459787+0000","last_became_peered":"2024-04-17T19:53:04.459787+0000","last_unstale":"2024-04-17T19:53:11.529342+0000","last_undegraded":"2024-04-17T19:53:11.529342+0000","last_fullsized":"2024-04-17T19:53:11.529342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:16:30.888573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.866660+0000","last_change":"2024-04-17T19:53:09.557144+0000","last_active":"2024-04-17T19:53:11.866660+0000","last_peered":"2024-04-17T19:53:11.866660+0000","last_clean":"2024-04-17T19:53:11.866660+0000","last_became_active":"2024-04-17T19:53:09.555953+0000","last_became_peered":"2024-04-17T19:53:09.555953+0000","last_unstale":"2024-04-17T19:53:11.866660+0000","last_undegraded":"2024-04-17T19:53:11.866660+0000","last_fullsized":"2024-04-17T19:53:11.866660+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:10:36.885109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.867320+0000","last_change":"2024-04-17T19:53:09.536930+0000","last_active":"2024-04-17T19:53:11.867320+0000","last_peered":"2024-04-17T19:53:11.867320+0000","last_clean":"2024-04-17T19:53:11.867320+0000","last_became_active":"2024-04-17T19:53:09.535559+0000","last_became_peered":"2024-04-17T19:53:09.535559+0000","last_unstale":"2024-04-17T19:53:11.867320+0000","last_undegraded":"2024-04-17T19:53:11.867320+0000","last_fullsized":"2024-04-17T19:53:11.867320+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:29:54.335720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.867019+0000","last_change":"2024-04-17T19:53:05.440653+0000","last_active":"2024-04-17T19:53:11.867019+0000","last_peered":"2024-04-17T19:53:11.867019+0000","last_clean":"2024-04-17T19:53:11.867019+0000","last_became_active":"2024-04-17T19:53:05.439793+0000","last_became_peered":"2024-04-17T19:53:05.439793+0000","last_unstale":"2024-04-17T19:53:11.867019+0000","last_undegraded":"2024-04-17T19:53:11.867019+0000","last_fullsized":"2024-04-17T19:53:11.867019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:10:21.772873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.491426+0000","last_change":"2024-04-17T19:53:04.461705+0000","last_active":"2024-04-17T19:53:10.491426+0000","last_peered":"2024-04-17T19:53:10.491426+0000","last_clean":"2024-04-17T19:53:10.491426+0000","last_became_active":"2024-04-17T19:53:04.461020+0000","last_became_peered":"2024-04-17T19:53:04.461020+0000","last_unstale":"2024-04-17T19:53:10.491426+0000","last_undegraded":"2024-04-17T19:53:10.491426+0000","last_fullsized":"2024-04-17T19:53:10.491426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:53:36.130201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.494505+0000","last_change":"2024-04-17T19:53:09.535147+0000","last_active":"2024-04-17T19:53:10.494505+0000","last_peered":"2024-04-17T19:53:10.494505+0000","last_clean":"2024-04-17T19:53:10.494505+0000","last_became_active":"2024-04-17T19:53:09.534655+0000","last_became_peered":"2024-04-17T19:53:09.534655+0000","last_unstale":"2024-04-17T19:53:10.494505+0000","last_undegraded":"2024-04-17T19:53:10.494505+0000","last_fullsized":"2024-04-17T19:53:10.494505+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:06:37.779654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.494234+0000","last_change":"2024-04-17T19:53:05.455848+0000","last_active":"2024-04-17T19:53:10.494234+0000","last_peered":"2024-04-17T19:53:10.494234+0000","last_clean":"2024-04-17T19:53:10.494234+0000","last_became_active":"2024-04-17T19:53:05.452844+0000","last_became_peered":"2024-04-17T19:53:05.452844+0000","last_unstale":"2024-04-17T19:53:10.494234+0000","last_undegraded":"2024-04-17T19:53:10.494234+0000","last_fullsized":"2024-04-17T19:53:10.494234+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:54:27.523970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.496158+0000","last_change":"2024-04-17T19:53:04.470824+0000","last_active":"2024-04-17T19:53:10.496158+0000","last_peered":"2024-04-17T19:53:10.496158+0000","last_clean":"2024-04-17T19:53:10.496158+0000","last_became_active":"2024-04-17T19:53:04.469777+0000","last_became_peered":"2024-04-17T19:53:04.469777+0000","last_unstale":"2024-04-17T19:53:10.496158+0000","last_undegraded":"2024-04-17T19:53:10.496158+0000","last_fullsized":"2024-04-17T19:53:10.496158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:30:04.861958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.492143+0000","last_change":"2024-04-17T19:53:04.469785+0000","last_active":"2024-04-17T19:53:10.492143+0000","last_peered":"2024-04-17T19:53:10.492143+0000","last_clean":"2024-04-17T19:53:10.492143+0000","last_became_active":"2024-04-17T19:53:04.469297+0000","last_became_peered":"2024-04-17T19:53:04.469297+0000","last_unstale":"2024-04-17T19:53:10.492143+0000","last_undegraded":"2024-04-17T19:53:10.492143+0000","last_fullsized":"2024-04-17T19:53:10.492143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:50:02.697725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.866551+0000","last_change":"2024-04-17T19:53:05.460191+0000","last_active":"2024-04-17T19:53:11.866551+0000","last_peered":"2024-04-17T19:53:11.866551+0000","last_clean":"2024-04-17T19:53:11.866551+0000","last_became_active":"2024-04-17T19:53:05.459616+0000","last_became_peered":"2024-04-17T19:53:05.459616+0000","last_unstale":"2024-04-17T19:53:11.866551+0000","last_undegraded":"2024-04-17T19:53:11.866551+0000","last_fullsized":"2024-04-17T19:53:11.866551+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:12:15.307126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.867060+0000","last_change":"2024-04-17T19:53:09.557279+0000","last_active":"2024-04-17T19:53:11.867060+0000","last_peered":"2024-04-17T19:53:11.867060+0000","last_clean":"2024-04-17T19:53:11.867060+0000","last_became_active":"2024-04-17T19:53:09.556190+0000","last_became_peered":"2024-04-17T19:53:09.556190+0000","last_unstale":"2024-04-17T19:53:11.867060+0000","last_undegraded":"2024-04-17T19:53:11.867060+0000","last_fullsized":"2024-04-17T19:53:11.867060+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:40:02.858481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.495230+0000","last_change":"2024-04-17T19:53:04.487292+0000","last_active":"2024-04-17T19:53:10.495230+0000","last_peered":"2024-04-17T19:53:10.495230+0000","last_clean":"2024-04-17T19:53:10.495230+0000","last_became_active":"2024-04-17T19:53:04.486707+0000","last_became_peered":"2024-04-17T19:53:04.486707+0000","last_unstale":"2024-04-17T19:53:10.495230+0000","last_undegraded":"2024-04-17T19:53:10.495230+0000","last_fullsized":"2024-04-17T19:53:10.495230+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:48:50.049562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.527598+0000","last_change":"2024-04-17T19:53:05.449319+0000","last_active":"2024-04-17T19:53:11.527598+0000","last_peered":"2024-04-17T19:53:11.527598+0000","last_clean":"2024-04-17T19:53:11.527598+0000","last_became_active":"2024-04-17T19:53:05.448374+0000","last_became_peered":"2024-04-17T19:53:05.448374+0000","last_unstale":"2024-04-17T19:53:11.527598+0000","last_undegraded":"2024-04-17T19:53:11.527598+0000","last_fullsized":"2024-04-17T19:53:11.527598+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:21:37.163564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.780524+0000","last_change":"2024-04-17T19:53:09.561127+0000","last_active":"2024-04-17T19:53:10.780524+0000","last_peered":"2024-04-17T19:53:10.780524+0000","last_clean":"2024-04-17T19:53:10.780524+0000","last_became_active":"2024-04-17T19:53:09.560076+0000","last_became_peered":"2024-04-17T19:53:09.560076+0000","last_unstale":"2024-04-17T19:53:10.780524+0000","last_undegraded":"2024-04-17T19:53:10.780524+0000","last_fullsized":"2024-04-17T19:53:10.780524+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:25:20.343613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.863628+0000","last_change":"2024-04-17T19:53:05.472665+0000","last_active":"2024-04-17T19:53:11.863628+0000","last_peered":"2024-04-17T19:53:11.863628+0000","last_clean":"2024-04-17T19:53:11.863628+0000","last_became_active":"2024-04-17T19:53:05.472324+0000","last_became_peered":"2024-04-17T19:53:05.472324+0000","last_unstale":"2024-04-17T19:53:11.863628+0000","last_undegraded":"2024-04-17T19:53:11.863628+0000","last_fullsized":"2024-04-17T19:53:11.863628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:50:03.709043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.779246+0000","last_change":"2024-04-17T19:53:05.477190+0000","last_active":"2024-04-17T19:53:10.779246+0000","last_peered":"2024-04-17T19:53:10.779246+0000","last_clean":"2024-04-17T19:53:10.779246+0000","last_became_active":"2024-04-17T19:53:05.475823+0000","last_became_peered":"2024-04-17T19:53:05.475823+0000","last_unstale":"2024-04-17T19:53:10.779246+0000","last_undegraded":"2024-04-17T19:53:10.779246+0000","last_fullsized":"2024-04-17T19:53:10.779246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:53:37.141518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.491805+0000","last_change":"2024-04-17T19:53:05.453565+0000","last_active":"2024-04-17T19:53:10.491805+0000","last_peered":"2024-04-17T19:53:10.491805+0000","last_clean":"2024-04-17T19:53:10.491805+0000","last_became_active":"2024-04-17T19:53:05.453142+0000","last_became_peered":"2024-04-17T19:53:05.453142+0000","last_unstale":"2024-04-17T19:53:10.491805+0000","last_undegraded":"2024-04-17T19:53:10.491805+0000","last_fullsized":"2024-04-17T19:53:10.491805+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:39:58.812875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.494369+0000","last_change":"2024-04-17T19:53:05.476450+0000","last_active":"2024-04-17T19:53:10.494369+0000","last_peered":"2024-04-17T19:53:10.494369+0000","last_clean":"2024-04-17T19:53:10.494369+0000","last_became_active":"2024-04-17T19:53:05.473931+0000","last_became_peered":"2024-04-17T19:53:05.473931+0000","last_unstale":"2024-04-17T19:53:10.494369+0000","last_undegraded":"2024-04-17T19:53:10.494369+0000","last_fullsized":"2024-04-17T19:53:10.494369+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:10:21.772873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.497745+0000","last_change":"2024-04-17T19:53:05.469653+0000","last_active":"2024-04-17T19:53:10.497745+0000","last_peered":"2024-04-17T19:53:10.497745+0000","last_clean":"2024-04-17T19:53:10.497745+0000","last_became_active":"2024-04-17T19:53:05.467838+0000","last_became_peered":"2024-04-17T19:53:05.467838+0000","last_unstale":"2024-04-17T19:53:10.497745+0000","last_undegraded":"2024-04-17T19:53:10.497745+0000","last_fullsized":"2024-04-17T19:53:10.497745+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:38:51.699072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.496163+0000","last_change":"2024-04-17T19:53:05.462678+0000","last_active":"2024-04-17T19:53:10.496163+0000","last_peered":"2024-04-17T19:53:10.496163+0000","last_clean":"2024-04-17T19:53:10.496163+0000","last_became_active":"2024-04-17T19:53:05.461829+0000","last_became_peered":"2024-04-17T19:53:05.461829+0000","last_unstale":"2024-04-17T19:53:10.496163+0000","last_undegraded":"2024-04-17T19:53:10.496163+0000","last_fullsized":"2024-04-17T19:53:10.496163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:03:53.876774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.864168+0000","last_change":"2024-04-17T19:53:05.465993+0000","last_active":"2024-04-17T19:53:11.864168+0000","last_peered":"2024-04-17T19:53:11.864168+0000","last_clean":"2024-04-17T19:53:11.864168+0000","last_became_active":"2024-04-17T19:53:05.465547+0000","last_became_peered":"2024-04-17T19:53:05.465547+0000","last_unstale":"2024-04-17T19:53:11.864168+0000","last_undegraded":"2024-04-17T19:53:11.864168+0000","last_fullsized":"2024-04-17T19:53:11.864168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:12:03.449509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.494257+0000","last_change":"2024-04-17T19:53:05.477188+0000","last_active":"2024-04-17T19:53:10.494257+0000","last_peered":"2024-04-17T19:53:10.494257+0000","last_clean":"2024-04-17T19:53:10.494257+0000","last_became_active":"2024-04-17T19:53:05.474798+0000","last_became_peered":"2024-04-17T19:53:05.474798+0000","last_unstale":"2024-04-17T19:53:10.494257+0000","last_undegraded":"2024-04-17T19:53:10.494257+0000","last_fullsized":"2024-04-17T19:53:10.494257+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:15:45.727550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.491362+0000","last_change":"2024-04-17T19:53:05.484009+0000","last_active":"2024-04-17T19:53:10.491362+0000","last_peered":"2024-04-17T19:53:10.491362+0000","last_clean":"2024-04-17T19:53:10.491362+0000","last_became_active":"2024-04-17T19:53:05.483664+0000","last_became_peered":"2024-04-17T19:53:05.483664+0000","last_unstale":"2024-04-17T19:53:10.491362+0000","last_undegraded":"2024-04-17T19:53:10.491362+0000","last_fullsized":"2024-04-17T19:53:10.491362+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:47:05.354826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.494973+0000","last_change":"2024-04-17T19:53:05.466532+0000","last_active":"2024-04-17T19:53:10.494973+0000","last_peered":"2024-04-17T19:53:10.494973+0000","last_clean":"2024-04-17T19:53:10.494973+0000","last_became_active":"2024-04-17T19:53:05.465302+0000","last_became_peered":"2024-04-17T19:53:05.465302+0000","last_unstale":"2024-04-17T19:53:10.494973+0000","last_undegraded":"2024-04-17T19:53:10.494973+0000","last_fullsized":"2024-04-17T19:53:10.494973+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:27:51.520335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.527637+0000","last_change":"2024-04-17T19:53:05.456313+0000","last_active":"2024-04-17T19:53:11.527637+0000","last_peered":"2024-04-17T19:53:11.527637+0000","last_clean":"2024-04-17T19:53:11.527637+0000","last_became_active":"2024-04-17T19:53:05.455862+0000","last_became_peered":"2024-04-17T19:53:05.455862+0000","last_unstale":"2024-04-17T19:53:11.527637+0000","last_undegraded":"2024-04-17T19:53:11.527637+0000","last_fullsized":"2024-04-17T19:53:11.527637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:23:03.879786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.866381+0000","last_change":"2024-04-17T19:53:05.465083+0000","last_active":"2024-04-17T19:53:11.866381+0000","last_peered":"2024-04-17T19:53:11.866381+0000","last_clean":"2024-04-17T19:53:11.866381+0000","last_became_active":"2024-04-17T19:53:05.463806+0000","last_became_peered":"2024-04-17T19:53:05.463806+0000","last_unstale":"2024-04-17T19:53:11.866381+0000","last_undegraded":"2024-04-17T19:53:11.866381+0000","last_fullsized":"2024-04-17T19:53:11.866381+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:25:16.298007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.529357+0000","last_change":"2024-04-17T19:53:05.464340+0000","last_active":"2024-04-17T19:53:10.529357+0000","last_peered":"2024-04-17T19:53:10.529357+0000","last_clean":"2024-04-17T19:53:10.529357+0000","last_became_active":"2024-04-17T19:53:05.463286+0000","last_became_peered":"2024-04-17T19:53:05.463286+0000","last_unstale":"2024-04-17T19:53:10.529357+0000","last_undegraded":"2024-04-17T19:53:10.529357+0000","last_fullsized":"2024-04-17T19:53:10.529357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:54:27.523970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.493221+0000","last_change":"2024-04-17T19:53:05.475791+0000","last_active":"2024-04-17T19:53:10.493221+0000","last_peered":"2024-04-17T19:53:10.493221+0000","last_clean":"2024-04-17T19:53:10.493221+0000","last_became_active":"2024-04-17T19:53:05.475372+0000","last_became_peered":"2024-04-17T19:53:05.475372+0000","last_unstale":"2024-04-17T19:53:10.493221+0000","last_undegraded":"2024-04-17T19:53:10.493221+0000","last_fullsized":"2024-04-17T19:53:10.493221+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:10:32.839503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.781055+0000","last_change":"2024-04-17T19:53:05.496650+0000","last_active":"2024-04-17T19:53:10.781055+0000","last_peered":"2024-04-17T19:53:10.781055+0000","last_clean":"2024-04-17T19:53:10.781055+0000","last_became_active":"2024-04-17T19:53:05.495881+0000","last_became_peered":"2024-04-17T19:53:05.495881+0000","last_unstale":"2024-04-17T19:53:10.781055+0000","last_undegraded":"2024-04-17T19:53:10.781055+0000","last_fullsized":"2024-04-17T19:53:10.781055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:23:03.879786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.494848+0000","last_change":"2024-04-17T19:53:05.461335+0000","last_active":"2024-04-17T19:53:10.494848+0000","last_peered":"2024-04-17T19:53:10.494848+0000","last_clean":"2024-04-17T19:53:10.494848+0000","last_became_active":"2024-04-17T19:53:05.460831+0000","last_became_peered":"2024-04-17T19:53:05.460831+0000","last_unstale":"2024-04-17T19:53:10.494848+0000","last_undegraded":"2024-04-17T19:53:10.494848+0000","last_fullsized":"2024-04-17T19:53:10.494848+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:22:55.343347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.491071+0000","last_change":"2024-04-17T19:53:05.473875+0000","last_active":"2024-04-17T19:53:10.491071+0000","last_peered":"2024-04-17T19:53:10.491071+0000","last_clean":"2024-04-17T19:53:10.491071+0000","last_became_active":"2024-04-17T19:53:05.467366+0000","last_became_peered":"2024-04-17T19:53:05.467366+0000","last_unstale":"2024-04-17T19:53:10.491071+0000","last_undegraded":"2024-04-17T19:53:10.491071+0000","last_fullsized":"2024-04-17T19:53:10.491071+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:05:21.173050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.493287+0000","last_change":"2024-04-17T19:53:05.467405+0000","last_active":"2024-04-17T19:53:10.493287+0000","last_peered":"2024-04-17T19:53:10.493287+0000","last_clean":"2024-04-17T19:53:10.493287+0000","last_became_active":"2024-04-17T19:53:05.466427+0000","last_became_peered":"2024-04-17T19:53:05.466427+0000","last_unstale":"2024-04-17T19:53:10.493287+0000","last_undegraded":"2024-04-17T19:53:10.493287+0000","last_fullsized":"2024-04-17T19:53:10.493287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:19:09.456602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.496615+0000","last_change":"2024-04-17T19:53:05.465968+0000","last_active":"2024-04-17T19:53:10.496615+0000","last_peered":"2024-04-17T19:53:10.496615+0000","last_clean":"2024-04-17T19:53:10.496615+0000","last_became_active":"2024-04-17T19:53:05.465145+0000","last_became_peered":"2024-04-17T19:53:05.465145+0000","last_unstale":"2024-04-17T19:53:10.496615+0000","last_undegraded":"2024-04-17T19:53:10.496615+0000","last_fullsized":"2024-04-17T19:53:10.496615+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:47:46.099722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.495836+0000","last_change":"2024-04-17T19:53:05.463993+0000","last_active":"2024-04-17T19:53:10.495836+0000","last_peered":"2024-04-17T19:53:10.495836+0000","last_clean":"2024-04-17T19:53:10.495836+0000","last_became_active":"2024-04-17T19:53:05.463172+0000","last_became_peered":"2024-04-17T19:53:05.463172+0000","last_unstale":"2024-04-17T19:53:10.495836+0000","last_undegraded":"2024-04-17T19:53:10.495836+0000","last_fullsized":"2024-04-17T19:53:10.495836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:29:50.457953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.529222+0000","last_change":"2024-04-17T19:53:05.471782+0000","last_active":"2024-04-17T19:53:10.529222+0000","last_peered":"2024-04-17T19:53:10.529222+0000","last_clean":"2024-04-17T19:53:10.529222+0000","last_became_active":"2024-04-17T19:53:05.471347+0000","last_became_peered":"2024-04-17T19:53:05.471347+0000","last_unstale":"2024-04-17T19:53:10.529222+0000","last_undegraded":"2024-04-17T19:53:10.529222+0000","last_fullsized":"2024-04-17T19:53:10.529222+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:42:22.878631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.529347+0000","last_change":"2024-04-17T19:53:05.460256+0000","last_active":"2024-04-17T19:53:10.529347+0000","last_peered":"2024-04-17T19:53:10.529347+0000","last_clean":"2024-04-17T19:53:10.529347+0000","last_became_active":"2024-04-17T19:53:05.459869+0000","last_became_peered":"2024-04-17T19:53:05.459869+0000","last_unstale":"2024-04-17T19:53:10.529347+0000","last_undegraded":"2024-04-17T19:53:10.529347+0000","last_fullsized":"2024-04-17T19:53:10.529347+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:47:05.354826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.529487+0000","last_change":"2024-04-17T19:53:05.467331+0000","last_active":"2024-04-17T19:53:10.529487+0000","last_peered":"2024-04-17T19:53:10.529487+0000","last_clean":"2024-04-17T19:53:10.529487+0000","last_became_active":"2024-04-17T19:53:05.467015+0000","last_became_peered":"2024-04-17T19:53:05.467015+0000","last_unstale":"2024-04-17T19:53:10.529487+0000","last_undegraded":"2024-04-17T19:53:10.529487+0000","last_fullsized":"2024-04-17T19:53:10.529487+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:10:32.839503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.529339+0000","last_change":"2024-04-17T19:53:05.462631+0000","last_active":"2024-04-17T19:53:11.529339+0000","last_peered":"2024-04-17T19:53:11.529339+0000","last_clean":"2024-04-17T19:53:11.529339+0000","last_became_active":"2024-04-17T19:53:05.462217+0000","last_became_peered":"2024-04-17T19:53:05.462217+0000","last_unstale":"2024-04-17T19:53:11.529339+0000","last_undegraded":"2024-04-17T19:53:11.529339+0000","last_fullsized":"2024-04-17T19:53:11.529339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:50:03.709043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.493026+0000","last_change":"2024-04-17T19:53:05.467941+0000","last_active":"2024-04-17T19:53:10.493026+0000","last_peered":"2024-04-17T19:53:10.493026+0000","last_clean":"2024-04-17T19:53:10.493026+0000","last_became_active":"2024-04-17T19:53:05.467093+0000","last_became_peered":"2024-04-17T19:53:05.467093+0000","last_unstale":"2024-04-17T19:53:10.493026+0000","last_undegraded":"2024-04-17T19:53:10.493026+0000","last_fullsized":"2024-04-17T19:53:10.493026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:12:15.307126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.528642+0000","last_change":"2024-04-17T19:53:05.465748+0000","last_active":"2024-04-17T19:53:10.528642+0000","last_peered":"2024-04-17T19:53:10.528642+0000","last_clean":"2024-04-17T19:53:10.528642+0000","last_became_active":"2024-04-17T19:53:05.465436+0000","last_became_peered":"2024-04-17T19:53:05.465436+0000","last_unstale":"2024-04-17T19:53:10.528642+0000","last_undegraded":"2024-04-17T19:53:10.528642+0000","last_fullsized":"2024-04-17T19:53:10.528642+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:02:40.799364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.863626+0000","last_change":"2024-04-17T19:53:05.458098+0000","last_active":"2024-04-17T19:53:11.863626+0000","last_peered":"2024-04-17T19:53:11.863626+0000","last_clean":"2024-04-17T19:53:11.863626+0000","last_became_active":"2024-04-17T19:53:05.457656+0000","last_became_peered":"2024-04-17T19:53:05.457656+0000","last_unstale":"2024-04-17T19:53:11.863626+0000","last_undegraded":"2024-04-17T19:53:11.863626+0000","last_fullsized":"2024-04-17T19:53:11.863626+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:40:31.558660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.529015+0000","last_change":"2024-04-17T19:53:05.477086+0000","last_active":"2024-04-17T19:53:10.529015+0000","last_peered":"2024-04-17T19:53:10.529015+0000","last_clean":"2024-04-17T19:53:10.529015+0000","last_became_active":"2024-04-17T19:53:05.476734+0000","last_became_peered":"2024-04-17T19:53:05.476734+0000","last_unstale":"2024-04-17T19:53:10.529015+0000","last_undegraded":"2024-04-17T19:53:10.529015+0000","last_fullsized":"2024-04-17T19:53:10.529015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:10:21.772873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:11.863461+0000","last_change":"2024-04-17T19:53:05.458378+0000","last_active":"2024-04-17T19:53:11.863461+0000","last_peered":"2024-04-17T19:53:11.863461+0000","last_clean":"2024-04-17T19:53:11.863461+0000","last_became_active":"2024-04-17T19:53:05.457210+0000","last_became_peered":"2024-04-17T19:53:05.457210+0000","last_unstale":"2024-04-17T19:53:11.863461+0000","last_undegraded":"2024-04-17T19:53:11.863461+0000","last_fullsized":"2024-04-17T19:53:11.863461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:23:03.879786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.494175+0000","last_change":"2024-04-17T19:53:05.455054+0000","last_active":"2024-04-17T19:53:10.494175+0000","last_peered":"2024-04-17T19:53:10.494175+0000","last_clean":"2024-04-17T19:53:10.494175+0000","last_became_active":"2024-04-17T19:53:05.454065+0000","last_became_peered":"2024-04-17T19:53:05.454065+0000","last_unstale":"2024-04-17T19:53:10.494175+0000","last_undegraded":"2024-04-17T19:53:10.494175+0000","last_fullsized":"2024-04-17T19:53:10.494175+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:42:22.878631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.496956+0000","last_change":"2024-04-17T19:53:05.456675+0000","last_active":"2024-04-17T19:53:10.496956+0000","last_peered":"2024-04-17T19:53:10.496956+0000","last_clean":"2024-04-17T19:53:10.496956+0000","last_became_active":"2024-04-17T19:53:05.455779+0000","last_became_peered":"2024-04-17T19:53:05.455779+0000","last_unstale":"2024-04-17T19:53:10.496956+0000","last_undegraded":"2024-04-17T19:53:10.496956+0000","last_fullsized":"2024-04-17T19:53:10.496956+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:02:40.799364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-17T19:53:10.529904+0000","last_change":"2024-04-17T19:53:05.461773+0000","last_active":"2024-04-17T19:53:10.529904+0000","last_peered":"2024-04-17T19:53:10.529904+0000","last_clean":"2024-04-17T19:53:10.529904+0000","last_became_active":"2024-04-17T19:53:05.461324+0000","last_became_peered":"2024-04-17T19:53:05.461324+0000","last_unstale":"2024-04-17T19:53:10.529904+0000","last_undegraded":"2024-04-17T19:53:10.529904+0000","last_fullsized":"2024-04-17T19:53:10.529904+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:05:21.173050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509451,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":110409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":884736,"data_stored":700745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509450,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":114799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31468,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340372,"statfs":{"total":96636764160,"available":96604540928,"internally_reserved":0,"allocated":286720,"data_stored":110867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509450,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":294912,"data_stored":114127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32040,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339800,"statfs":{"total":96636764160,"available":96603955200,"internally_reserved":0,"allocated":880640,"data_stored":700723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31472,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340368,"statfs":{"total":96636764160,"available":96604536832,"internally_reserved":0,"allocated":290816,"data_stored":110341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542154,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":110285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T19:53:29.727 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-17T19:53:29.727 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-17T19:53:29.727 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-17T19:53:29.727 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-17T19:53:29.779 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T19:53:29.808 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T19:53:29.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.909+0000 7fe42a647640 1 Processor -- start 2024-04-17T19:53:29.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.909+0000 7fe42a647640 1 -- start start 2024-04-17T19:53:29.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.913+0000 7fe42a647640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe42415e910 0x7fe42415ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:29.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.913+0000 7fe42a647640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe42406cd60 0x7fe42406d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:29.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.913+0000 7fe42a647640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe42406d6b0 con 0x7fe42415e1a0 2024-04-17T19:53:29.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.913+0000 7fe42a647640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7fe4240d0020 con 0x7fe42406cd60 2024-04-17T19:53:29.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.913+0000 7fe42a647640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fe4240cd930 con 0x7fe42415e910 2024-04-17T19:53:29.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.913+0000 7fe423fff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fe42415e1a0 0x7fe4240ce9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:51268/0 (socket says 172.21.15.18:51268) 2024-04-17T19:53:29.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.913+0000 7fe423fff640 1 -- 172.21.15.18:0/3715641229 learned_addr learned my addr 172.21.15.18:0/3715641229 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:29.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.913+0000 7fe41b7fe640 1 --2- 172.21.15.18:0/3715641229 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe42415e910 0x7fe42415ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:29.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.913+0000 7fe428be4640 1 --2- 172.21.15.18:0/3715641229 >> v2:172.21.15.173:3300/0 conn(0x7fe42406cd60 0x7fe42406d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:29.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.913+0000 7fe4237fe640 1 -- 172.21.15.18:0/3715641229 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1440431595 0 0) 0x7fe414001120 con 0x7fe42415e1a0 2024-04-17T19:53:29.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.913+0000 7fe4237fe640 1 -- 172.21.15.18:0/3715641229 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe410003530 con 0x7fe42415e1a0 2024-04-17T19:53:29.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.913+0000 7fe4237fe640 1 -- 172.21.15.18:0/3715641229 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3443940592 0 0) 0x7fe410003530 con 0x7fe42415e1a0 2024-04-17T19:53:29.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.913+0000 7fe4237fe640 1 -- 172.21.15.18:0/3715641229 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe42415e910 msgr2=0x7fe42415ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:29.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.913+0000 7fe4237fe640 1 --2- 172.21.15.18:0/3715641229 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe42415e910 0x7fe42415ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:29.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.913+0000 7fe4237fe640 1 -- 172.21.15.18:0/3715641229 >> v2:172.21.15.173:3300/0 conn(0x7fe42406cd60 msgr2=0x7fe42406d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:29.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.913+0000 7fe4237fe640 1 --2- 172.21.15.18:0/3715641229 >> v2:172.21.15.173:3300/0 conn(0x7fe42406cd60 0x7fe42406d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:29.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.913+0000 7fe4237fe640 1 -- 172.21.15.18:0/3715641229 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4240cdc10 con 0x7fe42415e1a0 2024-04-17T19:53:29.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.913+0000 7fe4237fe640 1 -- 172.21.15.18:0/3715641229 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3208559991 0 0) 0x7fe414001850 con 0x7fe42415e1a0 2024-04-17T19:53:29.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.913+0000 7fe4237fe640 1 -- 172.21.15.18:0/3715641229 >> v1:172.21.15.18:6789/0 conn(0x7fe42415e1a0 legacy=0x7fe4240ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:29.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.913+0000 7fe4237fe640 1 --2- 172.21.15.18:0/3715641229 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe42415e910 0x7fe4100039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:29.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.913+0000 7fe4237fe640 1 --2- 172.21.15.18:0/3715641229 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe410003f40 0x7fe410004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:29.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.913+0000 7fe4237fe640 1 --2- 172.21.15.18:0/3715641229 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe410004d50 0x7fe410005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:29.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.913+0000 7fe4237fe640 1 -- 172.21.15.18:0/3715641229 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe4240d0020 con 0x7fe410003f40 2024-04-17T19:53:29.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.913+0000 7fe4237fe640 1 -- 172.21.15.18:0/3715641229 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe4240cd930 con 0x7fe410004d50 2024-04-17T19:53:29.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.913+0000 7fe4237fe640 1 -- 172.21.15.18:0/3715641229 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fe41000bad0 con 0x7fe42415e910 2024-04-17T19:53:29.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.913+0000 7fe41b7fe640 1 --2- 172.21.15.18:0/3715641229 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe410003f40 0x7fe410004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:29.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.913+0000 7fe428be4640 1 --2- 172.21.15.18:0/3715641229 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe410004d50 0x7fe410005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:29.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.913+0000 7fe41b7fe640 1 -- 172.21.15.18:0/3715641229 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe42415e910 msgr2=0x7fe4100039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:29.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.913+0000 7fe423fff640 1 --2- 172.21.15.18:0/3715641229 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe42415e910 0x7fe4100039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:29.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.913+0000 7fe41b7fe640 1 --2- 172.21.15.18:0/3715641229 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe42415e910 0x7fe4100039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:29.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.913+0000 7fe41b7fe640 1 -- 172.21.15.18:0/3715641229 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe410004d50 msgr2=0x7fe410005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:29.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.913+0000 7fe41b7fe640 1 --2- 172.21.15.18:0/3715641229 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe410004d50 0x7fe410005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:29.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.913+0000 7fe41b7fe640 1 -- 172.21.15.18:0/3715641229 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe410003530 con 0x7fe410003f40 2024-04-17T19:53:29.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.913+0000 7fe428be4640 1 --2- 172.21.15.18:0/3715641229 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe410004d50 0x7fe410005160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:53:29.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.913+0000 7fe423fff640 1 --2- 172.21.15.18:0/3715641229 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe42415e910 0x7fe4100039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:53:29.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.917+0000 7fe41b7fe640 1 --2- 172.21.15.18:0/3715641229 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe410003f40 0x7fe410004810 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe40c009ab0 tx=0x7fe40c01ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d09d703d5df550c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:29.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.917+0000 7fe4237fe640 1 -- 172.21.15.18:0/3715641229 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe40c0b2070 con 0x7fe410003f40 2024-04-17T19:53:29.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.917+0000 7fe4237fe640 1 -- 172.21.15.18:0/3715641229 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe40c0a5520 con 0x7fe410003f40 2024-04-17T19:53:29.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.917+0000 7fe4237fe640 1 -- 172.21.15.18:0/3715641229 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe40c0096b0 con 0x7fe410003f40 2024-04-17T19:53:29.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.917+0000 7fe42a647640 1 -- 172.21.15.18:0/3715641229 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe410003f40 msgr2=0x7fe410004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:29.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.917+0000 7fe42a647640 1 --2- 172.21.15.18:0/3715641229 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe410003f40 0x7fe410004810 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe40c009ab0 tx=0x7fe40c01ca40 comp rx=0 tx=0).stop 2024-04-17T19:53:29.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.917+0000 7fe428be4640 1 -- 172.21.15.18:0/3715641229 reap_dead start 2024-04-17T19:53:29.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.917+0000 7fe42a647640 1 -- 172.21.15.18:0/3715641229 shutdown_connections 2024-04-17T19:53:29.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.917+0000 7fe42a647640 1 -- 172.21.15.18:0/3715641229 >> 172.21.15.18:0/3715641229 conn(0x7fe424072bb0 msgr2=0x7fe424072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:29.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.917+0000 7fe42a647640 1 -- 172.21.15.18:0/3715641229 shutdown_connections 2024-04-17T19:53:29.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.917+0000 7fe42a647640 1 -- 172.21.15.18:0/3715641229 wait complete. 2024-04-17T19:53:29.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.921+0000 7fe42a647640 1 Processor -- start 2024-04-17T19:53:29.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.921+0000 7fe42a647640 1 -- start start 2024-04-17T19:53:29.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.921+0000 7fe42a647640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe42414e940 0x7fe4241552c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:29.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.921+0000 7fe42a647640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe42414f050 0x7fe42414f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:29.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.921+0000 7fe42a647640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe424163200 0x7fe424163610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:29.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.921+0000 7fe42a647640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe42415e5b0 con 0x7fe42414e940 2024-04-17T19:53:29.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.921+0000 7fe42a647640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe42415f130 con 0x7fe424163200 2024-04-17T19:53:29.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.921+0000 7fe42a647640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fe42415e730 con 0x7fe42414f050 2024-04-17T19:53:29.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.921+0000 7fe423fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe42414e940 0x7fe4241552c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:29.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.921+0000 7fe423fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe42414e940 0x7fe4241552c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50174/0 (socket says 172.21.15.18:50174) 2024-04-17T19:53:29.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.921+0000 7fe423fff640 1 -- 172.21.15.18:0/1954229630 learned_addr learned my addr 172.21.15.18:0/1954229630 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:29.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.921+0000 7fe428be4640 1 --2- 172.21.15.18:0/1954229630 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe424163200 0x7fe424163610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:29.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.921+0000 7fe41b7fe640 1 --2- 172.21.15.18:0/1954229630 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe42414f050 0x7fe42414f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:29.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.921+0000 7fe423fff640 1 -- 172.21.15.18:0/1954229630 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe42414f050 msgr2=0x7fe42414f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:29.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.921+0000 7fe423fff640 1 --2- 172.21.15.18:0/1954229630 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe42414f050 0x7fe42414f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:29.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.921+0000 7fe423fff640 1 -- 172.21.15.18:0/1954229630 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe424163200 msgr2=0x7fe424163610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:29.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.921+0000 7fe423fff640 1 --2- 172.21.15.18:0/1954229630 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe424163200 0x7fe424163610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:29.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.921+0000 7fe423fff640 1 -- 172.21.15.18:0/1954229630 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe424155800 con 0x7fe42414e940 2024-04-17T19:53:29.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.921+0000 7fe423fff640 1 --2- 172.21.15.18:0/1954229630 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe42414e940 0x7fe4241552c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe414001ec0 tx=0x7fe41400dc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:29.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.921+0000 7fe4217fa640 1 -- 172.21.15.18:0/1954229630 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe414019070 con 0x7fe42414e940 2024-04-17T19:53:29.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.921+0000 7fe4217fa640 1 -- 172.21.15.18:0/1954229630 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4140074e0 con 0x7fe42414e940 2024-04-17T19:53:29.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.921+0000 7fe42a647640 1 -- 172.21.15.18:0/1954229630 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe424163b50 con 0x7fe42414e940 2024-04-17T19:53:29.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.921+0000 7fe4217fa640 1 -- 172.21.15.18:0/1954229630 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe414004a30 con 0x7fe42414e940 2024-04-17T19:53:29.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.921+0000 7fe42a647640 1 -- 172.21.15.18:0/1954229630 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4241547e0 con 0x7fe42414e940 2024-04-17T19:53:29.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.921+0000 7fe42a647640 1 -- 172.21.15.18:0/1954229630 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe424069950 con 0x7fe42414e940 2024-04-17T19:53:29.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.921+0000 7fe4217fa640 1 -- 172.21.15.18:0/1954229630 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe41401c070 con 0x7fe42414e940 2024-04-17T19:53:29.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.925+0000 7fe4217fa640 1 --2- 172.21.15.18:0/1954229630 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fe404068380 0x7fe40406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:29.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.925+0000 7fe41b7fe640 1 --2- 172.21.15.18:0/1954229630 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fe404068380 0x7fe40406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:29.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.925+0000 7fe4217fa640 1 -- 172.21.15.18:0/1954229630 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fe414086710 con 0x7fe42414e940 2024-04-17T19:53:29.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.925+0000 7fe41b7fe640 1 --2- 172.21.15.18:0/1954229630 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fe404068380 0x7fe40406a890 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe40c0af000 tx=0x7fe40c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:29.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:29.929+0000 7fe4217fa640 1 -- 172.21.15.18:0/1954229630 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe42406d6b0 con 0x7fe42414e940 2024-04-17T19:53:30.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.117+0000 7fe42a647640 1 -- 172.21.15.18:0/1954229630 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe4240cf200 con 0x7fe42414e940 2024-04-17T19:53:30.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.121+0000 7fe4217fa640 1 -- 172.21.15.18:0/1954229630 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fe414056a20 con 0x7fe42414e940 2024-04-17T19:53:30.115 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:53:30.116 INFO:teuthology.orchestra.run.smithi018.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-17T19:53:30.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.121+0000 7fe42a647640 1 -- 172.21.15.18:0/1954229630 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fe404068380 msgr2=0x7fe40406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:30.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.121+0000 7fe42a647640 1 --2- 172.21.15.18:0/1954229630 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fe404068380 0x7fe40406a890 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe40c0af000 tx=0x7fe40c008040 comp rx=0 tx=0).stop 2024-04-17T19:53:30.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.121+0000 7fe42a647640 1 -- 172.21.15.18:0/1954229630 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe42414e940 msgr2=0x7fe4241552c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:30.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.121+0000 7fe42a647640 1 --2- 172.21.15.18:0/1954229630 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe42414e940 0x7fe4241552c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe414001ec0 tx=0x7fe41400dc70 comp rx=0 tx=0).stop 2024-04-17T19:53:30.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.121+0000 7fe42a647640 1 -- 172.21.15.18:0/1954229630 shutdown_connections 2024-04-17T19:53:30.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.121+0000 7fe42a647640 1 --2- 172.21.15.18:0/1954229630 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fe404068380 0x7fe40406a890 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:30.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.121+0000 7fe42a647640 1 --2- 172.21.15.18:0/1954229630 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe424163200 0x7fe424163610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:30.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.121+0000 7fe42a647640 1 --2- 172.21.15.18:0/1954229630 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe42414f050 0x7fe42414f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:30.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.121+0000 7fe42a647640 1 --2- 172.21.15.18:0/1954229630 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe42414e940 0x7fe4241552c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:30.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.121+0000 7fe42a647640 1 -- 172.21.15.18:0/1954229630 >> 172.21.15.18:0/1954229630 conn(0x7fe424072bb0 msgr2=0x7fe424152560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:30.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.121+0000 7fe42a647640 1 -- 172.21.15.18:0/1954229630 shutdown_connections 2024-04-17T19:53:30.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.121+0000 7fe42a647640 1 -- 172.21.15.18:0/1954229630 wait complete. 2024-04-17T19:53:30.136 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-17T19:53:30.137 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T19:53:30.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.281+0000 7f324156a640 1 Processor -- start 2024-04-17T19:53:30.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.281+0000 7f324156a640 1 -- start start 2024-04-17T19:53:30.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.281+0000 7f324156a640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f323c06d470 0x7f323c1424e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:30.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.281+0000 7f324156a640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f323c1431e0 0x7f323c1435f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:30.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.281+0000 7f324156a640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f323c1600f0 con 0x7f323c145340 2024-04-17T19:53:30.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.281+0000 7f324156a640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f323c1603d0 con 0x7f323c06d470 2024-04-17T19:53:30.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.281+0000 7f324156a640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f323c1606b0 con 0x7f323c1431e0 2024-04-17T19:53:30.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.281+0000 7f323affd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f323c145340 0x7f323c06cd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:51276/0 (socket says 172.21.15.18:51276) 2024-04-17T19:53:30.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.281+0000 7f323affd640 1 -- 172.21.15.18:0/646597833 learned_addr learned my addr 172.21.15.18:0/646597833 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:30.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.281+0000 7f323a7fc640 1 --2- 172.21.15.18:0/646597833 >> v2:172.21.15.18:3300/0 conn(0x7f323c06d470 0x7f323c1424e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:30.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.281+0000 7f323b7fe640 1 --2- 172.21.15.18:0/646597833 >> v2:172.21.15.173:3300/0 conn(0x7f323c1431e0 0x7f323c1435f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:30.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.281+0000 7f3239ffb640 1 -- 172.21.15.18:0/646597833 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1703500260 0 0) 0x7f323c1600f0 con 0x7f323c145340 2024-04-17T19:53:30.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.281+0000 7f3239ffb640 1 -- 172.21.15.18:0/646597833 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3228003530 con 0x7f323c145340 2024-04-17T19:53:30.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.281+0000 7f323a7fc640 1 -- 172.21.15.18:0/646597833 >> v2:172.21.15.173:3300/0 conn(0x7f323c1431e0 msgr2=0x7f323c1435f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:30.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.281+0000 7f323a7fc640 1 --2- 172.21.15.18:0/646597833 >> v2:172.21.15.173:3300/0 conn(0x7f323c1431e0 0x7f323c1435f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:30.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.281+0000 7f323a7fc640 1 -- 172.21.15.18:0/646597833 >> v1:172.21.15.18:6789/0 conn(0x7f323c145340 legacy=0x7f323c06cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:30.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.281+0000 7f323a7fc640 1 -- 172.21.15.18:0/646597833 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f323c160990 con 0x7f323c06d470 2024-04-17T19:53:30.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.285+0000 7f323a7fc640 1 --2- 172.21.15.18:0/646597833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f323c06d470 0x7f323c1424e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f323c0d0980 tx=0x7f322401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b6a1ffe3b0ee607 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:30.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.285+0000 7f3239ffb640 1 -- 172.21.15.18:0/646597833 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32240b0070 con 0x7f323c06d470 2024-04-17T19:53:30.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.285+0000 7f3239ffb640 1 -- 172.21.15.18:0/646597833 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32240ab600 con 0x7f323c06d470 2024-04-17T19:53:30.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.285+0000 7f3239ffb640 1 -- 172.21.15.18:0/646597833 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32240ab9d0 con 0x7f323c06d470 2024-04-17T19:53:30.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.285+0000 7f324156a640 1 -- 172.21.15.18:0/646597833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f323c06d470 msgr2=0x7f323c1424e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:30.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.285+0000 7f324156a640 1 --2- 172.21.15.18:0/646597833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f323c06d470 0x7f323c1424e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f323c0d0980 tx=0x7f322401c480 comp rx=0 tx=0).stop 2024-04-17T19:53:30.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.285+0000 7f324156a640 1 -- 172.21.15.18:0/646597833 shutdown_connections 2024-04-17T19:53:30.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.285+0000 7f324156a640 1 --2- 172.21.15.18:0/646597833 >> v2:172.21.15.173:3300/0 conn(0x7f323c1431e0 0x7f323c1435f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:30.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.285+0000 7f324156a640 1 --2- 172.21.15.18:0/646597833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f323c06d470 0x7f323c1424e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:30.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.285+0000 7f324156a640 1 -- 172.21.15.18:0/646597833 >> 172.21.15.18:0/646597833 conn(0x7f323c072bb0 msgr2=0x7f323c072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:30.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.285+0000 7f324156a640 1 -- 172.21.15.18:0/646597833 shutdown_connections 2024-04-17T19:53:30.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.285+0000 7f324156a640 1 -- 172.21.15.18:0/646597833 wait complete. 2024-04-17T19:53:30.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.285+0000 7f324156a640 1 Processor -- start 2024-04-17T19:53:30.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.285+0000 7f324156a640 1 -- start start 2024-04-17T19:53:30.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.289+0000 7f324156a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f323c1431e0 0x7f323c13a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:30.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.289+0000 7f324156a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f323c145340 0x7f323c15abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:30.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.289+0000 7f324156a640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f323c0b1a80 0x7f323c15b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:30.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.289+0000 7f324156a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f323c169b30 con 0x7f323c145340 2024-04-17T19:53:30.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.289+0000 7f324156a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f323c1699b0 con 0x7f323c1431e0 2024-04-17T19:53:30.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.289+0000 7f324156a640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f323c169cb0 con 0x7f323c0b1a80 2024-04-17T19:53:30.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.289+0000 7f323a7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f323c145340 0x7f323c15abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:30.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.289+0000 7f323a7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f323c145340 0x7f323c15abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50190/0 (socket says 172.21.15.18:50190) 2024-04-17T19:53:30.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.289+0000 7f323a7fc640 1 -- 172.21.15.18:0/1160218761 learned_addr learned my addr 172.21.15.18:0/1160218761 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:30.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.289+0000 7f323affd640 1 --2- 172.21.15.18:0/1160218761 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f323c1431e0 0x7f323c13a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:30.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.289+0000 7f323b7fe640 1 --2- 172.21.15.18:0/1160218761 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f323c0b1a80 0x7f323c15b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:30.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.289+0000 7f323a7fc640 1 -- 172.21.15.18:0/1160218761 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f323c0b1a80 msgr2=0x7f323c15b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:30.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.289+0000 7f323a7fc640 1 --2- 172.21.15.18:0/1160218761 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f323c0b1a80 0x7f323c15b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:30.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.289+0000 7f323a7fc640 1 -- 172.21.15.18:0/1160218761 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f323c1431e0 msgr2=0x7f323c13a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:30.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.289+0000 7f323a7fc640 1 --2- 172.21.15.18:0/1160218761 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f323c1431e0 0x7f323c13a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:30.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.289+0000 7f323a7fc640 1 -- 172.21.15.18:0/1160218761 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f323c13b600 con 0x7f323c145340 2024-04-17T19:53:30.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.289+0000 7f323affd640 1 --2- 172.21.15.18:0/1160218761 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f323c1431e0 0x7f323c13a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:53:30.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.289+0000 7f323a7fc640 1 --2- 172.21.15.18:0/1160218761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f323c145340 0x7f323c15abf0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f322401a0b0 tx=0x7f3224019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:30.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.289+0000 7f32337fe640 1 -- 172.21.15.18:0/1160218761 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32240b0040 con 0x7f323c145340 2024-04-17T19:53:30.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.289+0000 7f32337fe640 1 -- 172.21.15.18:0/1160218761 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32240b9070 con 0x7f323c145340 2024-04-17T19:53:30.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.289+0000 7f324156a640 1 -- 172.21.15.18:0/1160218761 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f323c1563d0 con 0x7f323c145340 2024-04-17T19:53:30.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.289+0000 7f32337fe640 1 -- 172.21.15.18:0/1160218761 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32240b4870 con 0x7f323c145340 2024-04-17T19:53:30.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.289+0000 7f324156a640 1 -- 172.21.15.18:0/1160218761 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f323c0b21b0 con 0x7f323c145340 2024-04-17T19:53:30.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.289+0000 7f324156a640 1 -- 172.21.15.18:0/1160218761 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f323c069950 con 0x7f323c145340 2024-04-17T19:53:30.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.289+0000 7f32337fe640 1 -- 172.21.15.18:0/1160218761 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f32240ab4c0 con 0x7f323c145340 2024-04-17T19:53:30.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.293+0000 7f32337fe640 1 --2- 172.21.15.18:0/1160218761 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f321c0683b0 0x7f321c06a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:30.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.293+0000 7f32337fe640 1 -- 172.21.15.18:0/1160218761 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f32241211b0 con 0x7f323c145340 2024-04-17T19:53:30.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.293+0000 7f323affd640 1 --2- 172.21.15.18:0/1160218761 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f321c0683b0 0x7f321c06a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:30.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.293+0000 7f323affd640 1 --2- 172.21.15.18:0/1160218761 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f321c0683b0 0x7f321c06a8c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f322c005890 tx=0x7f322c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:30.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.297+0000 7f32337fe640 1 -- 172.21.15.18:0/1160218761 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f32240c4060 con 0x7f323c145340 2024-04-17T19:53:30.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.457+0000 7f324156a640 1 -- 172.21.15.18:0/1160218761 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f323c0b4b70 con 0x7f323c145340 2024-04-17T19:53:30.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.457+0000 7f32337fe640 1 -- 172.21.15.18:0/1160218761 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18506 (secure 0 0 0) 0x7f3224016070 con 0x7f323c145340 2024-04-17T19:53:30.455 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:53:30.456 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":27,"fsid":"dd480169-5a81-4623-be5f-0499aa244b28","created":"2024-04-17T19:52:39.533760+0000","modified":"2024-04-17T19:53:09.903922+0000","last_up_change":"2024-04-17T19:52:51.229698+0000","last_in_change":"2024-04-17T19:52:42.144259+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T19:52:52.391648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T19:53:02.734240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T19:53:03.813028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T19:53:07.478812+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e232d577-2508-4ea4-b355-29fbae1ff025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6801","nonce":2323038417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6803","nonce":2323038417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6807","nonce":2323038417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6805","nonce":2323038417}]},"public_addr":"172.21.15.18:6801/2323038417","cluster_addr":"172.21.15.18:6803/2323038417","heartbeat_back_addr":"172.21.15.18:6807/2323038417","heartbeat_front_addr":"172.21.15.18:6805/2323038417","state":["exists","up"]},{"osd":1,"uuid":"31810ef3-2c71-48d6-8748-b74a2968d23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6817","nonce":1283678238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6819","nonce":1283678238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6823","nonce":1283678238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6821","nonce":1283678238}]},"public_addr":"172.21.15.18:6817/1283678238","cluster_addr":"172.21.15.18:6819/1283678238","heartbeat_back_addr":"172.21.15.18:6823/1283678238","heartbeat_front_addr":"172.21.15.18:6821/1283678238","state":["exists","up"]},{"osd":2,"uuid":"5a783cc5-a41c-4967-9e11-6b8330f97d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6809","nonce":1212875862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6811","nonce":1212875862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6815","nonce":1212875862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6813","nonce":1212875862}]},"public_addr":"172.21.15.18:6809/1212875862","cluster_addr":"172.21.15.18:6811/1212875862","heartbeat_back_addr":"172.21.15.18:6815/1212875862","heartbeat_front_addr":"172.21.15.18:6813/1212875862","state":["exists","up"]},{"osd":3,"uuid":"b7e056d9-9da5-46e1-810d-0c3e242fe5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6825","nonce":2428878428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6827","nonce":2428878428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6831","nonce":2428878428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6829","nonce":2428878428}]},"public_addr":"172.21.15.18:6825/2428878428","cluster_addr":"172.21.15.18:6827/2428878428","heartbeat_back_addr":"172.21.15.18:6831/2428878428","heartbeat_front_addr":"172.21.15.18:6829/2428878428","state":["exists","up"]},{"osd":4,"uuid":"21df023f-bc8b-4abb-93e5-0ecc91acda0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6825","nonce":1421511819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6827","nonce":1421511819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6831","nonce":1421511819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6829","nonce":1421511819}]},"public_addr":"172.21.15.173:6825/1421511819","cluster_addr":"172.21.15.173:6827/1421511819","heartbeat_back_addr":"172.21.15.173:6831/1421511819","heartbeat_front_addr":"172.21.15.173:6829/1421511819","state":["exists","up"]},{"osd":5,"uuid":"e270098a-6d33-49f8-84ed-94e09a880cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6801","nonce":4221907702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6803","nonce":4221907702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6807","nonce":4221907702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6805","nonce":4221907702}]},"public_addr":"172.21.15.173:6801/4221907702","cluster_addr":"172.21.15.173:6803/4221907702","heartbeat_back_addr":"172.21.15.173:6807/4221907702","heartbeat_front_addr":"172.21.15.173:6805/4221907702","state":["exists","up"]},{"osd":6,"uuid":"93c67c8c-268d-4e32-877c-043cd3acd87c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6809","nonce":761678552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6811","nonce":761678552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6815","nonce":761678552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6813","nonce":761678552}]},"public_addr":"172.21.15.173:6809/761678552","cluster_addr":"172.21.15.173:6811/761678552","heartbeat_back_addr":"172.21.15.173:6815/761678552","heartbeat_front_addr":"172.21.15.173:6813/761678552","state":["exists","up"]},{"osd":7,"uuid":"faf10eea-80de-40f6-abbb-34d07d3f59ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6817","nonce":383724537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6819","nonce":383724537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6823","nonce":383724537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6821","nonce":383724537}]},"public_addr":"172.21.15.173:6817/383724537","cluster_addr":"172.21.15.173:6819/383724537","heartbeat_back_addr":"172.21.15.173:6823/383724537","heartbeat_front_addr":"172.21.15.173:6821/383724537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.668924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.761747+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.768128+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.632252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.742608+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.734327+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.477107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.818292+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T19:53:30.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.461+0000 7f324156a640 1 -- 172.21.15.18:0/1160218761 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f321c0683b0 msgr2=0x7f321c06a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:30.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.461+0000 7f324156a640 1 --2- 172.21.15.18:0/1160218761 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f321c0683b0 0x7f321c06a8c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f322c005890 tx=0x7f322c009040 comp rx=0 tx=0).stop 2024-04-17T19:53:30.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.461+0000 7f324156a640 1 -- 172.21.15.18:0/1160218761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f323c145340 msgr2=0x7f323c15abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:30.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.461+0000 7f324156a640 1 --2- 172.21.15.18:0/1160218761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f323c145340 0x7f323c15abf0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f322401a0b0 tx=0x7f3224019220 comp rx=0 tx=0).stop 2024-04-17T19:53:30.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.461+0000 7f324156a640 1 -- 172.21.15.18:0/1160218761 shutdown_connections 2024-04-17T19:53:30.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.461+0000 7f324156a640 1 --2- 172.21.15.18:0/1160218761 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f321c0683b0 0x7f321c06a8c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:30.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.461+0000 7f324156a640 1 --2- 172.21.15.18:0/1160218761 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f323c0b1a80 0x7f323c15b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:30.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.461+0000 7f324156a640 1 --2- 172.21.15.18:0/1160218761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f323c145340 0x7f323c15abf0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:30.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.461+0000 7f324156a640 1 --2- 172.21.15.18:0/1160218761 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f323c1431e0 0x7f323c13a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:30.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.461+0000 7f324156a640 1 -- 172.21.15.18:0/1160218761 >> 172.21.15.18:0/1160218761 conn(0x7f323c072bb0 msgr2=0x7f323c13c060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:30.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.461+0000 7f324156a640 1 -- 172.21.15.18:0/1160218761 shutdown_connections 2024-04-17T19:53:30.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.461+0000 7f324156a640 1 -- 172.21.15.18:0/1160218761 wait complete. 2024-04-17T19:53:30.476 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T19:52:52.391648+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-17T19:53:02.734240+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-17T19:53:03.813028+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-17T19:53:07.478812+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-17T19:53:30.476 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T19:53:30.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.629+0000 7f71e4c9c640 1 Processor -- start 2024-04-17T19:53:30.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.629+0000 7f71e4c9c640 1 -- start start 2024-04-17T19:53:30.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.629+0000 7f71e4c9c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f71e00d37c0 0x7f71e00d4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:30.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.629+0000 7f71e4c9c640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f71e00d0230 0x7f71e00b82f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:30.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.629+0000 7f71e4c9c640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71e006c1e0 con 0x7f71e006d280 2024-04-17T19:53:30.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.629+0000 7f71e4c9c640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f71e006c4c0 con 0x7f71e00d37c0 2024-04-17T19:53:30.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.629+0000 7f71e4c9c640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f71e006c7a0 con 0x7f71e00d0230 2024-04-17T19:53:30.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.629+0000 7f71de59c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f71e00d37c0 0x7f71e00d4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:30.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.629+0000 7f71de59c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f71e00d37c0 0x7f71e00d4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50192/0 (socket says 172.21.15.18:50192) 2024-04-17T19:53:30.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.629+0000 7f71de59c640 1 -- 172.21.15.18:0/2662305822 learned_addr learned my addr 172.21.15.18:0/2662305822 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:30.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.629+0000 7f71ded9d640 1 --2- 172.21.15.18:0/2662305822 >> v2:172.21.15.173:3300/0 conn(0x7f71e00d0230 0x7f71e00b82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:30.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.629+0000 7f71de59c640 1 -- 172.21.15.18:0/2662305822 >> v2:172.21.15.173:3300/0 conn(0x7f71e00d0230 msgr2=0x7f71e00b82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:30.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.629+0000 7f71de59c640 1 --2- 172.21.15.18:0/2662305822 >> v2:172.21.15.173:3300/0 conn(0x7f71e00d0230 0x7f71e00b82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:30.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.629+0000 7f71de59c640 1 -- 172.21.15.18:0/2662305822 >> v1:172.21.15.173:6789/0 conn(0x7f71e006d280 legacy=0x7f71e00cfb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:30.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.629+0000 7f71de59c640 1 -- 172.21.15.18:0/2662305822 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71e006ca80 con 0x7f71e00d37c0 2024-04-17T19:53:30.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.633+0000 7f71de59c640 1 --2- 172.21.15.18:0/2662305822 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71e00d37c0 0x7f71e00d4330 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f71e008d760 tx=0x7f71d001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=816a419fc84de6e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:30.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.633+0000 7f71dd59a640 1 -- 172.21.15.18:0/2662305822 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d00b0070 con 0x7f71e00d37c0 2024-04-17T19:53:30.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.633+0000 7f71dd59a640 1 -- 172.21.15.18:0/2662305822 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71d00ab600 con 0x7f71e00d37c0 2024-04-17T19:53:30.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.633+0000 7f71dd59a640 1 -- 172.21.15.18:0/2662305822 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d00ab9d0 con 0x7f71e00d37c0 2024-04-17T19:53:30.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.633+0000 7f71e4c9c640 1 -- 172.21.15.18:0/2662305822 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71e00d37c0 msgr2=0x7f71e00d4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:30.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.633+0000 7f71e4c9c640 1 --2- 172.21.15.18:0/2662305822 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71e00d37c0 0x7f71e00d4330 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f71e008d760 tx=0x7f71d001c420 comp rx=0 tx=0).stop 2024-04-17T19:53:30.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.633+0000 7f71e4c9c640 1 -- 172.21.15.18:0/2662305822 shutdown_connections 2024-04-17T19:53:30.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.633+0000 7f71e4c9c640 1 --2- 172.21.15.18:0/2662305822 >> v2:172.21.15.173:3300/0 conn(0x7f71e00d0230 0x7f71e00b82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:30.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.633+0000 7f71e4c9c640 1 --2- 172.21.15.18:0/2662305822 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71e00d37c0 0x7f71e00d4330 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:30.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.633+0000 7f71e4c9c640 1 -- 172.21.15.18:0/2662305822 >> 172.21.15.18:0/2662305822 conn(0x7f71e00b6cd0 msgr2=0x7f71e00b70e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:30.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.633+0000 7f71e4c9c640 1 -- 172.21.15.18:0/2662305822 shutdown_connections 2024-04-17T19:53:30.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.633+0000 7f71e4c9c640 1 -- 172.21.15.18:0/2662305822 wait complete. 2024-04-17T19:53:30.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.637+0000 7f71e4c9c640 1 Processor -- start 2024-04-17T19:53:30.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.637+0000 7f71e4c9c640 1 -- start start 2024-04-17T19:53:30.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.637+0000 7f71e4c9c640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f71e006d280 0x7f71e015b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:30.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.637+0000 7f71e4c9c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71e00d37c0 0x7f71e00cfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:30.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.637+0000 7f71e4c9c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f71e01f94c0 0x7f71e01f8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:30.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.637+0000 7f71e4c9c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f71e015ea30 con 0x7f71e00d37c0 2024-04-17T19:53:30.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.637+0000 7f71e4c9c640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f71e006bfa0 con 0x7f71e01f94c0 2024-04-17T19:53:30.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.637+0000 7f71e4c9c640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f71e015ebb0 con 0x7f71e006d280 2024-04-17T19:53:30.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.637+0000 7f71ddd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71e00d37c0 0x7f71e00cfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:30.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.637+0000 7f71ddd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71e00d37c0 0x7f71e00cfaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50198/0 (socket says 172.21.15.18:50198) 2024-04-17T19:53:30.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.637+0000 7f71ddd9b640 1 -- 172.21.15.18:0/4157341020 learned_addr learned my addr 172.21.15.18:0/4157341020 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:30.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.637+0000 7f71de59c640 1 --2- 172.21.15.18:0/4157341020 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f71e006d280 0x7f71e015b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:30.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.637+0000 7f71ded9d640 1 --2- 172.21.15.18:0/4157341020 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f71e01f94c0 0x7f71e01f8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:30.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.637+0000 7f71ddd9b640 1 -- 172.21.15.18:0/4157341020 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f71e006d280 msgr2=0x7f71e015b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:30.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.637+0000 7f71ddd9b640 1 --2- 172.21.15.18:0/4157341020 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f71e006d280 0x7f71e015b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:30.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.637+0000 7f71ddd9b640 1 -- 172.21.15.18:0/4157341020 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f71e01f94c0 msgr2=0x7f71e01f8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:30.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.637+0000 7f71ddd9b640 1 --2- 172.21.15.18:0/4157341020 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f71e01f94c0 0x7f71e01f8620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:30.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.637+0000 7f71ddd9b640 1 -- 172.21.15.18:0/4157341020 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71e00ba360 con 0x7f71e00d37c0 2024-04-17T19:53:30.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.637+0000 7f71ddd9b640 1 --2- 172.21.15.18:0/4157341020 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71e00d37c0 0x7f71e00cfaf0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f71d400b410 tx=0x7f71d400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:30.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.637+0000 7f71ceffd640 1 -- 172.21.15.18:0/4157341020 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d4015030 con 0x7f71e00d37c0 2024-04-17T19:53:30.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.637+0000 7f71ceffd640 1 -- 172.21.15.18:0/4157341020 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71d4004020 con 0x7f71e00d37c0 2024-04-17T19:53:30.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.637+0000 7f71e4c9c640 1 -- 172.21.15.18:0/4157341020 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71e00ba640 con 0x7f71e00d37c0 2024-04-17T19:53:30.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.637+0000 7f71ceffd640 1 -- 172.21.15.18:0/4157341020 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71d4004450 con 0x7f71e00d37c0 2024-04-17T19:53:30.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.637+0000 7f71e4c9c640 1 -- 172.21.15.18:0/4157341020 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71e0161690 con 0x7f71e00d37c0 2024-04-17T19:53:30.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.637+0000 7f71e4c9c640 1 -- 172.21.15.18:0/4157341020 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71e0069950 con 0x7f71e00d37c0 2024-04-17T19:53:30.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.637+0000 7f71ceffd640 1 -- 172.21.15.18:0/4157341020 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f71d4018070 con 0x7f71e00d37c0 2024-04-17T19:53:30.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.641+0000 7f71ceffd640 1 --2- 172.21.15.18:0/4157341020 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f71c0068380 0x7f71c006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:30.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.641+0000 7f71ceffd640 1 -- 172.21.15.18:0/4157341020 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f71d40869e0 con 0x7f71e00d37c0 2024-04-17T19:53:30.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.641+0000 7f71de59c640 1 --2- 172.21.15.18:0/4157341020 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f71c0068380 0x7f71c006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:30.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.641+0000 7f71de59c640 1 --2- 172.21.15.18:0/4157341020 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f71c0068380 0x7f71c006a890 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f71d00ad000 tx=0x7f71d0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:30.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.645+0000 7f71ceffd640 1 -- 172.21.15.18:0/4157341020 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f71d4056b30 con 0x7f71e00d37c0 2024-04-17T19:53:30.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.805+0000 7f71e4c9c640 1 -- 172.21.15.18:0/4157341020 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f71e015b9a0 con 0x7f71e00d37c0 2024-04-17T19:53:30.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.805+0000 7f71ceffd640 1 -- 172.21.15.18:0/4157341020 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f71d4056430 con 0x7f71e00d37c0 2024-04-17T19:53:30.803 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-17T19:53:30.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.809+0000 7f71e4c9c640 1 -- 172.21.15.18:0/4157341020 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f71c0068380 msgr2=0x7f71c006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:30.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.809+0000 7f71e4c9c640 1 --2- 172.21.15.18:0/4157341020 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f71c0068380 0x7f71c006a890 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f71d00ad000 tx=0x7f71d0008040 comp rx=0 tx=0).stop 2024-04-17T19:53:30.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.809+0000 7f71e4c9c640 1 -- 172.21.15.18:0/4157341020 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71e00d37c0 msgr2=0x7f71e00cfaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:30.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.809+0000 7f71e4c9c640 1 --2- 172.21.15.18:0/4157341020 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71e00d37c0 0x7f71e00cfaf0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f71d400b410 tx=0x7f71d400b8d0 comp rx=0 tx=0).stop 2024-04-17T19:53:30.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.809+0000 7f71e4c9c640 1 -- 172.21.15.18:0/4157341020 shutdown_connections 2024-04-17T19:53:30.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.809+0000 7f71e4c9c640 1 --2- 172.21.15.18:0/4157341020 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f71c0068380 0x7f71c006a890 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:30.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.809+0000 7f71e4c9c640 1 --2- 172.21.15.18:0/4157341020 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f71e01f94c0 0x7f71e01f8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:30.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.809+0000 7f71e4c9c640 1 --2- 172.21.15.18:0/4157341020 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71e00d37c0 0x7f71e00cfaf0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:30.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.809+0000 7f71e4c9c640 1 --2- 172.21.15.18:0/4157341020 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f71e006d280 0x7f71e015b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:30.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.809+0000 7f71e4c9c640 1 -- 172.21.15.18:0/4157341020 >> 172.21.15.18:0/4157341020 conn(0x7f71e00b6cd0 msgr2=0x7f71e0156d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:30.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.809+0000 7f71e4c9c640 1 -- 172.21.15.18:0/4157341020 shutdown_connections 2024-04-17T19:53:30.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.809+0000 7f71e4c9c640 1 -- 172.21.15.18:0/4157341020 wait complete. 2024-04-17T19:53:30.825 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-17T19:53:30.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.985+0000 7fbfa1de8640 1 Processor -- start 2024-04-17T19:53:30.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.985+0000 7fbfa1de8640 1 -- start start 2024-04-17T19:53:30.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.989+0000 7fbfa1de8640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fbf9c0cece0 0x7fbf9c161500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:30.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.989+0000 7fbfa1de8640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbf9c0cf0f0 0x7fbf9c0b1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:30.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.989+0000 7fbfa1de8640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbf9c161a40 0x7fbf9c0b1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:30.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.989+0000 7fbfa1de8640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fbf9c0ce4b0 con 0x7fbf9c0cf0f0 2024-04-17T19:53:30.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.989+0000 7fbfa1de8640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7fbf9c161070 con 0x7fbf9c0cece0 2024-04-17T19:53:30.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.989+0000 7fbfa1de8640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fbf9c0cdc10 con 0x7fbf9c161a40 2024-04-17T19:53:30.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.989+0000 7fbf93fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbf9c0cf0f0 0x7fbf9c0b1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:30.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.989+0000 7fbf93fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbf9c0cf0f0 0x7fbf9c0b1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50202/0 (socket says 172.21.15.18:50202) 2024-04-17T19:53:30.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.989+0000 7fbf93fff640 1 -- 172.21.15.18:0/991485766 learned_addr learned my addr 172.21.15.18:0/991485766 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:30.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.989+0000 7fbf9b7fe640 1 --2- 172.21.15.18:0/991485766 >> v2:172.21.15.173:3300/0 conn(0x7fbf9c0cece0 0x7fbf9c161500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:30.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.989+0000 7fbf9bfff640 1 --2- 172.21.15.18:0/991485766 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbf9c161a40 0x7fbf9c0b1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:30.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.989+0000 7fbf93fff640 1 -- 172.21.15.18:0/991485766 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbf9c161a40 msgr2=0x7fbf9c0b1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:30.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.989+0000 7fbf93fff640 1 --2- 172.21.15.18:0/991485766 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbf9c161a40 0x7fbf9c0b1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:30.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.989+0000 7fbf93fff640 1 -- 172.21.15.18:0/991485766 >> v2:172.21.15.173:3300/0 conn(0x7fbf9c0cece0 msgr2=0x7fbf9c161500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:30.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.989+0000 7fbf93fff640 1 --2- 172.21.15.18:0/991485766 >> v2:172.21.15.173:3300/0 conn(0x7fbf9c0cece0 0x7fbf9c161500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:30.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.989+0000 7fbf93fff640 1 -- 172.21.15.18:0/991485766 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf9c0cdef0 con 0x7fbf9c0cf0f0 2024-04-17T19:53:30.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.993+0000 7fbf93fff640 1 --2- 172.21.15.18:0/991485766 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf9c0cf0f0 0x7fbf9c0b1340 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c0d2b90 tx=0x7fbf8401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=802023877b7aa8fd server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:30.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.993+0000 7fbf9affd640 1 -- 172.21.15.18:0/991485766 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf840ab5f0 con 0x7fbf9c0cf0f0 2024-04-17T19:53:30.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.993+0000 7fbf9affd640 1 -- 172.21.15.18:0/991485766 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf840b0070 con 0x7fbf9c0cf0f0 2024-04-17T19:53:30.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.993+0000 7fbf9affd640 1 -- 172.21.15.18:0/991485766 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf840ab9b0 con 0x7fbf9c0cf0f0 2024-04-17T19:53:30.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.993+0000 7fbfa1de8640 1 -- 172.21.15.18:0/991485766 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf9c0cf0f0 msgr2=0x7fbf9c0b1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:30.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.993+0000 7fbfa1de8640 1 --2- 172.21.15.18:0/991485766 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf9c0cf0f0 0x7fbf9c0b1340 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c0d2b90 tx=0x7fbf8401c520 comp rx=0 tx=0).stop 2024-04-17T19:53:30.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.993+0000 7fbfa1de8640 1 -- 172.21.15.18:0/991485766 shutdown_connections 2024-04-17T19:53:30.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.993+0000 7fbfa1de8640 1 --2- 172.21.15.18:0/991485766 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbf9c161a40 0x7fbf9c0b1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:30.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.993+0000 7fbfa1de8640 1 --2- 172.21.15.18:0/991485766 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf9c0cf0f0 0x7fbf9c0b1340 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:30.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.993+0000 7fbfa1de8640 1 --2- 172.21.15.18:0/991485766 >> v2:172.21.15.173:3300/0 conn(0x7fbf9c0cece0 0x7fbf9c161500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:30.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.993+0000 7fbfa1de8640 1 -- 172.21.15.18:0/991485766 >> 172.21.15.18:0/991485766 conn(0x7fbf9c09aa70 msgr2=0x7fbf9c09ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:30.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.993+0000 7fbfa1de8640 1 -- 172.21.15.18:0/991485766 shutdown_connections 2024-04-17T19:53:30.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.993+0000 7fbfa1de8640 1 -- 172.21.15.18:0/991485766 wait complete. 2024-04-17T19:53:30.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.993+0000 7fbfa1de8640 1 Processor -- start 2024-04-17T19:53:30.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.993+0000 7fbfa1de8640 1 -- start start 2024-04-17T19:53:30.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.997+0000 7fbfa1de8640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbf9c0cece0 0x7fbf9c154920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:30.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.997+0000 7fbfa1de8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf9c0cf0f0 0x7fbf9c166ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:30.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.997+0000 7fbfa1de8640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf9c161a40 0x7fbf9c0c7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:30.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.997+0000 7fbfa1de8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbf9c0d1e30 con 0x7fbf9c0cf0f0 2024-04-17T19:53:30.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.997+0000 7fbfa1de8640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fbf9c0d1cb0 con 0x7fbf9c161a40 2024-04-17T19:53:30.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.997+0000 7fbfa1de8640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fbf9c0d1fb0 con 0x7fbf9c0cece0 2024-04-17T19:53:30.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.997+0000 7fbf93fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf9c0cf0f0 0x7fbf9c166ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:30.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.997+0000 7fbf93fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf9c0cf0f0 0x7fbf9c166ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50214/0 (socket says 172.21.15.18:50214) 2024-04-17T19:53:30.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.997+0000 7fbf93fff640 1 -- 172.21.15.18:0/1915969268 learned_addr learned my addr 172.21.15.18:0/1915969268 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:30.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.997+0000 7fbf9bfff640 1 --2- 172.21.15.18:0/1915969268 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf9c161a40 0x7fbf9c0c7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:30.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.997+0000 7fbf9b7fe640 1 --2- 172.21.15.18:0/1915969268 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbf9c0cece0 0x7fbf9c154920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:30.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.997+0000 7fbf93fff640 1 -- 172.21.15.18:0/1915969268 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbf9c0cece0 msgr2=0x7fbf9c154920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:30.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.997+0000 7fbf93fff640 1 --2- 172.21.15.18:0/1915969268 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbf9c0cece0 0x7fbf9c154920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:30.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.997+0000 7fbf93fff640 1 -- 172.21.15.18:0/1915969268 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf9c161a40 msgr2=0x7fbf9c0c7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:30.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.997+0000 7fbf93fff640 1 --2- 172.21.15.18:0/1915969268 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf9c161a40 0x7fbf9c0c7ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:30.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.997+0000 7fbf93fff640 1 -- 172.21.15.18:0/1915969268 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf9c155470 con 0x7fbf9c0cf0f0 2024-04-17T19:53:30.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.997+0000 7fbf93fff640 1 --2- 172.21.15.18:0/1915969268 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf9c0cf0f0 0x7fbf9c166ed0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbf8401ca00 tx=0x7fbf8401ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:30.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.997+0000 7fbf98ff9640 1 -- 172.21.15.18:0/1915969268 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf840be3f0 con 0x7fbf9c0cf0f0 2024-04-17T19:53:30.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.997+0000 7fbf98ff9640 1 -- 172.21.15.18:0/1915969268 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf840be5b0 con 0x7fbf9c0cf0f0 2024-04-17T19:53:30.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.997+0000 7fbfa1de8640 1 -- 172.21.15.18:0/1915969268 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf9c06dac0 con 0x7fbf9c0cf0f0 2024-04-17T19:53:30.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.997+0000 7fbf98ff9640 1 -- 172.21.15.18:0/1915969268 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf840be9a0 con 0x7fbf9c0cf0f0 2024-04-17T19:53:30.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.997+0000 7fbfa1de8640 1 -- 172.21.15.18:0/1915969268 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf9c06e080 con 0x7fbf9c0cf0f0 2024-04-17T19:53:30.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.997+0000 7fbfa1de8640 1 -- 172.21.15.18:0/1915969268 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf9c1677b0 con 0x7fbf9c0cf0f0 2024-04-17T19:53:30.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:30.997+0000 7fbf98ff9640 1 -- 172.21.15.18:0/1915969268 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbf840b43f0 con 0x7fbf9c0cf0f0 2024-04-17T19:53:30.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.001+0000 7fbf98ff9640 1 --2- 172.21.15.18:0/1915969268 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fbf7c0683b0 0x7fbf7c06a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:30.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.001+0000 7fbf98ff9640 1 -- 172.21.15.18:0/1915969268 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fbf84120940 con 0x7fbf9c0cf0f0 2024-04-17T19:53:30.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.001+0000 7fbf9b7fe640 1 --2- 172.21.15.18:0/1915969268 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fbf7c0683b0 0x7fbf7c06a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:30.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.001+0000 7fbf9b7fe640 1 --2- 172.21.15.18:0/1915969268 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fbf7c0683b0 0x7fbf7c06a8c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c0099d0 tx=0x7fbf8c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:31.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.005+0000 7fbf98ff9640 1 -- 172.21.15.18:0/1915969268 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbf840c4060 con 0x7fbf9c0cf0f0 2024-04-17T19:53:31.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.165+0000 7fbfa1de8640 1 -- 172.21.15.18:0/1915969268 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fbf9c069950 con 0x7fbf9c0cf0f0 2024-04-17T19:53:31.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.165+0000 7fbf98ff9640 1 -- 172.21.15.18:0/1915969268 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7fbf9c0b2810 con 0x7fbf9c0cf0f0 2024-04-17T19:53:31.163 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-17T19:53:31.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.169+0000 7fbfa1de8640 1 -- 172.21.15.18:0/1915969268 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fbf7c0683b0 msgr2=0x7fbf7c06a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:31.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.169+0000 7fbfa1de8640 1 --2- 172.21.15.18:0/1915969268 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fbf7c0683b0 0x7fbf7c06a8c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c0099d0 tx=0x7fbf8c008040 comp rx=0 tx=0).stop 2024-04-17T19:53:31.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.169+0000 7fbfa1de8640 1 -- 172.21.15.18:0/1915969268 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf9c0cf0f0 msgr2=0x7fbf9c166ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:31.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.169+0000 7fbfa1de8640 1 --2- 172.21.15.18:0/1915969268 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf9c0cf0f0 0x7fbf9c166ed0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbf8401ca00 tx=0x7fbf8401ad60 comp rx=0 tx=0).stop 2024-04-17T19:53:31.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.169+0000 7fbfa1de8640 1 -- 172.21.15.18:0/1915969268 shutdown_connections 2024-04-17T19:53:31.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.169+0000 7fbfa1de8640 1 --2- 172.21.15.18:0/1915969268 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fbf7c0683b0 0x7fbf7c06a8c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:31.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.169+0000 7fbfa1de8640 1 --2- 172.21.15.18:0/1915969268 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf9c161a40 0x7fbf9c0c7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:31.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.169+0000 7fbfa1de8640 1 --2- 172.21.15.18:0/1915969268 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf9c0cf0f0 0x7fbf9c166ed0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:31.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.169+0000 7fbfa1de8640 1 --2- 172.21.15.18:0/1915969268 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbf9c0cece0 0x7fbf9c154920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:31.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.169+0000 7fbfa1de8640 1 -- 172.21.15.18:0/1915969268 >> 172.21.15.18:0/1915969268 conn(0x7fbf9c09aa70 msgr2=0x7fbf9c0d23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:31.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.169+0000 7fbfa1de8640 1 -- 172.21.15.18:0/1915969268 shutdown_connections 2024-04-17T19:53:31.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.169+0000 7fbfa1de8640 1 -- 172.21.15.18:0/1915969268 wait complete. 2024-04-17T19:53:31.186 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-17T19:53:31.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.341+0000 7f58190cb640 1 Processor -- start 2024-04-17T19:53:31.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.341+0000 7f58190cb640 1 -- start start 2024-04-17T19:53:31.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.341+0000 7f58190cb640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f581415e1a0 0x7f58140ce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:31.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.341+0000 7f58190cb640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58140d0020 con 0x7f581406cd60 2024-04-17T19:53:31.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.341+0000 7f58190cb640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58140cd930 con 0x7f58140cef10 2024-04-17T19:53:31.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.341+0000 7f58190cb640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f58140cdc10 con 0x7f581415e1a0 2024-04-17T19:53:31.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.341+0000 7f581359e640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f581406cd60 0x7f581406d170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:51280/0 (socket says 172.21.15.18:51280) 2024-04-17T19:53:31.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.341+0000 7f581359e640 1 -- 172.21.15.18:0/1702919573 learned_addr learned my addr 172.21.15.18:0/1702919573 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:31.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.341+0000 7f5812d9d640 1 --2- 172.21.15.18:0/1702919573 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f581415e1a0 0x7f58140ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:31.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.341+0000 7f5811d9b640 1 -- 172.21.15.18:0/1702919573 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 440758619 0 0) 0x7f58140d0020 con 0x7f581406cd60 2024-04-17T19:53:31.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.341+0000 7f5811d9b640 1 -- 172.21.15.18:0/1702919573 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57fc003530 con 0x7f581406cd60 2024-04-17T19:53:31.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.341+0000 7f5811d9b640 1 -- 172.21.15.18:0/1702919573 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3977200933 0 0) 0x7f57fc003530 con 0x7f581406cd60 2024-04-17T19:53:31.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.341+0000 7f5811d9b640 1 -- 172.21.15.18:0/1702919573 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f581415e1a0 msgr2=0x7f58140ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:31.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.341+0000 7f5811d9b640 1 --2- 172.21.15.18:0/1702919573 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f581415e1a0 0x7f58140ce9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:31.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.341+0000 7f5811d9b640 1 -- 172.21.15.18:0/1702919573 >> v1:172.21.15.173:6789/0 conn(0x7f58140cef10 legacy=0x7f581415e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:31.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.341+0000 7f5811d9b640 1 -- 172.21.15.18:0/1702919573 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58140cdef0 con 0x7f581406cd60 2024-04-17T19:53:31.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.341+0000 7f5811d9b640 1 -- 172.21.15.18:0/1702919573 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3208559991 0 0) 0x7f580c001680 con 0x7f581406cd60 2024-04-17T19:53:31.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.341+0000 7f5811d9b640 1 -- 172.21.15.18:0/1702919573 >> v1:172.21.15.18:6789/0 conn(0x7f581406cd60 legacy=0x7f581406d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:31.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.341+0000 7f5811d9b640 1 --2- 172.21.15.18:0/1702919573 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f581415e1a0 0x7f57fc0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:31.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.341+0000 7f5811d9b640 1 --2- 172.21.15.18:0/1702919573 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57fc003f50 0x7f57fc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:31.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.341+0000 7f5811d9b640 1 --2- 172.21.15.18:0/1702919573 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57fc004d50 0x7f57fc005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:31.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.341+0000 7f5811d9b640 1 -- 172.21.15.18:0/1702919573 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f58140cdc10 con 0x7f57fc003f50 2024-04-17T19:53:31.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.341+0000 7f5811d9b640 1 -- 172.21.15.18:0/1702919573 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f57fc00bb90 con 0x7f57fc004d50 2024-04-17T19:53:31.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.341+0000 7f5811d9b640 1 -- 172.21.15.18:0/1702919573 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f57fc00bd90 con 0x7f581415e1a0 2024-04-17T19:53:31.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.345+0000 7f581259c640 1 --2- 172.21.15.18:0/1702919573 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57fc003f50 0x7f57fc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:31.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.345+0000 7f581359e640 1 --2- 172.21.15.18:0/1702919573 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57fc004d50 0x7f57fc005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:31.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.345+0000 7f5812d9d640 1 --2- 172.21.15.18:0/1702919573 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f581415e1a0 0x7f57fc0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:31.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.345+0000 7f581259c640 1 -- 172.21.15.18:0/1702919573 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f581415e1a0 msgr2=0x7f57fc0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:31.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.345+0000 7f581259c640 1 --2- 172.21.15.18:0/1702919573 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f581415e1a0 0x7f57fc0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:31.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.345+0000 7f581259c640 1 -- 172.21.15.18:0/1702919573 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57fc004d50 msgr2=0x7f57fc005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:31.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.345+0000 7f581259c640 1 --2- 172.21.15.18:0/1702919573 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57fc004d50 0x7f57fc005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:31.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.345+0000 7f581259c640 1 -- 172.21.15.18:0/1702919573 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57fc003530 con 0x7f57fc003f50 2024-04-17T19:53:31.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.345+0000 7f581259c640 1 --2- 172.21.15.18:0/1702919573 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57fc003f50 0x7f57fc004810 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f58140a9d50 tx=0x7f580801ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=921392b93dbfb781 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:31.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.345+0000 7f5811d9b640 1 -- 172.21.15.18:0/1702919573 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58080b5070 con 0x7f57fc003f50 2024-04-17T19:53:31.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.345+0000 7f5811d9b640 1 -- 172.21.15.18:0/1702919573 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58080a8810 con 0x7f57fc003f50 2024-04-17T19:53:31.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.345+0000 7f5811d9b640 1 -- 172.21.15.18:0/1702919573 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5808001480 con 0x7f57fc003f50 2024-04-17T19:53:31.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.345+0000 7f58190cb640 1 -- 172.21.15.18:0/1702919573 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57fc003f50 msgr2=0x7f57fc004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:31.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.345+0000 7f58190cb640 1 --2- 172.21.15.18:0/1702919573 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57fc003f50 0x7f57fc004810 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f58140a9d50 tx=0x7f580801ebf0 comp rx=0 tx=0).stop 2024-04-17T19:53:31.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.345+0000 7f581359e640 1 -- 172.21.15.18:0/1702919573 reap_dead start 2024-04-17T19:53:31.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.345+0000 7f58190cb640 1 -- 172.21.15.18:0/1702919573 shutdown_connections 2024-04-17T19:53:31.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.345+0000 7f58190cb640 1 -- 172.21.15.18:0/1702919573 >> 172.21.15.18:0/1702919573 conn(0x7f5814072bb0 msgr2=0x7f5814072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:31.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.345+0000 7f58190cb640 1 -- 172.21.15.18:0/1702919573 shutdown_connections 2024-04-17T19:53:31.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.345+0000 7f58190cb640 1 -- 172.21.15.18:0/1702919573 wait complete. 2024-04-17T19:53:31.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.349+0000 7f58190cb640 1 Processor -- start 2024-04-17T19:53:31.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.349+0000 7f58190cb640 1 -- start start 2024-04-17T19:53:31.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.349+0000 7f58190cb640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57fc003f50 0x7f58141e60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:31.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.349+0000 7f58190cb640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58141e66f0 0x7f5814142090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:31.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.349+0000 7f58190cb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5814152040 0x7f5814152450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:31.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.349+0000 7f58190cb640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f581415e5b0 con 0x7f5814152040 2024-04-17T19:53:31.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.349+0000 7f58190cb640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f58140ce4b0 con 0x7f57fc003f50 2024-04-17T19:53:31.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.349+0000 7f58190cb640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f581415e730 con 0x7f58141e66f0 2024-04-17T19:53:31.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.349+0000 7f581359e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5814152040 0x7f5814152450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:31.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.349+0000 7f581359e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5814152040 0x7f5814152450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50240/0 (socket says 172.21.15.18:50240) 2024-04-17T19:53:31.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.349+0000 7f581359e640 1 -- 172.21.15.18:0/1320246628 learned_addr learned my addr 172.21.15.18:0/1320246628 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:31.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.349+0000 7f5812d9d640 1 --2- 172.21.15.18:0/1320246628 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57fc003f50 0x7f58141e60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:31.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.349+0000 7f581259c640 1 --2- 172.21.15.18:0/1320246628 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58141e66f0 0x7f5814142090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:31.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.349+0000 7f581359e640 1 -- 172.21.15.18:0/1320246628 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58141e66f0 msgr2=0x7f5814142090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:31.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.349+0000 7f581359e640 1 --2- 172.21.15.18:0/1320246628 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58141e66f0 0x7f5814142090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:31.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.349+0000 7f581359e640 1 -- 172.21.15.18:0/1320246628 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57fc003f50 msgr2=0x7f58141e60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:31.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.349+0000 7f581359e640 1 --2- 172.21.15.18:0/1320246628 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57fc003f50 0x7f58141e60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:31.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.349+0000 7f581359e640 1 -- 172.21.15.18:0/1320246628 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5814152990 con 0x7f5814152040 2024-04-17T19:53:31.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.349+0000 7f581259c640 1 --2- 172.21.15.18:0/1320246628 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58141e66f0 0x7f5814142090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:53:31.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.349+0000 7f581359e640 1 --2- 172.21.15.18:0/1320246628 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5814152040 0x7f5814152450 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f58140b5ee0 tx=0x7f580c00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:31.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.349+0000 7f57fb7fe640 1 -- 172.21.15.18:0/1320246628 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f580c00c630 con 0x7f5814152040 2024-04-17T19:53:31.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.349+0000 7f57fb7fe640 1 -- 172.21.15.18:0/1320246628 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f580c018070 con 0x7f5814152040 2024-04-17T19:53:31.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.349+0000 7f58190cb640 1 -- 172.21.15.18:0/1320246628 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58141e4b50 con 0x7f5814152040 2024-04-17T19:53:31.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.349+0000 7f57fb7fe640 1 -- 172.21.15.18:0/1320246628 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f580c00ca10 con 0x7f5814152040 2024-04-17T19:53:31.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.349+0000 7f58190cb640 1 -- 172.21.15.18:0/1320246628 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58141e5330 con 0x7f5814152040 2024-04-17T19:53:31.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.353+0000 7f58190cb640 1 -- 172.21.15.18:0/1320246628 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58141e4dc0 con 0x7f5814152040 2024-04-17T19:53:31.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.353+0000 7f57fb7fe640 1 -- 172.21.15.18:0/1320246628 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f580c00cbb0 con 0x7f5814152040 2024-04-17T19:53:31.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.353+0000 7f57fb7fe640 1 --2- 172.21.15.18:0/1320246628 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f5800068380 0x7f580006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:31.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.353+0000 7f57fb7fe640 1 -- 172.21.15.18:0/1320246628 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f580c086870 con 0x7f5814152040 2024-04-17T19:53:31.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.353+0000 7f5812d9d640 1 --2- 172.21.15.18:0/1320246628 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f5800068380 0x7f580006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:31.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.353+0000 7f5812d9d640 1 --2- 172.21.15.18:0/1320246628 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f5800068380 0x7f580006a890 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f58140b5f30 tx=0x7f580400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:31.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.357+0000 7f57fb7fe640 1 -- 172.21.15.18:0/1320246628 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5814152990 con 0x7f5814152040 2024-04-17T19:53:31.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.521+0000 7f58190cb640 1 -- 172.21.15.18:0/1320246628 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f5814069950 con 0x7f5814152040 2024-04-17T19:53:31.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.525+0000 7f57fb7fe640 1 -- 172.21.15.18:0/1320246628 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f580c0569c0 con 0x7f5814152040 2024-04-17T19:53:31.520 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-17T19:53:31.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.525+0000 7f58190cb640 1 -- 172.21.15.18:0/1320246628 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f5800068380 msgr2=0x7f580006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:31.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.525+0000 7f58190cb640 1 --2- 172.21.15.18:0/1320246628 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f5800068380 0x7f580006a890 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f58140b5f30 tx=0x7f580400b040 comp rx=0 tx=0).stop 2024-04-17T19:53:31.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.525+0000 7f58190cb640 1 -- 172.21.15.18:0/1320246628 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5814152040 msgr2=0x7f5814152450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:31.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.525+0000 7f58190cb640 1 --2- 172.21.15.18:0/1320246628 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5814152040 0x7f5814152450 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f58140b5ee0 tx=0x7f580c00eb90 comp rx=0 tx=0).stop 2024-04-17T19:53:31.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.525+0000 7f58190cb640 1 -- 172.21.15.18:0/1320246628 shutdown_connections 2024-04-17T19:53:31.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.525+0000 7f58190cb640 1 --2- 172.21.15.18:0/1320246628 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f5800068380 0x7f580006a890 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:31.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.525+0000 7f58190cb640 1 --2- 172.21.15.18:0/1320246628 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5814152040 0x7f5814152450 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:31.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.525+0000 7f58190cb640 1 --2- 172.21.15.18:0/1320246628 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f58141e66f0 0x7f5814142090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:31.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.525+0000 7f58190cb640 1 --2- 172.21.15.18:0/1320246628 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57fc003f50 0x7f58141e60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:31.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.525+0000 7f58190cb640 1 -- 172.21.15.18:0/1320246628 >> 172.21.15.18:0/1320246628 conn(0x7f5814072bb0 msgr2=0x7f58140ccd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:31.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.525+0000 7f58190cb640 1 -- 172.21.15.18:0/1320246628 shutdown_connections 2024-04-17T19:53:31.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.525+0000 7f58190cb640 1 -- 172.21.15.18:0/1320246628 wait complete. 2024-04-17T19:53:31.542 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-17T19:53:31.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.705+0000 7f44f56ed640 1 Processor -- start 2024-04-17T19:53:31.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.705+0000 7f44f56ed640 1 -- start start 2024-04-17T19:53:31.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.705+0000 7f44f56ed640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44f015e1a0 0x7f44f00ce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:31.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.705+0000 7f44f56ed640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f44f00cef10 0x7f44f015e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:31.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.705+0000 7f44f56ed640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44f00d0020 con 0x7f44f015ee50 2024-04-17T19:53:31.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.705+0000 7f44f56ed640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f44f00cd930 con 0x7f44f00cef10 2024-04-17T19:53:31.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.705+0000 7f44f56ed640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f44f00cdc10 con 0x7f44f015e1a0 2024-04-17T19:53:31.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.705+0000 7f44ef7fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f44f015ee50 0x7f44f006cd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:51294/0 (socket says 172.21.15.18:51294) 2024-04-17T19:53:31.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.705+0000 7f44ef7fe640 1 -- 172.21.15.18:0/4007115866 learned_addr learned my addr 172.21.15.18:0/4007115866 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:31.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.705+0000 7f44ee7fc640 1 --2- 172.21.15.18:0/4007115866 >> v2:172.21.15.173:3300/0 conn(0x7f44f00cef10 0x7f44f015e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:31.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.705+0000 7f44eeffd640 1 --2- 172.21.15.18:0/4007115866 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44f015e1a0 0x7f44f00ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:31.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.705+0000 7f44edffb640 1 -- 172.21.15.18:0/4007115866 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1743126673 0 0) 0x7f44f00d0020 con 0x7f44f015ee50 2024-04-17T19:53:31.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.705+0000 7f44edffb640 1 -- 172.21.15.18:0/4007115866 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44d8003530 con 0x7f44f015ee50 2024-04-17T19:53:31.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.705+0000 7f44edffb640 1 -- 172.21.15.18:0/4007115866 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1713494375 0 0) 0x7f44d8003530 con 0x7f44f015ee50 2024-04-17T19:53:31.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.705+0000 7f44edffb640 1 -- 172.21.15.18:0/4007115866 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44f015e1a0 msgr2=0x7f44f00ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:31.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.705+0000 7f44edffb640 1 --2- 172.21.15.18:0/4007115866 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44f015e1a0 0x7f44f00ce9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:31.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.705+0000 7f44edffb640 1 -- 172.21.15.18:0/4007115866 >> v2:172.21.15.173:3300/0 conn(0x7f44f00cef10 msgr2=0x7f44f015e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:31.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.705+0000 7f44edffb640 1 --2- 172.21.15.18:0/4007115866 >> v2:172.21.15.173:3300/0 conn(0x7f44f00cef10 0x7f44f015e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:31.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.705+0000 7f44edffb640 1 -- 172.21.15.18:0/4007115866 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44f00cdef0 con 0x7f44f015ee50 2024-04-17T19:53:31.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.705+0000 7f44edffb640 1 -- 172.21.15.18:0/4007115866 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3208559991 0 0) 0x7f44e8001a00 con 0x7f44f015ee50 2024-04-17T19:53:31.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.709+0000 7f44edffb640 1 -- 172.21.15.18:0/4007115866 >> v1:172.21.15.18:6789/0 conn(0x7f44f015ee50 legacy=0x7f44f006cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:31.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.709+0000 7f44edffb640 1 --2- 172.21.15.18:0/4007115866 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44d80039c0 0x7f44d8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:31.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.709+0000 7f44edffb640 1 --2- 172.21.15.18:0/4007115866 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44d8004810 0x7f44d8004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:31.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.709+0000 7f44edffb640 1 --2- 172.21.15.18:0/4007115866 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44f015e1a0 0x7f44d8005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:31.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.709+0000 7f44edffb640 1 -- 172.21.15.18:0/4007115866 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f44f00cd930 con 0x7f44d80039c0 2024-04-17T19:53:31.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.709+0000 7f44edffb640 1 -- 172.21.15.18:0/4007115866 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f44f00cdc10 con 0x7f44d8004810 2024-04-17T19:53:31.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.709+0000 7f44edffb640 1 -- 172.21.15.18:0/4007115866 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f44d800ba80 con 0x7f44f015e1a0 2024-04-17T19:53:31.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.709+0000 7f44eeffd640 1 --2- 172.21.15.18:0/4007115866 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44d80039c0 0x7f44d8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:31.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.709+0000 7f44ee7fc640 1 --2- 172.21.15.18:0/4007115866 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44d8004810 0x7f44d8004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:31.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.709+0000 7f44ef7fe640 1 --2- 172.21.15.18:0/4007115866 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44f015e1a0 0x7f44d8005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:31.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.709+0000 7f44eeffd640 1 -- 172.21.15.18:0/4007115866 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44f015e1a0 msgr2=0x7f44d8005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:31.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.709+0000 7f44eeffd640 1 --2- 172.21.15.18:0/4007115866 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44f015e1a0 0x7f44d8005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:31.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.709+0000 7f44eeffd640 1 -- 172.21.15.18:0/4007115866 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44d8004810 msgr2=0x7f44d8004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:31.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.709+0000 7f44eeffd640 1 --2- 172.21.15.18:0/4007115866 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44d8004810 0x7f44d8004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:31.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.709+0000 7f44eeffd640 1 -- 172.21.15.18:0/4007115866 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44d8003530 con 0x7f44d80039c0 2024-04-17T19:53:31.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.709+0000 7f44eeffd640 1 --2- 172.21.15.18:0/4007115866 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44d80039c0 0x7f44d8003e30 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f44e0009ab0 tx=0x7f44e001ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=641c16204f72742e server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:31.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.709+0000 7f44edffb640 1 -- 172.21.15.18:0/4007115866 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e00b2070 con 0x7f44d80039c0 2024-04-17T19:53:31.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.709+0000 7f44edffb640 1 -- 172.21.15.18:0/4007115866 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44e00a5530 con 0x7f44d80039c0 2024-04-17T19:53:31.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.709+0000 7f44edffb640 1 -- 172.21.15.18:0/4007115866 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e00096b0 con 0x7f44d80039c0 2024-04-17T19:53:31.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.709+0000 7f44f56ed640 1 -- 172.21.15.18:0/4007115866 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44d80039c0 msgr2=0x7f44d8003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:31.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.709+0000 7f44f56ed640 1 --2- 172.21.15.18:0/4007115866 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44d80039c0 0x7f44d8003e30 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f44e0009ab0 tx=0x7f44e001ca70 comp rx=0 tx=0).stop 2024-04-17T19:53:31.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.709+0000 7f44ef7fe640 1 -- 172.21.15.18:0/4007115866 reap_dead start 2024-04-17T19:53:31.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.709+0000 7f44f56ed640 1 -- 172.21.15.18:0/4007115866 shutdown_connections 2024-04-17T19:53:31.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.709+0000 7f44f56ed640 1 -- 172.21.15.18:0/4007115866 >> 172.21.15.18:0/4007115866 conn(0x7f44f0072bb0 msgr2=0x7f44f0072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:31.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.709+0000 7f44f56ed640 1 -- 172.21.15.18:0/4007115866 shutdown_connections 2024-04-17T19:53:31.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.709+0000 7f44f56ed640 1 -- 172.21.15.18:0/4007115866 wait complete. 2024-04-17T19:53:31.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.713+0000 7f44f56ed640 1 Processor -- start 2024-04-17T19:53:31.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.713+0000 7f44f56ed640 1 -- start start 2024-04-17T19:53:31.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.713+0000 7f44f56ed640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44d80039c0 0x7f44f013ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:31.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.713+0000 7f44f56ed640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44f013b390 0x7f44f0150de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:31.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.713+0000 7f44f56ed640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44f0151320 0x7f44f0151730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:31.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.713+0000 7f44f56ed640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f44f0157b90 con 0x7f44d80039c0 2024-04-17T19:53:31.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.713+0000 7f44f56ed640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f44f0157a10 con 0x7f44f0151320 2024-04-17T19:53:31.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.713+0000 7f44f56ed640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f44f006d470 con 0x7f44f013b390 2024-04-17T19:53:31.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.713+0000 7f44eeffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44d80039c0 0x7f44f013ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:31.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.713+0000 7f44eeffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44d80039c0 0x7f44f013ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50266/0 (socket says 172.21.15.18:50266) 2024-04-17T19:53:31.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.713+0000 7f44eeffd640 1 -- 172.21.15.18:0/3056481437 learned_addr learned my addr 172.21.15.18:0/3056481437 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:31.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.713+0000 7f44ee7fc640 1 --2- 172.21.15.18:0/3056481437 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44f013b390 0x7f44f0150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:31.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.713+0000 7f44ef7fe640 1 --2- 172.21.15.18:0/3056481437 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44f0151320 0x7f44f0151730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:31.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.713+0000 7f44eeffd640 1 -- 172.21.15.18:0/3056481437 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44f013b390 msgr2=0x7f44f0150de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:31.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.713+0000 7f44eeffd640 1 --2- 172.21.15.18:0/3056481437 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44f013b390 0x7f44f0150de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:31.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.713+0000 7f44eeffd640 1 -- 172.21.15.18:0/3056481437 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44f0151320 msgr2=0x7f44f0151730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:31.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.713+0000 7f44eeffd640 1 --2- 172.21.15.18:0/3056481437 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44f0151320 0x7f44f0151730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:31.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.713+0000 7f44eeffd640 1 -- 172.21.15.18:0/3056481437 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44f01f6e20 con 0x7f44d80039c0 2024-04-17T19:53:31.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.713+0000 7f44eeffd640 1 --2- 172.21.15.18:0/3056481437 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44d80039c0 0x7f44f013ae50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f44e0000c10 tx=0x7f44d8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:31.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.713+0000 7f44d77fe640 1 -- 172.21.15.18:0/3056481437 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e00be070 con 0x7f44d80039c0 2024-04-17T19:53:31.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.717+0000 7f44d77fe640 1 -- 172.21.15.18:0/3056481437 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44e00a5d60 con 0x7f44d80039c0 2024-04-17T19:53:31.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.717+0000 7f44f56ed640 1 -- 172.21.15.18:0/3056481437 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44f0148af0 con 0x7f44d80039c0 2024-04-17T19:53:31.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.717+0000 7f44d77fe640 1 -- 172.21.15.18:0/3056481437 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e00b2040 con 0x7f44d80039c0 2024-04-17T19:53:31.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.717+0000 7f44f56ed640 1 -- 172.21.15.18:0/3056481437 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44f014f5a0 con 0x7f44d80039c0 2024-04-17T19:53:31.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.717+0000 7f44f56ed640 1 -- 172.21.15.18:0/3056481437 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44f0069950 con 0x7f44d80039c0 2024-04-17T19:53:31.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.717+0000 7f44d77fe640 1 -- 172.21.15.18:0/3056481437 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f44e00c1070 con 0x7f44d80039c0 2024-04-17T19:53:31.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.717+0000 7f44d77fe640 1 --2- 172.21.15.18:0/3056481437 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f44dc068380 0x7f44dc06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:31.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.717+0000 7f44d77fe640 1 -- 172.21.15.18:0/3056481437 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f44e0120830 con 0x7f44d80039c0 2024-04-17T19:53:31.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.717+0000 7f44ee7fc640 1 --2- 172.21.15.18:0/3056481437 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f44dc068380 0x7f44dc06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:31.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.717+0000 7f44ee7fc640 1 --2- 172.21.15.18:0/3056481437 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f44dc068380 0x7f44dc06a890 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f44f0160280 tx=0x7f44e4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:31.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.721+0000 7f44d77fe640 1 -- 172.21.15.18:0/3056481437 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f44e0016780 con 0x7f44d80039c0 2024-04-17T19:53:31.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.881+0000 7f44f56ed640 1 -- 172.21.15.18:0/3056481437 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f44f0152c30 con 0x7f44d80039c0 2024-04-17T19:53:31.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.881+0000 7f44d77fe640 1 -- 172.21.15.18:0/3056481437 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f44e00f0330 con 0x7f44d80039c0 2024-04-17T19:53:31.879 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-17T19:53:31.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.885+0000 7f44f56ed640 1 -- 172.21.15.18:0/3056481437 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f44dc068380 msgr2=0x7f44dc06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:31.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.885+0000 7f44f56ed640 1 --2- 172.21.15.18:0/3056481437 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f44dc068380 0x7f44dc06a890 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f44f0160280 tx=0x7f44e4008040 comp rx=0 tx=0).stop 2024-04-17T19:53:31.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.885+0000 7f44f56ed640 1 -- 172.21.15.18:0/3056481437 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44d80039c0 msgr2=0x7f44f013ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:31.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.885+0000 7f44f56ed640 1 --2- 172.21.15.18:0/3056481437 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44d80039c0 0x7f44f013ae50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f44e0000c10 tx=0x7f44d8005840 comp rx=0 tx=0).stop 2024-04-17T19:53:31.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.885+0000 7f44f56ed640 1 -- 172.21.15.18:0/3056481437 shutdown_connections 2024-04-17T19:53:31.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.885+0000 7f44f56ed640 1 --2- 172.21.15.18:0/3056481437 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f44dc068380 0x7f44dc06a890 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:31.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.885+0000 7f44f56ed640 1 --2- 172.21.15.18:0/3056481437 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44f0151320 0x7f44f0151730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:31.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.885+0000 7f44f56ed640 1 --2- 172.21.15.18:0/3056481437 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44f013b390 0x7f44f0150de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:31.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.885+0000 7f44f56ed640 1 --2- 172.21.15.18:0/3056481437 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44d80039c0 0x7f44f013ae50 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:31.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.885+0000 7f44f56ed640 1 -- 172.21.15.18:0/3056481437 >> 172.21.15.18:0/3056481437 conn(0x7f44f0072bb0 msgr2=0x7f44f006bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:31.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.885+0000 7f44f56ed640 1 -- 172.21.15.18:0/3056481437 shutdown_connections 2024-04-17T19:53:31.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:31.885+0000 7f44f56ed640 1 -- 172.21.15.18:0/3056481437 wait complete. 2024-04-17T19:53:31.900 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T19:53:32.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.041+0000 7f09c537b640 1 Processor -- start 2024-04-17T19:53:32.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.041+0000 7f09c537b640 1 -- start start 2024-04-17T19:53:32.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.041+0000 7f09c537b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f09c006cd60 0x7f09c006d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:32.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.041+0000 7f09c537b640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f09c015d7c0 0x7f09c015dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:32.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.041+0000 7f09c537b640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09c015fc90 con 0x7f09c015c7c0 2024-04-17T19:53:32.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.041+0000 7f09c537b640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f09c006d6b0 con 0x7f09c006cd60 2024-04-17T19:53:32.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.041+0000 7f09c537b640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f09c0142870 con 0x7f09c015d7c0 2024-04-17T19:53:32.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.041+0000 7f09beffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f09c006cd60 0x7f09c006d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:32.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.041+0000 7f09be7fc640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f09c015c7c0 0x7f09c015cbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:51300/0 (socket says 172.21.15.18:51300) 2024-04-17T19:53:32.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.041+0000 7f09be7fc640 1 -- 172.21.15.18:0/647052493 learned_addr learned my addr 172.21.15.18:0/647052493 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:32.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.041+0000 7f09beffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f09c006cd60 0x7f09c006d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50280/0 (socket says 172.21.15.18:50280) 2024-04-17T19:53:32.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.041+0000 7f09beffd640 1 -- 172.21.15.18:0/647052493 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f09c015d7c0 msgr2=0x7f09c015dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:32.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.041+0000 7f09beffd640 1 --2- 172.21.15.18:0/647052493 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f09c015d7c0 0x7f09c015dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:32.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.041+0000 7f09beffd640 1 -- 172.21.15.18:0/647052493 >> v1:172.21.15.18:6789/0 conn(0x7f09c015c7c0 legacy=0x7f09c015cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:32.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.041+0000 7f09beffd640 1 -- 172.21.15.18:0/647052493 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09c015ff00 con 0x7f09c006cd60 2024-04-17T19:53:32.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.045+0000 7f09beffd640 1 --2- 172.21.15.18:0/647052493 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09c006cd60 0x7f09c006d170 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f09b80097f0 tx=0x7f09b801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fe870558aae152 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:32.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.045+0000 7f09bdffb640 1 -- 172.21.15.18:0/647052493 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b80b0070 con 0x7f09c006cd60 2024-04-17T19:53:32.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.045+0000 7f09bdffb640 1 -- 172.21.15.18:0/647052493 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09b80ab600 con 0x7f09c006cd60 2024-04-17T19:53:32.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.045+0000 7f09bdffb640 1 -- 172.21.15.18:0/647052493 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b80ab9d0 con 0x7f09c006cd60 2024-04-17T19:53:32.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.045+0000 7f09c537b640 1 -- 172.21.15.18:0/647052493 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09c006cd60 msgr2=0x7f09c006d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:32.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.045+0000 7f09c537b640 1 --2- 172.21.15.18:0/647052493 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09c006cd60 0x7f09c006d170 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f09b80097f0 tx=0x7f09b801c440 comp rx=0 tx=0).stop 2024-04-17T19:53:32.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.045+0000 7f09c537b640 1 -- 172.21.15.18:0/647052493 shutdown_connections 2024-04-17T19:53:32.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.045+0000 7f09c537b640 1 --2- 172.21.15.18:0/647052493 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f09c015d7c0 0x7f09c015dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:32.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.045+0000 7f09c537b640 1 --2- 172.21.15.18:0/647052493 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09c006cd60 0x7f09c006d170 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:32.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.045+0000 7f09c537b640 1 -- 172.21.15.18:0/647052493 >> 172.21.15.18:0/647052493 conn(0x7f09c0072bb0 msgr2=0x7f09c0072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:32.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.045+0000 7f09c537b640 1 -- 172.21.15.18:0/647052493 shutdown_connections 2024-04-17T19:53:32.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.045+0000 7f09c537b640 1 -- 172.21.15.18:0/647052493 wait complete. 2024-04-17T19:53:32.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.049+0000 7f09c537b640 1 Processor -- start 2024-04-17T19:53:32.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.049+0000 7f09c537b640 1 -- start start 2024-04-17T19:53:32.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.049+0000 7f09c537b640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f09c006cd60 0x7f09c0159220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:32.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.049+0000 7f09c537b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09c015c7c0 0x7f09c01544e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:32.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.049+0000 7f09c537b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09c015d7c0 0x7f09c012a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:32.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.049+0000 7f09c537b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f09c01609e0 con 0x7f09c015c7c0 2024-04-17T19:53:32.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.049+0000 7f09c537b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f09c0166f80 con 0x7f09c015d7c0 2024-04-17T19:53:32.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.049+0000 7f09c537b640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f09c0154a20 con 0x7f09c006cd60 2024-04-17T19:53:32.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.049+0000 7f09be7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09c015c7c0 0x7f09c01544e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:32.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.049+0000 7f09be7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09c015c7c0 0x7f09c01544e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50294/0 (socket says 172.21.15.18:50294) 2024-04-17T19:53:32.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.049+0000 7f09be7fc640 1 -- 172.21.15.18:0/4208345409 learned_addr learned my addr 172.21.15.18:0/4208345409 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:32.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.049+0000 7f09beffd640 1 --2- 172.21.15.18:0/4208345409 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f09c006cd60 0x7f09c0159220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:32.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.049+0000 7f09bf7fe640 1 --2- 172.21.15.18:0/4208345409 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09c015d7c0 0x7f09c012a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:32.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.049+0000 7f09be7fc640 1 -- 172.21.15.18:0/4208345409 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f09c006cd60 msgr2=0x7f09c0159220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:32.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.049+0000 7f09be7fc640 1 --2- 172.21.15.18:0/4208345409 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f09c006cd60 0x7f09c0159220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:32.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.049+0000 7f09be7fc640 1 -- 172.21.15.18:0/4208345409 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09c015d7c0 msgr2=0x7f09c012a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:32.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.049+0000 7f09be7fc640 1 --2- 172.21.15.18:0/4208345409 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09c015d7c0 0x7f09c012a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:32.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.049+0000 7f09be7fc640 1 -- 172.21.15.18:0/4208345409 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09c0155a70 con 0x7f09c015c7c0 2024-04-17T19:53:32.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.049+0000 7f09beffd640 1 --2- 172.21.15.18:0/4208345409 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f09c006cd60 0x7f09c0159220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:53:32.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.049+0000 7f09bf7fe640 1 --2- 172.21.15.18:0/4208345409 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09c015d7c0 0x7f09c012a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:53:32.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.049+0000 7f09be7fc640 1 --2- 172.21.15.18:0/4208345409 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09c015c7c0 0x7f09c01544e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f09b400c340 tx=0x7f09b400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:32.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.049+0000 7f09a77fe640 1 -- 172.21.15.18:0/4208345409 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b4017070 con 0x7f09c015c7c0 2024-04-17T19:53:32.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.049+0000 7f09a77fe640 1 -- 172.21.15.18:0/4208345409 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09b4005cf0 con 0x7f09c015c7c0 2024-04-17T19:53:32.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.049+0000 7f09a77fe640 1 -- 172.21.15.18:0/4208345409 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09b40072f0 con 0x7f09c015c7c0 2024-04-17T19:53:32.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.049+0000 7f09c537b640 1 -- 172.21.15.18:0/4208345409 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09c0128f70 con 0x7f09c015c7c0 2024-04-17T19:53:32.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.049+0000 7f09c537b640 1 -- 172.21.15.18:0/4208345409 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09c0129530 con 0x7f09c015c7c0 2024-04-17T19:53:32.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.049+0000 7f09c537b640 1 -- 172.21.15.18:0/4208345409 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09c0069950 con 0x7f09c015c7c0 2024-04-17T19:53:32.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.053+0000 7f09a77fe640 1 -- 172.21.15.18:0/4208345409 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f09b401a070 con 0x7f09c015c7c0 2024-04-17T19:53:32.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.053+0000 7f09a77fe640 1 --2- 172.21.15.18:0/4208345409 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f09ac068380 0x7f09ac06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:32.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.053+0000 7f09a77fe640 1 -- 172.21.15.18:0/4208345409 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f09b4086130 con 0x7f09c015c7c0 2024-04-17T19:53:32.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.053+0000 7f09beffd640 1 --2- 172.21.15.18:0/4208345409 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f09ac068380 0x7f09ac06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:32.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.053+0000 7f09beffd640 1 --2- 172.21.15.18:0/4208345409 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f09ac068380 0x7f09ac06a890 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f09b80ad000 tx=0x7f09b8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:32.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.057+0000 7f09a77fe640 1 -- 172.21.15.18:0/4208345409 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f09b40562a0 con 0x7f09c015c7c0 2024-04-17T19:53:32.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.245+0000 7f09c537b640 1 -- 172.21.15.18:0/4208345409 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f09c00b4b80 con 0x7f09c015c7c0 2024-04-17T19:53:32.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.245+0000 7f09a77fe640 1 -- 172.21.15.18:0/4208345409 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5177 (secure 0 0 0) 0x7f09b4055ba0 con 0x7f09c015c7c0 2024-04-17T19:53:32.243 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:53:32.243 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/729504609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":729504609},{"type":"v1","addr":"172.21.15.173:6833","nonce":729504609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4261,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/3797017174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3797017174},{"type":"v1","addr":"172.21.15.173:6835","nonce":3797017174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/995848920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":995848920},{"type":"v1","addr":"172.21.15.18:6835","nonce":995848920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-17T19:53:04.851226+0000","modified":"2024-04-17T19:53:22.952315+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6837/1926349198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1926349198},{"type":"v1","addr":"172.21.15.18:6837","nonce":1926349198}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1}]} 2024-04-17T19:53:32.243 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 9 2024-04-17T19:53:32.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.249+0000 7f09c537b640 1 -- 172.21.15.18:0/4208345409 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f09ac068380 msgr2=0x7f09ac06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:32.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.249+0000 7f09c537b640 1 --2- 172.21.15.18:0/4208345409 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f09ac068380 0x7f09ac06a890 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f09b80ad000 tx=0x7f09b8008040 comp rx=0 tx=0).stop 2024-04-17T19:53:32.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.249+0000 7f09c537b640 1 -- 172.21.15.18:0/4208345409 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09c015c7c0 msgr2=0x7f09c01544e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:32.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.249+0000 7f09c537b640 1 --2- 172.21.15.18:0/4208345409 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09c015c7c0 0x7f09c01544e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f09b400c340 tx=0x7f09b400c800 comp rx=0 tx=0).stop 2024-04-17T19:53:32.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.249+0000 7f09c537b640 1 -- 172.21.15.18:0/4208345409 shutdown_connections 2024-04-17T19:53:32.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.249+0000 7f09c537b640 1 --2- 172.21.15.18:0/4208345409 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f09ac068380 0x7f09ac06a890 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:32.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.249+0000 7f09c537b640 1 --2- 172.21.15.18:0/4208345409 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09c015d7c0 0x7f09c012a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:32.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.249+0000 7f09c537b640 1 --2- 172.21.15.18:0/4208345409 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09c015c7c0 0x7f09c01544e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:32.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.249+0000 7f09c537b640 1 --2- 172.21.15.18:0/4208345409 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f09c006cd60 0x7f09c0159220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:32.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.249+0000 7f09c537b640 1 -- 172.21.15.18:0/4208345409 >> 172.21.15.18:0/4208345409 conn(0x7f09c0072bb0 msgr2=0x7f09c015e980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:32.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.249+0000 7f09c537b640 1 -- 172.21.15.18:0/4208345409 shutdown_connections 2024-04-17T19:53:32.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.249+0000 7f09c537b640 1 -- 172.21.15.18:0/4208345409 wait complete. 2024-04-17T19:53:32.263 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T19:53:32.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.417+0000 7fc668b33640 1 Processor -- start 2024-04-17T19:53:32.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.417+0000 7fc668b33640 1 -- start start 2024-04-17T19:53:32.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.417+0000 7fc668b33640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc66409ecc0 0x7fc6641617b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:32.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.417+0000 7fc668b33640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc6640aeb90 0x7fc66406bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:32.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.417+0000 7fc668b33640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6640af140 con 0x7fc66406c290 2024-04-17T19:53:32.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.417+0000 7fc668b33640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7fc6640af420 con 0x7fc6640aeb90 2024-04-17T19:53:32.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.417+0000 7fc668b33640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fc6640af700 con 0x7fc66409ecc0 2024-04-17T19:53:32.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.417+0000 7fc65bfff640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc6640aeb90 0x7fc66406bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:32.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.417+0000 7fc66259c640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc66409ecc0 0x7fc6641617b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:32.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.417+0000 7fc65bfff640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc6640aeb90 0x7fc66406bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.18:44364/0 (socket says 172.21.15.18:44364) 2024-04-17T19:53:32.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.417+0000 7fc65bfff640 1 -- 172.21.15.18:0/1504618777 learned_addr learned my addr 172.21.15.18:0/1504618777 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:32.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.417+0000 7fc66259c640 1 -- 172.21.15.18:0/1504618777 >> v2:172.21.15.173:3300/0 conn(0x7fc6640aeb90 msgr2=0x7fc66406bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:32.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.417+0000 7fc66259c640 1 --2- 172.21.15.18:0/1504618777 >> v2:172.21.15.173:3300/0 conn(0x7fc6640aeb90 0x7fc66406bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:32.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.417+0000 7fc66259c640 1 -- 172.21.15.18:0/1504618777 >> v1:172.21.15.173:6789/0 conn(0x7fc66406c290 legacy=0x7fc66415de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:32.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.417+0000 7fc66259c640 1 -- 172.21.15.18:0/1504618777 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc66415e590 con 0x7fc66409ecc0 2024-04-17T19:53:32.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.417+0000 7fc65bfff640 1 --2- 172.21.15.18:0/1504618777 >> v2:172.21.15.173:3300/0 conn(0x7fc6640aeb90 0x7fc66406bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T19:53:32.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.421+0000 7fc66259c640 1 --2- 172.21.15.18:0/1504618777 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc66409ecc0 0x7fc6641617b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc6540097c0 tx=0x7fc65401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1cd616c6e38ac9c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:32.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.421+0000 7fc661d9b640 1 -- 172.21.15.18:0/1504618777 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6540b0070 con 0x7fc66409ecc0 2024-04-17T19:53:32.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.421+0000 7fc661d9b640 1 -- 172.21.15.18:0/1504618777 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6540ab600 con 0x7fc66409ecc0 2024-04-17T19:53:32.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.421+0000 7fc661d9b640 1 -- 172.21.15.18:0/1504618777 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6540ab9d0 con 0x7fc66409ecc0 2024-04-17T19:53:32.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.421+0000 7fc668b33640 1 -- 172.21.15.18:0/1504618777 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc66409ecc0 msgr2=0x7fc6641617b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:32.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.421+0000 7fc668b33640 1 --2- 172.21.15.18:0/1504618777 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc66409ecc0 0x7fc6641617b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc6540097c0 tx=0x7fc65401c4a0 comp rx=0 tx=0).stop 2024-04-17T19:53:32.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.421+0000 7fc668b33640 1 -- 172.21.15.18:0/1504618777 shutdown_connections 2024-04-17T19:53:32.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.421+0000 7fc668b33640 1 --2- 172.21.15.18:0/1504618777 >> v2:172.21.15.173:3300/0 conn(0x7fc6640aeb90 0x7fc66406bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:32.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.421+0000 7fc668b33640 1 --2- 172.21.15.18:0/1504618777 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc66409ecc0 0x7fc6641617b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:32.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.421+0000 7fc668b33640 1 -- 172.21.15.18:0/1504618777 >> 172.21.15.18:0/1504618777 conn(0x7fc6640d1230 msgr2=0x7fc6640d1640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:32.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.421+0000 7fc668b33640 1 -- 172.21.15.18:0/1504618777 shutdown_connections 2024-04-17T19:53:32.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.421+0000 7fc668b33640 1 -- 172.21.15.18:0/1504618777 wait complete. 2024-04-17T19:53:32.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.425+0000 7fc668b33640 1 Processor -- start 2024-04-17T19:53:32.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.425+0000 7fc668b33640 1 -- start start 2024-04-17T19:53:32.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.425+0000 7fc668b33640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc66406c290 0x7fc66413ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:32.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.425+0000 7fc668b33640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc66409ecc0 0x7fc6641550c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:32.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.425+0000 7fc668b33640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc6640aeb90 0x7fc6640b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:32.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.425+0000 7fc668b33640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc66416ad30 con 0x7fc66409ecc0 2024-04-17T19:53:32.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.425+0000 7fc668b33640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc66416abb0 con 0x7fc66406c290 2024-04-17T19:53:32.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.425+0000 7fc668b33640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fc66416aeb0 con 0x7fc6640aeb90 2024-04-17T19:53:32.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.425+0000 7fc65bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc66409ecc0 0x7fc6641550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:32.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.425+0000 7fc65bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc66409ecc0 0x7fc6641550c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50298/0 (socket says 172.21.15.18:50298) 2024-04-17T19:53:32.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.425+0000 7fc65bfff640 1 -- 172.21.15.18:0/4260958190 learned_addr learned my addr 172.21.15.18:0/4260958190 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:32.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.425+0000 7fc662d9d640 1 --2- 172.21.15.18:0/4260958190 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc6640aeb90 0x7fc6640b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:32.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.425+0000 7fc66259c640 1 --2- 172.21.15.18:0/4260958190 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc66406c290 0x7fc66413ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:32.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.425+0000 7fc65bfff640 1 -- 172.21.15.18:0/4260958190 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc6640aeb90 msgr2=0x7fc6640b4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:32.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.425+0000 7fc65bfff640 1 --2- 172.21.15.18:0/4260958190 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc6640aeb90 0x7fc6640b4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:32.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.425+0000 7fc65bfff640 1 -- 172.21.15.18:0/4260958190 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc66406c290 msgr2=0x7fc66413ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:32.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.425+0000 7fc65bfff640 1 --2- 172.21.15.18:0/4260958190 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc66406c290 0x7fc66413ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:32.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.425+0000 7fc65bfff640 1 -- 172.21.15.18:0/4260958190 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6640ce170 con 0x7fc66409ecc0 2024-04-17T19:53:32.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.425+0000 7fc65bfff640 1 --2- 172.21.15.18:0/4260958190 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc66409ecc0 0x7fc6641550c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc64c00e930 tx=0x7fc64c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:32.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.425+0000 7fc65affd640 1 -- 172.21.15.18:0/4260958190 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc64c017070 con 0x7fc66409ecc0 2024-04-17T19:53:32.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.425+0000 7fc65affd640 1 -- 172.21.15.18:0/4260958190 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc64c00ca00 con 0x7fc66409ecc0 2024-04-17T19:53:32.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.425+0000 7fc65affd640 1 -- 172.21.15.18:0/4260958190 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc64c00cdd0 con 0x7fc66409ecc0 2024-04-17T19:53:32.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.425+0000 7fc668b33640 1 -- 172.21.15.18:0/4260958190 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6640ce450 con 0x7fc66409ecc0 2024-04-17T19:53:32.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.425+0000 7fc668b33640 1 -- 172.21.15.18:0/4260958190 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6640cea10 con 0x7fc66409ecc0 2024-04-17T19:53:32.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.425+0000 7fc668b33640 1 -- 172.21.15.18:0/4260958190 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc664069950 con 0x7fc66409ecc0 2024-04-17T19:53:32.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.429+0000 7fc65affd640 1 -- 172.21.15.18:0/4260958190 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc64c01a070 con 0x7fc66409ecc0 2024-04-17T19:53:32.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.429+0000 7fc65affd640 1 --2- 172.21.15.18:0/4260958190 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fc644068380 0x7fc64406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:32.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.429+0000 7fc65affd640 1 -- 172.21.15.18:0/4260958190 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fc64c087210 con 0x7fc66409ecc0 2024-04-17T19:53:32.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.429+0000 7fc66259c640 1 --2- 172.21.15.18:0/4260958190 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fc644068380 0x7fc64406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:32.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.429+0000 7fc66259c640 1 --2- 172.21.15.18:0/4260958190 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fc644068380 0x7fc64406a890 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc6540ad000 tx=0x7fc6540a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:32.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.433+0000 7fc65affd640 1 -- 172.21.15.18:0/4260958190 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc64c056f20 con 0x7fc66409ecc0 2024-04-17T19:53:32.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.601+0000 7fc668b33640 1 -- 172.21.15.18:0/4260958190 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc6640cdeb0 con 0x7fc66409ecc0 2024-04-17T19:53:32.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.605+0000 7fc65affd640 1 -- 172.21.15.18:0/4260958190 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18506 (secure 0 0 0) 0x7fc64c05b220 con 0x7fc66409ecc0 2024-04-17T19:53:32.601 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:53:32.601 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":27,"fsid":"dd480169-5a81-4623-be5f-0499aa244b28","created":"2024-04-17T19:52:39.533760+0000","modified":"2024-04-17T19:53:09.903922+0000","last_up_change":"2024-04-17T19:52:51.229698+0000","last_in_change":"2024-04-17T19:52:42.144259+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T19:52:52.391648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T19:53:02.734240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T19:53:03.813028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T19:53:07.478812+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e232d577-2508-4ea4-b355-29fbae1ff025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6801","nonce":2323038417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6803","nonce":2323038417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6807","nonce":2323038417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6805","nonce":2323038417}]},"public_addr":"172.21.15.18:6801/2323038417","cluster_addr":"172.21.15.18:6803/2323038417","heartbeat_back_addr":"172.21.15.18:6807/2323038417","heartbeat_front_addr":"172.21.15.18:6805/2323038417","state":["exists","up"]},{"osd":1,"uuid":"31810ef3-2c71-48d6-8748-b74a2968d23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6817","nonce":1283678238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6819","nonce":1283678238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6823","nonce":1283678238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6821","nonce":1283678238}]},"public_addr":"172.21.15.18:6817/1283678238","cluster_addr":"172.21.15.18:6819/1283678238","heartbeat_back_addr":"172.21.15.18:6823/1283678238","heartbeat_front_addr":"172.21.15.18:6821/1283678238","state":["exists","up"]},{"osd":2,"uuid":"5a783cc5-a41c-4967-9e11-6b8330f97d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6809","nonce":1212875862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6811","nonce":1212875862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6815","nonce":1212875862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6813","nonce":1212875862}]},"public_addr":"172.21.15.18:6809/1212875862","cluster_addr":"172.21.15.18:6811/1212875862","heartbeat_back_addr":"172.21.15.18:6815/1212875862","heartbeat_front_addr":"172.21.15.18:6813/1212875862","state":["exists","up"]},{"osd":3,"uuid":"b7e056d9-9da5-46e1-810d-0c3e242fe5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6825","nonce":2428878428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6827","nonce":2428878428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6831","nonce":2428878428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6829","nonce":2428878428}]},"public_addr":"172.21.15.18:6825/2428878428","cluster_addr":"172.21.15.18:6827/2428878428","heartbeat_back_addr":"172.21.15.18:6831/2428878428","heartbeat_front_addr":"172.21.15.18:6829/2428878428","state":["exists","up"]},{"osd":4,"uuid":"21df023f-bc8b-4abb-93e5-0ecc91acda0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6825","nonce":1421511819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6827","nonce":1421511819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6831","nonce":1421511819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6829","nonce":1421511819}]},"public_addr":"172.21.15.173:6825/1421511819","cluster_addr":"172.21.15.173:6827/1421511819","heartbeat_back_addr":"172.21.15.173:6831/1421511819","heartbeat_front_addr":"172.21.15.173:6829/1421511819","state":["exists","up"]},{"osd":5,"uuid":"e270098a-6d33-49f8-84ed-94e09a880cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6801","nonce":4221907702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6803","nonce":4221907702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6807","nonce":4221907702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6805","nonce":4221907702}]},"public_addr":"172.21.15.173:6801/4221907702","cluster_addr":"172.21.15.173:6803/4221907702","heartbeat_back_addr":"172.21.15.173:6807/4221907702","heartbeat_front_addr":"172.21.15.173:6805/4221907702","state":["exists","up"]},{"osd":6,"uuid":"93c67c8c-268d-4e32-877c-043cd3acd87c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6809","nonce":761678552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6811","nonce":761678552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6815","nonce":761678552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6813","nonce":761678552}]},"public_addr":"172.21.15.173:6809/761678552","cluster_addr":"172.21.15.173:6811/761678552","heartbeat_back_addr":"172.21.15.173:6815/761678552","heartbeat_front_addr":"172.21.15.173:6813/761678552","state":["exists","up"]},{"osd":7,"uuid":"faf10eea-80de-40f6-abbb-34d07d3f59ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6817","nonce":383724537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6819","nonce":383724537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6823","nonce":383724537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6821","nonce":383724537}]},"public_addr":"172.21.15.173:6817/383724537","cluster_addr":"172.21.15.173:6819/383724537","heartbeat_back_addr":"172.21.15.173:6823/383724537","heartbeat_front_addr":"172.21.15.173:6821/383724537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.668924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.761747+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.768128+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.632252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.742608+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.734327+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.477107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.818292+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T19:53:32.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.609+0000 7fc668b33640 1 -- 172.21.15.18:0/4260958190 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fc644068380 msgr2=0x7fc64406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:32.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.609+0000 7fc668b33640 1 --2- 172.21.15.18:0/4260958190 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fc644068380 0x7fc64406a890 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc6540ad000 tx=0x7fc6540a6000 comp rx=0 tx=0).stop 2024-04-17T19:53:32.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.609+0000 7fc668b33640 1 -- 172.21.15.18:0/4260958190 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc66409ecc0 msgr2=0x7fc6641550c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:32.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.609+0000 7fc668b33640 1 --2- 172.21.15.18:0/4260958190 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc66409ecc0 0x7fc6641550c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc64c00e930 tx=0x7fc64c00edf0 comp rx=0 tx=0).stop 2024-04-17T19:53:32.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.609+0000 7fc668b33640 1 -- 172.21.15.18:0/4260958190 shutdown_connections 2024-04-17T19:53:32.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.609+0000 7fc668b33640 1 --2- 172.21.15.18:0/4260958190 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fc644068380 0x7fc64406a890 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:32.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.609+0000 7fc668b33640 1 --2- 172.21.15.18:0/4260958190 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc6640aeb90 0x7fc6640b4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:32.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.609+0000 7fc668b33640 1 --2- 172.21.15.18:0/4260958190 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc66409ecc0 0x7fc6641550c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:32.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.609+0000 7fc668b33640 1 --2- 172.21.15.18:0/4260958190 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc66406c290 0x7fc66413ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:32.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.609+0000 7fc668b33640 1 -- 172.21.15.18:0/4260958190 >> 172.21.15.18:0/4260958190 conn(0x7fc6640d1230 msgr2=0x7fc66415e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:32.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.609+0000 7fc668b33640 1 -- 172.21.15.18:0/4260958190 shutdown_connections 2024-04-17T19:53:32.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.609+0000 7fc668b33640 1 -- 172.21.15.18:0/4260958190 wait complete. 2024-04-17T19:53:32.625 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T19:52:52.391648+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-17T19:53:02.734240+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-17T19:53:03.813028+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-17T19:53:07.478812+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-17T19:53:32.625 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T19:53:32.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.781+0000 7efdcb7e2640 1 Processor -- start 2024-04-17T19:53:32.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.781+0000 7efdcb7e2640 1 -- start start 2024-04-17T19:53:32.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.781+0000 7efdcb7e2640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7efdc40cece0 0x7efdc4161500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:32.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.781+0000 7efdcb7e2640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efdc4161a40 0x7efdc40b6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:32.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.781+0000 7efdcb7e2640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdc40cdc10 con 0x7efdc40cf0f0 2024-04-17T19:53:32.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.781+0000 7efdcb7e2640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7efdc40ce4b0 con 0x7efdc40cece0 2024-04-17T19:53:32.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.781+0000 7efdcb7e2640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7efdc4161070 con 0x7efdc4161a40 2024-04-17T19:53:32.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.781+0000 7efdc957e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7efdc40cece0 0x7efdc4161500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:32.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.781+0000 7efdc957e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7efdc40cece0 0x7efdc4161500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50310/0 (socket says 172.21.15.18:50310) 2024-04-17T19:53:32.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.781+0000 7efdc957e640 1 -- 172.21.15.18:0/3999866002 learned_addr learned my addr 172.21.15.18:0/3999866002 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:32.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.781+0000 7efdc9d7f640 1 --2- 172.21.15.18:0/3999866002 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efdc4161a40 0x7efdc40b6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:32.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.781+0000 7efdc957e640 1 -- 172.21.15.18:0/3999866002 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efdc4161a40 msgr2=0x7efdc40b6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:32.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.781+0000 7efdc957e640 1 --2- 172.21.15.18:0/3999866002 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efdc4161a40 0x7efdc40b6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:32.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.781+0000 7efdc957e640 1 -- 172.21.15.18:0/3999866002 >> v1:172.21.15.173:6789/0 conn(0x7efdc40cf0f0 legacy=0x7efdc40b1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:32.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.781+0000 7efdc957e640 1 -- 172.21.15.18:0/3999866002 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdc40cdef0 con 0x7efdc40cece0 2024-04-17T19:53:32.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.785+0000 7efdc957e640 1 --2- 172.21.15.18:0/3999866002 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efdc40cece0 0x7efdc4161500 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7efdc0009870 tx=0x7efdc001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37a903fa13e4d0a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:32.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.785+0000 7efdbbfff640 1 -- 172.21.15.18:0/3999866002 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc00b2070 con 0x7efdc40cece0 2024-04-17T19:53:32.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.785+0000 7efdbbfff640 1 -- 172.21.15.18:0/3999866002 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdc00a9070 con 0x7efdc40cece0 2024-04-17T19:53:32.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.785+0000 7efdbbfff640 1 -- 172.21.15.18:0/3999866002 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc00ad880 con 0x7efdc40cece0 2024-04-17T19:53:32.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.785+0000 7efdcb7e2640 1 -- 172.21.15.18:0/3999866002 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efdc40cece0 msgr2=0x7efdc4161500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:32.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.785+0000 7efdcb7e2640 1 --2- 172.21.15.18:0/3999866002 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efdc40cece0 0x7efdc4161500 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7efdc0009870 tx=0x7efdc001c560 comp rx=0 tx=0).stop 2024-04-17T19:53:32.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.785+0000 7efdcb7e2640 1 -- 172.21.15.18:0/3999866002 shutdown_connections 2024-04-17T19:53:32.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.785+0000 7efdcb7e2640 1 --2- 172.21.15.18:0/3999866002 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efdc4161a40 0x7efdc40b6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:32.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.785+0000 7efdcb7e2640 1 --2- 172.21.15.18:0/3999866002 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efdc40cece0 0x7efdc4161500 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:32.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.785+0000 7efdcb7e2640 1 -- 172.21.15.18:0/3999866002 >> 172.21.15.18:0/3999866002 conn(0x7efdc409aa70 msgr2=0x7efdc409ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:32.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.785+0000 7efdcb7e2640 1 -- 172.21.15.18:0/3999866002 shutdown_connections 2024-04-17T19:53:32.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.785+0000 7efdcb7e2640 1 -- 172.21.15.18:0/3999866002 wait complete. 2024-04-17T19:53:32.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.789+0000 7efdcb7e2640 1 Processor -- start 2024-04-17T19:53:32.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.789+0000 7efdcb7e2640 1 -- start start 2024-04-17T19:53:32.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.789+0000 7efdcb7e2640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efdc40cece0 0x7efdc415f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:32.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.789+0000 7efdcb7e2640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efdc40cf0f0 0x7efdc414f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:32.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.789+0000 7efdcb7e2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efdc4161a40 0x7efdc4155ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:32.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.789+0000 7efdcb7e2640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efdc40b2810 con 0x7efdc4161a40 2024-04-17T19:53:32.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.789+0000 7efdcb7e2640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7efdc40b1c60 con 0x7efdc40cf0f0 2024-04-17T19:53:32.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.789+0000 7efdcb7e2640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7efdc416a990 con 0x7efdc40cece0 2024-04-17T19:53:32.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.789+0000 7efdc9d7f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efdc4161a40 0x7efdc4155ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:32.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.789+0000 7efdc9d7f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efdc4161a40 0x7efdc4155ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50318/0 (socket says 172.21.15.18:50318) 2024-04-17T19:53:32.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.789+0000 7efdc9d7f640 1 -- 172.21.15.18:0/1379243341 learned_addr learned my addr 172.21.15.18:0/1379243341 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:32.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.789+0000 7efdc8d7d640 1 --2- 172.21.15.18:0/1379243341 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efdc40cf0f0 0x7efdc414f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:32.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.789+0000 7efdc957e640 1 --2- 172.21.15.18:0/1379243341 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efdc40cece0 0x7efdc415f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:32.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.789+0000 7efdc9d7f640 1 -- 172.21.15.18:0/1379243341 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efdc40cece0 msgr2=0x7efdc415f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:32.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.789+0000 7efdc9d7f640 1 --2- 172.21.15.18:0/1379243341 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efdc40cece0 0x7efdc415f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:32.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.789+0000 7efdc9d7f640 1 -- 172.21.15.18:0/1379243341 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efdc40cf0f0 msgr2=0x7efdc414f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:32.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.789+0000 7efdc9d7f640 1 --2- 172.21.15.18:0/1379243341 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efdc40cf0f0 0x7efdc414f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:32.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.789+0000 7efdc9d7f640 1 -- 172.21.15.18:0/1379243341 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdc415fa90 con 0x7efdc4161a40 2024-04-17T19:53:32.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.789+0000 7efdc957e640 1 --2- 172.21.15.18:0/1379243341 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efdc40cece0 0x7efdc415f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:53:32.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.789+0000 7efdc9d7f640 1 --2- 172.21.15.18:0/1379243341 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efdc4161a40 0x7efdc4155ac0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7efdbc007d80 tx=0x7efdbc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:32.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.789+0000 7efdb9ffb640 1 -- 172.21.15.18:0/1379243341 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdbc014420 con 0x7efdc4161a40 2024-04-17T19:53:32.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.789+0000 7efdb9ffb640 1 -- 172.21.15.18:0/1379243341 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdbc019070 con 0x7efdc4161a40 2024-04-17T19:53:32.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.789+0000 7efdb9ffb640 1 -- 172.21.15.18:0/1379243341 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdbc014800 con 0x7efdc4161a40 2024-04-17T19:53:32.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.789+0000 7efdcb7e2640 1 -- 172.21.15.18:0/1379243341 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdc415fd70 con 0x7efdc4161a40 2024-04-17T19:53:32.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.789+0000 7efdcb7e2640 1 -- 172.21.15.18:0/1379243341 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdc4160330 con 0x7efdc4161a40 2024-04-17T19:53:32.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.793+0000 7efdcb7e2640 1 -- 172.21.15.18:0/1379243341 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdc415f800 con 0x7efdc4161a40 2024-04-17T19:53:32.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.793+0000 7efdb9ffb640 1 -- 172.21.15.18:0/1379243341 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efdbc0149a0 con 0x7efdc4161a40 2024-04-17T19:53:32.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.793+0000 7efdb9ffb640 1 --2- 172.21.15.18:0/1379243341 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7efda8068380 0x7efda806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:32.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.793+0000 7efdb9ffb640 1 -- 172.21.15.18:0/1379243341 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7efdbc087f00 con 0x7efdc4161a40 2024-04-17T19:53:32.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.793+0000 7efdc957e640 1 --2- 172.21.15.18:0/1379243341 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7efda8068380 0x7efda806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:32.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.793+0000 7efdc957e640 1 --2- 172.21.15.18:0/1379243341 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7efda8068380 0x7efda806a890 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efdc00af000 tx=0x7efdc0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:32.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.797+0000 7efdb9ffb640 1 -- 172.21.15.18:0/1379243341 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efdbc0581d0 con 0x7efdc4161a40 2024-04-17T19:53:32.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.961+0000 7efdcb7e2640 1 -- 172.21.15.18:0/1379243341 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7efdc4069950 con 0x7efdc4161a40 2024-04-17T19:53:32.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.961+0000 7efdb9ffb640 1 -- 172.21.15.18:0/1379243341 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7efdbc057ad0 con 0x7efdc4161a40 2024-04-17T19:53:32.958 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-17T19:53:32.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.965+0000 7efdcb7e2640 1 -- 172.21.15.18:0/1379243341 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7efda8068380 msgr2=0x7efda806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:32.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.965+0000 7efdcb7e2640 1 --2- 172.21.15.18:0/1379243341 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7efda8068380 0x7efda806a890 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efdc00af000 tx=0x7efdc0008040 comp rx=0 tx=0).stop 2024-04-17T19:53:32.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.965+0000 7efdcb7e2640 1 -- 172.21.15.18:0/1379243341 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efdc4161a40 msgr2=0x7efdc4155ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:32.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.965+0000 7efdcb7e2640 1 --2- 172.21.15.18:0/1379243341 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efdc4161a40 0x7efdc4155ac0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7efdbc007d80 tx=0x7efdbc00e4b0 comp rx=0 tx=0).stop 2024-04-17T19:53:32.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.965+0000 7efdcb7e2640 1 -- 172.21.15.18:0/1379243341 shutdown_connections 2024-04-17T19:53:32.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.965+0000 7efdcb7e2640 1 --2- 172.21.15.18:0/1379243341 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7efda8068380 0x7efda806a890 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:32.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.965+0000 7efdcb7e2640 1 --2- 172.21.15.18:0/1379243341 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efdc4161a40 0x7efdc4155ac0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:32.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.965+0000 7efdcb7e2640 1 --2- 172.21.15.18:0/1379243341 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efdc40cf0f0 0x7efdc414f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:32.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.965+0000 7efdcb7e2640 1 --2- 172.21.15.18:0/1379243341 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efdc40cece0 0x7efdc415f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:32.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.965+0000 7efdcb7e2640 1 -- 172.21.15.18:0/1379243341 >> 172.21.15.18:0/1379243341 conn(0x7efdc409aa70 msgr2=0x7efdc409ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:32.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.965+0000 7efdcb7e2640 1 -- 172.21.15.18:0/1379243341 shutdown_connections 2024-04-17T19:53:32.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:32.965+0000 7efdcb7e2640 1 -- 172.21.15.18:0/1379243341 wait complete. 2024-04-17T19:53:32.980 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-17T19:53:33.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.141+0000 7fb43e521640 1 Processor -- start 2024-04-17T19:53:33.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.141+0000 7fb43e521640 1 -- start start 2024-04-17T19:53:33.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.141+0000 7fb43e521640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb4381429f0 0x7fb438073080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:33.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.141+0000 7fb43e521640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb4380735c0 0x7fb438159380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:33.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.141+0000 7fb43e521640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4380739d0 con 0x7fb4381598c0 2024-04-17T19:53:33.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.141+0000 7fb43e521640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fb43815fdd0 con 0x7fb4381429f0 2024-04-17T19:53:33.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.141+0000 7fb43e521640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7fb4381600b0 con 0x7fb4380735c0 2024-04-17T19:53:33.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.141+0000 7fb437fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb4381429f0 0x7fb438073080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:33.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.141+0000 7fb437fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb4381429f0 0x7fb438073080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50322/0 (socket says 172.21.15.18:50322) 2024-04-17T19:53:33.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.141+0000 7fb437fff640 1 -- 172.21.15.18:0/1777675103 learned_addr learned my addr 172.21.15.18:0/1777675103 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:33.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.141+0000 7fb4377fe640 1 --2- 172.21.15.18:0/1777675103 >> v2:172.21.15.173:3300/0 conn(0x7fb4380735c0 0x7fb438159380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:33.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.141+0000 7fb437fff640 1 -- 172.21.15.18:0/1777675103 >> v2:172.21.15.173:3300/0 conn(0x7fb4380735c0 msgr2=0x7fb438159380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:33.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.141+0000 7fb437fff640 1 --2- 172.21.15.18:0/1777675103 >> v2:172.21.15.173:3300/0 conn(0x7fb4380735c0 0x7fb438159380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:33.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.141+0000 7fb437fff640 1 -- 172.21.15.18:0/1777675103 >> v1:172.21.15.173:6789/0 conn(0x7fb4381598c0 legacy=0x7fb4380b47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:33.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.141+0000 7fb437fff640 1 -- 172.21.15.18:0/1777675103 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb438160390 con 0x7fb4381429f0 2024-04-17T19:53:33.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.145+0000 7fb437fff640 1 --2- 172.21.15.18:0/1777675103 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4381429f0 0x7fb438073080 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb4380745c0 tx=0x7fb42801c270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94bc3e955272fbd3 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:33.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.145+0000 7fb436ffd640 1 -- 172.21.15.18:0/1777675103 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4280b0070 con 0x7fb4381429f0 2024-04-17T19:53:33.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.145+0000 7fb436ffd640 1 -- 172.21.15.18:0/1777675103 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4280ab600 con 0x7fb4381429f0 2024-04-17T19:53:33.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.145+0000 7fb436ffd640 1 -- 172.21.15.18:0/1777675103 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4280ab9d0 con 0x7fb4381429f0 2024-04-17T19:53:33.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.145+0000 7fb43e521640 1 -- 172.21.15.18:0/1777675103 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4381429f0 msgr2=0x7fb438073080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:33.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.145+0000 7fb43e521640 1 --2- 172.21.15.18:0/1777675103 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4381429f0 0x7fb438073080 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb4380745c0 tx=0x7fb42801c270 comp rx=0 tx=0).stop 2024-04-17T19:53:33.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.145+0000 7fb43e521640 1 -- 172.21.15.18:0/1777675103 shutdown_connections 2024-04-17T19:53:33.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.145+0000 7fb43e521640 1 --2- 172.21.15.18:0/1777675103 >> v2:172.21.15.173:3300/0 conn(0x7fb4380735c0 0x7fb438159380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:33.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.145+0000 7fb43e521640 1 --2- 172.21.15.18:0/1777675103 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4381429f0 0x7fb438073080 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:33.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.145+0000 7fb43e521640 1 -- 172.21.15.18:0/1777675103 >> 172.21.15.18:0/1777675103 conn(0x7fb4380b38c0 msgr2=0x7fb4380d12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:33.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.145+0000 7fb43e521640 1 -- 172.21.15.18:0/1777675103 shutdown_connections 2024-04-17T19:53:33.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.145+0000 7fb43e521640 1 -- 172.21.15.18:0/1777675103 wait complete. 2024-04-17T19:53:33.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.149+0000 7fb43e521640 1 Processor -- start 2024-04-17T19:53:33.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.149+0000 7fb43e521640 1 -- start start 2024-04-17T19:53:33.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.149+0000 7fb43e521640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4380735c0 0x7fb438147370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:33.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.149+0000 7fb43e521640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb4381429f0 0x7fb438140a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:33.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.149+0000 7fb43e521640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb4381598c0 0x7fb438140fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:33.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.149+0000 7fb43e521640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb438163660 con 0x7fb4380735c0 2024-04-17T19:53:33.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.149+0000 7fb43e521640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb438142e00 con 0x7fb4381598c0 2024-04-17T19:53:33.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.149+0000 7fb43e521640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fb4381637e0 con 0x7fb4381429f0 2024-04-17T19:53:33.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.149+0000 7fb437fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4380735c0 0x7fb438147370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:33.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.149+0000 7fb437fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4380735c0 0x7fb438147370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50326/0 (socket says 172.21.15.18:50326) 2024-04-17T19:53:33.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.149+0000 7fb437fff640 1 -- 172.21.15.18:0/295353511 learned_addr learned my addr 172.21.15.18:0/295353511 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:33.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.149+0000 7fb43cabe640 1 --2- 172.21.15.18:0/295353511 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb4381598c0 0x7fb438140fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:33.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.149+0000 7fb437fff640 1 -- 172.21.15.18:0/295353511 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb4381429f0 msgr2=0x7fb438140a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:33.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.149+0000 7fb437fff640 1 --2- 172.21.15.18:0/295353511 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb4381429f0 0x7fb438140a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:33.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.149+0000 7fb437fff640 1 -- 172.21.15.18:0/295353511 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb4381598c0 msgr2=0x7fb438140fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:33.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.149+0000 7fb437fff640 1 --2- 172.21.15.18:0/295353511 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb4381598c0 0x7fb438140fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:33.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.149+0000 7fb437fff640 1 -- 172.21.15.18:0/295353511 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4381478b0 con 0x7fb4380735c0 2024-04-17T19:53:33.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.149+0000 7fb43cabe640 1 --2- 172.21.15.18:0/295353511 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb4381598c0 0x7fb438140fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:53:33.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.149+0000 7fb437fff640 1 --2- 172.21.15.18:0/295353511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4380735c0 0x7fb438147370 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb42801a920 tx=0x7fb42801aab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:33.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.149+0000 7fb434ff9640 1 -- 172.21.15.18:0/295353511 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4280b0040 con 0x7fb4380735c0 2024-04-17T19:53:33.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.149+0000 7fb434ff9640 1 -- 172.21.15.18:0/295353511 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4280bc070 con 0x7fb4380735c0 2024-04-17T19:53:33.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.149+0000 7fb43e521640 1 -- 172.21.15.18:0/295353511 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb438144c20 con 0x7fb4380735c0 2024-04-17T19:53:33.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.149+0000 7fb434ff9640 1 -- 172.21.15.18:0/295353511 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4280b6880 con 0x7fb4380735c0 2024-04-17T19:53:33.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.149+0000 7fb43e521640 1 -- 172.21.15.18:0/295353511 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4381451e0 con 0x7fb4380735c0 2024-04-17T19:53:33.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.153+0000 7fb43e521640 1 -- 172.21.15.18:0/295353511 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb438146d20 con 0x7fb4380735c0 2024-04-17T19:53:33.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.153+0000 7fb434ff9640 1 -- 172.21.15.18:0/295353511 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb4280ab480 con 0x7fb4380735c0 2024-04-17T19:53:33.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.153+0000 7fb434ff9640 1 --2- 172.21.15.18:0/295353511 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fb4180683b0 0x7fb41806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:33.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.153+0000 7fb434ff9640 1 -- 172.21.15.18:0/295353511 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fb428120ec0 con 0x7fb4380735c0 2024-04-17T19:53:33.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.153+0000 7fb4377fe640 1 --2- 172.21.15.18:0/295353511 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fb4180683b0 0x7fb41806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:33.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.153+0000 7fb4377fe640 1 --2- 172.21.15.18:0/295353511 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fb4180683b0 0x7fb41806a8c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb438142620 tx=0x7fb420008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:33.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.157+0000 7fb434ff9640 1 -- 172.21.15.18:0/295353511 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb4380739d0 con 0x7fb4380735c0 2024-04-17T19:53:33.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.317+0000 7fb43e521640 1 -- 172.21.15.18:0/295353511 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb438069950 con 0x7fb4380735c0 2024-04-17T19:53:33.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.317+0000 7fb434ff9640 1 -- 172.21.15.18:0/295353511 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7fb4280f11d0 con 0x7fb4380735c0 2024-04-17T19:53:33.315 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-17T19:53:33.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.321+0000 7fb43e521640 1 -- 172.21.15.18:0/295353511 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fb4180683b0 msgr2=0x7fb41806a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:33.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.321+0000 7fb43e521640 1 --2- 172.21.15.18:0/295353511 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fb4180683b0 0x7fb41806a8c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb438142620 tx=0x7fb420008040 comp rx=0 tx=0).stop 2024-04-17T19:53:33.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.321+0000 7fb43e521640 1 -- 172.21.15.18:0/295353511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4380735c0 msgr2=0x7fb438147370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:33.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.321+0000 7fb43e521640 1 --2- 172.21.15.18:0/295353511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4380735c0 0x7fb438147370 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb42801a920 tx=0x7fb42801aab0 comp rx=0 tx=0).stop 2024-04-17T19:53:33.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.321+0000 7fb43e521640 1 -- 172.21.15.18:0/295353511 shutdown_connections 2024-04-17T19:53:33.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.321+0000 7fb43e521640 1 --2- 172.21.15.18:0/295353511 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fb4180683b0 0x7fb41806a8c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:33.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.321+0000 7fb43e521640 1 --2- 172.21.15.18:0/295353511 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb4381598c0 0x7fb438140fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:33.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.321+0000 7fb43e521640 1 --2- 172.21.15.18:0/295353511 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb4381429f0 0x7fb438140a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:33.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.321+0000 7fb43e521640 1 --2- 172.21.15.18:0/295353511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4380735c0 0x7fb438147370 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:33.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.321+0000 7fb43e521640 1 -- 172.21.15.18:0/295353511 >> 172.21.15.18:0/295353511 conn(0x7fb4380b38c0 msgr2=0x7fb43806f850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:33.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.321+0000 7fb43e521640 1 -- 172.21.15.18:0/295353511 shutdown_connections 2024-04-17T19:53:33.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.321+0000 7fb43e521640 1 -- 172.21.15.18:0/295353511 wait complete. 2024-04-17T19:53:33.337 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-17T19:53:33.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.497+0000 7f8433eb7640 1 Processor -- start 2024-04-17T19:53:33.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.497+0000 7f8433eb7640 1 -- start start 2024-04-17T19:53:33.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.497+0000 7f8433eb7640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f842c0cd260 0x7f842c16b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:33.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.497+0000 7f8433eb7640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f842c0cf180 con 0x7f842c0b6f60 2024-04-17T19:53:33.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.497+0000 7f8433eb7640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f842c0b33e0 con 0x7f842c0ced70 2024-04-17T19:53:33.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.497+0000 7f8433eb7640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f842c0b2c70 con 0x7f842c0cd260 2024-04-17T19:53:33.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.497+0000 7f8431452640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f842c0b6f60 0x7f842c0ccb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:51316/0 (socket says 172.21.15.18:51316) 2024-04-17T19:53:33.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.497+0000 7f8431452640 1 -- 172.21.15.18:0/180684141 learned_addr learned my addr 172.21.15.18:0/180684141 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:33.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.497+0000 7f8432454640 1 --2- 172.21.15.18:0/180684141 >> v2:172.21.15.173:3300/0 conn(0x7f842c0cd260 0x7f842c16b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:33.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.501+0000 7f8430c51640 1 -- 172.21.15.18:0/180684141 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2216181930 0 0) 0x7f841c001120 con 0x7f842c0b6f60 2024-04-17T19:53:33.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.501+0000 7f8430c51640 1 -- 172.21.15.18:0/180684141 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8418003530 con 0x7f842c0b6f60 2024-04-17T19:53:33.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.501+0000 7f8430c51640 1 -- 172.21.15.18:0/180684141 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1742068760 0 0) 0x7f8418003530 con 0x7f842c0b6f60 2024-04-17T19:53:33.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.501+0000 7f8430c51640 1 -- 172.21.15.18:0/180684141 >> v2:172.21.15.173:3300/0 conn(0x7f842c0cd260 msgr2=0x7f842c16b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:33.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.501+0000 7f8430c51640 1 --2- 172.21.15.18:0/180684141 >> v2:172.21.15.173:3300/0 conn(0x7f842c0cd260 0x7f842c16b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:33.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.501+0000 7f8430c51640 1 -- 172.21.15.18:0/180684141 >> v1:172.21.15.173:6789/0 conn(0x7f842c0ced70 legacy=0x7f842c0b6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:33.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.501+0000 7f8430c51640 1 -- 172.21.15.18:0/180684141 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f842c0b0db0 con 0x7f842c0b6f60 2024-04-17T19:53:33.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.501+0000 7f8430c51640 1 -- 172.21.15.18:0/180684141 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3208559991 0 0) 0x7f841c001850 con 0x7f842c0b6f60 2024-04-17T19:53:33.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.501+0000 7f8430c51640 1 -- 172.21.15.18:0/180684141 >> v1:172.21.15.18:6789/0 conn(0x7f842c0b6f60 legacy=0x7f842c0ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:33.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.501+0000 7f8430c51640 1 --2- 172.21.15.18:0/180684141 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84180039c0 0x7f8418003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:33.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.501+0000 7f8430c51640 1 --2- 172.21.15.18:0/180684141 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8418004810 0x7f8418004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:33.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.501+0000 7f8430c51640 1 --2- 172.21.15.18:0/180684141 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84180051d0 0x7f841800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:33.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.501+0000 7f8430c51640 1 -- 172.21.15.18:0/180684141 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f842c0b2c70 con 0x7f84180051d0 2024-04-17T19:53:33.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.501+0000 7f8430c51640 1 -- 172.21.15.18:0/180684141 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f841800c170 con 0x7f84180039c0 2024-04-17T19:53:33.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.501+0000 7f8430c51640 1 -- 172.21.15.18:0/180684141 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f841800c370 con 0x7f8418004810 2024-04-17T19:53:33.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.501+0000 7f8432454640 1 --2- 172.21.15.18:0/180684141 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84180051d0 0x7f841800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:33.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.501+0000 7f8431452640 1 --2- 172.21.15.18:0/180684141 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8418004810 0x7f8418004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:33.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.501+0000 7f8431c53640 1 --2- 172.21.15.18:0/180684141 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84180039c0 0x7f8418003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:33.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.501+0000 7f8432454640 1 -- 172.21.15.18:0/180684141 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8418004810 msgr2=0x7f8418004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:33.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.501+0000 7f8432454640 1 --2- 172.21.15.18:0/180684141 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8418004810 0x7f8418004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:33.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.501+0000 7f8432454640 1 -- 172.21.15.18:0/180684141 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84180039c0 msgr2=0x7f8418003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:33.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.501+0000 7f8432454640 1 --2- 172.21.15.18:0/180684141 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84180039c0 0x7f8418003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:33.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.501+0000 7f8432454640 1 -- 172.21.15.18:0/180684141 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8418003530 con 0x7f84180051d0 2024-04-17T19:53:33.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.501+0000 7f8431c53640 1 --2- 172.21.15.18:0/180684141 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84180039c0 0x7f8418003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:53:33.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.501+0000 7f8432454640 1 -- 172.21.15.18:0/180684141 reap_dead start 2024-04-17T19:53:33.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.501+0000 7f8432454640 1 --2- 172.21.15.18:0/180684141 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84180051d0 0x7f841800b9d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8424009fc0 tx=0x7f842401cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=708ac08408a0edd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:33.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.501+0000 7f8430c51640 1 -- 172.21.15.18:0/180684141 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8424009c10 con 0x7f84180051d0 2024-04-17T19:53:33.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.501+0000 7f8430c51640 1 -- 172.21.15.18:0/180684141 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84240a5c50 con 0x7f84180051d0 2024-04-17T19:53:33.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.501+0000 7f8430c51640 1 -- 172.21.15.18:0/180684141 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84240039a0 con 0x7f84180051d0 2024-04-17T19:53:33.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.501+0000 7f8433eb7640 1 -- 172.21.15.18:0/180684141 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84180051d0 msgr2=0x7f841800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:33.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.501+0000 7f8433eb7640 1 --2- 172.21.15.18:0/180684141 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84180051d0 0x7f841800b9d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8424009fc0 tx=0x7f842401cc00 comp rx=0 tx=0).stop 2024-04-17T19:53:33.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.501+0000 7f8433eb7640 1 -- 172.21.15.18:0/180684141 shutdown_connections 2024-04-17T19:53:33.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.501+0000 7f8433eb7640 1 --2- 172.21.15.18:0/180684141 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84180051d0 0x7f841800b9d0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:33.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.501+0000 7f8433eb7640 1 -- 172.21.15.18:0/180684141 >> 172.21.15.18:0/180684141 conn(0x7f842c09aa70 msgr2=0x7f842c09ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:33.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.501+0000 7f8433eb7640 1 -- 172.21.15.18:0/180684141 shutdown_connections 2024-04-17T19:53:33.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.501+0000 7f8433eb7640 1 -- 172.21.15.18:0/180684141 wait complete. 2024-04-17T19:53:33.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.505+0000 7f8433eb7640 1 Processor -- start 2024-04-17T19:53:33.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.505+0000 7f8433eb7640 1 -- start start 2024-04-17T19:53:33.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.505+0000 7f8433eb7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84180051d0 0x7f842c1570d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:33.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.505+0000 7f8433eb7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f842c0cb8e0 0x7f842c06d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:33.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.505+0000 7f8433eb7640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f842c0cbcf0 0x7f842c06db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:33.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.505+0000 7f8433eb7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f842c0cf360 con 0x7f842c0cb8e0 2024-04-17T19:53:33.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.505+0000 7f8433eb7640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f842c0ce4d0 con 0x7f84180051d0 2024-04-17T19:53:33.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.505+0000 7f8433eb7640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f842c0b2ec0 con 0x7f842c0cbcf0 2024-04-17T19:53:33.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.505+0000 7f8431452640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f842c0cb8e0 0x7f842c06d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:33.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.505+0000 7f8431452640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f842c0cb8e0 0x7f842c06d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50348/0 (socket says 172.21.15.18:50348) 2024-04-17T19:53:33.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.505+0000 7f8431452640 1 -- 172.21.15.18:0/3109894416 learned_addr learned my addr 172.21.15.18:0/3109894416 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:33.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.505+0000 7f8431c53640 1 --2- 172.21.15.18:0/3109894416 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84180051d0 0x7f842c1570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:33.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.505+0000 7f8432454640 1 --2- 172.21.15.18:0/3109894416 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f842c0cbcf0 0x7f842c06db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:33.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.505+0000 7f8431452640 1 -- 172.21.15.18:0/3109894416 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f842c0cbcf0 msgr2=0x7f842c06db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:33.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.505+0000 7f8431452640 1 --2- 172.21.15.18:0/3109894416 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f842c0cbcf0 0x7f842c06db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:33.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.505+0000 7f8431452640 1 -- 172.21.15.18:0/3109894416 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84180051d0 msgr2=0x7f842c1570d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:33.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.505+0000 7f8431452640 1 --2- 172.21.15.18:0/3109894416 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84180051d0 0x7f842c1570d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:33.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.505+0000 7f8431452640 1 -- 172.21.15.18:0/3109894416 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f842c1f5560 con 0x7f842c0cb8e0 2024-04-17T19:53:33.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.505+0000 7f8431c53640 1 --2- 172.21.15.18:0/3109894416 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84180051d0 0x7f842c1570d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:53:33.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.505+0000 7f8432454640 1 --2- 172.21.15.18:0/3109894416 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f842c0cbcf0 0x7f842c06db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:53:33.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.505+0000 7f8431452640 1 --2- 172.21.15.18:0/3109894416 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f842c0cb8e0 0x7f842c06d630 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f841c00e7b0 tx=0x7f841c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:33.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.505+0000 7f84227fc640 1 -- 172.21.15.18:0/3109894416 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841c00ee60 con 0x7f842c0cb8e0 2024-04-17T19:53:33.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.505+0000 7f84227fc640 1 -- 172.21.15.18:0/3109894416 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f841c018070 con 0x7f842c0cb8e0 2024-04-17T19:53:33.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.505+0000 7f8433eb7640 1 -- 172.21.15.18:0/3109894416 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f842c1f5840 con 0x7f842c0cb8e0 2024-04-17T19:53:33.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.505+0000 7f84227fc640 1 -- 172.21.15.18:0/3109894416 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841c00caf0 con 0x7f842c0cb8e0 2024-04-17T19:53:33.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.505+0000 7f8433eb7640 1 -- 172.21.15.18:0/3109894416 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f842c1f5e00 con 0x7f842c0cb8e0 2024-04-17T19:53:33.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.509+0000 7f8433eb7640 1 -- 172.21.15.18:0/3109894416 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f842c1f52d0 con 0x7f842c0cb8e0 2024-04-17T19:53:33.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.509+0000 7f84227fc640 1 -- 172.21.15.18:0/3109894416 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f841c00cc90 con 0x7f842c0cb8e0 2024-04-17T19:53:33.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.509+0000 7f84227fc640 1 --2- 172.21.15.18:0/3109894416 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f8410068380 0x7f841006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:33.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.509+0000 7f84227fc640 1 -- 172.21.15.18:0/3109894416 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f841c086bf0 con 0x7f842c0cb8e0 2024-04-17T19:53:33.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.509+0000 7f8431c53640 1 --2- 172.21.15.18:0/3109894416 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f8410068380 0x7f841006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:33.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.509+0000 7f8431c53640 1 --2- 172.21.15.18:0/3109894416 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f8410068380 0x7f841006a890 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8428000f70 tx=0x7f8428009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:33.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.513+0000 7f84227fc640 1 -- 172.21.15.18:0/3109894416 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f842c0cf180 con 0x7f842c0cb8e0 2024-04-17T19:53:33.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.681+0000 7f8433eb7640 1 -- 172.21.15.18:0/3109894416 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f842c069950 con 0x7f842c0cb8e0 2024-04-17T19:53:33.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.681+0000 7f84227fc640 1 -- 172.21.15.18:0/3109894416 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f841c056de0 con 0x7f842c0cb8e0 2024-04-17T19:53:33.677 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-17T19:53:33.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.681+0000 7f8433eb7640 1 -- 172.21.15.18:0/3109894416 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f8410068380 msgr2=0x7f841006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:33.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.681+0000 7f8433eb7640 1 --2- 172.21.15.18:0/3109894416 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f8410068380 0x7f841006a890 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8428000f70 tx=0x7f8428009040 comp rx=0 tx=0).stop 2024-04-17T19:53:33.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.681+0000 7f8433eb7640 1 -- 172.21.15.18:0/3109894416 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f842c0cb8e0 msgr2=0x7f842c06d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:33.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.681+0000 7f8433eb7640 1 --2- 172.21.15.18:0/3109894416 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f842c0cb8e0 0x7f842c06d630 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f841c00e7b0 tx=0x7f841c00ec70 comp rx=0 tx=0).stop 2024-04-17T19:53:33.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.681+0000 7f8433eb7640 1 -- 172.21.15.18:0/3109894416 shutdown_connections 2024-04-17T19:53:33.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.681+0000 7f8433eb7640 1 --2- 172.21.15.18:0/3109894416 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f8410068380 0x7f841006a890 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:33.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.681+0000 7f8433eb7640 1 --2- 172.21.15.18:0/3109894416 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f842c0cbcf0 0x7f842c06db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:33.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.681+0000 7f8433eb7640 1 --2- 172.21.15.18:0/3109894416 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f842c0cb8e0 0x7f842c06d630 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:33.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.681+0000 7f8433eb7640 1 --2- 172.21.15.18:0/3109894416 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84180051d0 0x7f842c1570d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:33.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.681+0000 7f8433eb7640 1 -- 172.21.15.18:0/3109894416 >> 172.21.15.18:0/3109894416 conn(0x7f842c09aa70 msgr2=0x7f842c0d1420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:33.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.681+0000 7f8433eb7640 1 -- 172.21.15.18:0/3109894416 shutdown_connections 2024-04-17T19:53:33.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.681+0000 7f8433eb7640 1 -- 172.21.15.18:0/3109894416 wait complete. 2024-04-17T19:53:33.698 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-17T19:53:33.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.849+0000 7f8424141640 1 Processor -- start 2024-04-17T19:53:33.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.849+0000 7f8424141640 1 -- start start 2024-04-17T19:53:33.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.849+0000 7f8424141640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f841c15e910 0x7f841c15ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:33.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.849+0000 7f8424141640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f841c06cd60 0x7f841c06d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:33.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.849+0000 7f8424141640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f841c06d6b0 con 0x7f841c15e1a0 2024-04-17T19:53:33.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.849+0000 7f8424141640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f841c0d0020 con 0x7f841c06cd60 2024-04-17T19:53:33.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.849+0000 7f8424141640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f841c0cd930 con 0x7f841c15e910 2024-04-17T19:53:33.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.849+0000 7f84216dc640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f841c15e910 0x7f841c15ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:33.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.849+0000 7f84226de640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f841c06cd60 0x7f841c06d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:33.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.849+0000 7f84216dc640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f841c15e910 0x7f841c15ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.18:60902/0 (socket says 172.21.15.18:60902) 2024-04-17T19:53:33.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.849+0000 7f84216dc640 1 -- 172.21.15.18:0/3679640391 learned_addr learned my addr 172.21.15.18:0/3679640391 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:33.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.849+0000 7f8421edd640 1 --1- 172.21.15.18:0/3679640391 >> v1:172.21.15.173:6789/0 conn(0x7f841c15e1a0 0x7f841c0ce9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.18:33588/0 (socket says 172.21.15.18:33588) 2024-04-17T19:53:33.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.853+0000 7f84216dc640 1 -- 172.21.15.18:0/3679640391 >> v2:172.21.15.173:3300/0 conn(0x7f841c06cd60 msgr2=0x7f841c06d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:33.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.853+0000 7f84216dc640 1 --2- 172.21.15.18:0/3679640391 >> v2:172.21.15.173:3300/0 conn(0x7f841c06cd60 0x7f841c06d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:33.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.853+0000 7f84216dc640 1 -- 172.21.15.18:0/3679640391 >> v1:172.21.15.173:6789/0 conn(0x7f841c15e1a0 legacy=0x7f841c0ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:33.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.853+0000 7f84216dc640 1 -- 172.21.15.18:0/3679640391 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f841c0cdc10 con 0x7f841c15e910 2024-04-17T19:53:33.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.853+0000 7f84216dc640 1 --2- 172.21.15.18:0/3679640391 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f841c15e910 0x7f841c15ed20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f840c009870 tx=0x7f840c01c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37c2b76dc2270c4b server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:33.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.853+0000 7f8420edb640 1 -- 172.21.15.18:0/3679640391 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f840c0b1070 con 0x7f841c15e910 2024-04-17T19:53:33.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.853+0000 7f8420edb640 1 -- 172.21.15.18:0/3679640391 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f840c0ac620 con 0x7f841c15e910 2024-04-17T19:53:33.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.853+0000 7f8420edb640 1 -- 172.21.15.18:0/3679640391 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f840c0ac9f0 con 0x7f841c15e910 2024-04-17T19:53:33.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.853+0000 7f8424141640 1 -- 172.21.15.18:0/3679640391 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f841c15e910 msgr2=0x7f841c15ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:33.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.853+0000 7f8424141640 1 --2- 172.21.15.18:0/3679640391 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f841c15e910 0x7f841c15ed20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f840c009870 tx=0x7f840c01c4d0 comp rx=0 tx=0).stop 2024-04-17T19:53:33.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.853+0000 7f8424141640 1 -- 172.21.15.18:0/3679640391 shutdown_connections 2024-04-17T19:53:33.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.853+0000 7f8424141640 1 --2- 172.21.15.18:0/3679640391 >> v2:172.21.15.173:3300/0 conn(0x7f841c06cd60 0x7f841c06d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:33.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.853+0000 7f8424141640 1 --2- 172.21.15.18:0/3679640391 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f841c15e910 0x7f841c15ed20 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:33.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.853+0000 7f8424141640 1 -- 172.21.15.18:0/3679640391 >> 172.21.15.18:0/3679640391 conn(0x7f841c072bb0 msgr2=0x7f841c072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:33.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.857+0000 7f8424141640 1 -- 172.21.15.18:0/3679640391 shutdown_connections 2024-04-17T19:53:33.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.857+0000 7f8424141640 1 -- 172.21.15.18:0/3679640391 wait complete. 2024-04-17T19:53:33.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.857+0000 7f8424141640 1 Processor -- start 2024-04-17T19:53:33.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.857+0000 7f8424141640 1 -- start start 2024-04-17T19:53:33.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.857+0000 7f8424141640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f841c06cd60 0x7f841c0af550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:33.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.857+0000 7f8424141640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f841c15e1a0 0x7f841c1558d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:33.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.857+0000 7f8424141640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f841c15e910 0x7f841c14c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:33.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.857+0000 7f8424141640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f841c15e730 con 0x7f841c06cd60 2024-04-17T19:53:33.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.857+0000 7f8424141640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f841c15e5b0 con 0x7f841c15e910 2024-04-17T19:53:33.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.857+0000 7f8424141640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f841c0cf0e0 con 0x7f841c15e1a0 2024-04-17T19:53:33.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.857+0000 7f8421edd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f841c06cd60 0x7f841c0af550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:33.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.857+0000 7f8421edd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f841c06cd60 0x7f841c0af550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50354/0 (socket says 172.21.15.18:50354) 2024-04-17T19:53:33.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.857+0000 7f8421edd640 1 -- 172.21.15.18:0/2391712436 learned_addr learned my addr 172.21.15.18:0/2391712436 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:33.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.857+0000 7f84226de640 1 --2- 172.21.15.18:0/2391712436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f841c15e910 0x7f841c14c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:33.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.857+0000 7f84216dc640 1 --2- 172.21.15.18:0/2391712436 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f841c15e1a0 0x7f841c1558d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:33.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.857+0000 7f8421edd640 1 -- 172.21.15.18:0/2391712436 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f841c15e1a0 msgr2=0x7f841c1558d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:33.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.857+0000 7f8421edd640 1 --2- 172.21.15.18:0/2391712436 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f841c15e1a0 0x7f841c1558d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:33.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.857+0000 7f8421edd640 1 -- 172.21.15.18:0/2391712436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f841c15e910 msgr2=0x7f841c14c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:33.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.857+0000 7f8421edd640 1 --2- 172.21.15.18:0/2391712436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f841c15e910 0x7f841c14c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:33.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.857+0000 7f8421edd640 1 -- 172.21.15.18:0/2391712436 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f841c1563f0 con 0x7f841c06cd60 2024-04-17T19:53:33.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.857+0000 7f8421edd640 1 --2- 172.21.15.18:0/2391712436 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f841c06cd60 0x7f841c0af550 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f841800c370 tx=0x7f841800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:33.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.861+0000 7f84127fc640 1 -- 172.21.15.18:0/2391712436 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84180074e0 con 0x7f841c06cd60 2024-04-17T19:53:33.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.861+0000 7f84127fc640 1 -- 172.21.15.18:0/2391712436 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8418007680 con 0x7f841c06cd60 2024-04-17T19:53:33.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.861+0000 7f8424141640 1 -- 172.21.15.18:0/2391712436 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f841c158d90 con 0x7f841c06cd60 2024-04-17T19:53:33.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.861+0000 7f84127fc640 1 -- 172.21.15.18:0/2391712436 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8418004a30 con 0x7f841c06cd60 2024-04-17T19:53:33.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.861+0000 7f8424141640 1 -- 172.21.15.18:0/2391712436 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f841c159310 con 0x7f841c06cd60 2024-04-17T19:53:33.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.861+0000 7f8424141640 1 -- 172.21.15.18:0/2391712436 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f841c069950 con 0x7f841c06cd60 2024-04-17T19:53:33.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.861+0000 7f84127fc640 1 -- 172.21.15.18:0/2391712436 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f841801a020 con 0x7f841c06cd60 2024-04-17T19:53:33.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.861+0000 7f84127fc640 1 --2- 172.21.15.18:0/2391712436 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f8400068380 0x7f840006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:33.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.861+0000 7f84127fc640 1 -- 172.21.15.18:0/2391712436 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f84180863f0 con 0x7f841c06cd60 2024-04-17T19:53:33.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.861+0000 7f84216dc640 1 --2- 172.21.15.18:0/2391712436 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f8400068380 0x7f840006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:33.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.861+0000 7f84216dc640 1 --2- 172.21.15.18:0/2391712436 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f8400068380 0x7f840006a890 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f840c0ae000 tx=0x7f840c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:33.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:33.865+0000 7f84127fc640 1 -- 172.21.15.18:0/2391712436 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f841c158d90 con 0x7f841c06cd60 2024-04-17T19:53:34.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.029+0000 7f8424141640 1 -- 172.21.15.18:0/2391712436 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f841c158470 con 0x7f841c06cd60 2024-04-17T19:53:34.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.029+0000 7f84127fc640 1 -- 172.21.15.18:0/2391712436 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f841c06d6b0 con 0x7f841c06cd60 2024-04-17T19:53:34.027 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-17T19:53:34.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.033+0000 7f8424141640 1 -- 172.21.15.18:0/2391712436 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f8400068380 msgr2=0x7f840006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:34.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.033+0000 7f8424141640 1 --2- 172.21.15.18:0/2391712436 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f8400068380 0x7f840006a890 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f840c0ae000 tx=0x7f840c008040 comp rx=0 tx=0).stop 2024-04-17T19:53:34.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.033+0000 7f8424141640 1 -- 172.21.15.18:0/2391712436 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f841c06cd60 msgr2=0x7f841c0af550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:34.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.033+0000 7f8424141640 1 --2- 172.21.15.18:0/2391712436 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f841c06cd60 0x7f841c0af550 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f841800c370 tx=0x7f841800c830 comp rx=0 tx=0).stop 2024-04-17T19:53:34.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.033+0000 7f8424141640 1 -- 172.21.15.18:0/2391712436 shutdown_connections 2024-04-17T19:53:34.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.033+0000 7f8424141640 1 --2- 172.21.15.18:0/2391712436 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f8400068380 0x7f840006a890 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:34.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.033+0000 7f8424141640 1 --2- 172.21.15.18:0/2391712436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f841c15e910 0x7f841c14c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:34.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.033+0000 7f8424141640 1 --2- 172.21.15.18:0/2391712436 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f841c15e1a0 0x7f841c1558d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:34.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.033+0000 7f8424141640 1 --2- 172.21.15.18:0/2391712436 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f841c06cd60 0x7f841c0af550 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:34.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.033+0000 7f8424141640 1 -- 172.21.15.18:0/2391712436 >> 172.21.15.18:0/2391712436 conn(0x7f841c072bb0 msgr2=0x7f841c0b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:34.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.033+0000 7f8424141640 1 -- 172.21.15.18:0/2391712436 shutdown_connections 2024-04-17T19:53:34.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.033+0000 7f8424141640 1 -- 172.21.15.18:0/2391712436 wait complete. 2024-04-17T19:53:34.048 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T19:53:34.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.189+0000 7ff20681c640 1 Processor -- start 2024-04-17T19:53:34.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.189+0000 7ff20681c640 1 -- start start 2024-04-17T19:53:34.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.193+0000 7ff20681c640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff2000d4330 0x7ff2000cfb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:34.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.193+0000 7ff20681c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff2000d0060 0x7ff2000b82f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:34.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.193+0000 7ff20681c640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2000d0470 con 0x7ff2000d37c0 2024-04-17T19:53:34.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.193+0000 7ff20681c640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7ff20006c1e0 con 0x7ff2000d0060 2024-04-17T19:53:34.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.193+0000 7ff20681c640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7ff20006c4c0 con 0x7ff2000d4330 2024-04-17T19:53:34.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.193+0000 7ff204db9640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff2000d0060 0x7ff2000b82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:34.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.193+0000 7ff204db9640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff2000d0060 0x7ff2000b82f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50356/0 (socket says 172.21.15.18:50356) 2024-04-17T19:53:34.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.193+0000 7ff204db9640 1 -- 172.21.15.18:0/3244154825 learned_addr learned my addr 172.21.15.18:0/3244154825 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:34.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.193+0000 7ff1ff7fe640 1 --2- 172.21.15.18:0/3244154825 >> v2:172.21.15.173:3300/0 conn(0x7ff2000d4330 0x7ff2000cfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:34.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.193+0000 7ff204db9640 1 -- 172.21.15.18:0/3244154825 >> v2:172.21.15.173:3300/0 conn(0x7ff2000d4330 msgr2=0x7ff2000cfb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:34.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.193+0000 7ff204db9640 1 --2- 172.21.15.18:0/3244154825 >> v2:172.21.15.173:3300/0 conn(0x7ff2000d4330 0x7ff2000cfb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:34.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.193+0000 7ff204db9640 1 -- 172.21.15.18:0/3244154825 >> v1:172.21.15.173:6789/0 conn(0x7ff2000d37c0 legacy=0x7ff20006d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:34.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.193+0000 7ff204db9640 1 -- 172.21.15.18:0/3244154825 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff20006c7a0 con 0x7ff2000d0060 2024-04-17T19:53:34.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.197+0000 7ff204db9640 1 --2- 172.21.15.18:0/3244154825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2000d0060 0x7ff2000b82f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff2000d3220 tx=0x7ff1f801c180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59360cbcf225c7bd server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:34.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.197+0000 7ff1feffd640 1 -- 172.21.15.18:0/3244154825 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f80b0070 con 0x7ff2000d0060 2024-04-17T19:53:34.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.197+0000 7ff1feffd640 1 -- 172.21.15.18:0/3244154825 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1f80ab600 con 0x7ff2000d0060 2024-04-17T19:53:34.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.197+0000 7ff1feffd640 1 -- 172.21.15.18:0/3244154825 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f80ab9d0 con 0x7ff2000d0060 2024-04-17T19:53:34.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.197+0000 7ff20681c640 1 -- 172.21.15.18:0/3244154825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2000d0060 msgr2=0x7ff2000b82f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:34.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.197+0000 7ff20681c640 1 --2- 172.21.15.18:0/3244154825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2000d0060 0x7ff2000b82f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff2000d3220 tx=0x7ff1f801c180 comp rx=0 tx=0).stop 2024-04-17T19:53:34.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.197+0000 7ff20681c640 1 -- 172.21.15.18:0/3244154825 shutdown_connections 2024-04-17T19:53:34.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.197+0000 7ff20681c640 1 --2- 172.21.15.18:0/3244154825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2000d0060 0x7ff2000b82f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:34.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.197+0000 7ff20681c640 1 --2- 172.21.15.18:0/3244154825 >> v2:172.21.15.173:3300/0 conn(0x7ff2000d4330 0x7ff2000cfb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:34.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.197+0000 7ff20681c640 1 -- 172.21.15.18:0/3244154825 >> 172.21.15.18:0/3244154825 conn(0x7ff2000b6cd0 msgr2=0x7ff2000b70e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:34.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.197+0000 7ff20681c640 1 -- 172.21.15.18:0/3244154825 shutdown_connections 2024-04-17T19:53:34.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.197+0000 7ff20681c640 1 -- 172.21.15.18:0/3244154825 wait complete. 2024-04-17T19:53:34.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.197+0000 7ff20681c640 1 Processor -- start 2024-04-17T19:53:34.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.197+0000 7ff20681c640 1 -- start start 2024-04-17T19:53:34.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.201+0000 7ff20681c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2000d0060 0x7ff20015fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:34.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.201+0000 7ff20681c640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff2000d37c0 0x7ff2001553a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:34.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.201+0000 7ff20681c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2000d4330 0x7ff2000ca780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:34.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.201+0000 7ff20681c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff20006bed0 con 0x7ff2000d0060 2024-04-17T19:53:34.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.201+0000 7ff20681c640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff20006bd50 con 0x7ff2000d4330 2024-04-17T19:53:34.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.201+0000 7ff20681c640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7ff20015ea30 con 0x7ff2000d37c0 2024-04-17T19:53:34.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.201+0000 7ff1fffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2000d0060 0x7ff20015fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:34.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.201+0000 7ff1fffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2000d0060 0x7ff20015fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50362/0 (socket says 172.21.15.18:50362) 2024-04-17T19:53:34.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.201+0000 7ff1fffff640 1 -- 172.21.15.18:0/2412136590 learned_addr learned my addr 172.21.15.18:0/2412136590 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:34.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.201+0000 7ff204db9640 1 --2- 172.21.15.18:0/2412136590 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2000d4330 0x7ff2000ca780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:34.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.201+0000 7ff1ff7fe640 1 --2- 172.21.15.18:0/2412136590 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff2000d37c0 0x7ff2001553a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:34.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.201+0000 7ff1fffff640 1 -- 172.21.15.18:0/2412136590 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff2000d37c0 msgr2=0x7ff2001553a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:34.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.201+0000 7ff1fffff640 1 --2- 172.21.15.18:0/2412136590 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff2000d37c0 0x7ff2001553a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:34.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.201+0000 7ff1fffff640 1 -- 172.21.15.18:0/2412136590 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2000d4330 msgr2=0x7ff2000ca780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:34.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.201+0000 7ff1fffff640 1 --2- 172.21.15.18:0/2412136590 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2000d4330 0x7ff2000ca780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:34.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.201+0000 7ff1fffff640 1 -- 172.21.15.18:0/2412136590 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2001558e0 con 0x7ff2000d0060 2024-04-17T19:53:34.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.201+0000 7ff204db9640 1 --2- 172.21.15.18:0/2412136590 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2000d4330 0x7ff2000ca780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:53:34.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.201+0000 7ff1fffff640 1 --2- 172.21.15.18:0/2412136590 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2000d0060 0x7ff20015fa80 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff1f000ba80 tx=0x7ff1f000bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:34.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.201+0000 7ff1fcff9640 1 -- 172.21.15.18:0/2412136590 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f000cc00 con 0x7ff2000d0060 2024-04-17T19:53:34.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.201+0000 7ff1fcff9640 1 -- 172.21.15.18:0/2412136590 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1f000cda0 con 0x7ff2000d0060 2024-04-17T19:53:34.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.201+0000 7ff1fcff9640 1 -- 172.21.15.18:0/2412136590 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f0003bc0 con 0x7ff2000d0060 2024-04-17T19:53:34.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.201+0000 7ff20681c640 1 -- 172.21.15.18:0/2412136590 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff200160460 con 0x7ff2000d0060 2024-04-17T19:53:34.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.201+0000 7ff20681c640 1 -- 172.21.15.18:0/2412136590 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff200154ba0 con 0x7ff2000d0060 2024-04-17T19:53:34.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.201+0000 7ff20681c640 1 -- 172.21.15.18:0/2412136590 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff200160980 con 0x7ff2000d0060 2024-04-17T19:53:34.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.201+0000 7ff1fcff9640 1 -- 172.21.15.18:0/2412136590 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff1f0006d10 con 0x7ff2000d0060 2024-04-17T19:53:34.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.205+0000 7ff1fcff9640 1 --2- 172.21.15.18:0/2412136590 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7ff1ec0683b0 0x7ff1ec06a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:34.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.205+0000 7ff1fcff9640 1 -- 172.21.15.18:0/2412136590 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7ff1f00869a0 con 0x7ff2000d0060 2024-04-17T19:53:34.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.205+0000 7ff1ff7fe640 1 --2- 172.21.15.18:0/2412136590 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7ff1ec0683b0 0x7ff1ec06a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:34.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.205+0000 7ff1ff7fe640 1 --2- 172.21.15.18:0/2412136590 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7ff1ec0683b0 0x7ff1ec06a8c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff2001544d0 tx=0x7ff1f4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:34.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.209+0000 7ff1fcff9640 1 -- 172.21.15.18:0/2412136590 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff200160980 con 0x7ff2000d0060 2024-04-17T19:53:34.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.397+0000 7ff20681c640 1 -- 172.21.15.18:0/2412136590 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff200069950 con 0x7ff2000d0060 2024-04-17T19:53:34.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.401+0000 7ff1fcff9640 1 -- 172.21.15.18:0/2412136590 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5177 (secure 0 0 0) 0x7ff1f0056b90 con 0x7ff2000d0060 2024-04-17T19:53:34.396 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:53:34.396 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/729504609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":729504609},{"type":"v1","addr":"172.21.15.173:6833","nonce":729504609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4261,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/3797017174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3797017174},{"type":"v1","addr":"172.21.15.173:6835","nonce":3797017174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/995848920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":995848920},{"type":"v1","addr":"172.21.15.18:6835","nonce":995848920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-17T19:53:04.851226+0000","modified":"2024-04-17T19:53:22.952315+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6837/1926349198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1926349198},{"type":"v1","addr":"172.21.15.18:6837","nonce":1926349198}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1}]} 2024-04-17T19:53:34.397 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 9 2024-04-17T19:53:34.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.401+0000 7ff20681c640 1 -- 172.21.15.18:0/2412136590 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7ff1ec0683b0 msgr2=0x7ff1ec06a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:34.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.401+0000 7ff20681c640 1 --2- 172.21.15.18:0/2412136590 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7ff1ec0683b0 0x7ff1ec06a8c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff2001544d0 tx=0x7ff1f4008040 comp rx=0 tx=0).stop 2024-04-17T19:53:34.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.401+0000 7ff20681c640 1 -- 172.21.15.18:0/2412136590 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2000d0060 msgr2=0x7ff20015fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:34.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.401+0000 7ff20681c640 1 --2- 172.21.15.18:0/2412136590 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2000d0060 0x7ff20015fa80 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff1f000ba80 tx=0x7ff1f000bf40 comp rx=0 tx=0).stop 2024-04-17T19:53:34.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.401+0000 7ff20681c640 1 -- 172.21.15.18:0/2412136590 shutdown_connections 2024-04-17T19:53:34.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.401+0000 7ff20681c640 1 --2- 172.21.15.18:0/2412136590 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7ff1ec0683b0 0x7ff1ec06a8c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:34.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.401+0000 7ff20681c640 1 --2- 172.21.15.18:0/2412136590 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff2000d4330 0x7ff2000ca780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:34.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.401+0000 7ff20681c640 1 --2- 172.21.15.18:0/2412136590 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff2000d37c0 0x7ff2001553a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:34.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.401+0000 7ff20681c640 1 --2- 172.21.15.18:0/2412136590 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2000d0060 0x7ff20015fa80 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:34.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.401+0000 7ff20681c640 1 -- 172.21.15.18:0/2412136590 >> 172.21.15.18:0/2412136590 conn(0x7ff2000b6cd0 msgr2=0x7ff200162f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:34.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.401+0000 7ff20681c640 1 -- 172.21.15.18:0/2412136590 shutdown_connections 2024-04-17T19:53:34.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.401+0000 7ff20681c640 1 -- 172.21.15.18:0/2412136590 wait complete. 2024-04-17T19:53:34.416 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T19:53:34.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.557+0000 7f4961f7f640 1 Processor -- start 2024-04-17T19:53:34.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.557+0000 7f4961f7f640 1 -- start start 2024-04-17T19:53:34.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.557+0000 7f4961f7f640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f495c0cfb20 0x7f495c0cff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:34.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.557+0000 7f4961f7f640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f495c0b53d0 con 0x7f495c06ef30 2024-04-17T19:53:34.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.557+0000 7f4961f7f640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f495c0b56b0 con 0x7f495c15b810 2024-04-17T19:53:34.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.557+0000 7f4961f7f640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f495c0b5990 con 0x7f495c0cfb20 2024-04-17T19:53:34.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.557+0000 7f495bfff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f495c06ef30 0x7f495c06f340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:48036/0 (socket says 172.21.15.18:48036) 2024-04-17T19:53:34.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.557+0000 7f495bfff640 1 -- 172.21.15.18:0/3034239635 learned_addr learned my addr 172.21.15.18:0/3034239635 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:34.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.557+0000 7f495affd640 1 --2- 172.21.15.18:0/3034239635 >> v2:172.21.15.173:3300/0 conn(0x7f495c0cfb20 0x7f495c0cff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:34.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.557+0000 7f495a7fc640 1 -- 172.21.15.18:0/3034239635 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3878202613 0 0) 0x7f495c0b53d0 con 0x7f495c06ef30 2024-04-17T19:53:34.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.557+0000 7f495a7fc640 1 -- 172.21.15.18:0/3034239635 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4944004640 con 0x7f495c06ef30 2024-04-17T19:53:34.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.561+0000 7f495a7fc640 1 -- 172.21.15.18:0/3034239635 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3203427933 0 0) 0x7f4944004640 con 0x7f495c06ef30 2024-04-17T19:53:34.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.561+0000 7f495a7fc640 1 -- 172.21.15.18:0/3034239635 >> v2:172.21.15.173:3300/0 conn(0x7f495c0cfb20 msgr2=0x7f495c0cff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:34.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.561+0000 7f495a7fc640 1 --2- 172.21.15.18:0/3034239635 >> v2:172.21.15.173:3300/0 conn(0x7f495c0cfb20 0x7f495c0cff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:34.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.561+0000 7f495a7fc640 1 -- 172.21.15.18:0/3034239635 >> v1:172.21.15.173:6789/0 conn(0x7f495c15b810 legacy=0x7f495c0cde90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:34.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.561+0000 7f495a7fc640 1 -- 172.21.15.18:0/3034239635 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f495c06ea10 con 0x7f495c06ef30 2024-04-17T19:53:34.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.561+0000 7f495a7fc640 1 -- 172.21.15.18:0/3034239635 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3208559991 0 0) 0x7f4954001a00 con 0x7f495c06ef30 2024-04-17T19:53:34.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.561+0000 7f495a7fc640 1 -- 172.21.15.18:0/3034239635 >> v1:172.21.15.18:6789/0 conn(0x7f495c06ef30 legacy=0x7f495c06f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:34.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.561+0000 7f495a7fc640 1 --2- 172.21.15.18:0/3034239635 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4944004ad0 0x7f4944004f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:34.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.561+0000 7f495a7fc640 1 --2- 172.21.15.18:0/3034239635 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4944005920 0x7f4944005d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:34.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.561+0000 7f495a7fc640 1 --2- 172.21.15.18:0/3034239635 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4944006370 0x7f4944003450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:34.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.561+0000 7f495a7fc640 1 -- 172.21.15.18:0/3034239635 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f495c0b5990 con 0x7f4944004ad0 2024-04-17T19:53:34.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.561+0000 7f495a7fc640 1 -- 172.21.15.18:0/3034239635 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4944003c70 con 0x7f4944006370 2024-04-17T19:53:34.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.561+0000 7f495a7fc640 1 -- 172.21.15.18:0/3034239635 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f4944003e70 con 0x7f4944005920 2024-04-17T19:53:34.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.561+0000 7f495b7fe640 1 --2- 172.21.15.18:0/3034239635 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4944004ad0 0x7f4944004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:34.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.561+0000 7f495bfff640 1 --2- 172.21.15.18:0/3034239635 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4944006370 0x7f4944003450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:34.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.561+0000 7f495affd640 1 --2- 172.21.15.18:0/3034239635 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4944005920 0x7f4944005d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:34.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.561+0000 7f495b7fe640 1 -- 172.21.15.18:0/3034239635 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4944005920 msgr2=0x7f4944005d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:34.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.561+0000 7f495b7fe640 1 --2- 172.21.15.18:0/3034239635 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4944005920 0x7f4944005d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:34.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.561+0000 7f495b7fe640 1 -- 172.21.15.18:0/3034239635 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4944006370 msgr2=0x7f4944003450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:34.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.561+0000 7f495b7fe640 1 --2- 172.21.15.18:0/3034239635 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4944006370 0x7f4944003450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:34.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.561+0000 7f495b7fe640 1 -- 172.21.15.18:0/3034239635 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4944004640 con 0x7f4944004ad0 2024-04-17T19:53:34.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.561+0000 7f495bfff640 1 --2- 172.21.15.18:0/3034239635 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4944006370 0x7f4944003450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:53:34.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.561+0000 7f495bfff640 1 -- 172.21.15.18:0/3034239635 reap_dead start 2024-04-17T19:53:34.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.561+0000 7f495affd640 1 --2- 172.21.15.18:0/3034239635 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4944005920 0x7f4944005d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:53:34.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.565+0000 7f495b7fe640 1 --2- 172.21.15.18:0/3034239635 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4944004ad0 0x7f4944004f40 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f494c001750 tx=0x7f494c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a55b821ca00ae88b server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:34.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.565+0000 7f495a7fc640 1 -- 172.21.15.18:0/3034239635 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494c0013a0 con 0x7f4944004ad0 2024-04-17T19:53:34.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.565+0000 7f495a7fc640 1 -- 172.21.15.18:0/3034239635 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f494c0052f0 con 0x7f4944004ad0 2024-04-17T19:53:34.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.565+0000 7f495a7fc640 1 -- 172.21.15.18:0/3034239635 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494c003840 con 0x7f4944004ad0 2024-04-17T19:53:34.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.565+0000 7f4961f7f640 1 -- 172.21.15.18:0/3034239635 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4944004ad0 msgr2=0x7f4944004f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:34.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.565+0000 7f4961f7f640 1 --2- 172.21.15.18:0/3034239635 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4944004ad0 0x7f4944004f40 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f494c001750 tx=0x7f494c01c3c0 comp rx=0 tx=0).stop 2024-04-17T19:53:34.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.565+0000 7f4961f7f640 1 -- 172.21.15.18:0/3034239635 shutdown_connections 2024-04-17T19:53:34.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.565+0000 7f4961f7f640 1 --2- 172.21.15.18:0/3034239635 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4944004ad0 0x7f4944004f40 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:34.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.565+0000 7f4961f7f640 1 -- 172.21.15.18:0/3034239635 >> 172.21.15.18:0/3034239635 conn(0x7f495c072bb0 msgr2=0x7f495c072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:34.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.565+0000 7f4961f7f640 1 -- 172.21.15.18:0/3034239635 shutdown_connections 2024-04-17T19:53:34.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.565+0000 7f4961f7f640 1 -- 172.21.15.18:0/3034239635 wait complete. 2024-04-17T19:53:34.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.565+0000 7f4961f7f640 1 Processor -- start 2024-04-17T19:53:34.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.565+0000 7f4961f7f640 1 -- start start 2024-04-17T19:53:34.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.569+0000 7f4961f7f640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4944004ad0 0x7f495c1e9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:34.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.569+0000 7f4961f7f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f495c1f55d0 0x7f495c150290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:34.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.569+0000 7f4961f7f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f495c1507d0 0x7f495c1e8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:34.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.569+0000 7f4961f7f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f495c15f650 con 0x7f495c1f55d0 2024-04-17T19:53:34.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.569+0000 7f4961f7f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f495c15f4d0 con 0x7f495c1507d0 2024-04-17T19:53:34.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.569+0000 7f4961f7f640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f495c15f7d0 con 0x7f4944004ad0 2024-04-17T19:53:34.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.569+0000 7f495affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f495c1f55d0 0x7f495c150290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:34.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.569+0000 7f495affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f495c1f55d0 0x7f495c150290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48584/0 (socket says 172.21.15.18:48584) 2024-04-17T19:53:34.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.569+0000 7f495affd640 1 -- 172.21.15.18:0/1619844880 learned_addr learned my addr 172.21.15.18:0/1619844880 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:34.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.569+0000 7f495affd640 1 -- 172.21.15.18:0/1619844880 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4944004ad0 msgr2=0x7f495c1e9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:34.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.569+0000 7f495bfff640 1 --2- 172.21.15.18:0/1619844880 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f495c1507d0 0x7f495c1e8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:34.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.569+0000 7f495b7fe640 1 --2- 172.21.15.18:0/1619844880 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4944004ad0 0x7f495c1e9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:34.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.569+0000 7f495affd640 1 --2- 172.21.15.18:0/1619844880 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4944004ad0 0x7f495c1e9c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:34.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.569+0000 7f495affd640 1 -- 172.21.15.18:0/1619844880 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f495c1507d0 msgr2=0x7f495c1e8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:34.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.569+0000 7f495affd640 1 --2- 172.21.15.18:0/1619844880 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f495c1507d0 0x7f495c1e8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:34.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.569+0000 7f495affd640 1 -- 172.21.15.18:0/1619844880 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f495c14f1f0 con 0x7f495c1f55d0 2024-04-17T19:53:34.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.569+0000 7f495affd640 1 --2- 172.21.15.18:0/1619844880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f495c1f55d0 0x7f495c150290 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4950010790 tx=0x7f4950010c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:34.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.569+0000 7f4943fff640 1 -- 172.21.15.18:0/1619844880 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f495000f040 con 0x7f495c1f55d0 2024-04-17T19:53:34.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.569+0000 7f4943fff640 1 -- 172.21.15.18:0/1619844880 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4950004020 con 0x7f495c1f55d0 2024-04-17T19:53:34.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.569+0000 7f4961f7f640 1 -- 172.21.15.18:0/1619844880 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f495c14f4d0 con 0x7f495c1f55d0 2024-04-17T19:53:34.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.569+0000 7f4943fff640 1 -- 172.21.15.18:0/1619844880 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49500043f0 con 0x7f495c1f55d0 2024-04-17T19:53:34.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.569+0000 7f4961f7f640 1 -- 172.21.15.18:0/1619844880 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f495c14fa90 con 0x7f495c1f55d0 2024-04-17T19:53:34.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.569+0000 7f4961f7f640 1 -- 172.21.15.18:0/1619844880 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f495c14ef60 con 0x7f495c1f55d0 2024-04-17T19:53:34.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.569+0000 7f4943fff640 1 -- 172.21.15.18:0/1619844880 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f495000e960 con 0x7f495c1f55d0 2024-04-17T19:53:34.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.569+0000 7f4943fff640 1 --2- 172.21.15.18:0/1619844880 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f4948068380 0x7f494806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:34.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.569+0000 7f4943fff640 1 -- 172.21.15.18:0/1619844880 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f4950086ee0 con 0x7f495c1f55d0 2024-04-17T19:53:34.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.569+0000 7f495b7fe640 1 --2- 172.21.15.18:0/1619844880 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f4948068380 0x7f494806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:34.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.573+0000 7f495b7fe640 1 --2- 172.21.15.18:0/1619844880 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f4948068380 0x7f494806a890 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f495c0afc10 tx=0x7f494c0011a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:34.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.577+0000 7f4943fff640 1 -- 172.21.15.18:0/1619844880 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4950018030 con 0x7f495c1f55d0 2024-04-17T19:53:34.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.733+0000 7f4961f7f640 1 -- 172.21.15.18:0/1619844880 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f495c069950 con 0x7f495c1f55d0 2024-04-17T19:53:34.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.737+0000 7f4943fff640 1 -- 172.21.15.18:0/1619844880 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18506 (secure 0 0 0) 0x7f49500570c0 con 0x7f495c1f55d0 2024-04-17T19:53:34.735 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:53:34.735 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":27,"fsid":"dd480169-5a81-4623-be5f-0499aa244b28","created":"2024-04-17T19:52:39.533760+0000","modified":"2024-04-17T19:53:09.903922+0000","last_up_change":"2024-04-17T19:52:51.229698+0000","last_in_change":"2024-04-17T19:52:42.144259+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T19:52:52.391648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T19:53:02.734240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T19:53:03.813028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T19:53:07.478812+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e232d577-2508-4ea4-b355-29fbae1ff025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6801","nonce":2323038417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6803","nonce":2323038417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6807","nonce":2323038417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6805","nonce":2323038417}]},"public_addr":"172.21.15.18:6801/2323038417","cluster_addr":"172.21.15.18:6803/2323038417","heartbeat_back_addr":"172.21.15.18:6807/2323038417","heartbeat_front_addr":"172.21.15.18:6805/2323038417","state":["exists","up"]},{"osd":1,"uuid":"31810ef3-2c71-48d6-8748-b74a2968d23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6817","nonce":1283678238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6819","nonce":1283678238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6823","nonce":1283678238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6821","nonce":1283678238}]},"public_addr":"172.21.15.18:6817/1283678238","cluster_addr":"172.21.15.18:6819/1283678238","heartbeat_back_addr":"172.21.15.18:6823/1283678238","heartbeat_front_addr":"172.21.15.18:6821/1283678238","state":["exists","up"]},{"osd":2,"uuid":"5a783cc5-a41c-4967-9e11-6b8330f97d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6809","nonce":1212875862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6811","nonce":1212875862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6815","nonce":1212875862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6813","nonce":1212875862}]},"public_addr":"172.21.15.18:6809/1212875862","cluster_addr":"172.21.15.18:6811/1212875862","heartbeat_back_addr":"172.21.15.18:6815/1212875862","heartbeat_front_addr":"172.21.15.18:6813/1212875862","state":["exists","up"]},{"osd":3,"uuid":"b7e056d9-9da5-46e1-810d-0c3e242fe5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6825","nonce":2428878428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6827","nonce":2428878428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6831","nonce":2428878428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6829","nonce":2428878428}]},"public_addr":"172.21.15.18:6825/2428878428","cluster_addr":"172.21.15.18:6827/2428878428","heartbeat_back_addr":"172.21.15.18:6831/2428878428","heartbeat_front_addr":"172.21.15.18:6829/2428878428","state":["exists","up"]},{"osd":4,"uuid":"21df023f-bc8b-4abb-93e5-0ecc91acda0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6825","nonce":1421511819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6827","nonce":1421511819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6831","nonce":1421511819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6829","nonce":1421511819}]},"public_addr":"172.21.15.173:6825/1421511819","cluster_addr":"172.21.15.173:6827/1421511819","heartbeat_back_addr":"172.21.15.173:6831/1421511819","heartbeat_front_addr":"172.21.15.173:6829/1421511819","state":["exists","up"]},{"osd":5,"uuid":"e270098a-6d33-49f8-84ed-94e09a880cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6801","nonce":4221907702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6803","nonce":4221907702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6807","nonce":4221907702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6805","nonce":4221907702}]},"public_addr":"172.21.15.173:6801/4221907702","cluster_addr":"172.21.15.173:6803/4221907702","heartbeat_back_addr":"172.21.15.173:6807/4221907702","heartbeat_front_addr":"172.21.15.173:6805/4221907702","state":["exists","up"]},{"osd":6,"uuid":"93c67c8c-268d-4e32-877c-043cd3acd87c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6809","nonce":761678552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6811","nonce":761678552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6815","nonce":761678552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6813","nonce":761678552}]},"public_addr":"172.21.15.173:6809/761678552","cluster_addr":"172.21.15.173:6811/761678552","heartbeat_back_addr":"172.21.15.173:6815/761678552","heartbeat_front_addr":"172.21.15.173:6813/761678552","state":["exists","up"]},{"osd":7,"uuid":"faf10eea-80de-40f6-abbb-34d07d3f59ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6817","nonce":383724537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6819","nonce":383724537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6823","nonce":383724537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6821","nonce":383724537}]},"public_addr":"172.21.15.173:6817/383724537","cluster_addr":"172.21.15.173:6819/383724537","heartbeat_back_addr":"172.21.15.173:6823/383724537","heartbeat_front_addr":"172.21.15.173:6821/383724537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.668924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.761747+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.768128+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.632252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.742608+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.734327+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.477107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.818292+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T19:53:34.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.741+0000 7f4961f7f640 1 -- 172.21.15.18:0/1619844880 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f4948068380 msgr2=0x7f494806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:34.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.741+0000 7f4961f7f640 1 --2- 172.21.15.18:0/1619844880 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f4948068380 0x7f494806a890 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f495c0afc10 tx=0x7f494c0011a0 comp rx=0 tx=0).stop 2024-04-17T19:53:34.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.741+0000 7f4961f7f640 1 -- 172.21.15.18:0/1619844880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f495c1f55d0 msgr2=0x7f495c150290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:34.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.741+0000 7f4961f7f640 1 --2- 172.21.15.18:0/1619844880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f495c1f55d0 0x7f495c150290 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4950010790 tx=0x7f4950010c50 comp rx=0 tx=0).stop 2024-04-17T19:53:34.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.741+0000 7f4961f7f640 1 -- 172.21.15.18:0/1619844880 shutdown_connections 2024-04-17T19:53:34.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.741+0000 7f4961f7f640 1 --2- 172.21.15.18:0/1619844880 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f4948068380 0x7f494806a890 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:34.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.741+0000 7f4961f7f640 1 --2- 172.21.15.18:0/1619844880 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f495c1507d0 0x7f495c1e8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:34.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.741+0000 7f4961f7f640 1 --2- 172.21.15.18:0/1619844880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f495c1f55d0 0x7f495c150290 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:34.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.741+0000 7f4961f7f640 1 --2- 172.21.15.18:0/1619844880 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4944004ad0 0x7f495c1e9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:34.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.741+0000 7f4961f7f640 1 -- 172.21.15.18:0/1619844880 >> 172.21.15.18:0/1619844880 conn(0x7f495c072bb0 msgr2=0x7f495c0b1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:34.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.741+0000 7f4961f7f640 1 -- 172.21.15.18:0/1619844880 shutdown_connections 2024-04-17T19:53:34.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.741+0000 7f4961f7f640 1 -- 172.21.15.18:0/1619844880 wait complete. 2024-04-17T19:53:34.756 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T19:53:34.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.897+0000 7f3d0bf8d640 1 Processor -- start 2024-04-17T19:53:34.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.897+0000 7f3d0bf8d640 1 -- start start 2024-04-17T19:53:34.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.897+0000 7f3d0bf8d640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3d0415e1a0 0x7f3d040ce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:34.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.897+0000 7f3d0bf8d640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d040d0020 con 0x7f3d0406cd60 2024-04-17T19:53:34.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.897+0000 7f3d0bf8d640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d040cd930 con 0x7f3d040cef10 2024-04-17T19:53:34.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.897+0000 7f3d0bf8d640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f3d040cdc10 con 0x7f3d0415e1a0 2024-04-17T19:53:34.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.897+0000 7f3d0a52a640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f3d0406cd60 0x7f3d0406d170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:48042/0 (socket says 172.21.15.18:48042) 2024-04-17T19:53:34.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.897+0000 7f3d0a52a640 1 -- 172.21.15.18:0/3554185897 learned_addr learned my addr 172.21.15.18:0/3554185897 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:34.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.897+0000 7f3d09d29640 1 --2- 172.21.15.18:0/3554185897 >> v2:172.21.15.173:3300/0 conn(0x7f3d0415e1a0 0x7f3d040ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:34.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.897+0000 7f3d08d27640 1 -- 172.21.15.18:0/3554185897 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3568905281 0 0) 0x7f3d040d0020 con 0x7f3d0406cd60 2024-04-17T19:53:34.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.897+0000 7f3d08d27640 1 -- 172.21.15.18:0/3554185897 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3cf0003530 con 0x7f3d0406cd60 2024-04-17T19:53:34.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.897+0000 7f3d08d27640 1 -- 172.21.15.18:0/3554185897 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 84614968 0 0) 0x7f3cf0003530 con 0x7f3d0406cd60 2024-04-17T19:53:34.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.897+0000 7f3d08d27640 1 -- 172.21.15.18:0/3554185897 >> v2:172.21.15.173:3300/0 conn(0x7f3d0415e1a0 msgr2=0x7f3d040ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:34.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.897+0000 7f3d08d27640 1 --2- 172.21.15.18:0/3554185897 >> v2:172.21.15.173:3300/0 conn(0x7f3d0415e1a0 0x7f3d040ce9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:34.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.901+0000 7f3d08d27640 1 -- 172.21.15.18:0/3554185897 >> v1:172.21.15.173:6789/0 conn(0x7f3d040cef10 legacy=0x7f3d0415e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:34.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.901+0000 7f3d08d27640 1 -- 172.21.15.18:0/3554185897 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d040cdef0 con 0x7f3d0406cd60 2024-04-17T19:53:34.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.901+0000 7f3d08d27640 1 -- 172.21.15.18:0/3554185897 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3208559991 0 0) 0x7f3cfc001a20 con 0x7f3d0406cd60 2024-04-17T19:53:34.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.901+0000 7f3d08d27640 1 -- 172.21.15.18:0/3554185897 >> v1:172.21.15.18:6789/0 conn(0x7f3d0406cd60 legacy=0x7f3d0406d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:34.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.901+0000 7f3d08d27640 1 --2- 172.21.15.18:0/3554185897 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3cf00039c0 0x7f3cf0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:34.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.901+0000 7f3d08d27640 1 --2- 172.21.15.18:0/3554185897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3cf0004810 0x7f3cf0004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:34.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.901+0000 7f3d08d27640 1 --2- 172.21.15.18:0/3554185897 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3cf0005260 0x7f3cf000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:34.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.901+0000 7f3d08d27640 1 -- 172.21.15.18:0/3554185897 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3d040cdc10 con 0x7f3cf0004810 2024-04-17T19:53:34.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.901+0000 7f3d08d27640 1 -- 172.21.15.18:0/3554185897 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf000c1f0 con 0x7f3cf0005260 2024-04-17T19:53:34.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.901+0000 7f3d08d27640 1 -- 172.21.15.18:0/3554185897 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f3cf000c3f0 con 0x7f3cf00039c0 2024-04-17T19:53:34.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.901+0000 7f3d09528640 1 --2- 172.21.15.18:0/3554185897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3cf0004810 0x7f3cf0004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:34.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.901+0000 7f3d0a52a640 1 --2- 172.21.15.18:0/3554185897 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3cf0005260 0x7f3cf000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:34.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.901+0000 7f3d09528640 1 -- 172.21.15.18:0/3554185897 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3cf00039c0 msgr2=0x7f3cf0003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:34.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.901+0000 7f3d09d29640 1 --2- 172.21.15.18:0/3554185897 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3cf00039c0 0x7f3cf0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:34.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.901+0000 7f3d09528640 1 --2- 172.21.15.18:0/3554185897 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3cf00039c0 0x7f3cf0003e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:34.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.901+0000 7f3d09528640 1 -- 172.21.15.18:0/3554185897 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3cf0005260 msgr2=0x7f3cf000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:34.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.901+0000 7f3d09528640 1 --2- 172.21.15.18:0/3554185897 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3cf0005260 0x7f3cf000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:34.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.901+0000 7f3d09528640 1 -- 172.21.15.18:0/3554185897 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cf0003530 con 0x7f3cf0004810 2024-04-17T19:53:34.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.901+0000 7f3d0a52a640 1 --2- 172.21.15.18:0/3554185897 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3cf0005260 0x7f3cf000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:53:34.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.901+0000 7f3d0a52a640 1 -- 172.21.15.18:0/3554185897 reap_dead start 2024-04-17T19:53:34.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.901+0000 7f3d09528640 1 --2- 172.21.15.18:0/3554185897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3cf0004810 0x7f3cf0004c20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3cf4001750 tx=0x7f3cf401c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7b80af048d00b41 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:34.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.901+0000 7f3d08d27640 1 -- 172.21.15.18:0/3554185897 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf40013a0 con 0x7f3cf0004810 2024-04-17T19:53:34.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.901+0000 7f3d08d27640 1 -- 172.21.15.18:0/3554185897 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cf40a4e50 con 0x7f3cf0004810 2024-04-17T19:53:34.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.901+0000 7f3d08d27640 1 -- 172.21.15.18:0/3554185897 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cf4003600 con 0x7f3cf0004810 2024-04-17T19:53:34.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.901+0000 7f3d0bf8d640 1 -- 172.21.15.18:0/3554185897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3cf0004810 msgr2=0x7f3cf0004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:34.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.901+0000 7f3d0bf8d640 1 --2- 172.21.15.18:0/3554185897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3cf0004810 0x7f3cf0004c20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3cf4001750 tx=0x7f3cf401c390 comp rx=0 tx=0).stop 2024-04-17T19:53:34.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.901+0000 7f3d0bf8d640 1 -- 172.21.15.18:0/3554185897 shutdown_connections 2024-04-17T19:53:34.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.901+0000 7f3d0bf8d640 1 --2- 172.21.15.18:0/3554185897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3cf0004810 0x7f3cf0004c20 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:34.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.901+0000 7f3d0bf8d640 1 -- 172.21.15.18:0/3554185897 >> 172.21.15.18:0/3554185897 conn(0x7f3d04072bb0 msgr2=0x7f3d04072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:34.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.901+0000 7f3d0bf8d640 1 -- 172.21.15.18:0/3554185897 shutdown_connections 2024-04-17T19:53:34.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.901+0000 7f3d0bf8d640 1 -- 172.21.15.18:0/3554185897 wait complete. 2024-04-17T19:53:34.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.905+0000 7f3d0bf8d640 1 Processor -- start 2024-04-17T19:53:34.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.905+0000 7f3d0bf8d640 1 -- start start 2024-04-17T19:53:34.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.905+0000 7f3d0bf8d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3cf0004810 0x7f3d0414db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:34.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.905+0000 7f3d0bf8d640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3d041fa630 0x7f3d041f9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:34.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.905+0000 7f3d0bf8d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d041f99b0 0x7f3d040ae420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:34.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.905+0000 7f3d0bf8d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3d0406d580 con 0x7f3cf0004810 2024-04-17T19:53:34.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.905+0000 7f3d0bf8d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3d0415e5b0 con 0x7f3d041f99b0 2024-04-17T19:53:34.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.905+0000 7f3d0bf8d640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f3d041fad60 con 0x7f3d041fa630 2024-04-17T19:53:34.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.905+0000 7f3d09d29640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3cf0004810 0x7f3d0414db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:34.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.905+0000 7f3d09d29640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3cf0004810 0x7f3d0414db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48592/0 (socket says 172.21.15.18:48592) 2024-04-17T19:53:34.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.905+0000 7f3d09d29640 1 -- 172.21.15.18:0/3338243843 learned_addr learned my addr 172.21.15.18:0/3338243843 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:34.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.905+0000 7f3d0a52a640 1 --2- 172.21.15.18:0/3338243843 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d041f99b0 0x7f3d040ae420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:34.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.905+0000 7f3d09d29640 1 -- 172.21.15.18:0/3338243843 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3d041fa630 msgr2=0x7f3d041f9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:34.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.905+0000 7f3d09d29640 1 --2- 172.21.15.18:0/3338243843 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3d041fa630 0x7f3d041f9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:34.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.905+0000 7f3d09d29640 1 -- 172.21.15.18:0/3338243843 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d041f99b0 msgr2=0x7f3d040ae420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:34.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.905+0000 7f3d09d29640 1 --2- 172.21.15.18:0/3338243843 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d041f99b0 0x7f3d040ae420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:34.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.905+0000 7f3d09d29640 1 -- 172.21.15.18:0/3338243843 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d040b5c20 con 0x7f3cf0004810 2024-04-17T19:53:34.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.905+0000 7f3d09d29640 1 --2- 172.21.15.18:0/3338243843 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3cf0004810 0x7f3d0414db50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3d00010900 tx=0x7f3d00010dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:34.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.905+0000 7f3cfa7fc640 1 -- 172.21.15.18:0/3338243843 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d0000f040 con 0x7f3cf0004810 2024-04-17T19:53:34.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.905+0000 7f3cfa7fc640 1 -- 172.21.15.18:0/3338243843 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d0000ec20 con 0x7f3cf0004810 2024-04-17T19:53:34.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.905+0000 7f3d0bf8d640 1 -- 172.21.15.18:0/3338243843 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d041fa0c0 con 0x7f3cf0004810 2024-04-17T19:53:34.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.909+0000 7f3cfa7fc640 1 -- 172.21.15.18:0/3338243843 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d0001c400 con 0x7f3cf0004810 2024-04-17T19:53:34.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.909+0000 7f3d0bf8d640 1 -- 172.21.15.18:0/3338243843 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d04151820 con 0x7f3cf0004810 2024-04-17T19:53:34.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.909+0000 7f3d0bf8d640 1 -- 172.21.15.18:0/3338243843 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d04069950 con 0x7f3cf0004810 2024-04-17T19:53:34.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.909+0000 7f3cfa7fc640 1 -- 172.21.15.18:0/3338243843 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3d0001c5a0 con 0x7f3cf0004810 2024-04-17T19:53:34.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.909+0000 7f3cfa7fc640 1 --2- 172.21.15.18:0/3338243843 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f3ce8068380 0x7f3ce806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:34.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.909+0000 7f3cfa7fc640 1 -- 172.21.15.18:0/3338243843 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f3d00087450 con 0x7f3cf0004810 2024-04-17T19:53:34.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.909+0000 7f3d09528640 1 --2- 172.21.15.18:0/3338243843 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f3ce8068380 0x7f3ce806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:34.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.909+0000 7f3d09528640 1 --2- 172.21.15.18:0/3338243843 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f3ce8068380 0x7f3ce806a890 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3d040b0750 tx=0x7f3cf4001130 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:34.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:34.913+0000 7f3cfa7fc640 1 -- 172.21.15.18:0/3338243843 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3d040b5c20 con 0x7f3cf0004810 2024-04-17T19:53:35.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.109+0000 7f3d0bf8d640 1 -- 172.21.15.18:0/3338243843 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3d041606c0 con 0x7f3cf0004810 2024-04-17T19:53:35.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.113+0000 7f3cfa7fc640 1 -- 172.21.15.18:0/3338243843 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5177 (secure 0 0 0) 0x7f3d00018030 con 0x7f3cf0004810 2024-04-17T19:53:35.108 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:53:35.109 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/729504609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":729504609},{"type":"v1","addr":"172.21.15.173:6833","nonce":729504609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4261,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/3797017174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3797017174},{"type":"v1","addr":"172.21.15.173:6835","nonce":3797017174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/995848920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":995848920},{"type":"v1","addr":"172.21.15.18:6835","nonce":995848920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-17T19:53:04.851226+0000","modified":"2024-04-17T19:53:22.952315+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6837/1926349198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1926349198},{"type":"v1","addr":"172.21.15.18:6837","nonce":1926349198}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1}]} 2024-04-17T19:53:35.109 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 9 2024-04-17T19:53:35.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.113+0000 7f3d0bf8d640 1 -- 172.21.15.18:0/3338243843 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f3ce8068380 msgr2=0x7f3ce806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:35.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.113+0000 7f3d0bf8d640 1 --2- 172.21.15.18:0/3338243843 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f3ce8068380 0x7f3ce806a890 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3d040b0750 tx=0x7f3cf4001130 comp rx=0 tx=0).stop 2024-04-17T19:53:35.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.113+0000 7f3d0bf8d640 1 -- 172.21.15.18:0/3338243843 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3cf0004810 msgr2=0x7f3d0414db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:35.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.113+0000 7f3d0bf8d640 1 --2- 172.21.15.18:0/3338243843 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3cf0004810 0x7f3d0414db50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3d00010900 tx=0x7f3d00010dc0 comp rx=0 tx=0).stop 2024-04-17T19:53:35.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.113+0000 7f3d0bf8d640 1 -- 172.21.15.18:0/3338243843 shutdown_connections 2024-04-17T19:53:35.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.113+0000 7f3d0bf8d640 1 --2- 172.21.15.18:0/3338243843 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f3ce8068380 0x7f3ce806a890 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:35.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.113+0000 7f3d0bf8d640 1 --2- 172.21.15.18:0/3338243843 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d041f99b0 0x7f3d040ae420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:35.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.113+0000 7f3d0bf8d640 1 --2- 172.21.15.18:0/3338243843 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3d041fa630 0x7f3d041f9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:35.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.113+0000 7f3d0bf8d640 1 --2- 172.21.15.18:0/3338243843 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3cf0004810 0x7f3d0414db50 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:35.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.113+0000 7f3d0bf8d640 1 -- 172.21.15.18:0/3338243843 >> 172.21.15.18:0/3338243843 conn(0x7f3d04072bb0 msgr2=0x7f3d040b0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:35.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.113+0000 7f3d0bf8d640 1 -- 172.21.15.18:0/3338243843 shutdown_connections 2024-04-17T19:53:35.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.113+0000 7f3d0bf8d640 1 -- 172.21.15.18:0/3338243843 wait complete. 2024-04-17T19:53:35.532 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-17T19:53:04.851226+0000', 'modified': '2024-04-17T19:53:22.952315+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4278}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4278': {'gid': 4278, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.18:6837/1926349198', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6836', 'nonce': 1926349198}, {'type': 'v1', 'addr': '172.21.15.18:6837', 'nonce': 1926349198}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4278, 'qdb_cluster': [4278]} 2024-04-17T19:53:35.532 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-17T19:53:35.533 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-17T19:53:35.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.701+0000 7f52e19f9640 1 Processor -- start 2024-04-17T19:53:35.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.701+0000 7f52e19f9640 1 -- start start 2024-04-17T19:53:35.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.705+0000 7f52e19f9640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f52dc0d2730 0x7f52dc1680e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:35.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.705+0000 7f52e19f9640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52dc1610c0 con 0x7f52dc0cd4c0 2024-04-17T19:53:35.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.705+0000 7f52e19f9640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52dc1613a0 con 0x7f52dc06f900 2024-04-17T19:53:35.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.705+0000 7f52e19f9640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f52dc161680 con 0x7f52dc0d2730 2024-04-17T19:53:35.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.705+0000 7f52daffd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f52dc0cd4c0 0x7f52dc15cfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:48056/0 (socket says 172.21.15.18:48056) 2024-04-17T19:53:35.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.705+0000 7f52daffd640 1 -- 172.21.15.18:0/1337707766 learned_addr learned my addr 172.21.15.18:0/1337707766 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:35.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.705+0000 7f52db7fe640 1 --2- 172.21.15.18:0/1337707766 >> v2:172.21.15.18:3300/0 conn(0x7f52dc0d2730 0x7f52dc1680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:35.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.705+0000 7f52d9ffb640 1 -- 172.21.15.18:0/1337707766 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 620911925 0 0) 0x7f52dc1610c0 con 0x7f52dc0cd4c0 2024-04-17T19:53:35.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.705+0000 7f52d9ffb640 1 -- 172.21.15.18:0/1337707766 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52c8003530 con 0x7f52dc0cd4c0 2024-04-17T19:53:35.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.705+0000 7f52db7fe640 1 -- 172.21.15.18:0/1337707766 >> v1:172.21.15.173:6789/0 conn(0x7f52dc06f900 legacy=0x7f52dc06fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:35.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.705+0000 7f52db7fe640 1 -- 172.21.15.18:0/1337707766 >> v1:172.21.15.18:6789/0 conn(0x7f52dc0cd4c0 legacy=0x7f52dc15cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:35.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.705+0000 7f52db7fe640 1 -- 172.21.15.18:0/1337707766 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52dc161960 con 0x7f52dc0d2730 2024-04-17T19:53:35.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.705+0000 7f52db7fe640 1 --2- 172.21.15.18:0/1337707766 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52dc0d2730 0x7f52dc1680e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f52d40097c0 tx=0x7f52d401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12f9fb1a67c17a47 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:35.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.705+0000 7f52d9ffb640 1 -- 172.21.15.18:0/1337707766 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d40b0070 con 0x7f52dc0d2730 2024-04-17T19:53:35.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.705+0000 7f52d9ffb640 1 -- 172.21.15.18:0/1337707766 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52d40ab600 con 0x7f52dc0d2730 2024-04-17T19:53:35.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.705+0000 7f52d9ffb640 1 -- 172.21.15.18:0/1337707766 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d40ab9d0 con 0x7f52dc0d2730 2024-04-17T19:53:35.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.709+0000 7f52e19f9640 1 -- 172.21.15.18:0/1337707766 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52dc0d2730 msgr2=0x7f52dc1680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:35.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.709+0000 7f52e19f9640 1 --2- 172.21.15.18:0/1337707766 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52dc0d2730 0x7f52dc1680e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f52d40097c0 tx=0x7f52d401c410 comp rx=0 tx=0).stop 2024-04-17T19:53:35.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.709+0000 7f52e19f9640 1 -- 172.21.15.18:0/1337707766 shutdown_connections 2024-04-17T19:53:35.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.709+0000 7f52e19f9640 1 --2- 172.21.15.18:0/1337707766 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52dc0d2730 0x7f52dc1680e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:35.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.709+0000 7f52e19f9640 1 -- 172.21.15.18:0/1337707766 >> 172.21.15.18:0/1337707766 conn(0x7f52dc0cf6e0 msgr2=0x7f52dc0cfaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:35.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.709+0000 7f52e19f9640 1 -- 172.21.15.18:0/1337707766 shutdown_connections 2024-04-17T19:53:35.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.709+0000 7f52e19f9640 1 -- 172.21.15.18:0/1337707766 wait complete. 2024-04-17T19:53:35.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.709+0000 7f52e19f9640 1 Processor -- start 2024-04-17T19:53:35.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.709+0000 7f52e19f9640 1 -- start start 2024-04-17T19:53:35.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.713+0000 7f52e19f9640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f52dc06f900 0x7f52dc1589e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:35.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.713+0000 7f52e19f9640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52dc0cd4c0 0x7f52dc152cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:35.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.713+0000 7f52e19f9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52dc0d2730 0x7f52dc0b5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:35.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.713+0000 7f52e19f9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f52dc16b1d0 con 0x7f52dc0d2730 2024-04-17T19:53:35.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.713+0000 7f52e19f9640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f52dc16b050 con 0x7f52dc0cd4c0 2024-04-17T19:53:35.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.713+0000 7f52e19f9640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f52dc16b350 con 0x7f52dc06f900 2024-04-17T19:53:35.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.713+0000 7f52db7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52dc0d2730 0x7f52dc0b5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:35.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.713+0000 7f52db7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52dc0d2730 0x7f52dc0b5fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48610/0 (socket says 172.21.15.18:48610) 2024-04-17T19:53:35.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.713+0000 7f52db7fe640 1 -- 172.21.15.18:0/567820774 learned_addr learned my addr 172.21.15.18:0/567820774 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:35.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.713+0000 7f52da7fc640 1 --2- 172.21.15.18:0/567820774 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52dc0cd4c0 0x7f52dc152cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:35.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.713+0000 7f52daffd640 1 --2- 172.21.15.18:0/567820774 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f52dc06f900 0x7f52dc1589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:35.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.713+0000 7f52db7fe640 1 -- 172.21.15.18:0/567820774 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f52dc06f900 msgr2=0x7f52dc1589e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:35.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.713+0000 7f52db7fe640 1 --2- 172.21.15.18:0/567820774 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f52dc06f900 0x7f52dc1589e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:35.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.713+0000 7f52db7fe640 1 -- 172.21.15.18:0/567820774 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52dc0cd4c0 msgr2=0x7f52dc152cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:35.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.713+0000 7f52db7fe640 1 --2- 172.21.15.18:0/567820774 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52dc0cd4c0 0x7f52dc152cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:35.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.713+0000 7f52db7fe640 1 -- 172.21.15.18:0/567820774 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52dc1595f0 con 0x7f52dc0d2730 2024-04-17T19:53:35.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.713+0000 7f52daffd640 1 --2- 172.21.15.18:0/567820774 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f52dc06f900 0x7f52dc1589e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:53:35.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.713+0000 7f52db7fe640 1 --2- 172.21.15.18:0/567820774 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52dc0d2730 0x7f52dc0b5fe0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f52d401a040 tx=0x7f52d40191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:35.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.713+0000 7f52d3fff640 1 -- 172.21.15.18:0/567820774 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d40b0040 con 0x7f52dc0d2730 2024-04-17T19:53:35.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.713+0000 7f52d3fff640 1 -- 172.21.15.18:0/567820774 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52d40b9070 con 0x7f52dc0d2730 2024-04-17T19:53:35.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.713+0000 7f52e19f9640 1 -- 172.21.15.18:0/567820774 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52dc1598d0 con 0x7f52dc0d2730 2024-04-17T19:53:35.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.713+0000 7f52d3fff640 1 -- 172.21.15.18:0/567820774 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d40b4650 con 0x7f52dc0d2730 2024-04-17T19:53:35.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.713+0000 7f52e19f9640 1 -- 172.21.15.18:0/567820774 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52dc159e90 con 0x7f52dc0d2730 2024-04-17T19:53:35.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.713+0000 7f52d3fff640 1 -- 172.21.15.18:0/567820774 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f52d40b47f0 con 0x7f52dc0d2730 2024-04-17T19:53:35.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.717+0000 7f52d3fff640 1 --2- 172.21.15.18:0/567820774 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f52bc068380 0x7f52bc06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:35.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.717+0000 7f52d3fff640 1 -- 172.21.15.18:0/567820774 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f52d4120900 con 0x7f52dc0d2730 2024-04-17T19:53:35.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.717+0000 7f52daffd640 1 --2- 172.21.15.18:0/567820774 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f52bc068380 0x7f52bc06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:35.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.717+0000 7f52daffd640 1 --2- 172.21.15.18:0/567820774 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f52bc068380 0x7f52bc06a890 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f52c40011f0 tx=0x7f52c4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:35.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.717+0000 7f52e8d4f000 1 Processor -- start 2024-04-17T19:53:35.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.717+0000 7f52e8d4f000 1 -- start start 2024-04-17T19:53:35.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.717+0000 7f52e8d4f000 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55f74592cc10 0x55f745a9f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:35.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.717+0000 7f52e8d4f000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f745925930 0x55f745a9f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:35.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.717+0000 7f52e8d4f000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f745525280 0x55f745a9fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:35.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.717+0000 7f52e8d4f000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f7458a34f0 con 0x55f745525280 2024-04-17T19:53:35.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.717+0000 7f52e8d4f000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55f74583dc10 con 0x55f745925930 2024-04-17T19:53:35.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.717+0000 7f52e8d4f000 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x55f74589f4b0 con 0x55f74592cc10 2024-04-17T19:53:35.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.717+0000 7f52db7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f745525280 0x55f745a9fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:35.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.717+0000 7f52db7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f745525280 0x55f745a9fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48620/0 (socket says 172.21.15.18:48620) 2024-04-17T19:53:35.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.717+0000 7f52db7fe640 1 -- 172.21.15.18:0/1641876879 learned_addr learned my addr 172.21.15.18:0/1641876879 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:35.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.717+0000 7f52daffd640 1 --2- 172.21.15.18:0/1641876879 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55f74592cc10 0x55f745a9f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:35.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.717+0000 7f52da7fc640 1 --2- 172.21.15.18:0/1641876879 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f745925930 0x55f745a9f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:35.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.717+0000 7f52db7fe640 1 -- 172.21.15.18:0/1641876879 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55f74592cc10 msgr2=0x55f745a9f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:35.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.717+0000 7f52db7fe640 1 --2- 172.21.15.18:0/1641876879 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55f74592cc10 0x55f745a9f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:35.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.717+0000 7f52db7fe640 1 -- 172.21.15.18:0/1641876879 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f745925930 msgr2=0x55f745a9f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:35.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.717+0000 7f52db7fe640 1 --2- 172.21.15.18:0/1641876879 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f745925930 0x55f745a9f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:35.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.717+0000 7f52db7fe640 1 -- 172.21.15.18:0/1641876879 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f74583de60 con 0x55f745525280 2024-04-17T19:53:35.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.717+0000 7f52db7fe640 1 --2- 172.21.15.18:0/1641876879 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f745525280 0x55f745a9fab0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f52d40ae040 tx=0x7f52d40094d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=960baf56da1c999a server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:35.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.717+0000 7f52d17fa640 1 -- 172.21.15.18:0/1641876879 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d40f47a0 con 0x55f745525280 2024-04-17T19:53:35.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.717+0000 7f52d17fa640 1 -- 172.21.15.18:0/1641876879 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52d40f9060 con 0x55f745525280 2024-04-17T19:53:35.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.717+0000 7f52d17fa640 1 -- 172.21.15.18:0/1641876879 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d40eca60 con 0x55f745525280 2024-04-17T19:53:35.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.717+0000 7f52e8d4f000 1 -- 172.21.15.18:0/1641876879 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f745525280 msgr2=0x55f745a9fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:35.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.717+0000 7f52e8d4f000 1 --2- 172.21.15.18:0/1641876879 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f745525280 0x55f745a9fab0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f52d40ae040 tx=0x7f52d40094d0 comp rx=0 tx=0).stop 2024-04-17T19:53:35.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.717+0000 7f52e8d4f000 1 -- 172.21.15.18:0/1641876879 shutdown_connections 2024-04-17T19:53:35.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.717+0000 7f52e8d4f000 1 --2- 172.21.15.18:0/1641876879 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f745525280 0x55f745a9fab0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:35.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.717+0000 7f52e8d4f000 1 --2- 172.21.15.18:0/1641876879 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f745925930 0x55f745a9f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:35.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.717+0000 7f52e8d4f000 1 --2- 172.21.15.18:0/1641876879 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55f74592cc10 0x55f745a9f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:35.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.717+0000 7f52e8d4f000 1 -- 172.21.15.18:0/1641876879 >> 172.21.15.18:0/1641876879 conn(0x55f74596e670 msgr2=0x55f745a539a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:35.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.717+0000 7f52e8d4f000 1 -- 172.21.15.18:0/1641876879 shutdown_connections 2024-04-17T19:53:35.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.717+0000 7f52e8d4f000 1 -- 172.21.15.18:0/1641876879 wait complete. 2024-04-17T19:53:35.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.721+0000 7f52e8d4f000 1 -- start start 2024-04-17T19:53:35.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.721+0000 7f52e8d4f000 1 Processor -- start 2024-04-17T19:53:35.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.721+0000 7f52e8d4f000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f745525280 0x55f745aa5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:35.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.721+0000 7f52e8d4f000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f745925930 0x55f745aa63a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:35.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.721+0000 7f52e8d4f000 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55f74592cc10 0x55f745a59360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:35.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.721+0000 7f52e8d4f000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f7458e49e0 con 0x55f745525280 2024-04-17T19:53:35.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.721+0000 7f52e8d4f000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55f745860a80 con 0x55f745925930 2024-04-17T19:53:35.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.721+0000 7f52e8d4f000 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x55f74585ed10 con 0x55f74592cc10 2024-04-17T19:53:35.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.721+0000 7f52e8d4f000 10 client.0 _ll_register_callbacks cb 0x55f745a40b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-17T19:53:35.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.721+0000 7f52daffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f745525280 0x55f745aa5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:35.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.721+0000 7f52daffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f745525280 0x55f745aa5e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48628/0 (socket says 172.21.15.18:48628) 2024-04-17T19:53:35.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.721+0000 7f52daffd640 1 -- 172.21.15.18:0/3018857926 learned_addr learned my addr 172.21.15.18:0/3018857926 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:35.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.721+0000 7f52da7fc640 1 --2- 172.21.15.18:0/3018857926 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f745925930 0x55f745aa63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:35.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.721+0000 7f52db7fe640 1 --2- 172.21.15.18:0/3018857926 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55f74592cc10 0x55f745a59360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:35.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.721+0000 7f52daffd640 1 -- 172.21.15.18:0/3018857926 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55f74592cc10 msgr2=0x55f745a59360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:35.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.721+0000 7f52daffd640 1 --2- 172.21.15.18:0/3018857926 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55f74592cc10 0x55f745a59360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:35.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.721+0000 7f52daffd640 1 -- 172.21.15.18:0/3018857926 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f745925930 msgr2=0x55f745aa63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:35.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.721+0000 7f52daffd640 1 --2- 172.21.15.18:0/3018857926 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f745925930 0x55f745aa63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:35.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.721+0000 7f52daffd640 1 -- 172.21.15.18:0/3018857926 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f74586ee20 con 0x55f745525280 2024-04-17T19:53:35.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.721+0000 7f52da7fc640 1 --2- 172.21.15.18:0/3018857926 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f745925930 0x55f745aa63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:53:35.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.721+0000 7f52db7fe640 1 --2- 172.21.15.18:0/3018857926 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55f74592cc10 0x55f745a59360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:53:35.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.721+0000 7f52daffd640 1 --2- 172.21.15.18:0/3018857926 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f745525280 0x55f745aa5e60 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f52c4005f30 tx=0x7f52c4000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5e3ea4974c986a server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:35.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.721+0000 7f52ba7fc640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-17T19:53:35.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.721+0000 7f52ba7fc640 1 -- 172.21.15.18:0/3018857926 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c4027060 con 0x55f745525280 2024-04-17T19:53:35.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.721+0000 7f52ba7fc640 1 -- 172.21.15.18:0/3018857926 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f52c4010040 con 0x55f745525280 2024-04-17T19:53:35.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.721+0000 7f52e8d4f000 1 -- 172.21.15.18:0/3018857926 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52d40f9060 con 0x55f745525280 2024-04-17T19:53:35.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.721+0000 7f52ba7fc640 1 -- 172.21.15.18:0/3018857926 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f52c4007560 con 0x55f745525280 2024-04-17T19:53:35.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.721+0000 7f52e8d4f000 10 client.4875 fetch_fsmap learned FSMap version 9 2024-04-17T19:53:35.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.721+0000 7f52e8d4f000 1 -- 172.21.15.18:0/3018857926 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55f74596ea80 con 0x55f745525280 2024-04-17T19:53:35.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.721+0000 7f52ba7fc640 1 -- 172.21.15.18:0/3018857926 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52d40f9060 con 0x55f745525280 2024-04-17T19:53:35.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.721+0000 7f52ba7fc640 1 -- 172.21.15.18:0/3018857926 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 9) ==== 3502+0+0 (secure 0 0 0) 0x7f52c4013420 con 0x55f745525280 2024-04-17T19:53:35.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.721+0000 7f52e8d4f000 10 client.4875 fetch_fsmap finished waiting for FSMap version 9 2024-04-17T19:53:35.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.721+0000 7f52e8d4f000 10 client.4875 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-17T19:53:35.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.721+0000 7f52e8d4f000 20 client.4875 populate_metadata read hostname 'smithi018' 2024-04-17T19:53:35.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.721+0000 7f52e8d4f000 1 --2- 172.21.15.18:0/3018857926 >> [v2:172.21.15.18:6836/1926349198,v1:172.21.15.18:6837/1926349198] conn(0x55f7455497d0 0x55f745a5a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:35.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.721+0000 7f52e8d4f000 4 client.4875 mds_command: new command op to 4278 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-17T19:53:35.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.721+0000 7f52e8d4f000 1 -- 172.21.15.18:0/3018857926 --> [v2:172.21.15.18:6836/1926349198,v1:172.21.15.18:6837/1926349198] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f74583cbe0 con 0x55f7455497d0 2024-04-17T19:53:35.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.725+0000 7f52da7fc640 1 --2- 172.21.15.18:0/3018857926 >> [v2:172.21.15.18:6836/1926349198,v1:172.21.15.18:6837/1926349198] conn(0x55f7455497d0 0x55f745a5a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:35.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.725+0000 7f52ba7fc640 10 client.4875 ms_handle_connect on v2:172.21.15.18:6836/1926349198 2024-04-17T19:53:35.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.725+0000 7f52da7fc640 1 --2- 172.21.15.18:0/3018857926 >> [v2:172.21.15.18:6836/1926349198,v1:172.21.15.18:6837/1926349198] conn(0x55f7455497d0 0x55f745a5a0a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0fb7409f513bdaf server_cookie=911b4c30e9e3798d in_seq=0 out_seq=0 2024-04-17T19:53:35.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.725+0000 7f52ba7fc640 1 -- 172.21.15.18:0/3018857926 <== mds.0 v2:172.21.15.18:6836/1926349198 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f74583cbe0 con 0x55f7455497d0 2024-04-17T19:53:35.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.725+0000 7f52ba7fc640 10 client.4875 handle_command_reply: tid=0 2024-04-17T19:53:35.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.725+0000 7f52e8d4f000 1 client.4875 shutdown 2024-04-17T19:53:35.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.725+0000 7f52e8d4f000 1 -- 172.21.15.18:0/3018857926 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f745525280 msgr2=0x55f745aa5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:35.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.725+0000 7f52e8d4f000 1 --2- 172.21.15.18:0/3018857926 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f745525280 0x55f745aa5e60 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f52c4005f30 tx=0x7f52c4000ee0 comp rx=0 tx=0).stop 2024-04-17T19:53:35.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.725+0000 7f52e8d4f000 1 -- 172.21.15.18:0/3018857926 shutdown_connections 2024-04-17T19:53:35.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.725+0000 7f52e8d4f000 1 --2- 172.21.15.18:0/3018857926 >> [v2:172.21.15.18:6836/1926349198,v1:172.21.15.18:6837/1926349198] conn(0x55f7455497d0 0x55f745a5a0a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:35.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.725+0000 7f52e8d4f000 1 --2- 172.21.15.18:0/3018857926 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55f74592cc10 0x55f745a59360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:35.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.725+0000 7f52e8d4f000 1 --2- 172.21.15.18:0/3018857926 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f745925930 0x55f745aa63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:35.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.725+0000 7f52ba7fc640 0 client.4875 ms_handle_reset on v2:172.21.15.18:6836/1926349198 2024-04-17T19:53:35.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.725+0000 7f52e8d4f000 1 --2- 172.21.15.18:0/3018857926 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f745525280 0x55f745aa5e60 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:35.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.725+0000 7f52e8d4f000 1 -- 172.21.15.18:0/3018857926 >> 172.21.15.18:0/3018857926 conn(0x55f74596e670 msgr2=0x55f745a82630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:35.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.725+0000 7f52e8d4f000 1 -- 172.21.15.18:0/3018857926 shutdown_connections 2024-04-17T19:53:35.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.725+0000 7f52e8d4f000 1 -- 172.21.15.18:0/3018857926 wait complete. 2024-04-17T19:53:35.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.725+0000 7f52e8d4f000 20 client.4875 trim_cache size 0 max 16384 2024-04-17T19:53:35.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.745+0000 7f52e8d4f000 1 Processor -- start 2024-04-17T19:53:35.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.745+0000 7f52e8d4f000 1 -- start start 2024-04-17T19:53:35.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.745+0000 7f52e8d4f000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f745525280 0x55f745aaaed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:35.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.745+0000 7f52e8d4f000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f745925930 0x55f745a5b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:35.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.745+0000 7f52e8d4f000 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55f74592cc10 0x55f745a5b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:35.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.745+0000 7f52e8d4f000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f52dc203220 con 0x55f745525280 2024-04-17T19:53:35.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.745+0000 7f52e8d4f000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f52dc2025b0 con 0x55f745925930 2024-04-17T19:53:35.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.745+0000 7f52e8d4f000 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f52dc202c00 con 0x55f74592cc10 2024-04-17T19:53:35.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.745+0000 7f52daffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f745525280 0x55f745aaaed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:35.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.745+0000 7f52daffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f745525280 0x55f745aaaed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48634/0 (socket says 172.21.15.18:48634) 2024-04-17T19:53:35.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.745+0000 7f52daffd640 1 -- 172.21.15.18:0/553589643 learned_addr learned my addr 172.21.15.18:0/553589643 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:35.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.745+0000 7f52da7fc640 1 --2- 172.21.15.18:0/553589643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f745925930 0x55f745a5b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:35.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.745+0000 7f52daffd640 1 -- 172.21.15.18:0/553589643 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55f74592cc10 msgr2=0x55f745a5b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:35.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.745+0000 7f52daffd640 1 --2- 172.21.15.18:0/553589643 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55f74592cc10 0x55f745a5b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:35.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.745+0000 7f52daffd640 1 -- 172.21.15.18:0/553589643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f745925930 msgr2=0x55f745a5b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:35.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.745+0000 7f52daffd640 1 --2- 172.21.15.18:0/553589643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f745925930 0x55f745a5b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:35.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.745+0000 7f52daffd640 1 -- 172.21.15.18:0/553589643 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7458fce30 con 0x55f745525280 2024-04-17T19:53:35.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.745+0000 7f52daffd640 1 --2- 172.21.15.18:0/553589643 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f745525280 0x55f745aaaed0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f52c400e5b0 tx=0x7f52c401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39c4c7dee529a204 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:35.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.745+0000 7f52d0ff9640 1 -- 172.21.15.18:0/553589643 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c4007700 con 0x55f745525280 2024-04-17T19:53:35.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.745+0000 7f52d0ff9640 1 -- 172.21.15.18:0/553589643 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52c4013420 con 0x55f745525280 2024-04-17T19:53:35.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.745+0000 7f52d0ff9640 1 -- 172.21.15.18:0/553589643 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52c4013970 con 0x55f745525280 2024-04-17T19:53:35.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.745+0000 7f52e8d4f000 1 -- 172.21.15.18:0/553589643 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f745525280 msgr2=0x55f745aaaed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:35.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.745+0000 7f52e8d4f000 1 --2- 172.21.15.18:0/553589643 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f745525280 0x55f745aaaed0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f52c400e5b0 tx=0x7f52c401f000 comp rx=0 tx=0).stop 2024-04-17T19:53:35.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.745+0000 7f52e8d4f000 1 -- 172.21.15.18:0/553589643 shutdown_connections 2024-04-17T19:53:35.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.745+0000 7f52e8d4f000 1 --2- 172.21.15.18:0/553589643 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55f74592cc10 0x55f745a5b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:35.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.745+0000 7f52e8d4f000 1 --2- 172.21.15.18:0/553589643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f745925930 0x55f745a5b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:35.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.745+0000 7f52e8d4f000 1 --2- 172.21.15.18:0/553589643 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f745525280 0x55f745aaaed0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:35.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.745+0000 7f52e8d4f000 1 -- 172.21.15.18:0/553589643 >> 172.21.15.18:0/553589643 conn(0x55f74596e670 msgr2=0x55f745a58d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:35.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.745+0000 7f52e8d4f000 1 -- 172.21.15.18:0/553589643 shutdown_connections 2024-04-17T19:53:35.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.745+0000 7f52e8d4f000 1 -- 172.21.15.18:0/553589643 wait complete. 2024-04-17T19:53:35.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.749+0000 7f52e8d4f000 1 -- start start 2024-04-17T19:53:35.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.749+0000 7f52e8d4f000 1 Processor -- start 2024-04-17T19:53:35.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.749+0000 7f52e8d4f000 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55f745525280 0x55f745b11170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:35.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.749+0000 7f52e8d4f000 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f745925930 0x55f745b116b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:35.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.749+0000 7f52e8d4f000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f74592cc10 0x55f745aa91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:35.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.749+0000 7f52e8d4f000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f7458a7b20 con 0x55f74592cc10 2024-04-17T19:53:35.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.749+0000 7f52e8d4f000 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55f7458a2800 con 0x55f745925930 2024-04-17T19:53:35.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.749+0000 7f52e8d4f000 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x55f7458b0700 con 0x55f745525280 2024-04-17T19:53:35.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.749+0000 7f52e8d4f000 10 client.0 _ll_register_callbacks cb 0x7f52c4001d10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-17T19:53:35.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.749+0000 7f52db7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f74592cc10 0x55f745aa91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:35.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.749+0000 7f52db7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f74592cc10 0x55f745aa91a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48650/0 (socket says 172.21.15.18:48650) 2024-04-17T19:53:35.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.749+0000 7f52db7fe640 1 -- 172.21.15.18:0/3641197111 learned_addr learned my addr 172.21.15.18:0/3641197111 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:35.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.749+0000 7f52da7fc640 1 --2- 172.21.15.18:0/3641197111 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f745925930 0x55f745b116b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:35.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.749+0000 7f52daffd640 1 --2- 172.21.15.18:0/3641197111 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55f745525280 0x55f745b11170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:35.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.749+0000 7f52db7fe640 1 -- 172.21.15.18:0/3641197111 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55f745525280 msgr2=0x55f745b11170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:35.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.749+0000 7f52db7fe640 1 --2- 172.21.15.18:0/3641197111 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55f745525280 0x55f745b11170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:35.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.749+0000 7f52db7fe640 1 -- 172.21.15.18:0/3641197111 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f745925930 msgr2=0x55f745b116b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:35.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.749+0000 7f52db7fe640 1 --2- 172.21.15.18:0/3641197111 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f745925930 0x55f745b116b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:35.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.749+0000 7f52db7fe640 1 -- 172.21.15.18:0/3641197111 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7458357e0 con 0x55f74592cc10 2024-04-17T19:53:35.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.749+0000 7f52daffd640 1 --2- 172.21.15.18:0/3641197111 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55f745525280 0x55f745b11170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:53:35.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.749+0000 7f52db7fe640 1 --2- 172.21.15.18:0/3641197111 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f74592cc10 0x55f745aa91a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f52d401aac0 tx=0x7f52d4009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f19300b38dddd851 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:35.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.749+0000 7f52ba7fc640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-17T19:53:35.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.749+0000 7f52ba7fc640 1 -- 172.21.15.18:0/3641197111 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52d40f8dd0 con 0x55f74592cc10 2024-04-17T19:53:35.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.749+0000 7f52ba7fc640 1 -- 172.21.15.18:0/3641197111 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7f52d40ef840 con 0x55f74592cc10 2024-04-17T19:53:35.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.749+0000 7f52e8d4f000 1 -- 172.21.15.18:0/3641197111 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52c4013420 con 0x55f74592cc10 2024-04-17T19:53:35.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.749+0000 7f52ba7fc640 1 -- 172.21.15.18:0/3641197111 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f52d40f9060 con 0x55f74592cc10 2024-04-17T19:53:35.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.749+0000 7f52e8d4f000 10 client.4881 fetch_fsmap learned FSMap version 9 2024-04-17T19:53:35.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.749+0000 7f52e8d4f000 1 -- 172.21.15.18:0/3641197111 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55f745848670 con 0x55f74592cc10 2024-04-17T19:53:35.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.749+0000 7f52ba7fc640 1 -- 172.21.15.18:0/3641197111 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52c4013420 con 0x55f74592cc10 2024-04-17T19:53:35.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.749+0000 7f52ba7fc640 1 -- 172.21.15.18:0/3641197111 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 9) ==== 3502+0+0 (secure 0 0 0) 0x7f52d40b3070 con 0x55f74592cc10 2024-04-17T19:53:35.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.749+0000 7f52e8d4f000 10 client.4881 fetch_fsmap finished waiting for FSMap version 9 2024-04-17T19:53:35.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.749+0000 7f52e8d4f000 10 client.4881 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-17T19:53:35.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.749+0000 7f52e8d4f000 20 client.4881 populate_metadata read hostname 'smithi018' 2024-04-17T19:53:35.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.749+0000 7f52e8d4f000 1 --2- 172.21.15.18:0/3641197111 >> [v2:172.21.15.18:6836/1926349198,v1:172.21.15.18:6837/1926349198] conn(0x55f745537830 0x55f745aa9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:35.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.749+0000 7f52e8d4f000 4 client.4881 mds_command: new command op to 4278 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-17T19:53:35.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.749+0000 7f52e8d4f000 1 -- 172.21.15.18:0/3641197111 --> [v2:172.21.15.18:6836/1926349198,v1:172.21.15.18:6837/1926349198] -- command(tid 0: {"prefix": "status"}) -- 0x55f745a55620 con 0x55f745537830 2024-04-17T19:53:35.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.749+0000 7f52daffd640 1 --2- 172.21.15.18:0/3641197111 >> [v2:172.21.15.18:6836/1926349198,v1:172.21.15.18:6837/1926349198] conn(0x55f745537830 0x55f745aa9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:35.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.753+0000 7f52ba7fc640 10 client.4881 ms_handle_connect on v2:172.21.15.18:6836/1926349198 2024-04-17T19:53:35.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.753+0000 7f52daffd640 1 --2- 172.21.15.18:0/3641197111 >> [v2:172.21.15.18:6836/1926349198,v1:172.21.15.18:6837/1926349198] conn(0x55f745537830 0x55f745aa9b60 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ade681cd392b5a9 server_cookie=6e83109f0365e490 in_seq=0 out_seq=0 2024-04-17T19:53:35.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.753+0000 7f52ba7fc640 1 -- 172.21.15.18:0/3641197111 <== mds.0 v2:172.21.15.18:6836/1926349198 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x55f745a55620 con 0x55f745537830 2024-04-17T19:53:35.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.753+0000 7f52ba7fc640 10 client.4881 handle_command_reply: tid=0 2024-04-17T19:53:35.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.753+0000 7f52e8d4f000 1 client.4881 shutdown 2024-04-17T19:53:35.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.753+0000 7f52e8d4f000 1 -- 172.21.15.18:0/3641197111 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f74592cc10 msgr2=0x55f745aa91a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:35.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.753+0000 7f52e8d4f000 1 --2- 172.21.15.18:0/3641197111 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f74592cc10 0x55f745aa91a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f52d401aac0 tx=0x7f52d4009190 comp rx=0 tx=0).stop 2024-04-17T19:53:35.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.753+0000 7f52e8d4f000 1 -- 172.21.15.18:0/3641197111 shutdown_connections 2024-04-17T19:53:35.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.753+0000 7f52e8d4f000 1 --2- 172.21.15.18:0/3641197111 >> [v2:172.21.15.18:6836/1926349198,v1:172.21.15.18:6837/1926349198] conn(0x55f745537830 0x55f745aa9b60 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:35.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.753+0000 7f52e8d4f000 1 --2- 172.21.15.18:0/3641197111 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f74592cc10 0x55f745aa91a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:35.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.753+0000 7f52e8d4f000 1 --2- 172.21.15.18:0/3641197111 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f745925930 0x55f745b116b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:35.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.753+0000 7f52e8d4f000 1 --2- 172.21.15.18:0/3641197111 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55f745525280 0x55f745b11170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:35.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.753+0000 7f52ba7fc640 0 client.4881 ms_handle_reset on v2:172.21.15.18:6836/1926349198 2024-04-17T19:53:35.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.753+0000 7f52e8d4f000 1 -- 172.21.15.18:0/3641197111 >> 172.21.15.18:0/3641197111 conn(0x55f74596e670 msgr2=0x55f745a5a0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:35.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.753+0000 7f52e8d4f000 1 -- 172.21.15.18:0/3641197111 shutdown_connections 2024-04-17T19:53:35.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.753+0000 7f52e8d4f000 1 -- 172.21.15.18:0/3641197111 wait complete. 2024-04-17T19:53:35.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.753+0000 7f52e8d4f000 20 client.4881 trim_cache size 0 max 16384 2024-04-17T19:53:35.758 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-17T19:53:35.758 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "dd480169-5a81-4623-be5f-0499aa244b28", 2024-04-17T19:53:35.758 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 0, 2024-04-17T19:53:35.758 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 4278, 2024-04-17T19:53:35.758 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-04-17T19:53:35.758 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-04-17T19:53:35.758 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-04-17T19:53:35.758 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 30.304621484999998, 2024-04-17T19:53:35.758 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 9, 2024-04-17T19:53:35.759 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 27, 2024-04-17T19:53:35.759 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 27, 2024-04-17T19:53:35.759 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 37.822309062000002 2024-04-17T19:53:35.759 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-17T19:53:35.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.753+0000 7f52e19f9640 1 -- 172.21.15.18:0/567820774 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f52bc068380 msgr2=0x7f52bc06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:35.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.753+0000 7f52e19f9640 1 --2- 172.21.15.18:0/567820774 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f52bc068380 0x7f52bc06a890 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f52c40011f0 tx=0x7f52c4009040 comp rx=0 tx=0).stop 2024-04-17T19:53:35.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.753+0000 7f52e19f9640 1 -- 172.21.15.18:0/567820774 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52dc0d2730 msgr2=0x7f52dc0b5fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:35.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.753+0000 7f52e19f9640 1 --2- 172.21.15.18:0/567820774 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52dc0d2730 0x7f52dc0b5fe0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f52d401a040 tx=0x7f52d40191b0 comp rx=0 tx=0).stop 2024-04-17T19:53:35.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.753+0000 7f52e19f9640 1 -- 172.21.15.18:0/567820774 shutdown_connections 2024-04-17T19:53:35.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.753+0000 7f52e19f9640 1 --2- 172.21.15.18:0/567820774 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f52bc068380 0x7f52bc06a890 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:35.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.753+0000 7f52e19f9640 1 --2- 172.21.15.18:0/567820774 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52dc0d2730 0x7f52dc0b5fe0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:35.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.753+0000 7f52e19f9640 1 --2- 172.21.15.18:0/567820774 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52dc0cd4c0 0x7f52dc152cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:35.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.753+0000 7f52e19f9640 1 --2- 172.21.15.18:0/567820774 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f52dc06f900 0x7f52dc1589e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:35.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.753+0000 7f52e19f9640 1 -- 172.21.15.18:0/567820774 >> 172.21.15.18:0/567820774 conn(0x7f52dc0cf6e0 msgr2=0x7f52dc15cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:35.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.753+0000 7f52e19f9640 1 -- 172.21.15.18:0/567820774 shutdown_connections 2024-04-17T19:53:35.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:35.753+0000 7f52e19f9640 1 -- 172.21.15.18:0/567820774 wait complete. 2024-04-17T19:53:35.768 INFO:teuthology.run_tasks:Running task sequential... 2024-04-17T19:53:35.778 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-17T19:53:35.778 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-17T19:53:35.779 INFO:teuthology.task.print:Enabling mgr modules 2024-04-17T19:53:35.779 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-17T19:53:35.821 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-17T19:53:35.821 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-04-17T19:53:35.821 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-17T19:53:35.821 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-17T19:53:35.821 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-17T19:53:35.822 INFO:tasks.ceph_fuse:client.2 config is {} 2024-04-17T19:53:35.822 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-17T19:53:35.822 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-17T19:53:35.822 INFO:tasks.ceph_fuse:client.1 config is {} 2024-04-17T19:53:35.822 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-17T19:53:35.822 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-17T19:53:35.822 INFO:tasks.ceph_fuse:client.3 config is {} 2024-04-17T19:53:35.822 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-17T19:53:35.822 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-17T19:53:35.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:35.823 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-04-17T19:53:35.828 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-04-17T19:53:35.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:35.829 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-17T19:53:35.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:35.883 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link delete ceph-brx 2024-04-17T19:53:36.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:36.082 DEBUG:teuthology.orchestra.run.smithi173:> ip netns list 2024-04-17T19:53:36.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:36.089 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link delete ceph-brx 2024-04-17T19:53:36.148 INFO:teuthology.orchestra.run.smithi173.stderr:Cannot find device "ceph-brx" 2024-04-17T19:53:36.150 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T19:53:36.150 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-17T19:53:36.151 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-17T19:53:36.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.317+0000 7fb7381cd640 1 Processor -- start 2024-04-17T19:53:36.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.317+0000 7fb7381cd640 1 -- start start 2024-04-17T19:53:36.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.317+0000 7fb7381cd640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb73006cd60 0x7fb73006d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:36.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.317+0000 7fb7381cd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb73015c7c0 0x7fb73015cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:36.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.317+0000 7fb7381cd640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb73015fc90 con 0x7fb73006f9f0 2024-04-17T19:53:36.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.317+0000 7fb7381cd640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fb73015e7d0 con 0x7fb73015c7c0 2024-04-17T19:53:36.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.317+0000 7fb7381cd640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7fb73006d6b0 con 0x7fb73006cd60 2024-04-17T19:53:36.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.317+0000 7fb73676a640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fb73006f9f0 0x7fb73006fe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:48066/0 (socket says 172.21.15.18:48066) 2024-04-17T19:53:36.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.317+0000 7fb73676a640 1 -- 172.21.15.18:0/904157699 learned_addr learned my addr 172.21.15.18:0/904157699 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:36.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.317+0000 7fb735768640 1 --2- 172.21.15.18:0/904157699 >> v2:172.21.15.18:3300/0 conn(0x7fb73015c7c0 0x7fb73015cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:36.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.317+0000 7fb735f69640 1 --2- 172.21.15.18:0/904157699 >> v2:172.21.15.173:3300/0 conn(0x7fb73006cd60 0x7fb73006d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:36.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.317+0000 7fb735768640 1 -- 172.21.15.18:0/904157699 >> v2:172.21.15.173:3300/0 conn(0x7fb73006cd60 msgr2=0x7fb73006d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:36.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.317+0000 7fb735768640 1 --2- 172.21.15.18:0/904157699 >> v2:172.21.15.173:3300/0 conn(0x7fb73006cd60 0x7fb73006d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:36.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.317+0000 7fb735768640 1 -- 172.21.15.18:0/904157699 >> v1:172.21.15.18:6789/0 conn(0x7fb73006f9f0 legacy=0x7fb73006fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:36.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.317+0000 7fb735768640 1 -- 172.21.15.18:0/904157699 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb730142870 con 0x7fb73015c7c0 2024-04-17T19:53:36.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.317+0000 7fb734f67640 1 -- 172.21.15.18:0/904157699 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1736233603 0 0) 0x7fb73015fc90 con 0x7fb73006f9f0 2024-04-17T19:53:36.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.321+0000 7fb735768640 1 --2- 172.21.15.18:0/904157699 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb73015c7c0 0x7fb73015cbd0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb7200097c0 tx=0x7fb72001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21b481ea9ca93328 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:36.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.321+0000 7fb734f67640 1 -- 172.21.15.18:0/904157699 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7200b1070 con 0x7fb73015c7c0 2024-04-17T19:53:36.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.321+0000 7fb734f67640 1 -- 172.21.15.18:0/904157699 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7200ac600 con 0x7fb73015c7c0 2024-04-17T19:53:36.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.321+0000 7fb734f67640 1 -- 172.21.15.18:0/904157699 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7200ac9d0 con 0x7fb73015c7c0 2024-04-17T19:53:36.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.321+0000 7fb7381cd640 1 -- 172.21.15.18:0/904157699 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb73015c7c0 msgr2=0x7fb73015cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:36.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.321+0000 7fb7381cd640 1 --2- 172.21.15.18:0/904157699 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb73015c7c0 0x7fb73015cbd0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb7200097c0 tx=0x7fb72001c3a0 comp rx=0 tx=0).stop 2024-04-17T19:53:36.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.321+0000 7fb7381cd640 1 -- 172.21.15.18:0/904157699 shutdown_connections 2024-04-17T19:53:36.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.321+0000 7fb7381cd640 1 --2- 172.21.15.18:0/904157699 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb73015c7c0 0x7fb73015cbd0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:36.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.321+0000 7fb7381cd640 1 --2- 172.21.15.18:0/904157699 >> v2:172.21.15.173:3300/0 conn(0x7fb73006cd60 0x7fb73006d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:36.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.321+0000 7fb7381cd640 1 -- 172.21.15.18:0/904157699 >> 172.21.15.18:0/904157699 conn(0x7fb730072bb0 msgr2=0x7fb730072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:36.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.321+0000 7fb7381cd640 1 -- 172.21.15.18:0/904157699 shutdown_connections 2024-04-17T19:53:36.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.321+0000 7fb7381cd640 1 -- 172.21.15.18:0/904157699 wait complete. 2024-04-17T19:53:36.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.325+0000 7fb7381cd640 1 Processor -- start 2024-04-17T19:53:36.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.325+0000 7fb7381cd640 1 -- start start 2024-04-17T19:53:36.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.325+0000 7fb7381cd640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb73006cd60 0x7fb730151e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:36.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.325+0000 7fb7381cd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb73006f9f0 0x7fb7301523c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:36.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.325+0000 7fb7381cd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb73015c7c0 0x7fb73013d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:36.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.325+0000 7fb7381cd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb7301609e0 con 0x7fb73015c7c0 2024-04-17T19:53:36.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.325+0000 7fb7381cd640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb73015d4f0 con 0x7fb73006f9f0 2024-04-17T19:53:36.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.325+0000 7fb7381cd640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fb73013f410 con 0x7fb73006cd60 2024-04-17T19:53:36.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.325+0000 7fb73676a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb73015c7c0 0x7fb73013d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:36.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.325+0000 7fb73676a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb73015c7c0 0x7fb73013d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48680/0 (socket says 172.21.15.18:48680) 2024-04-17T19:53:36.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.325+0000 7fb73676a640 1 -- 172.21.15.18:0/1958422737 learned_addr learned my addr 172.21.15.18:0/1958422737 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:36.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.325+0000 7fb735768640 1 --2- 172.21.15.18:0/1958422737 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb73006f9f0 0x7fb7301523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:36.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.325+0000 7fb735f69640 1 --2- 172.21.15.18:0/1958422737 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb73006cd60 0x7fb730151e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:36.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.325+0000 7fb73676a640 1 -- 172.21.15.18:0/1958422737 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb73006cd60 msgr2=0x7fb730151e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:36.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.325+0000 7fb73676a640 1 --2- 172.21.15.18:0/1958422737 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb73006cd60 0x7fb730151e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:36.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.325+0000 7fb73676a640 1 -- 172.21.15.18:0/1958422737 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb73006f9f0 msgr2=0x7fb7301523c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:36.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.325+0000 7fb73676a640 1 --2- 172.21.15.18:0/1958422737 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb73006f9f0 0x7fb7301523c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:36.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.325+0000 7fb73676a640 1 -- 172.21.15.18:0/1958422737 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb73013f890 con 0x7fb73015c7c0 2024-04-17T19:53:36.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.325+0000 7fb735f69640 1 --2- 172.21.15.18:0/1958422737 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb73006cd60 0x7fb730151e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:53:36.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.325+0000 7fb73676a640 1 --2- 172.21.15.18:0/1958422737 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb73015c7c0 0x7fb73013d230 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb72800c3f0 tx=0x7fb72800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:36.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.325+0000 7fb7267fc640 1 -- 172.21.15.18:0/1958422737 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb728017070 con 0x7fb73015c7c0 2024-04-17T19:53:36.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.325+0000 7fb7267fc640 1 -- 172.21.15.18:0/1958422737 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb728005d10 con 0x7fb73015c7c0 2024-04-17T19:53:36.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.325+0000 7fb7267fc640 1 -- 172.21.15.18:0/1958422737 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb728007310 con 0x7fb73015c7c0 2024-04-17T19:53:36.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.325+0000 7fb7381cd640 1 -- 172.21.15.18:0/1958422737 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7301365e0 con 0x7fb73015c7c0 2024-04-17T19:53:36.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.325+0000 7fb7381cd640 1 -- 172.21.15.18:0/1958422737 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb730136ba0 con 0x7fb73015c7c0 2024-04-17T19:53:36.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.329+0000 7fb7381cd640 1 -- 172.21.15.18:0/1958422737 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb73013f5f0 con 0x7fb73015c7c0 2024-04-17T19:53:36.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.329+0000 7fb7267fc640 1 -- 172.21.15.18:0/1958422737 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb72801a070 con 0x7fb73015c7c0 2024-04-17T19:53:36.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.329+0000 7fb7267fc640 1 --2- 172.21.15.18:0/1958422737 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fb714068380 0x7fb71406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:36.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.329+0000 7fb7267fc640 1 -- 172.21.15.18:0/1958422737 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fb728086130 con 0x7fb73015c7c0 2024-04-17T19:53:36.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.329+0000 7fb735f69640 1 --2- 172.21.15.18:0/1958422737 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fb714068380 0x7fb71406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:36.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.329+0000 7fb735f69640 1 --2- 172.21.15.18:0/1958422737 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fb714068380 0x7fb71406a890 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb7300b0750 tx=0x7fb72c00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:36.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.333+0000 7fb7267fc640 1 -- 172.21.15.18:0/1958422737 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb73013f5f0 con 0x7fb73015c7c0 2024-04-17T19:53:36.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.533+0000 7fb7381cd640 1 -- 172.21.15.18:0/1958422737 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb730069950 con 0x7fb73015c7c0 2024-04-17T19:53:36.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.537+0000 7fb7267fc640 1 -- 172.21.15.18:0/1958422737 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7fb728056320 con 0x7fb73015c7c0 2024-04-17T19:53:36.532 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-17T19:53:36.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.537+0000 7fb7381cd640 1 -- 172.21.15.18:0/1958422737 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fb714068380 msgr2=0x7fb71406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:36.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.537+0000 7fb7381cd640 1 --2- 172.21.15.18:0/1958422737 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fb714068380 0x7fb71406a890 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb7300b0750 tx=0x7fb72c00b040 comp rx=0 tx=0).stop 2024-04-17T19:53:36.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.537+0000 7fb7381cd640 1 -- 172.21.15.18:0/1958422737 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb73015c7c0 msgr2=0x7fb73013d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:36.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.537+0000 7fb7381cd640 1 --2- 172.21.15.18:0/1958422737 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb73015c7c0 0x7fb73013d230 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb72800c3f0 tx=0x7fb72800c8b0 comp rx=0 tx=0).stop 2024-04-17T19:53:36.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.537+0000 7fb7381cd640 1 -- 172.21.15.18:0/1958422737 shutdown_connections 2024-04-17T19:53:36.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.537+0000 7fb7381cd640 1 --2- 172.21.15.18:0/1958422737 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fb714068380 0x7fb71406a890 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:36.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.537+0000 7fb7381cd640 1 --2- 172.21.15.18:0/1958422737 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb73015c7c0 0x7fb73013d230 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:36.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.537+0000 7fb7381cd640 1 --2- 172.21.15.18:0/1958422737 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb73006f9f0 0x7fb7301523c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:36.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.537+0000 7fb7381cd640 1 --2- 172.21.15.18:0/1958422737 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb73006cd60 0x7fb730151e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:36.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.537+0000 7fb7381cd640 1 -- 172.21.15.18:0/1958422737 >> 172.21.15.18:0/1958422737 conn(0x7fb730072bb0 msgr2=0x7fb73006fe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:36.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.537+0000 7fb7381cd640 1 -- 172.21.15.18:0/1958422737 shutdown_connections 2024-04-17T19:53:36.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36.537+0000 7fb7381cd640 1 -- 172.21.15.18:0/1958422737 wait complete. 2024-04-17T19:53:36.555 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-17T19:53:36.555 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-17T19:53:36.555 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi018.front.sepia.ceph.com 2024-04-17T19:53:36.555 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-17T19:53:36.555 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-17T19:53:36.555 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-17T19:53:36.555 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-17T19:53:36.555 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-17T19:53:36.555 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-17T19:53:36.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:36.556 DEBUG:teuthology.orchestra.run.smithi018:> ip addr 2024-04-17T19:53:36.562 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-17T19:53:36.562 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-17T19:53:36.562 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2024-04-17T19:53:36.563 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-17T19:53:36.563 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2024-04-17T19:53:36.563 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-17T19:53:36.563 INFO:teuthology.orchestra.run.smithi018.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-17T19:53:36.563 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:98 brd ff:ff:ff:ff:ff:ff 2024-04-17T19:53:36.563 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f0 2024-04-17T19:53:36.563 INFO:teuthology.orchestra.run.smithi018.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-17T19:53:36.563 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:99 brd ff:ff:ff:ff:ff:ff 2024-04-17T19:53:36.563 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f1 2024-04-17T19:53:36.563 INFO:teuthology.orchestra.run.smithi018.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-17T19:53:36.563 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:62 brd ff:ff:ff:ff:ff:ff 2024-04-17T19:53:36.564 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f0 2024-04-17T19:53:36.564 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.21.15.18/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-17T19:53:36.564 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft 42443sec preferred_lft 42443sec 2024-04-17T19:53:36.564 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::ec4:7aff:febd:1362/64 scope link 2024-04-17T19:53:36.564 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-17T19:53:36.564 INFO:teuthology.orchestra.run.smithi018.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-17T19:53:36.564 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:63 brd ff:ff:ff:ff:ff:ff 2024-04-17T19:53:36.564 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f1 2024-04-17T19:53:36.564 INFO:teuthology.orchestra.run.smithi018.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-17T19:53:36.564 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 02:42:a8:c7:c7:ae brd ff:ff:ff:ff:ff:ff 2024-04-17T19:53:36.564 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-17T19:53:36.565 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-17T19:53:36.565 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-17T19:53:36.565 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T19:53:36.565 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-17T19:53:36.565 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link add name ceph-brx type bridge 2024-04-17T19:53:36.565 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip addr flush dev ceph-brx 2024-04-17T19:53:36.565 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set ceph-brx up 2024-04-17T19:53:36.565 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-17T19:53:36.566 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-17T19:53:36.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T19:53:36.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T19:53:36.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:36.693 DEBUG:teuthology.orchestra.run.smithi018:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-17T19:53:36.702 INFO:teuthology.orchestra.run.smithi018.stdout:1 2024-04-17T19:53:36.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:36.704 DEBUG:teuthology.orchestra.run.smithi018:> route 2024-04-17T19:53:36.757 INFO:teuthology.orchestra.run.smithi018.stdout:Kernel IP routing table 2024-04-17T19:53:36.757 INFO:teuthology.orchestra.run.smithi018.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-17T19:53:36.757 INFO:teuthology.orchestra.run.smithi018.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-17T19:53:36.757 INFO:teuthology.orchestra.run.smithi018.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-17T19:53:36.757 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-17T19:53:36.757 INFO:teuthology.orchestra.run.smithi018.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-17T19:53:36.757 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T19:53:36.758 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-17T19:53:36.758 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-17T19:53:36.758 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-17T19:53:36.758 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-17T19:53:36.758 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-17T19:53:36.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T19:53:36.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T19:53:36.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:36.886 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-04-17T19:53:36.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:36.893 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list-id 2024-04-17T19:53:36.945 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T19:53:36.945 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-17T19:53:36.945 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-17T19:53:36.945 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-17T19:53:36.945 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-17T19:53:37.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T19:53:37.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T19:53:37.068 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-17T19:53:37.069 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T19:53:37.069 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-17T19:53:37.069 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-17T19:53:37.069 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-17T19:53:37.069 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-17T19:53:37.069 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-17T19:53:37.069 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-17T19:53:37.069 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-17T19:53:37.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T19:53:37.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T19:53:37.163 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T19:53:37.163 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-17T19:53:37.163 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set brx.0 up 2024-04-17T19:53:37.163 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set dev brx.0 master ceph-brx 2024-04-17T19:53:37.163 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-17T19:53:37.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T19:53:37.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T19:53:37.265 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-17T19:53:37.265 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-17T19:53:37.265 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-17T19:53:37.312 INFO:teuthology.orchestra.run.smithi018.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-17T19:53:37.312 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-17T19:53:37.312 DEBUG:teuthology.orchestra.run.smithi018:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-17T19:53:37.360 DEBUG:teuthology.orchestra.run.smithi018:> sudo modprobe fuse 2024-04-17T19:53:37.417 DEBUG:teuthology.orchestra.run.smithi018:> cat /proc/self/mounts | awk '{print $2}' 2024-04-17T19:53:37.465 INFO:teuthology.orchestra.run.smithi018.stdout:/sys 2024-04-17T19:53:37.465 INFO:teuthology.orchestra.run.smithi018.stdout:/proc 2024-04-17T19:53:37.465 INFO:teuthology.orchestra.run.smithi018.stdout:/dev 2024-04-17T19:53:37.465 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/pts 2024-04-17T19:53:37.465 INFO:teuthology.orchestra.run.smithi018.stdout:/run 2024-04-17T19:53:37.465 INFO:teuthology.orchestra.run.smithi018.stdout:/ 2024-04-17T19:53:37.465 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/security 2024-04-17T19:53:37.465 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/shm 2024-04-17T19:53:37.465 INFO:teuthology.orchestra.run.smithi018.stdout:/run/lock 2024-04-17T19:53:37.465 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/cgroup 2024-04-17T19:53:37.465 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/pstore 2024-04-17T19:53:37.466 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/bpf 2024-04-17T19:53:37.466 INFO:teuthology.orchestra.run.smithi018.stdout:/proc/sys/fs/binfmt_misc 2024-04-17T19:53:37.466 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/hugepages 2024-04-17T19:53:37.466 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/mqueue 2024-04-17T19:53:37.466 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/debug 2024-04-17T19:53:37.466 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/tracing 2024-04-17T19:53:37.466 INFO:teuthology.orchestra.run.smithi018.stdout:/proc/fs/nfsd 2024-04-17T19:53:37.466 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/fuse/connections 2024-04-17T19:53:37.466 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/config 2024-04-17T19:53:37.466 INFO:teuthology.orchestra.run.smithi018.stdout:/run/credentials/systemd-sysusers.service 2024-04-17T19:53:37.466 INFO:teuthology.orchestra.run.smithi018.stdout:/run/rpc_pipefs 2024-04-17T19:53:37.466 INFO:teuthology.orchestra.run.smithi018.stdout:/run/user/1000 2024-04-17T19:53:37.466 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph 2024-04-17T19:53:37.467 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph/osd/ceph-0 2024-04-17T19:53:37.467 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph/osd/ceph-1 2024-04-17T19:53:37.467 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph/osd/ceph-2 2024-04-17T19:53:37.467 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph/osd/ceph-3 2024-04-17T19:53:37.467 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns 2024-04-17T19:53:37.467 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-17T19:53:37.467 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-17T19:53:37.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:37.468 DEBUG:teuthology.orchestra.run.smithi018:> ls /sys/fs/fuse/connections 2024-04-17T19:53:37.516 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-17T19:53:37.516 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-17T19:53:37.561 DEBUG:teuthology.orchestra.run.smithi018:> sudo modprobe fuse 2024-04-17T19:53:37.576 DEBUG:teuthology.orchestra.run.smithi018:> cat /proc/self/mounts | awk '{print $2}' 2024-04-17T19:53:37.625 INFO:teuthology.orchestra.run.smithi018.stdout:/sys 2024-04-17T19:53:37.625 INFO:teuthology.orchestra.run.smithi018.stdout:/proc 2024-04-17T19:53:37.625 INFO:teuthology.orchestra.run.smithi018.stdout:/dev 2024-04-17T19:53:37.625 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/pts 2024-04-17T19:53:37.625 INFO:teuthology.orchestra.run.smithi018.stdout:/run 2024-04-17T19:53:37.625 INFO:teuthology.orchestra.run.smithi018.stdout:/ 2024-04-17T19:53:37.625 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/security 2024-04-17T19:53:37.625 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/shm 2024-04-17T19:53:37.626 INFO:teuthology.orchestra.run.smithi018.stdout:/run/lock 2024-04-17T19:53:37.626 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/cgroup 2024-04-17T19:53:37.626 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/pstore 2024-04-17T19:53:37.626 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/bpf 2024-04-17T19:53:37.626 INFO:teuthology.orchestra.run.smithi018.stdout:/proc/sys/fs/binfmt_misc 2024-04-17T19:53:37.626 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/hugepages 2024-04-17T19:53:37.626 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/mqueue 2024-04-17T19:53:37.626 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/debug 2024-04-17T19:53:37.626 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/tracing 2024-04-17T19:53:37.626 INFO:teuthology.orchestra.run.smithi018.stdout:/proc/fs/nfsd 2024-04-17T19:53:37.626 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/fuse/connections 2024-04-17T19:53:37.626 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/config 2024-04-17T19:53:37.627 INFO:teuthology.orchestra.run.smithi018.stdout:/run/credentials/systemd-sysusers.service 2024-04-17T19:53:37.627 INFO:teuthology.orchestra.run.smithi018.stdout:/run/rpc_pipefs 2024-04-17T19:53:37.627 INFO:teuthology.orchestra.run.smithi018.stdout:/run/user/1000 2024-04-17T19:53:37.627 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph 2024-04-17T19:53:37.627 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph/osd/ceph-0 2024-04-17T19:53:37.627 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph/osd/ceph-1 2024-04-17T19:53:37.627 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph/osd/ceph-2 2024-04-17T19:53:37.627 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph/osd/ceph-3 2024-04-17T19:53:37.627 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns 2024-04-17T19:53:37.627 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-17T19:53:37.627 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-17T19:53:37.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:37.628 DEBUG:teuthology.orchestra.run.smithi018:> ls /sys/fs/fuse/connections 2024-04-17T19:53:37.675 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi018.stderr:2024-04-17T19:53:37.677+0000 7fb87d583580 -1 init, newargv = 0x7fb86c001220 newargc=15 2024-04-17T19:53:37.675 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi018.stderr:ceph-fuse[35523]: starting ceph client 2024-04-17T19:53:37.681 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi018.stderr:ceph-fuse[35523]: starting fuse 2024-04-17T19:53:38.777 DEBUG:teuthology.orchestra.run.smithi018:> sudo modprobe fuse 2024-04-17T19:53:38.794 DEBUG:teuthology.orchestra.run.smithi018:> cat /proc/self/mounts | awk '{print $2}' 2024-04-17T19:53:38.842 INFO:teuthology.orchestra.run.smithi018.stdout:/sys 2024-04-17T19:53:38.842 INFO:teuthology.orchestra.run.smithi018.stdout:/proc 2024-04-17T19:53:38.842 INFO:teuthology.orchestra.run.smithi018.stdout:/dev 2024-04-17T19:53:38.842 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/pts 2024-04-17T19:53:38.842 INFO:teuthology.orchestra.run.smithi018.stdout:/run 2024-04-17T19:53:38.842 INFO:teuthology.orchestra.run.smithi018.stdout:/ 2024-04-17T19:53:38.842 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/security 2024-04-17T19:53:38.842 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/shm 2024-04-17T19:53:38.842 INFO:teuthology.orchestra.run.smithi018.stdout:/run/lock 2024-04-17T19:53:38.843 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/cgroup 2024-04-17T19:53:38.843 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/pstore 2024-04-17T19:53:38.843 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/bpf 2024-04-17T19:53:38.843 INFO:teuthology.orchestra.run.smithi018.stdout:/proc/sys/fs/binfmt_misc 2024-04-17T19:53:38.843 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/hugepages 2024-04-17T19:53:38.843 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/mqueue 2024-04-17T19:53:38.843 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/debug 2024-04-17T19:53:38.843 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/tracing 2024-04-17T19:53:38.843 INFO:teuthology.orchestra.run.smithi018.stdout:/proc/fs/nfsd 2024-04-17T19:53:38.843 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/fuse/connections 2024-04-17T19:53:38.843 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/config 2024-04-17T19:53:38.844 INFO:teuthology.orchestra.run.smithi018.stdout:/run/credentials/systemd-sysusers.service 2024-04-17T19:53:38.844 INFO:teuthology.orchestra.run.smithi018.stdout:/run/rpc_pipefs 2024-04-17T19:53:38.844 INFO:teuthology.orchestra.run.smithi018.stdout:/run/user/1000 2024-04-17T19:53:38.844 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph 2024-04-17T19:53:38.844 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph/osd/ceph-0 2024-04-17T19:53:38.844 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph/osd/ceph-1 2024-04-17T19:53:38.844 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph/osd/ceph-2 2024-04-17T19:53:38.844 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph/osd/ceph-3 2024-04-17T19:53:38.844 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns 2024-04-17T19:53:38.844 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-17T19:53:38.845 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-17T19:53:38.845 INFO:teuthology.orchestra.run.smithi018.stdout:/home/ubuntu/cephtest/mnt.0 2024-04-17T19:53:38.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:38.846 DEBUG:teuthology.orchestra.run.smithi018:> ls /sys/fs/fuse/connections 2024-04-17T19:53:38.893 INFO:teuthology.orchestra.run.smithi018.stdout:45 2024-04-17T19:53:38.893 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-04-17T19:53:38.894 DEBUG:teuthology.orchestra.run.smithi018:> sudo stdin-killer -- python3 -c ' 2024-04-17T19:53:38.894 DEBUG:teuthology.orchestra.run.smithi018:> import glob 2024-04-17T19:53:38.894 DEBUG:teuthology.orchestra.run.smithi018:> import re 2024-04-17T19:53:38.894 DEBUG:teuthology.orchestra.run.smithi018:> import os 2024-04-17T19:53:38.894 DEBUG:teuthology.orchestra.run.smithi018:> import subprocess 2024-04-17T19:53:38.894 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-17T19:53:38.894 DEBUG:teuthology.orchestra.run.smithi018:> def _find_admin_socket(client_name): 2024-04-17T19:53:38.894 DEBUG:teuthology.orchestra.run.smithi018:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-17T19:53:38.894 DEBUG:teuthology.orchestra.run.smithi018:> files = glob.glob(asok_path) 2024-04-17T19:53:38.895 DEBUG:teuthology.orchestra.run.smithi018:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-17T19:53:38.895 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-17T19:53:38.895 DEBUG:teuthology.orchestra.run.smithi018:> # Given a non-glob path, it better be there 2024-04-17T19:53:38.895 DEBUG:teuthology.orchestra.run.smithi018:> if "*" not in asok_path: 2024-04-17T19:53:38.895 DEBUG:teuthology.orchestra.run.smithi018:> assert(len(files) == 1) 2024-04-17T19:53:38.895 DEBUG:teuthology.orchestra.run.smithi018:> return files[0] 2024-04-17T19:53:38.895 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-17T19:53:38.895 DEBUG:teuthology.orchestra.run.smithi018:> for f in files: 2024-04-17T19:53:38.895 DEBUG:teuthology.orchestra.run.smithi018:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-17T19:53:38.895 DEBUG:teuthology.orchestra.run.smithi018:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-17T19:53:38.895 DEBUG:teuthology.orchestra.run.smithi018:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-17T19:53:38.895 DEBUG:teuthology.orchestra.run.smithi018:> contents = proc_f.read() 2024-04-17T19:53:38.896 DEBUG:teuthology.orchestra.run.smithi018:> if mountpoint in contents: 2024-04-17T19:53:38.896 DEBUG:teuthology.orchestra.run.smithi018:> return f 2024-04-17T19:53:38.896 DEBUG:teuthology.orchestra.run.smithi018:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-17T19:53:38.896 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-17T19:53:38.896 DEBUG:teuthology.orchestra.run.smithi018:> print(_find_admin_socket("client.0")) 2024-04-17T19:53:38.896 DEBUG:teuthology.orchestra.run.smithi018:> ' 2024-04-17T19:53:39.020 INFO:teuthology.orchestra.run.smithi018.stdout:/var/run/ceph/ceph-client.0.35523.asok 2024-04-17T19:53:39.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T19:53:39.033 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.35523.asok 2024-04-17T19:53:39.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:39.033 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.35523.asok status 2024-04-17T19:53:39.219 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-17T19:53:39.220 INFO:teuthology.orchestra.run.smithi018.stdout: "metadata": { 2024-04-17T19:53:39.220 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_sha1": "f3a98d3f110319c567ec86bf70955c141495ccf6", 2024-04-17T19:53:39.220 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_version": "ceph version 19.0.0-3146-gf3a98d3f (f3a98d3f110319c567ec86bf70955c141495ccf6) squid (dev)", 2024-04-17T19:53:39.220 INFO:teuthology.orchestra.run.smithi018.stdout: "entity_id": "0", 2024-04-17T19:53:39.220 INFO:teuthology.orchestra.run.smithi018.stdout: "hostname": "smithi018", 2024-04-17T19:53:39.220 INFO:teuthology.orchestra.run.smithi018.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-17T19:53:39.220 INFO:teuthology.orchestra.run.smithi018.stdout: "pid": "35523", 2024-04-17T19:53:39.220 INFO:teuthology.orchestra.run.smithi018.stdout: "root": "/" 2024-04-17T19:53:39.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-17T19:53:39.221 INFO:teuthology.orchestra.run.smithi018.stdout: "dentry_count": 0, 2024-04-17T19:53:39.221 INFO:teuthology.orchestra.run.smithi018.stdout: "dentry_pinned_count": 0, 2024-04-17T19:53:39.221 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 4899, 2024-04-17T19:53:39.221 INFO:teuthology.orchestra.run.smithi018.stdout: "inst": { 2024-04-17T19:53:39.221 INFO:teuthology.orchestra.run.smithi018.stdout: "name": { 2024-04-17T19:53:39.221 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "client", 2024-04-17T19:53:39.221 INFO:teuthology.orchestra.run.smithi018.stdout: "num": 4899 2024-04-17T19:53:39.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-17T19:53:39.221 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": { 2024-04-17T19:53:39.221 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-04-17T19:53:39.222 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "192.168.0.1:0", 2024-04-17T19:53:39.222 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1976666192 2024-04-17T19:53:39.222 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-17T19:53:39.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-17T19:53:39.222 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": { 2024-04-17T19:53:39.222 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-04-17T19:53:39.222 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "192.168.0.1:0", 2024-04-17T19:53:39.222 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1976666192 2024-04-17T19:53:39.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-17T19:53:39.223 INFO:teuthology.orchestra.run.smithi018.stdout: "inst_str": "client.4899 192.168.0.1:0/1976666192", 2024-04-17T19:53:39.223 INFO:teuthology.orchestra.run.smithi018.stdout: "addr_str": "192.168.0.1:0/1976666192", 2024-04-17T19:53:39.223 INFO:teuthology.orchestra.run.smithi018.stdout: "inode_count": 1, 2024-04-17T19:53:39.223 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_epoch": 9, 2024-04-17T19:53:39.223 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_epoch": 27, 2024-04-17T19:53:39.223 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_epoch_barrier": 0, 2024-04-17T19:53:39.223 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklisted": false, 2024-04-17T19:53:39.223 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs" 2024-04-17T19:53:39.223 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-17T19:53:39.236 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-17T19:53:39.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.389+0000 7fa92c161640 1 Processor -- start 2024-04-17T19:53:39.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.389+0000 7fa92c161640 1 -- start start 2024-04-17T19:53:39.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.389+0000 7fa92c161640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa92406c8b0 0x7fa92406ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:39.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.389+0000 7fa92c161640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9240d41b0 con 0x7fa9240d3b80 2024-04-17T19:53:39.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.389+0000 7fa92c161640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9240d4490 con 0x7fa9240d0620 2024-04-17T19:53:39.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.389+0000 7fa92c161640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fa9240d3f90 con 0x7fa92406c8b0 2024-04-17T19:53:39.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.389+0000 7fa929efd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fa9240d3b80 0x7fa9240cff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:48080/0 (socket says 172.21.15.18:48080) 2024-04-17T19:53:39.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.389+0000 7fa929efd640 1 -- 172.21.15.18:0/931561917 learned_addr learned my addr 172.21.15.18:0/931561917 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:39.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.389+0000 7fa92a6fe640 1 --2- 172.21.15.18:0/931561917 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa92406c8b0 0x7fa92406ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:39.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.389+0000 7fa928efb640 1 -- 172.21.15.18:0/931561917 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2448449780 0 0) 0x7fa9240d41b0 con 0x7fa9240d3b80 2024-04-17T19:53:39.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.389+0000 7fa928efb640 1 -- 172.21.15.18:0/931561917 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa910003530 con 0x7fa9240d3b80 2024-04-17T19:53:39.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.389+0000 7fa928efb640 1 -- 172.21.15.18:0/931561917 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3035675037 0 0) 0x7fa910003530 con 0x7fa9240d3b80 2024-04-17T19:53:39.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.389+0000 7fa928efb640 1 -- 172.21.15.18:0/931561917 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa92406c8b0 msgr2=0x7fa92406ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:39.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.389+0000 7fa928efb640 1 --2- 172.21.15.18:0/931561917 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa92406c8b0 0x7fa92406ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:39.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.389+0000 7fa928efb640 1 -- 172.21.15.18:0/931561917 >> v1:172.21.15.173:6789/0 conn(0x7fa9240d0620 legacy=0x7fa92406c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:39.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.389+0000 7fa928efb640 1 -- 172.21.15.18:0/931561917 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9240d4770 con 0x7fa9240d3b80 2024-04-17T19:53:39.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.389+0000 7fa928efb640 1 -- 172.21.15.18:0/931561917 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3208559991 0 0) 0x7fa91c001a00 con 0x7fa9240d3b80 2024-04-17T19:53:39.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.389+0000 7fa928efb640 1 -- 172.21.15.18:0/931561917 >> v1:172.21.15.18:6789/0 conn(0x7fa9240d3b80 legacy=0x7fa9240cff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:39.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.389+0000 7fa928efb640 1 --2- 172.21.15.18:0/931561917 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa9100039f0 0x7fa910003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:39.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.389+0000 7fa928efb640 1 --2- 172.21.15.18:0/931561917 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa910004810 0x7fa910004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:39.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.389+0000 7fa928efb640 1 --2- 172.21.15.18:0/931561917 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa92406c8b0 0x7fa910005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:39.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.389+0000 7fa928efb640 1 -- 172.21.15.18:0/931561917 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa9240d3f90 con 0x7fa910004810 2024-04-17T19:53:39.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.389+0000 7fa928efb640 1 -- 172.21.15.18:0/931561917 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa91000ba80 con 0x7fa9100039f0 2024-04-17T19:53:39.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.389+0000 7fa928efb640 1 -- 172.21.15.18:0/931561917 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fa91000bc80 con 0x7fa92406c8b0 2024-04-17T19:53:39.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.389+0000 7fa9296fc640 1 --2- 172.21.15.18:0/931561917 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa910004810 0x7fa910004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:39.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.393+0000 7fa929efd640 1 --2- 172.21.15.18:0/931561917 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa9100039f0 0x7fa910003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:39.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.393+0000 7fa92a6fe640 1 --2- 172.21.15.18:0/931561917 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa92406c8b0 0x7fa910005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:39.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.393+0000 7fa9296fc640 1 -- 172.21.15.18:0/931561917 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa92406c8b0 msgr2=0x7fa910005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:39.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.393+0000 7fa9296fc640 1 --2- 172.21.15.18:0/931561917 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa92406c8b0 0x7fa910005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:39.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.393+0000 7fa9296fc640 1 -- 172.21.15.18:0/931561917 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa9100039f0 msgr2=0x7fa910003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:39.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.393+0000 7fa9296fc640 1 --2- 172.21.15.18:0/931561917 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa9100039f0 0x7fa910003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:39.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.393+0000 7fa9296fc640 1 -- 172.21.15.18:0/931561917 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa910003530 con 0x7fa910004810 2024-04-17T19:53:39.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.393+0000 7fa9296fc640 1 --2- 172.21.15.18:0/931561917 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa910004810 0x7fa910004c20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa914001910 tx=0x7fa91401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cea3d2290fe91f4d server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:39.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.393+0000 7fa928efb640 1 -- 172.21.15.18:0/931561917 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9140b5070 con 0x7fa910004810 2024-04-17T19:53:39.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.393+0000 7fa928efb640 1 -- 172.21.15.18:0/931561917 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9140a8930 con 0x7fa910004810 2024-04-17T19:53:39.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.393+0000 7fa928efb640 1 -- 172.21.15.18:0/931561917 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa914001510 con 0x7fa910004810 2024-04-17T19:53:39.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.393+0000 7fa92c161640 1 -- 172.21.15.18:0/931561917 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa910004810 msgr2=0x7fa910004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:39.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.393+0000 7fa92c161640 1 --2- 172.21.15.18:0/931561917 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa910004810 0x7fa910004c20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa914001910 tx=0x7fa91401ecf0 comp rx=0 tx=0).stop 2024-04-17T19:53:39.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.393+0000 7fa92a6fe640 1 -- 172.21.15.18:0/931561917 reap_dead start 2024-04-17T19:53:39.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.393+0000 7fa92c161640 1 -- 172.21.15.18:0/931561917 shutdown_connections 2024-04-17T19:53:39.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.393+0000 7fa92c161640 1 -- 172.21.15.18:0/931561917 >> 172.21.15.18:0/931561917 conn(0x7fa9240d4ed0 msgr2=0x7fa9240d52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:39.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.393+0000 7fa92c161640 1 -- 172.21.15.18:0/931561917 shutdown_connections 2024-04-17T19:53:39.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.393+0000 7fa92c161640 1 -- 172.21.15.18:0/931561917 wait complete. 2024-04-17T19:53:39.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.397+0000 7fa92c161640 1 Processor -- start 2024-04-17T19:53:39.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.397+0000 7fa92c161640 1 -- start start 2024-04-17T19:53:39.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.397+0000 7fa92c161640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa910004810 0x7fa924158ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:39.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.397+0000 7fa92c161640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa92415bc90 0x7fa9240c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:39.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.397+0000 7fa92c161640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9240c9470 0x7fa9241f5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:39.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.397+0000 7fa92c161640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa92415fdd0 con 0x7fa9240c9470 2024-04-17T19:53:39.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.397+0000 7fa92c161640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa92415ff50 con 0x7fa910004810 2024-04-17T19:53:39.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.397+0000 7fa92c161640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fa924159ed0 con 0x7fa92415bc90 2024-04-17T19:53:39.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.397+0000 7fa92a6fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9240c9470 0x7fa9241f5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:39.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.397+0000 7fa92a6fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9240c9470 0x7fa9241f5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48688/0 (socket says 172.21.15.18:48688) 2024-04-17T19:53:39.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.397+0000 7fa92a6fe640 1 -- 172.21.15.18:0/2584645494 learned_addr learned my addr 172.21.15.18:0/2584645494 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:39.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.397+0000 7fa929efd640 1 --2- 172.21.15.18:0/2584645494 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa910004810 0x7fa924158ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:39.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.397+0000 7fa9296fc640 1 --2- 172.21.15.18:0/2584645494 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa92415bc90 0x7fa9240c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:39.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.397+0000 7fa92a6fe640 1 -- 172.21.15.18:0/2584645494 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa92415bc90 msgr2=0x7fa9240c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:39.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.397+0000 7fa92a6fe640 1 --2- 172.21.15.18:0/2584645494 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa92415bc90 0x7fa9240c8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:39.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.397+0000 7fa92a6fe640 1 -- 172.21.15.18:0/2584645494 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa910004810 msgr2=0x7fa924158ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:39.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.397+0000 7fa92a6fe640 1 --2- 172.21.15.18:0/2584645494 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa910004810 0x7fa924158ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:39.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.397+0000 7fa92a6fe640 1 -- 172.21.15.18:0/2584645494 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa924159000 con 0x7fa9240c9470 2024-04-17T19:53:39.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.397+0000 7fa9296fc640 1 --2- 172.21.15.18:0/2584645494 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa92415bc90 0x7fa9240c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:53:39.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.397+0000 7fa92a6fe640 1 --2- 172.21.15.18:0/2584645494 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9240c9470 0x7fa9241f5ab0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa92415d7c0 tx=0x7fa920011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:39.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.397+0000 7fa91a7fc640 1 -- 172.21.15.18:0/2584645494 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa920004240 con 0x7fa9240c9470 2024-04-17T19:53:39.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.397+0000 7fa91a7fc640 1 -- 172.21.15.18:0/2584645494 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa92001b070 con 0x7fa9240c9470 2024-04-17T19:53:39.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.397+0000 7fa92c161640 1 -- 172.21.15.18:0/2584645494 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9240c9880 con 0x7fa9240c9470 2024-04-17T19:53:39.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.397+0000 7fa91a7fc640 1 -- 172.21.15.18:0/2584645494 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa92000f740 con 0x7fa9240c9470 2024-04-17T19:53:39.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.397+0000 7fa92c161640 1 -- 172.21.15.18:0/2584645494 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa92415ca70 con 0x7fa9240c9470 2024-04-17T19:53:39.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.401+0000 7fa92c161640 1 -- 172.21.15.18:0/2584645494 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa92415d080 con 0x7fa9240c9470 2024-04-17T19:53:39.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.401+0000 7fa91a7fc640 1 -- 172.21.15.18:0/2584645494 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa920012040 con 0x7fa9240c9470 2024-04-17T19:53:39.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.401+0000 7fa91a7fc640 1 --2- 172.21.15.18:0/2584645494 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fa908068380 0x7fa90806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:39.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.401+0000 7fa91a7fc640 1 -- 172.21.15.18:0/2584645494 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fa920086ba0 con 0x7fa9240c9470 2024-04-17T19:53:39.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.401+0000 7fa929efd640 1 --2- 172.21.15.18:0/2584645494 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fa908068380 0x7fa90806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:39.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.401+0000 7fa929efd640 1 --2- 172.21.15.18:0/2584645494 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fa908068380 0x7fa90806a890 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa91c0013e0 tx=0x7fa91c006040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:39.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.405+0000 7fa91a7fc640 1 -- 172.21.15.18:0/2584645494 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa92415d080 con 0x7fa9240c9470 2024-04-17T19:53:39.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.609+0000 7fa92c161640 1 -- 172.21.15.18:0/2584645494 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa924069950 con 0x7fa9240c9470 2024-04-17T19:53:39.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.609+0000 7fa91a7fc640 1 -- 172.21.15.18:0/2584645494 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7fa920086070 con 0x7fa9240c9470 2024-04-17T19:53:39.605 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-17T19:53:39.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.613+0000 7fa92c161640 1 -- 172.21.15.18:0/2584645494 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fa908068380 msgr2=0x7fa90806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:39.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.613+0000 7fa92c161640 1 --2- 172.21.15.18:0/2584645494 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fa908068380 0x7fa90806a890 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa91c0013e0 tx=0x7fa91c006040 comp rx=0 tx=0).stop 2024-04-17T19:53:39.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.613+0000 7fa92c161640 1 -- 172.21.15.18:0/2584645494 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9240c9470 msgr2=0x7fa9241f5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:39.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.613+0000 7fa92c161640 1 --2- 172.21.15.18:0/2584645494 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9240c9470 0x7fa9241f5ab0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa92415d7c0 tx=0x7fa920011cf0 comp rx=0 tx=0).stop 2024-04-17T19:53:39.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.613+0000 7fa92c161640 1 -- 172.21.15.18:0/2584645494 shutdown_connections 2024-04-17T19:53:39.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.613+0000 7fa92c161640 1 --2- 172.21.15.18:0/2584645494 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fa908068380 0x7fa90806a890 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:39.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.613+0000 7fa92c161640 1 --2- 172.21.15.18:0/2584645494 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9240c9470 0x7fa9241f5ab0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:39.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.613+0000 7fa92c161640 1 --2- 172.21.15.18:0/2584645494 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa92415bc90 0x7fa9240c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:39.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.613+0000 7fa92c161640 1 --2- 172.21.15.18:0/2584645494 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa910004810 0x7fa924158ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:39.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.613+0000 7fa92c161640 1 -- 172.21.15.18:0/2584645494 >> 172.21.15.18:0/2584645494 conn(0x7fa9240d4ed0 msgr2=0x7fa9241625d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:39.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.613+0000 7fa92c161640 1 -- 172.21.15.18:0/2584645494 shutdown_connections 2024-04-17T19:53:39.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39.613+0000 7fa92c161640 1 -- 172.21.15.18:0/2584645494 wait complete. 2024-04-17T19:53:39.628 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-17T19:53:39.628 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-17T19:53:39.628 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi018.front.sepia.ceph.com 2024-04-17T19:53:39.628 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-04-17T19:53:39.628 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-17T19:53:39.628 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-17T19:53:39.628 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-17T19:53:39.628 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-17T19:53:39.628 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-04-17T19:53:39.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:39.628 DEBUG:teuthology.orchestra.run.smithi018:> ip addr 2024-04-17T19:53:39.635 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-17T19:53:39.635 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-17T19:53:39.635 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2024-04-17T19:53:39.635 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-17T19:53:39.635 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2024-04-17T19:53:39.635 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-17T19:53:39.635 INFO:teuthology.orchestra.run.smithi018.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-17T19:53:39.635 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:98 brd ff:ff:ff:ff:ff:ff 2024-04-17T19:53:39.635 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f0 2024-04-17T19:53:39.635 INFO:teuthology.orchestra.run.smithi018.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-17T19:53:39.635 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:99 brd ff:ff:ff:ff:ff:ff 2024-04-17T19:53:39.635 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f1 2024-04-17T19:53:39.635 INFO:teuthology.orchestra.run.smithi018.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-17T19:53:39.635 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:62 brd ff:ff:ff:ff:ff:ff 2024-04-17T19:53:39.635 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f0 2024-04-17T19:53:39.636 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.21.15.18/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-17T19:53:39.636 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft 42439sec preferred_lft 42439sec 2024-04-17T19:53:39.636 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::ec4:7aff:febd:1362/64 scope link 2024-04-17T19:53:39.636 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-17T19:53:39.636 INFO:teuthology.orchestra.run.smithi018.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-17T19:53:39.636 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:63 brd ff:ff:ff:ff:ff:ff 2024-04-17T19:53:39.636 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f1 2024-04-17T19:53:39.636 INFO:teuthology.orchestra.run.smithi018.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-17T19:53:39.636 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 02:42:a8:c7:c7:ae brd ff:ff:ff:ff:ff:ff 2024-04-17T19:53:39.636 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-17T19:53:39.636 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-17T19:53:39.636 INFO:teuthology.orchestra.run.smithi018.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-17T19:53:39.636 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-17T19:53:39.636 INFO:teuthology.orchestra.run.smithi018.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-17T19:53:39.636 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-17T19:53:39.637 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-17T19:53:39.637 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-17T19:53:39.637 INFO:teuthology.orchestra.run.smithi018.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-17T19:53:39.637 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-17T19:53:39.637 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-17T19:53:39.637 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-17T19:53:39.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:39.637 DEBUG:teuthology.orchestra.run.smithi018:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-17T19:53:39.686 INFO:teuthology.orchestra.run.smithi018.stdout:1 2024-04-17T19:53:39.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:39.687 DEBUG:teuthology.orchestra.run.smithi018:> route 2024-04-17T19:53:39.737 INFO:teuthology.orchestra.run.smithi018.stdout:Kernel IP routing table 2024-04-17T19:53:39.737 INFO:teuthology.orchestra.run.smithi018.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-17T19:53:39.738 INFO:teuthology.orchestra.run.smithi018.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-17T19:53:39.738 INFO:teuthology.orchestra.run.smithi018.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-17T19:53:39.738 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-17T19:53:39.738 INFO:teuthology.orchestra.run.smithi018.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-17T19:53:39.738 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T19:53:39.738 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-17T19:53:39.738 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-17T19:53:39.738 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-17T19:53:39.738 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-17T19:53:39.738 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-17T19:53:39.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T19:53:39.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T19:53:39.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:39.863 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-04-17T19:53:39.868 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-17T19:53:39.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:39.869 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list-id 2024-04-17T19:53:39.915 INFO:teuthology.orchestra.run.smithi018.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-04-17T19:53:39.916 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T19:53:39.916 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-17T19:53:39.916 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-17T19:53:39.916 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-04-17T19:53:39.916 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-17T19:53:40.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T19:53:40.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T19:53:40.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:40.039 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-17T19:53:40.052 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-17T19:53:40.053 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-17T19:53:40.053 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2024-04-17T19:53:40.053 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-17T19:53:40.053 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2024-04-17T19:53:40.053 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-17T19:53:40.053 INFO:teuthology.orchestra.run.smithi018.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-17T19:53:40.053 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether ca:a7:8f:cc:f2:cb brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-17T19:53:40.053 INFO:teuthology.orchestra.run.smithi018.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-17T19:53:40.053 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-17T19:53:40.053 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::c8a7:8fff:fecc:f2cb/64 scope link 2024-04-17T19:53:40.053 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-17T19:53:40.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:40.055 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-17T19:53:40.108 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-17T19:53:40.108 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-17T19:53:40.108 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2024-04-17T19:53:40.108 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-17T19:53:40.108 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2024-04-17T19:53:40.108 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-17T19:53:40.108 INFO:teuthology.orchestra.run.smithi018.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-17T19:53:40.108 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether ca:a7:8f:cc:f2:cb brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-17T19:53:40.109 INFO:teuthology.orchestra.run.smithi018.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-17T19:53:40.109 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-17T19:53:40.109 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::c8a7:8fff:fecc:f2cb/64 scope link 2024-04-17T19:53:40.109 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-17T19:53:40.110 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-04-17T19:53:40.110 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T19:53:40.110 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-17T19:53:40.110 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-04-17T19:53:40.110 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-17T19:53:40.110 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-04-17T19:53:40.110 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-04-17T19:53:40.110 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-04-17T19:53:40.110 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-17T19:53:40.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T19:53:40.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T19:53:40.254 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T19:53:40.254 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-17T19:53:40.254 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set brx.1 up 2024-04-17T19:53:40.254 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set dev brx.1 master ceph-brx 2024-04-17T19:53:40.254 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-17T19:53:40.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T19:53:40.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T19:53:40.314 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-04-17T19:53:40.315 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-17T19:53:40.315 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-04-17T19:53:40.359 INFO:teuthology.orchestra.run.smithi018.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-04-17T19:53:40.360 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-17T19:53:40.360 DEBUG:teuthology.orchestra.run.smithi018:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-04-17T19:53:40.408 DEBUG:teuthology.orchestra.run.smithi018:> sudo modprobe fuse 2024-04-17T19:53:40.465 DEBUG:teuthology.orchestra.run.smithi018:> cat /proc/self/mounts | awk '{print $2}' 2024-04-17T19:53:40.517 INFO:teuthology.orchestra.run.smithi018.stdout:/sys 2024-04-17T19:53:40.517 INFO:teuthology.orchestra.run.smithi018.stdout:/proc 2024-04-17T19:53:40.517 INFO:teuthology.orchestra.run.smithi018.stdout:/dev 2024-04-17T19:53:40.517 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/pts 2024-04-17T19:53:40.518 INFO:teuthology.orchestra.run.smithi018.stdout:/run 2024-04-17T19:53:40.518 INFO:teuthology.orchestra.run.smithi018.stdout:/ 2024-04-17T19:53:40.518 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/security 2024-04-17T19:53:40.518 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/shm 2024-04-17T19:53:40.518 INFO:teuthology.orchestra.run.smithi018.stdout:/run/lock 2024-04-17T19:53:40.518 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/cgroup 2024-04-17T19:53:40.518 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/pstore 2024-04-17T19:53:40.518 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/bpf 2024-04-17T19:53:40.518 INFO:teuthology.orchestra.run.smithi018.stdout:/proc/sys/fs/binfmt_misc 2024-04-17T19:53:40.518 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/hugepages 2024-04-17T19:53:40.518 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/mqueue 2024-04-17T19:53:40.518 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/debug 2024-04-17T19:53:40.518 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/tracing 2024-04-17T19:53:40.519 INFO:teuthology.orchestra.run.smithi018.stdout:/proc/fs/nfsd 2024-04-17T19:53:40.519 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/fuse/connections 2024-04-17T19:53:40.519 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/config 2024-04-17T19:53:40.519 INFO:teuthology.orchestra.run.smithi018.stdout:/run/credentials/systemd-sysusers.service 2024-04-17T19:53:40.519 INFO:teuthology.orchestra.run.smithi018.stdout:/run/rpc_pipefs 2024-04-17T19:53:40.519 INFO:teuthology.orchestra.run.smithi018.stdout:/run/user/1000 2024-04-17T19:53:40.519 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph 2024-04-17T19:53:40.519 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph/osd/ceph-0 2024-04-17T19:53:40.519 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph/osd/ceph-1 2024-04-17T19:53:40.519 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph/osd/ceph-2 2024-04-17T19:53:40.519 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph/osd/ceph-3 2024-04-17T19:53:40.519 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns 2024-04-17T19:53:40.519 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-17T19:53:40.519 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-17T19:53:40.520 INFO:teuthology.orchestra.run.smithi018.stdout:/home/ubuntu/cephtest/mnt.0 2024-04-17T19:53:40.520 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-17T19:53:40.520 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-17T19:53:40.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:40.521 DEBUG:teuthology.orchestra.run.smithi018:> ls /sys/fs/fuse/connections 2024-04-17T19:53:40.568 INFO:teuthology.orchestra.run.smithi018.stdout:45 2024-04-17T19:53:40.569 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [45] 2024-04-17T19:53:40.569 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2024-04-17T19:53:40.613 DEBUG:teuthology.orchestra.run.smithi018:> sudo modprobe fuse 2024-04-17T19:53:40.628 DEBUG:teuthology.orchestra.run.smithi018:> cat /proc/self/mounts | awk '{print $2}' 2024-04-17T19:53:40.677 INFO:teuthology.orchestra.run.smithi018.stdout:/sys 2024-04-17T19:53:40.678 INFO:teuthology.orchestra.run.smithi018.stdout:/proc 2024-04-17T19:53:40.678 INFO:teuthology.orchestra.run.smithi018.stdout:/dev 2024-04-17T19:53:40.678 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/pts 2024-04-17T19:53:40.678 INFO:teuthology.orchestra.run.smithi018.stdout:/run 2024-04-17T19:53:40.678 INFO:teuthology.orchestra.run.smithi018.stdout:/ 2024-04-17T19:53:40.678 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/security 2024-04-17T19:53:40.678 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/shm 2024-04-17T19:53:40.678 INFO:teuthology.orchestra.run.smithi018.stdout:/run/lock 2024-04-17T19:53:40.678 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/cgroup 2024-04-17T19:53:40.678 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/pstore 2024-04-17T19:53:40.679 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/bpf 2024-04-17T19:53:40.679 INFO:teuthology.orchestra.run.smithi018.stdout:/proc/sys/fs/binfmt_misc 2024-04-17T19:53:40.679 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/hugepages 2024-04-17T19:53:40.679 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/mqueue 2024-04-17T19:53:40.679 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/debug 2024-04-17T19:53:40.679 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/tracing 2024-04-17T19:53:40.679 INFO:teuthology.orchestra.run.smithi018.stdout:/proc/fs/nfsd 2024-04-17T19:53:40.679 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/fuse/connections 2024-04-17T19:53:40.680 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/config 2024-04-17T19:53:40.680 INFO:teuthology.orchestra.run.smithi018.stdout:/run/credentials/systemd-sysusers.service 2024-04-17T19:53:40.680 INFO:teuthology.orchestra.run.smithi018.stdout:/run/rpc_pipefs 2024-04-17T19:53:40.680 INFO:teuthology.orchestra.run.smithi018.stdout:/run/user/1000 2024-04-17T19:53:40.680 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph 2024-04-17T19:53:40.680 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph/osd/ceph-0 2024-04-17T19:53:40.680 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph/osd/ceph-1 2024-04-17T19:53:40.680 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph/osd/ceph-2 2024-04-17T19:53:40.680 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph/osd/ceph-3 2024-04-17T19:53:40.680 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns 2024-04-17T19:53:40.681 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-17T19:53:40.681 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-17T19:53:40.681 INFO:teuthology.orchestra.run.smithi018.stdout:/home/ubuntu/cephtest/mnt.0 2024-04-17T19:53:40.681 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-17T19:53:40.681 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-17T19:53:40.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:40.681 DEBUG:teuthology.orchestra.run.smithi018:> ls /sys/fs/fuse/connections 2024-04-17T19:53:40.728 INFO:teuthology.orchestra.run.smithi018.stdout:45 2024-04-17T19:53:40.730 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi018.stderr:2024-04-17T19:53:40.733+0000 7fd897ca9580 -1 init, newargv = 0x7fd888001090 newargc=15 2024-04-17T19:53:40.730 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi018.stderr:ceph-fuse[35668]: starting ceph client 2024-04-17T19:53:40.737 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi018.stderr:ceph-fuse[35668]: starting fuse 2024-04-17T19:53:41.830 DEBUG:teuthology.orchestra.run.smithi018:> sudo modprobe fuse 2024-04-17T19:53:41.846 DEBUG:teuthology.orchestra.run.smithi018:> cat /proc/self/mounts | awk '{print $2}' 2024-04-17T19:53:41.895 INFO:teuthology.orchestra.run.smithi018.stdout:/sys 2024-04-17T19:53:41.895 INFO:teuthology.orchestra.run.smithi018.stdout:/proc 2024-04-17T19:53:41.895 INFO:teuthology.orchestra.run.smithi018.stdout:/dev 2024-04-17T19:53:41.896 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/pts 2024-04-17T19:53:41.896 INFO:teuthology.orchestra.run.smithi018.stdout:/run 2024-04-17T19:53:41.896 INFO:teuthology.orchestra.run.smithi018.stdout:/ 2024-04-17T19:53:41.896 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/security 2024-04-17T19:53:41.896 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/shm 2024-04-17T19:53:41.896 INFO:teuthology.orchestra.run.smithi018.stdout:/run/lock 2024-04-17T19:53:41.896 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/cgroup 2024-04-17T19:53:41.896 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/pstore 2024-04-17T19:53:41.896 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/bpf 2024-04-17T19:53:41.896 INFO:teuthology.orchestra.run.smithi018.stdout:/proc/sys/fs/binfmt_misc 2024-04-17T19:53:41.896 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/hugepages 2024-04-17T19:53:41.897 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/mqueue 2024-04-17T19:53:41.897 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/debug 2024-04-17T19:53:41.897 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/tracing 2024-04-17T19:53:41.897 INFO:teuthology.orchestra.run.smithi018.stdout:/proc/fs/nfsd 2024-04-17T19:53:41.897 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/fuse/connections 2024-04-17T19:53:41.897 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/config 2024-04-17T19:53:41.897 INFO:teuthology.orchestra.run.smithi018.stdout:/run/credentials/systemd-sysusers.service 2024-04-17T19:53:41.897 INFO:teuthology.orchestra.run.smithi018.stdout:/run/rpc_pipefs 2024-04-17T19:53:41.897 INFO:teuthology.orchestra.run.smithi018.stdout:/run/user/1000 2024-04-17T19:53:41.897 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph 2024-04-17T19:53:41.897 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph/osd/ceph-0 2024-04-17T19:53:41.898 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph/osd/ceph-1 2024-04-17T19:53:41.898 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph/osd/ceph-2 2024-04-17T19:53:41.898 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph/osd/ceph-3 2024-04-17T19:53:41.898 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns 2024-04-17T19:53:41.898 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-17T19:53:41.898 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-17T19:53:41.898 INFO:teuthology.orchestra.run.smithi018.stdout:/home/ubuntu/cephtest/mnt.0 2024-04-17T19:53:41.898 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-17T19:53:41.898 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-17T19:53:41.898 INFO:teuthology.orchestra.run.smithi018.stdout:/home/ubuntu/cephtest/mnt.2 2024-04-17T19:53:41.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:41.900 DEBUG:teuthology.orchestra.run.smithi018:> ls /sys/fs/fuse/connections 2024-04-17T19:53:41.949 INFO:teuthology.orchestra.run.smithi018.stdout:45 2024-04-17T19:53:41.949 INFO:teuthology.orchestra.run.smithi018.stdout:46 2024-04-17T19:53:41.949 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45, 46] 2024-04-17T19:53:41.950 DEBUG:teuthology.orchestra.run.smithi018:> sudo stdin-killer -- python3 -c ' 2024-04-17T19:53:41.950 DEBUG:teuthology.orchestra.run.smithi018:> import glob 2024-04-17T19:53:41.950 DEBUG:teuthology.orchestra.run.smithi018:> import re 2024-04-17T19:53:41.950 DEBUG:teuthology.orchestra.run.smithi018:> import os 2024-04-17T19:53:41.950 DEBUG:teuthology.orchestra.run.smithi018:> import subprocess 2024-04-17T19:53:41.950 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-17T19:53:41.950 DEBUG:teuthology.orchestra.run.smithi018:> def _find_admin_socket(client_name): 2024-04-17T19:53:41.950 DEBUG:teuthology.orchestra.run.smithi018:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-04-17T19:53:41.951 DEBUG:teuthology.orchestra.run.smithi018:> files = glob.glob(asok_path) 2024-04-17T19:53:41.951 DEBUG:teuthology.orchestra.run.smithi018:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-04-17T19:53:41.951 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-17T19:53:41.951 DEBUG:teuthology.orchestra.run.smithi018:> # Given a non-glob path, it better be there 2024-04-17T19:53:41.951 DEBUG:teuthology.orchestra.run.smithi018:> if "*" not in asok_path: 2024-04-17T19:53:41.951 DEBUG:teuthology.orchestra.run.smithi018:> assert(len(files) == 1) 2024-04-17T19:53:41.951 DEBUG:teuthology.orchestra.run.smithi018:> return files[0] 2024-04-17T19:53:41.951 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-17T19:53:41.951 DEBUG:teuthology.orchestra.run.smithi018:> for f in files: 2024-04-17T19:53:41.951 DEBUG:teuthology.orchestra.run.smithi018:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-17T19:53:41.951 DEBUG:teuthology.orchestra.run.smithi018:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-17T19:53:41.951 DEBUG:teuthology.orchestra.run.smithi018:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-17T19:53:41.952 DEBUG:teuthology.orchestra.run.smithi018:> contents = proc_f.read() 2024-04-17T19:53:41.952 DEBUG:teuthology.orchestra.run.smithi018:> if mountpoint in contents: 2024-04-17T19:53:41.952 DEBUG:teuthology.orchestra.run.smithi018:> return f 2024-04-17T19:53:41.952 DEBUG:teuthology.orchestra.run.smithi018:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-17T19:53:41.952 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-17T19:53:41.952 DEBUG:teuthology.orchestra.run.smithi018:> print(_find_admin_socket("client.2")) 2024-04-17T19:53:41.952 DEBUG:teuthology.orchestra.run.smithi018:> ' 2024-04-17T19:53:42.080 INFO:teuthology.orchestra.run.smithi018.stdout:/var/run/ceph/ceph-client.2.35668.asok 2024-04-17T19:53:42.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T19:53:42.093 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.35668.asok 2024-04-17T19:53:42.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:42.093 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.35668.asok status 2024-04-17T19:53:42.274 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-17T19:53:42.274 INFO:teuthology.orchestra.run.smithi018.stdout: "metadata": { 2024-04-17T19:53:42.274 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_sha1": "f3a98d3f110319c567ec86bf70955c141495ccf6", 2024-04-17T19:53:42.274 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_version": "ceph version 19.0.0-3146-gf3a98d3f (f3a98d3f110319c567ec86bf70955c141495ccf6) squid (dev)", 2024-04-17T19:53:42.274 INFO:teuthology.orchestra.run.smithi018.stdout: "entity_id": "2", 2024-04-17T19:53:42.274 INFO:teuthology.orchestra.run.smithi018.stdout: "hostname": "smithi018", 2024-04-17T19:53:42.275 INFO:teuthology.orchestra.run.smithi018.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-04-17T19:53:42.275 INFO:teuthology.orchestra.run.smithi018.stdout: "pid": "35668", 2024-04-17T19:53:42.275 INFO:teuthology.orchestra.run.smithi018.stdout: "root": "/" 2024-04-17T19:53:42.275 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-17T19:53:42.275 INFO:teuthology.orchestra.run.smithi018.stdout: "dentry_count": 0, 2024-04-17T19:53:42.275 INFO:teuthology.orchestra.run.smithi018.stdout: "dentry_pinned_count": 0, 2024-04-17T19:53:42.275 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 4908, 2024-04-17T19:53:42.275 INFO:teuthology.orchestra.run.smithi018.stdout: "inst": { 2024-04-17T19:53:42.275 INFO:teuthology.orchestra.run.smithi018.stdout: "name": { 2024-04-17T19:53:42.275 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "client", 2024-04-17T19:53:42.275 INFO:teuthology.orchestra.run.smithi018.stdout: "num": 4908 2024-04-17T19:53:42.275 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-17T19:53:42.275 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": { 2024-04-17T19:53:42.276 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-04-17T19:53:42.276 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "192.168.0.2:0", 2024-04-17T19:53:42.276 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1628727803 2024-04-17T19:53:42.276 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-17T19:53:42.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-17T19:53:42.276 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": { 2024-04-17T19:53:42.276 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-04-17T19:53:42.276 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "192.168.0.2:0", 2024-04-17T19:53:42.276 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1628727803 2024-04-17T19:53:42.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-17T19:53:42.276 INFO:teuthology.orchestra.run.smithi018.stdout: "inst_str": "client.4908 192.168.0.2:0/1628727803", 2024-04-17T19:53:42.276 INFO:teuthology.orchestra.run.smithi018.stdout: "addr_str": "192.168.0.2:0/1628727803", 2024-04-17T19:53:42.276 INFO:teuthology.orchestra.run.smithi018.stdout: "inode_count": 1, 2024-04-17T19:53:42.276 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_epoch": 9, 2024-04-17T19:53:42.277 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_epoch": 27, 2024-04-17T19:53:42.277 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_epoch_barrier": 0, 2024-04-17T19:53:42.277 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklisted": false, 2024-04-17T19:53:42.277 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs" 2024-04-17T19:53:42.277 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-17T19:53:42.291 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-17T19:53:42.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.449+0000 7fa0a160b640 1 Processor -- start 2024-04-17T19:53:42.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.449+0000 7fa0a160b640 1 -- start start 2024-04-17T19:53:42.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.449+0000 7fa0a160b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa09c06d470 0x7fa09c15ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:42.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.449+0000 7fa0a160b640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa09c0d0020 con 0x7fa09c15e1a0 2024-04-17T19:53:42.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.449+0000 7fa0a160b640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa09c0cd930 con 0x7fa09c15e910 2024-04-17T19:53:42.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.449+0000 7fa0a160b640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fa09c0cdc10 con 0x7fa09c06d470 2024-04-17T19:53:42.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.449+0000 7fa09b7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa09c06d470 0x7fa09c15ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:42.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.449+0000 7fa09affd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fa09c15e1a0 0x7fa09c0ce9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:48088/0 (socket says 172.21.15.18:48088) 2024-04-17T19:53:42.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.449+0000 7fa09affd640 1 -- 172.21.15.18:0/4112544399 learned_addr learned my addr 172.21.15.18:0/4112544399 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:42.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.449+0000 7fa09b7fe640 1 -- 172.21.15.18:0/4112544399 >> v1:172.21.15.173:6789/0 conn(0x7fa09c15e910 legacy=0x7fa09c06cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:42.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.449+0000 7fa09b7fe640 1 -- 172.21.15.18:0/4112544399 >> v1:172.21.15.18:6789/0 conn(0x7fa09c15e1a0 legacy=0x7fa09c0ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:42.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.449+0000 7fa09b7fe640 1 -- 172.21.15.18:0/4112544399 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa09c0cdef0 con 0x7fa09c06d470 2024-04-17T19:53:42.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.453+0000 7fa09b7fe640 1 --2- 172.21.15.18:0/4112544399 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa09c06d470 0x7fa09c15ed20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa094009d90 tx=0x7fa09401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ad991c6f87e4be6 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:42.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.453+0000 7fa099ffb640 1 -- 172.21.15.18:0/4112544399 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0940b2070 con 0x7fa09c06d470 2024-04-17T19:53:42.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.453+0000 7fa099ffb640 1 -- 172.21.15.18:0/4112544399 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0940a5890 con 0x7fa09c06d470 2024-04-17T19:53:42.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.453+0000 7fa099ffb640 1 -- 172.21.15.18:0/4112544399 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0940a5c60 con 0x7fa09c06d470 2024-04-17T19:53:42.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.453+0000 7fa0a160b640 1 -- 172.21.15.18:0/4112544399 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa09c06d470 msgr2=0x7fa09c15ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:42.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.453+0000 7fa0a160b640 1 --2- 172.21.15.18:0/4112544399 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa09c06d470 0x7fa09c15ed20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa094009d90 tx=0x7fa09401c8e0 comp rx=0 tx=0).stop 2024-04-17T19:53:42.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.453+0000 7fa0a160b640 1 -- 172.21.15.18:0/4112544399 shutdown_connections 2024-04-17T19:53:42.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.453+0000 7fa0a160b640 1 --2- 172.21.15.18:0/4112544399 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa09c06d470 0x7fa09c15ed20 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:42.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.453+0000 7fa0a160b640 1 -- 172.21.15.18:0/4112544399 >> 172.21.15.18:0/4112544399 conn(0x7fa09c072bb0 msgr2=0x7fa09c072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:42.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.453+0000 7fa0a160b640 1 -- 172.21.15.18:0/4112544399 shutdown_connections 2024-04-17T19:53:42.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.453+0000 7fa0a160b640 1 -- 172.21.15.18:0/4112544399 wait complete. 2024-04-17T19:53:42.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.457+0000 7fa0a160b640 1 Processor -- start 2024-04-17T19:53:42.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.457+0000 7fa0a160b640 1 -- start start 2024-04-17T19:53:42.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.457+0000 7fa0a160b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa09c15e1a0 0x7fa09c146d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:42.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.457+0000 7fa0a160b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa09c15e910 0x7fa09c154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:42.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.457+0000 7fa0a160b640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa09c1535e0 0x7fa09c1552b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:42.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.457+0000 7fa0a160b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa09c0cf260 con 0x7fa09c15e910 2024-04-17T19:53:42.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.457+0000 7fa0a160b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa09c0cf0e0 con 0x7fa09c15e1a0 2024-04-17T19:53:42.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.457+0000 7fa0a160b640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fa09c157a10 con 0x7fa09c1535e0 2024-04-17T19:53:42.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.457+0000 7fa09a7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa09c15e910 0x7fa09c154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:42.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.457+0000 7fa09a7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa09c15e910 0x7fa09c154d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48704/0 (socket says 172.21.15.18:48704) 2024-04-17T19:53:42.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.457+0000 7fa09a7fc640 1 -- 172.21.15.18:0/3442269639 learned_addr learned my addr 172.21.15.18:0/3442269639 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:42.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.457+0000 7fa09affd640 1 --2- 172.21.15.18:0/3442269639 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa09c15e1a0 0x7fa09c146d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:42.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.457+0000 7fa09b7fe640 1 --2- 172.21.15.18:0/3442269639 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa09c1535e0 0x7fa09c1552b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:42.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.457+0000 7fa09a7fc640 1 -- 172.21.15.18:0/3442269639 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa09c1535e0 msgr2=0x7fa09c1552b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:42.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.457+0000 7fa09a7fc640 1 --2- 172.21.15.18:0/3442269639 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa09c1535e0 0x7fa09c1552b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:42.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.457+0000 7fa09a7fc640 1 -- 172.21.15.18:0/3442269639 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa09c15e1a0 msgr2=0x7fa09c146d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:42.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.457+0000 7fa09a7fc640 1 --2- 172.21.15.18:0/3442269639 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa09c15e1a0 0x7fa09c146d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:42.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.457+0000 7fa09a7fc640 1 -- 172.21.15.18:0/3442269639 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa09c148f40 con 0x7fa09c15e910 2024-04-17T19:53:42.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.457+0000 7fa09a7fc640 1 --2- 172.21.15.18:0/3442269639 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa09c15e910 0x7fa09c154d70 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa09000c340 tx=0x7fa09000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:42.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.457+0000 7fa0837fe640 1 -- 172.21.15.18:0/3442269639 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0900052d0 con 0x7fa09c15e910 2024-04-17T19:53:42.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.457+0000 7fa0837fe640 1 -- 172.21.15.18:0/3442269639 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa090005470 con 0x7fa09c15e910 2024-04-17T19:53:42.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.457+0000 7fa0a160b640 1 -- 172.21.15.18:0/3442269639 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa09c1491c0 con 0x7fa09c15e910 2024-04-17T19:53:42.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.457+0000 7fa0837fe640 1 -- 172.21.15.18:0/3442269639 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa090007260 con 0x7fa09c15e910 2024-04-17T19:53:42.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.457+0000 7fa0a160b640 1 -- 172.21.15.18:0/3442269639 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa09c149780 con 0x7fa09c15e910 2024-04-17T19:53:42.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.461+0000 7fa0a160b640 1 -- 172.21.15.18:0/3442269639 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa09c14b1f0 con 0x7fa09c15e910 2024-04-17T19:53:42.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.461+0000 7fa0837fe640 1 -- 172.21.15.18:0/3442269639 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa090007400 con 0x7fa09c15e910 2024-04-17T19:53:42.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.461+0000 7fa0837fe640 1 --2- 172.21.15.18:0/3442269639 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fa088068380 0x7fa08806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:42.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.461+0000 7fa0837fe640 1 -- 172.21.15.18:0/3442269639 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6532+0+0 (secure 0 0 0) 0x7fa0900860a0 con 0x7fa09c15e910 2024-04-17T19:53:42.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.461+0000 7fa09affd640 1 --2- 172.21.15.18:0/3442269639 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fa088068380 0x7fa08806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:42.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.461+0000 7fa09affd640 1 --2- 172.21.15.18:0/3442269639 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fa088068380 0x7fa08806a890 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa08c000f70 tx=0x7fa08c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:42.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.465+0000 7fa0837fe640 1 -- 172.21.15.18:0/3442269639 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa09c148f40 con 0x7fa09c15e910 2024-04-17T19:53:42.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.665+0000 7fa0a160b640 1 -- 172.21.15.18:0/3442269639 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa09c069950 con 0x7fa09c15e910 2024-04-17T19:53:42.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.665+0000 7fa0837fe640 1 -- 172.21.15.18:0/3442269639 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7fa0900563b0 con 0x7fa09c15e910 2024-04-17T19:53:42.663 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-17T19:53:42.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.669+0000 7fa0a160b640 1 -- 172.21.15.18:0/3442269639 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fa088068380 msgr2=0x7fa08806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:42.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.669+0000 7fa0a160b640 1 --2- 172.21.15.18:0/3442269639 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fa088068380 0x7fa08806a890 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa08c000f70 tx=0x7fa08c009040 comp rx=0 tx=0).stop 2024-04-17T19:53:42.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.669+0000 7fa0a160b640 1 -- 172.21.15.18:0/3442269639 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa09c15e910 msgr2=0x7fa09c154d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:42.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.669+0000 7fa0a160b640 1 --2- 172.21.15.18:0/3442269639 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa09c15e910 0x7fa09c154d70 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa09000c340 tx=0x7fa09000c800 comp rx=0 tx=0).stop 2024-04-17T19:53:42.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.669+0000 7fa0a160b640 1 -- 172.21.15.18:0/3442269639 shutdown_connections 2024-04-17T19:53:42.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.669+0000 7fa0a160b640 1 --2- 172.21.15.18:0/3442269639 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fa088068380 0x7fa08806a890 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:42.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.669+0000 7fa0a160b640 1 --2- 172.21.15.18:0/3442269639 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa09c1535e0 0x7fa09c1552b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:42.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.669+0000 7fa0a160b640 1 --2- 172.21.15.18:0/3442269639 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa09c15e910 0x7fa09c154d70 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:42.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.669+0000 7fa0a160b640 1 --2- 172.21.15.18:0/3442269639 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa09c15e1a0 0x7fa09c146d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:42.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.669+0000 7fa0a160b640 1 -- 172.21.15.18:0/3442269639 >> 172.21.15.18:0/3442269639 conn(0x7fa09c072bb0 msgr2=0x7fa09c067ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:42.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.669+0000 7fa0a160b640 1 -- 172.21.15.18:0/3442269639 shutdown_connections 2024-04-17T19:53:42.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:42.669+0000 7fa0a160b640 1 -- 172.21.15.18:0/3442269639 wait complete. 2024-04-17T19:53:42.685 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-17T19:53:42.685 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-17T19:53:42.685 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi173.front.sepia.ceph.com 2024-04-17T19:53:42.685 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-17T19:53:42.685 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-17T19:53:42.685 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-17T19:53:42.685 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-17T19:53:42.685 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-17T19:53:42.685 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-17T19:53:42.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:42.686 DEBUG:teuthology.orchestra.run.smithi173:> ip addr 2024-04-17T19:53:42.692 INFO:teuthology.orchestra.run.smithi173.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-17T19:53:42.692 INFO:teuthology.orchestra.run.smithi173.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-17T19:53:42.693 INFO:teuthology.orchestra.run.smithi173.stdout: inet 127.0.0.1/8 scope host lo 2024-04-17T19:53:42.693 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-17T19:53:42.693 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 ::1/128 scope host 2024-04-17T19:53:42.693 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-17T19:53:42.693 INFO:teuthology.orchestra.run.smithi173.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-17T19:53:42.693 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:d9:38:6a brd ff:ff:ff:ff:ff:ff 2024-04-17T19:53:42.693 INFO:teuthology.orchestra.run.smithi173.stdout: altname enp7s0f0 2024-04-17T19:53:42.693 INFO:teuthology.orchestra.run.smithi173.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-17T19:53:42.693 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:d9:38:6b brd ff:ff:ff:ff:ff:ff 2024-04-17T19:53:42.693 INFO:teuthology.orchestra.run.smithi173.stdout: altname enp7s0f1 2024-04-17T19:53:42.693 INFO:teuthology.orchestra.run.smithi173.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-17T19:53:42.694 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:88:72:58 brd ff:ff:ff:ff:ff:ff 2024-04-17T19:53:42.694 INFO:teuthology.orchestra.run.smithi173.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-17T19:53:42.694 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:88:72:59 brd ff:ff:ff:ff:ff:ff 2024-04-17T19:53:42.694 INFO:teuthology.orchestra.run.smithi173.stdout: inet 172.21.15.173/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-17T19:53:42.694 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft 42435sec preferred_lft 42435sec 2024-04-17T19:53:42.694 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::ec4:7aff:fe88:7259/64 scope link 2024-04-17T19:53:42.694 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-17T19:53:42.694 INFO:teuthology.orchestra.run.smithi173.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-17T19:53:42.694 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 02:42:6c:fb:71:3d brd ff:ff:ff:ff:ff:ff 2024-04-17T19:53:42.694 INFO:teuthology.orchestra.run.smithi173.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-17T19:53:42.694 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-17T19:53:42.695 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-17T19:53:42.695 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T19:53:42.695 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-17T19:53:42.695 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link add name ceph-brx type bridge 2024-04-17T19:53:42.695 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip addr flush dev ceph-brx 2024-04-17T19:53:42.695 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link set ceph-brx up 2024-04-17T19:53:42.695 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-17T19:53:42.695 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-17T19:53:42.786 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:53:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T19:53:42.821 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:53:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T19:53:42.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:42.828 DEBUG:teuthology.orchestra.run.smithi173:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-17T19:53:42.837 INFO:teuthology.orchestra.run.smithi173.stdout:1 2024-04-17T19:53:42.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:42.839 DEBUG:teuthology.orchestra.run.smithi173:> route 2024-04-17T19:53:42.918 INFO:teuthology.orchestra.run.smithi173.stdout:Kernel IP routing table 2024-04-17T19:53:42.919 INFO:teuthology.orchestra.run.smithi173.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-17T19:53:42.919 INFO:teuthology.orchestra.run.smithi173.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-17T19:53:42.919 INFO:teuthology.orchestra.run.smithi173.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-17T19:53:42.919 INFO:teuthology.orchestra.run.smithi173.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-17T19:53:42.919 INFO:teuthology.orchestra.run.smithi173.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-17T19:53:42.919 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-17T19:53:42.919 INFO:teuthology.orchestra.run.smithi173.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-17T19:53:42.919 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-17T19:53:42.919 INFO:teuthology.orchestra.run.smithi173.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-17T19:53:42.919 INFO:teuthology.orchestra.run.smithi173.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-17T19:53:42.919 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T19:53:42.920 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-17T19:53:42.920 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-17T19:53:42.920 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-17T19:53:42.920 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-17T19:53:42.920 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-17T19:53:43.005 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:53:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T19:53:43.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:53:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T19:53:43.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:43.039 DEBUG:teuthology.orchestra.run.smithi173:> ip netns list 2024-04-17T19:53:43.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:43.045 DEBUG:teuthology.orchestra.run.smithi173:> ip netns list-id 2024-04-17T19:53:43.092 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T19:53:43.093 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-17T19:53:43.093 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-17T19:53:43.093 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-17T19:53:43.093 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-17T19:53:43.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:53:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T19:53:43.206 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:53:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T19:53:43.213 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-17T19:53:43.213 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T19:53:43.213 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-17T19:53:43.213 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-17T19:53:43.213 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-17T19:53:43.213 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-17T19:53:43.214 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-17T19:53:43.214 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-17T19:53:43.214 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-17T19:53:43.257 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:53:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T19:53:43.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:53:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T19:53:43.321 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T19:53:43.321 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-17T19:53:43.321 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link set brx.0 up 2024-04-17T19:53:43.321 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link set dev brx.0 master ceph-brx 2024-04-17T19:53:43.321 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-17T19:53:43.401 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:53:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T19:53:43.418 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:53:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T19:53:43.426 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-04-17T19:53:43.426 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-17T19:53:43.426 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-17T19:53:43.471 INFO:teuthology.orchestra.run.smithi173.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-17T19:53:43.472 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-17T19:53:43.472 DEBUG:teuthology.orchestra.run.smithi173:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-17T19:53:43.519 DEBUG:teuthology.orchestra.run.smithi173:> sudo modprobe fuse 2024-04-17T19:53:43.577 DEBUG:teuthology.orchestra.run.smithi173:> cat /proc/self/mounts | awk '{print $2}' 2024-04-17T19:53:43.625 INFO:teuthology.orchestra.run.smithi173.stdout:/sys 2024-04-17T19:53:43.625 INFO:teuthology.orchestra.run.smithi173.stdout:/proc 2024-04-17T19:53:43.625 INFO:teuthology.orchestra.run.smithi173.stdout:/dev 2024-04-17T19:53:43.626 INFO:teuthology.orchestra.run.smithi173.stdout:/dev/pts 2024-04-17T19:53:43.626 INFO:teuthology.orchestra.run.smithi173.stdout:/run 2024-04-17T19:53:43.626 INFO:teuthology.orchestra.run.smithi173.stdout:/ 2024-04-17T19:53:43.626 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/kernel/security 2024-04-17T19:53:43.626 INFO:teuthology.orchestra.run.smithi173.stdout:/dev/shm 2024-04-17T19:53:43.626 INFO:teuthology.orchestra.run.smithi173.stdout:/run/lock 2024-04-17T19:53:43.626 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/fs/cgroup 2024-04-17T19:53:43.626 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/fs/pstore 2024-04-17T19:53:43.626 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/fs/bpf 2024-04-17T19:53:43.626 INFO:teuthology.orchestra.run.smithi173.stdout:/proc/sys/fs/binfmt_misc 2024-04-17T19:53:43.626 INFO:teuthology.orchestra.run.smithi173.stdout:/dev/hugepages 2024-04-17T19:53:43.626 INFO:teuthology.orchestra.run.smithi173.stdout:/dev/mqueue 2024-04-17T19:53:43.626 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/kernel/debug 2024-04-17T19:53:43.627 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/kernel/tracing 2024-04-17T19:53:43.627 INFO:teuthology.orchestra.run.smithi173.stdout:/proc/fs/nfsd 2024-04-17T19:53:43.627 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/fs/fuse/connections 2024-04-17T19:53:43.627 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/kernel/config 2024-04-17T19:53:43.627 INFO:teuthology.orchestra.run.smithi173.stdout:/run/credentials/systemd-sysusers.service 2024-04-17T19:53:43.627 INFO:teuthology.orchestra.run.smithi173.stdout:/run/rpc_pipefs 2024-04-17T19:53:43.627 INFO:teuthology.orchestra.run.smithi173.stdout:/run/user/1000 2024-04-17T19:53:43.627 INFO:teuthology.orchestra.run.smithi173.stdout:/var/lib/ceph 2024-04-17T19:53:43.627 INFO:teuthology.orchestra.run.smithi173.stdout:/var/lib/ceph/osd/ceph-4 2024-04-17T19:53:43.627 INFO:teuthology.orchestra.run.smithi173.stdout:/var/lib/ceph/osd/ceph-5 2024-04-17T19:53:43.627 INFO:teuthology.orchestra.run.smithi173.stdout:/var/lib/ceph/osd/ceph-6 2024-04-17T19:53:43.627 INFO:teuthology.orchestra.run.smithi173.stdout:/var/lib/ceph/osd/ceph-7 2024-04-17T19:53:43.627 INFO:teuthology.orchestra.run.smithi173.stdout:/run/netns 2024-04-17T19:53:43.627 INFO:teuthology.orchestra.run.smithi173.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-17T19:53:43.627 INFO:teuthology.orchestra.run.smithi173.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-17T19:53:43.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:43.628 DEBUG:teuthology.orchestra.run.smithi173:> ls /sys/fs/fuse/connections 2024-04-17T19:53:43.672 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-17T19:53:43.672 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-04-17T19:53:43.717 DEBUG:teuthology.orchestra.run.smithi173:> sudo modprobe fuse 2024-04-17T19:53:43.730 DEBUG:teuthology.orchestra.run.smithi173:> cat /proc/self/mounts | awk '{print $2}' 2024-04-17T19:53:43.777 INFO:teuthology.orchestra.run.smithi173.stdout:/sys 2024-04-17T19:53:43.778 INFO:teuthology.orchestra.run.smithi173.stdout:/proc 2024-04-17T19:53:43.778 INFO:teuthology.orchestra.run.smithi173.stdout:/dev 2024-04-17T19:53:43.778 INFO:teuthology.orchestra.run.smithi173.stdout:/dev/pts 2024-04-17T19:53:43.778 INFO:teuthology.orchestra.run.smithi173.stdout:/run 2024-04-17T19:53:43.778 INFO:teuthology.orchestra.run.smithi173.stdout:/ 2024-04-17T19:53:43.778 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/kernel/security 2024-04-17T19:53:43.778 INFO:teuthology.orchestra.run.smithi173.stdout:/dev/shm 2024-04-17T19:53:43.778 INFO:teuthology.orchestra.run.smithi173.stdout:/run/lock 2024-04-17T19:53:43.778 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/fs/cgroup 2024-04-17T19:53:43.778 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/fs/pstore 2024-04-17T19:53:43.778 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/fs/bpf 2024-04-17T19:53:43.778 INFO:teuthology.orchestra.run.smithi173.stdout:/proc/sys/fs/binfmt_misc 2024-04-17T19:53:43.779 INFO:teuthology.orchestra.run.smithi173.stdout:/dev/hugepages 2024-04-17T19:53:43.779 INFO:teuthology.orchestra.run.smithi173.stdout:/dev/mqueue 2024-04-17T19:53:43.779 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/kernel/debug 2024-04-17T19:53:43.779 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/kernel/tracing 2024-04-17T19:53:43.779 INFO:teuthology.orchestra.run.smithi173.stdout:/proc/fs/nfsd 2024-04-17T19:53:43.779 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/fs/fuse/connections 2024-04-17T19:53:43.779 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/kernel/config 2024-04-17T19:53:43.779 INFO:teuthology.orchestra.run.smithi173.stdout:/run/credentials/systemd-sysusers.service 2024-04-17T19:53:43.779 INFO:teuthology.orchestra.run.smithi173.stdout:/run/rpc_pipefs 2024-04-17T19:53:43.779 INFO:teuthology.orchestra.run.smithi173.stdout:/run/user/1000 2024-04-17T19:53:43.779 INFO:teuthology.orchestra.run.smithi173.stdout:/var/lib/ceph 2024-04-17T19:53:43.779 INFO:teuthology.orchestra.run.smithi173.stdout:/var/lib/ceph/osd/ceph-4 2024-04-17T19:53:43.779 INFO:teuthology.orchestra.run.smithi173.stdout:/var/lib/ceph/osd/ceph-5 2024-04-17T19:53:43.779 INFO:teuthology.orchestra.run.smithi173.stdout:/var/lib/ceph/osd/ceph-6 2024-04-17T19:53:43.779 INFO:teuthology.orchestra.run.smithi173.stdout:/var/lib/ceph/osd/ceph-7 2024-04-17T19:53:43.779 INFO:teuthology.orchestra.run.smithi173.stdout:/run/netns 2024-04-17T19:53:43.780 INFO:teuthology.orchestra.run.smithi173.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-17T19:53:43.780 INFO:teuthology.orchestra.run.smithi173.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-17T19:53:43.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:43.780 DEBUG:teuthology.orchestra.run.smithi173:> ls /sys/fs/fuse/connections 2024-04-17T19:53:43.825 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi173.stderr:2024-04-17T19:53:43.830+0000 7f3036a14580 -1 init, newargv = 0x7f301801b4e0 newargc=15 2024-04-17T19:53:43.825 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi173.stderr:ceph-fuse[33073]: starting ceph client 2024-04-17T19:53:43.832 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi173.stderr:ceph-fuse[33073]: starting fuse 2024-04-17T19:53:44.925 DEBUG:teuthology.orchestra.run.smithi173:> sudo modprobe fuse 2024-04-17T19:53:44.941 DEBUG:teuthology.orchestra.run.smithi173:> cat /proc/self/mounts | awk '{print $2}' 2024-04-17T19:53:44.991 INFO:teuthology.orchestra.run.smithi173.stdout:/sys 2024-04-17T19:53:44.991 INFO:teuthology.orchestra.run.smithi173.stdout:/proc 2024-04-17T19:53:44.991 INFO:teuthology.orchestra.run.smithi173.stdout:/dev 2024-04-17T19:53:44.991 INFO:teuthology.orchestra.run.smithi173.stdout:/dev/pts 2024-04-17T19:53:44.992 INFO:teuthology.orchestra.run.smithi173.stdout:/run 2024-04-17T19:53:44.992 INFO:teuthology.orchestra.run.smithi173.stdout:/ 2024-04-17T19:53:44.992 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/kernel/security 2024-04-17T19:53:44.992 INFO:teuthology.orchestra.run.smithi173.stdout:/dev/shm 2024-04-17T19:53:44.992 INFO:teuthology.orchestra.run.smithi173.stdout:/run/lock 2024-04-17T19:53:44.992 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/fs/cgroup 2024-04-17T19:53:44.992 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/fs/pstore 2024-04-17T19:53:44.992 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/fs/bpf 2024-04-17T19:53:44.992 INFO:teuthology.orchestra.run.smithi173.stdout:/proc/sys/fs/binfmt_misc 2024-04-17T19:53:44.992 INFO:teuthology.orchestra.run.smithi173.stdout:/dev/hugepages 2024-04-17T19:53:44.992 INFO:teuthology.orchestra.run.smithi173.stdout:/dev/mqueue 2024-04-17T19:53:44.992 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/kernel/debug 2024-04-17T19:53:44.992 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/kernel/tracing 2024-04-17T19:53:44.992 INFO:teuthology.orchestra.run.smithi173.stdout:/proc/fs/nfsd 2024-04-17T19:53:44.992 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/fs/fuse/connections 2024-04-17T19:53:44.993 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/kernel/config 2024-04-17T19:53:44.993 INFO:teuthology.orchestra.run.smithi173.stdout:/run/credentials/systemd-sysusers.service 2024-04-17T19:53:44.993 INFO:teuthology.orchestra.run.smithi173.stdout:/run/rpc_pipefs 2024-04-17T19:53:44.993 INFO:teuthology.orchestra.run.smithi173.stdout:/run/user/1000 2024-04-17T19:53:44.993 INFO:teuthology.orchestra.run.smithi173.stdout:/var/lib/ceph 2024-04-17T19:53:44.993 INFO:teuthology.orchestra.run.smithi173.stdout:/var/lib/ceph/osd/ceph-4 2024-04-17T19:53:44.993 INFO:teuthology.orchestra.run.smithi173.stdout:/var/lib/ceph/osd/ceph-5 2024-04-17T19:53:44.993 INFO:teuthology.orchestra.run.smithi173.stdout:/var/lib/ceph/osd/ceph-6 2024-04-17T19:53:44.993 INFO:teuthology.orchestra.run.smithi173.stdout:/var/lib/ceph/osd/ceph-7 2024-04-17T19:53:44.993 INFO:teuthology.orchestra.run.smithi173.stdout:/run/netns 2024-04-17T19:53:44.993 INFO:teuthology.orchestra.run.smithi173.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-17T19:53:44.993 INFO:teuthology.orchestra.run.smithi173.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-17T19:53:44.993 INFO:teuthology.orchestra.run.smithi173.stdout:/home/ubuntu/cephtest/mnt.1 2024-04-17T19:53:44.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:44.995 DEBUG:teuthology.orchestra.run.smithi173:> ls /sys/fs/fuse/connections 2024-04-17T19:53:45.041 INFO:teuthology.orchestra.run.smithi173.stdout:45 2024-04-17T19:53:45.041 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-04-17T19:53:45.041 DEBUG:teuthology.orchestra.run.smithi173:> sudo stdin-killer -- python3 -c ' 2024-04-17T19:53:45.041 DEBUG:teuthology.orchestra.run.smithi173:> import glob 2024-04-17T19:53:45.041 DEBUG:teuthology.orchestra.run.smithi173:> import re 2024-04-17T19:53:45.041 DEBUG:teuthology.orchestra.run.smithi173:> import os 2024-04-17T19:53:45.041 DEBUG:teuthology.orchestra.run.smithi173:> import subprocess 2024-04-17T19:53:45.041 DEBUG:teuthology.orchestra.run.smithi173:> 2024-04-17T19:53:45.041 DEBUG:teuthology.orchestra.run.smithi173:> def _find_admin_socket(client_name): 2024-04-17T19:53:45.041 DEBUG:teuthology.orchestra.run.smithi173:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-04-17T19:53:45.042 DEBUG:teuthology.orchestra.run.smithi173:> files = glob.glob(asok_path) 2024-04-17T19:53:45.042 DEBUG:teuthology.orchestra.run.smithi173:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-04-17T19:53:45.042 DEBUG:teuthology.orchestra.run.smithi173:> 2024-04-17T19:53:45.042 DEBUG:teuthology.orchestra.run.smithi173:> # Given a non-glob path, it better be there 2024-04-17T19:53:45.042 DEBUG:teuthology.orchestra.run.smithi173:> if "*" not in asok_path: 2024-04-17T19:53:45.042 DEBUG:teuthology.orchestra.run.smithi173:> assert(len(files) == 1) 2024-04-17T19:53:45.042 DEBUG:teuthology.orchestra.run.smithi173:> return files[0] 2024-04-17T19:53:45.042 DEBUG:teuthology.orchestra.run.smithi173:> 2024-04-17T19:53:45.042 DEBUG:teuthology.orchestra.run.smithi173:> for f in files: 2024-04-17T19:53:45.042 DEBUG:teuthology.orchestra.run.smithi173:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-17T19:53:45.042 DEBUG:teuthology.orchestra.run.smithi173:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-17T19:53:45.042 DEBUG:teuthology.orchestra.run.smithi173:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-17T19:53:45.042 DEBUG:teuthology.orchestra.run.smithi173:> contents = proc_f.read() 2024-04-17T19:53:45.042 DEBUG:teuthology.orchestra.run.smithi173:> if mountpoint in contents: 2024-04-17T19:53:45.042 DEBUG:teuthology.orchestra.run.smithi173:> return f 2024-04-17T19:53:45.043 DEBUG:teuthology.orchestra.run.smithi173:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-17T19:53:45.043 DEBUG:teuthology.orchestra.run.smithi173:> 2024-04-17T19:53:45.043 DEBUG:teuthology.orchestra.run.smithi173:> print(_find_admin_socket("client.1")) 2024-04-17T19:53:45.043 DEBUG:teuthology.orchestra.run.smithi173:> ' 2024-04-17T19:53:45.163 INFO:teuthology.orchestra.run.smithi173.stdout:/var/run/ceph/ceph-client.1.33073.asok 2024-04-17T19:53:45.169 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:53:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T19:53:45.174 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.33073.asok 2024-04-17T19:53:45.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:45.175 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.33073.asok status 2024-04-17T19:53:45.354 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-17T19:53:45.354 INFO:teuthology.orchestra.run.smithi173.stdout: "metadata": { 2024-04-17T19:53:45.354 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_sha1": "f3a98d3f110319c567ec86bf70955c141495ccf6", 2024-04-17T19:53:45.354 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_version": "ceph version 19.0.0-3146-gf3a98d3f (f3a98d3f110319c567ec86bf70955c141495ccf6) squid (dev)", 2024-04-17T19:53:45.354 INFO:teuthology.orchestra.run.smithi173.stdout: "entity_id": "1", 2024-04-17T19:53:45.354 INFO:teuthology.orchestra.run.smithi173.stdout: "hostname": "smithi173", 2024-04-17T19:53:45.354 INFO:teuthology.orchestra.run.smithi173.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-04-17T19:53:45.354 INFO:teuthology.orchestra.run.smithi173.stdout: "pid": "33073", 2024-04-17T19:53:45.354 INFO:teuthology.orchestra.run.smithi173.stdout: "root": "/" 2024-04-17T19:53:45.355 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-17T19:53:45.355 INFO:teuthology.orchestra.run.smithi173.stdout: "dentry_count": 0, 2024-04-17T19:53:45.355 INFO:teuthology.orchestra.run.smithi173.stdout: "dentry_pinned_count": 0, 2024-04-17T19:53:45.355 INFO:teuthology.orchestra.run.smithi173.stdout: "id": 4547, 2024-04-17T19:53:45.355 INFO:teuthology.orchestra.run.smithi173.stdout: "inst": { 2024-04-17T19:53:45.355 INFO:teuthology.orchestra.run.smithi173.stdout: "name": { 2024-04-17T19:53:45.355 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "client", 2024-04-17T19:53:45.355 INFO:teuthology.orchestra.run.smithi173.stdout: "num": 4547 2024-04-17T19:53:45.355 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-17T19:53:45.355 INFO:teuthology.orchestra.run.smithi173.stdout: "addr": { 2024-04-17T19:53:45.355 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "v1", 2024-04-17T19:53:45.355 INFO:teuthology.orchestra.run.smithi173.stdout: "addr": "192.168.0.1:0", 2024-04-17T19:53:45.355 INFO:teuthology.orchestra.run.smithi173.stdout: "nonce": 1887700919 2024-04-17T19:53:45.355 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-17T19:53:45.355 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-17T19:53:45.355 INFO:teuthology.orchestra.run.smithi173.stdout: "addr": { 2024-04-17T19:53:45.356 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "v1", 2024-04-17T19:53:45.356 INFO:teuthology.orchestra.run.smithi173.stdout: "addr": "192.168.0.1:0", 2024-04-17T19:53:45.356 INFO:teuthology.orchestra.run.smithi173.stdout: "nonce": 1887700919 2024-04-17T19:53:45.356 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-17T19:53:45.356 INFO:teuthology.orchestra.run.smithi173.stdout: "inst_str": "client.4547 192.168.0.1:0/1887700919", 2024-04-17T19:53:45.356 INFO:teuthology.orchestra.run.smithi173.stdout: "addr_str": "192.168.0.1:0/1887700919", 2024-04-17T19:53:45.356 INFO:teuthology.orchestra.run.smithi173.stdout: "inode_count": 1, 2024-04-17T19:53:45.356 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_epoch": 9, 2024-04-17T19:53:45.356 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_epoch": 27, 2024-04-17T19:53:45.356 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_epoch_barrier": 0, 2024-04-17T19:53:45.356 INFO:teuthology.orchestra.run.smithi173.stdout: "blocklisted": false, 2024-04-17T19:53:45.356 INFO:teuthology.orchestra.run.smithi173.stdout: "fs_name": "cephfs" 2024-04-17T19:53:45.356 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-17T19:53:45.373 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-17T19:53:45.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.545+0000 7f071a153640 1 Processor -- start 2024-04-17T19:53:45.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.545+0000 7f071a153640 1 -- start start 2024-04-17T19:53:45.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.549+0000 7f071a153640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f07140d0910 0x7f07140d0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:45.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.549+0000 7f071a153640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f07141415f0 0x7f0714141a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:45.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.549+0000 7f071a153640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f071415d410 con 0x7f071415c6e0 2024-04-17T19:53:45.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.549+0000 7f071a153640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f07140cfe50 con 0x7f07140d0910 2024-04-17T19:53:45.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.549+0000 7f071a153640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f07140d0130 con 0x7f07141415f0 2024-04-17T19:53:45.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.549+0000 7f0713fff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f071415c6e0 0x7f071415caf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:54958/0 (socket says 172.21.15.18:54958) 2024-04-17T19:53:45.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.549+0000 7f0713fff640 1 -- 172.21.15.18:0/2507683222 learned_addr learned my addr 172.21.15.18:0/2507683222 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:45.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.549+0000 7f07137fe640 1 --2- 172.21.15.18:0/2507683222 >> v2:172.21.15.18:3300/0 conn(0x7f07140d0910 0x7f07140d0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:45.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.549+0000 7f0712ffd640 1 --2- 172.21.15.18:0/2507683222 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f07141415f0 0x7f0714141a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:45.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.549+0000 7f07127fc640 1 -- 172.21.15.18:0/2507683222 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3964603159 0 0) 0x7f071415d410 con 0x7f071415c6e0 2024-04-17T19:53:45.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.549+0000 7f07127fc640 1 -- 172.21.15.18:0/2507683222 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06fc003530 con 0x7f071415c6e0 2024-04-17T19:53:45.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.549+0000 7f07137fe640 1 -- 172.21.15.18:0/2507683222 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f07141415f0 msgr2=0x7f0714141a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:45.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.549+0000 7f07137fe640 1 --2- 172.21.15.18:0/2507683222 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f07141415f0 0x7f0714141a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:45.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.549+0000 7f07137fe640 1 -- 172.21.15.18:0/2507683222 >> v1:172.21.15.18:6789/0 conn(0x7f071415c6e0 legacy=0x7f071415caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:45.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.549+0000 7f07137fe640 1 -- 172.21.15.18:0/2507683222 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07140d0410 con 0x7f07140d0910 2024-04-17T19:53:45.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.553+0000 7f07137fe640 1 --2- 172.21.15.18:0/2507683222 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07140d0910 0x7f07140d0d20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f07040097c0 tx=0x7f070401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b669ad54ce4161df server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:45.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.553+0000 7f07127fc640 1 -- 172.21.15.18:0/2507683222 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07040b0070 con 0x7f07140d0910 2024-04-17T19:53:45.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.553+0000 7f07127fc640 1 -- 172.21.15.18:0/2507683222 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07040a4e50 con 0x7f07140d0910 2024-04-17T19:53:45.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.553+0000 7f07127fc640 1 -- 172.21.15.18:0/2507683222 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07040ab820 con 0x7f07140d0910 2024-04-17T19:53:45.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.553+0000 7f071a153640 1 -- 172.21.15.18:0/2507683222 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07140d0910 msgr2=0x7f07140d0d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:45.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.553+0000 7f071a153640 1 --2- 172.21.15.18:0/2507683222 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07140d0910 0x7f07140d0d20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f07040097c0 tx=0x7f070401c4a0 comp rx=0 tx=0).stop 2024-04-17T19:53:45.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.553+0000 7f071a153640 1 -- 172.21.15.18:0/2507683222 shutdown_connections 2024-04-17T19:53:45.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.553+0000 7f071a153640 1 --2- 172.21.15.18:0/2507683222 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f07141415f0 0x7f0714141a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:45.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.553+0000 7f071a153640 1 --2- 172.21.15.18:0/2507683222 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07140d0910 0x7f07140d0d20 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:45.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.553+0000 7f071a153640 1 -- 172.21.15.18:0/2507683222 >> 172.21.15.18:0/2507683222 conn(0x7f07140b3910 msgr2=0x7f07140d12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:45.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.553+0000 7f071a153640 1 -- 172.21.15.18:0/2507683222 shutdown_connections 2024-04-17T19:53:45.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.553+0000 7f071a153640 1 -- 172.21.15.18:0/2507683222 wait complete. 2024-04-17T19:53:45.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.553+0000 7f071a153640 1 Processor -- start 2024-04-17T19:53:45.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.553+0000 7f071a153640 1 -- start start 2024-04-17T19:53:45.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.557+0000 7f071a153640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f07140d0910 0x7f071415f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:45.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.557+0000 7f071a153640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07141415f0 0x7f071413bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:45.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.557+0000 7f071a153640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f071415c6e0 0x7f071406c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:45.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.557+0000 7f071a153640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0714073a10 con 0x7f07141415f0 2024-04-17T19:53:45.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.557+0000 7f071a153640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0714073890 con 0x7f071415c6e0 2024-04-17T19:53:45.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.557+0000 7f071a153640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f0714073b90 con 0x7f07140d0910 2024-04-17T19:53:45.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.557+0000 7f0712ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07141415f0 0x7f071413bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:45.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.557+0000 7f0712ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07141415f0 0x7f071413bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55536/0 (socket says 172.21.15.18:55536) 2024-04-17T19:53:45.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.557+0000 7f0712ffd640 1 -- 172.21.15.18:0/1263384402 learned_addr learned my addr 172.21.15.18:0/1263384402 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:45.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.557+0000 7f07137fe640 1 --2- 172.21.15.18:0/1263384402 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f07140d0910 0x7f071415f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:45.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.557+0000 7f0713fff640 1 --2- 172.21.15.18:0/1263384402 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f071415c6e0 0x7f071406c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:45.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.557+0000 7f0712ffd640 1 -- 172.21.15.18:0/1263384402 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f07140d0910 msgr2=0x7f071415f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:45.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.557+0000 7f0712ffd640 1 --2- 172.21.15.18:0/1263384402 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f07140d0910 0x7f071415f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:45.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.557+0000 7f0712ffd640 1 -- 172.21.15.18:0/1263384402 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f071415c6e0 msgr2=0x7f071406c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:45.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.557+0000 7f0712ffd640 1 --2- 172.21.15.18:0/1263384402 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f071415c6e0 0x7f071406c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:45.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.557+0000 7f0712ffd640 1 -- 172.21.15.18:0/1263384402 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f071413c4b0 con 0x7f07141415f0 2024-04-17T19:53:45.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.557+0000 7f0713fff640 1 --2- 172.21.15.18:0/1263384402 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f071415c6e0 0x7f071406c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:53:45.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.557+0000 7f0712ffd640 1 --2- 172.21.15.18:0/1263384402 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07141415f0 0x7f071413bf70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f070800d620 tx=0x7f070800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:45.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.557+0000 7f06fbfff640 1 -- 172.21.15.18:0/1263384402 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f070800b620 con 0x7f07141415f0 2024-04-17T19:53:45.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.557+0000 7f06fbfff640 1 -- 172.21.15.18:0/1263384402 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0708019070 con 0x7f07141415f0 2024-04-17T19:53:45.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.557+0000 7f071a153640 1 -- 172.21.15.18:0/1263384402 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f071415f800 con 0x7f07141415f0 2024-04-17T19:53:45.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.557+0000 7f06fbfff640 1 -- 172.21.15.18:0/1263384402 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f070800b9e0 con 0x7f07141415f0 2024-04-17T19:53:45.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.557+0000 7f071a153640 1 -- 172.21.15.18:0/1263384402 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f071415fdc0 con 0x7f07141415f0 2024-04-17T19:53:45.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.557+0000 7f071a153640 1 -- 172.21.15.18:0/1263384402 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0714069950 con 0x7f07141415f0 2024-04-17T19:53:45.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.557+0000 7f06fbfff640 1 -- 172.21.15.18:0/1263384402 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f070800bb80 con 0x7f07141415f0 2024-04-17T19:53:45.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.561+0000 7f06fbfff640 1 --2- 172.21.15.18:0/1263384402 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0700068380 0x7f070006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:45.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.561+0000 7f06fbfff640 1 -- 172.21.15.18:0/1263384402 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7f0708087200 con 0x7f07141415f0 2024-04-17T19:53:45.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.561+0000 7f07137fe640 1 --2- 172.21.15.18:0/1263384402 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0700068380 0x7f070006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:45.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.561+0000 7f07137fe640 1 --2- 172.21.15.18:0/1263384402 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0700068380 0x7f070006a890 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f07040ad000 tx=0x7f07040a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:45.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.565+0000 7f06fbfff640 1 -- 172.21.15.18:0/1263384402 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0708057360 con 0x7f07141415f0 2024-04-17T19:53:45.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.773+0000 7f071a153640 1 -- 172.21.15.18:0/1263384402 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f071415f590 con 0x7f07141415f0 2024-04-17T19:53:45.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.773+0000 7f06fbfff640 1 -- 172.21.15.18:0/1263384402 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f0708056c60 con 0x7f07141415f0 2024-04-17T19:53:45.771 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-17T19:53:45.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.777+0000 7f071a153640 1 -- 172.21.15.18:0/1263384402 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0700068380 msgr2=0x7f070006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:45.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.777+0000 7f071a153640 1 --2- 172.21.15.18:0/1263384402 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0700068380 0x7f070006a890 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f07040ad000 tx=0x7f07040a6000 comp rx=0 tx=0).stop 2024-04-17T19:53:45.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.777+0000 7f071a153640 1 -- 172.21.15.18:0/1263384402 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07141415f0 msgr2=0x7f071413bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:45.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.777+0000 7f071a153640 1 --2- 172.21.15.18:0/1263384402 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07141415f0 0x7f071413bf70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f070800d620 tx=0x7f070800dae0 comp rx=0 tx=0).stop 2024-04-17T19:53:45.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.777+0000 7f071a153640 1 -- 172.21.15.18:0/1263384402 shutdown_connections 2024-04-17T19:53:45.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.777+0000 7f071a153640 1 --2- 172.21.15.18:0/1263384402 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0700068380 0x7f070006a890 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:45.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.777+0000 7f071a153640 1 --2- 172.21.15.18:0/1263384402 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f071415c6e0 0x7f071406c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:45.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.777+0000 7f071a153640 1 --2- 172.21.15.18:0/1263384402 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07141415f0 0x7f071413bf70 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:45.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.777+0000 7f071a153640 1 --2- 172.21.15.18:0/1263384402 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f07140d0910 0x7f071415f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:45.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.777+0000 7f071a153640 1 -- 172.21.15.18:0/1263384402 >> 172.21.15.18:0/1263384402 conn(0x7f07140b3910 msgr2=0x7f07140b5a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:45.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.777+0000 7f071a153640 1 -- 172.21.15.18:0/1263384402 shutdown_connections 2024-04-17T19:53:45.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:45.777+0000 7f071a153640 1 -- 172.21.15.18:0/1263384402 wait complete. 2024-04-17T19:53:45.793 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-17T19:53:45.793 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-17T19:53:45.793 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi173.front.sepia.ceph.com 2024-04-17T19:53:45.793 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-04-17T19:53:45.793 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-17T19:53:45.793 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-17T19:53:45.793 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-17T19:53:45.794 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-17T19:53:45.794 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-04-17T19:53:45.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:45.794 DEBUG:teuthology.orchestra.run.smithi173:> ip addr 2024-04-17T19:53:45.801 INFO:teuthology.orchestra.run.smithi173.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-17T19:53:45.801 INFO:teuthology.orchestra.run.smithi173.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-17T19:53:45.801 INFO:teuthology.orchestra.run.smithi173.stdout: inet 127.0.0.1/8 scope host lo 2024-04-17T19:53:45.801 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-17T19:53:45.801 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 ::1/128 scope host 2024-04-17T19:53:45.801 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-17T19:53:45.801 INFO:teuthology.orchestra.run.smithi173.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-17T19:53:45.802 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:d9:38:6a brd ff:ff:ff:ff:ff:ff 2024-04-17T19:53:45.802 INFO:teuthology.orchestra.run.smithi173.stdout: altname enp7s0f0 2024-04-17T19:53:45.802 INFO:teuthology.orchestra.run.smithi173.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-17T19:53:45.802 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:d9:38:6b brd ff:ff:ff:ff:ff:ff 2024-04-17T19:53:45.802 INFO:teuthology.orchestra.run.smithi173.stdout: altname enp7s0f1 2024-04-17T19:53:45.802 INFO:teuthology.orchestra.run.smithi173.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-17T19:53:45.802 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:88:72:58 brd ff:ff:ff:ff:ff:ff 2024-04-17T19:53:45.802 INFO:teuthology.orchestra.run.smithi173.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-17T19:53:45.802 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:88:72:59 brd ff:ff:ff:ff:ff:ff 2024-04-17T19:53:45.802 INFO:teuthology.orchestra.run.smithi173.stdout: inet 172.21.15.173/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-17T19:53:45.802 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft 42432sec preferred_lft 42432sec 2024-04-17T19:53:45.802 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::ec4:7aff:fe88:7259/64 scope link 2024-04-17T19:53:45.802 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-17T19:53:45.802 INFO:teuthology.orchestra.run.smithi173.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-17T19:53:45.803 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 02:42:6c:fb:71:3d brd ff:ff:ff:ff:ff:ff 2024-04-17T19:53:45.803 INFO:teuthology.orchestra.run.smithi173.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-17T19:53:45.803 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-17T19:53:45.803 INFO:teuthology.orchestra.run.smithi173.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-17T19:53:45.803 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-17T19:53:45.803 INFO:teuthology.orchestra.run.smithi173.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-17T19:53:45.803 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-17T19:53:45.803 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-17T19:53:45.803 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-17T19:53:45.803 INFO:teuthology.orchestra.run.smithi173.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-17T19:53:45.803 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-17T19:53:45.803 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-17T19:53:45.803 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-17T19:53:45.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:45.804 DEBUG:teuthology.orchestra.run.smithi173:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-17T19:53:45.855 INFO:teuthology.orchestra.run.smithi173.stdout:1 2024-04-17T19:53:45.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:45.857 DEBUG:teuthology.orchestra.run.smithi173:> route 2024-04-17T19:53:45.912 INFO:teuthology.orchestra.run.smithi173.stdout:Kernel IP routing table 2024-04-17T19:53:45.913 INFO:teuthology.orchestra.run.smithi173.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-17T19:53:45.913 INFO:teuthology.orchestra.run.smithi173.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-17T19:53:45.913 INFO:teuthology.orchestra.run.smithi173.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-17T19:53:45.913 INFO:teuthology.orchestra.run.smithi173.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-17T19:53:45.913 INFO:teuthology.orchestra.run.smithi173.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-17T19:53:45.913 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-17T19:53:45.913 INFO:teuthology.orchestra.run.smithi173.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-17T19:53:45.913 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-17T19:53:45.913 INFO:teuthology.orchestra.run.smithi173.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-17T19:53:45.913 INFO:teuthology.orchestra.run.smithi173.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-17T19:53:45.914 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T19:53:45.914 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-17T19:53:45.914 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-17T19:53:45.914 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-17T19:53:45.914 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-17T19:53:45.914 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-17T19:53:46.008 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:53:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T19:53:46.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:53:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T19:53:46.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:46.047 DEBUG:teuthology.orchestra.run.smithi173:> ip netns list 2024-04-17T19:53:46.052 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-17T19:53:46.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:46.052 DEBUG:teuthology.orchestra.run.smithi173:> ip netns list-id 2024-04-17T19:53:46.101 INFO:teuthology.orchestra.run.smithi173.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-04-17T19:53:46.101 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T19:53:46.101 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-17T19:53:46.101 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-17T19:53:46.101 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-04-17T19:53:46.101 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-17T19:53:46.196 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:53:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T19:53:46.218 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:53:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T19:53:46.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:46.225 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-17T19:53:46.237 INFO:teuthology.orchestra.run.smithi173.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-17T19:53:46.237 INFO:teuthology.orchestra.run.smithi173.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-17T19:53:46.238 INFO:teuthology.orchestra.run.smithi173.stdout: inet 127.0.0.1/8 scope host lo 2024-04-17T19:53:46.238 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-17T19:53:46.238 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 ::1/128 scope host 2024-04-17T19:53:46.238 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-17T19:53:46.238 INFO:teuthology.orchestra.run.smithi173.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-17T19:53:46.238 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 4e:16:fb:c6:94:e3 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-17T19:53:46.238 INFO:teuthology.orchestra.run.smithi173.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-17T19:53:46.238 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-17T19:53:46.238 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::4c16:fbff:fec6:94e3/64 scope link 2024-04-17T19:53:46.238 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-17T19:53:46.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:46.239 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-17T19:53:46.294 INFO:teuthology.orchestra.run.smithi173.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-17T19:53:46.294 INFO:teuthology.orchestra.run.smithi173.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-17T19:53:46.294 INFO:teuthology.orchestra.run.smithi173.stdout: inet 127.0.0.1/8 scope host lo 2024-04-17T19:53:46.294 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-17T19:53:46.295 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 ::1/128 scope host 2024-04-17T19:53:46.295 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-17T19:53:46.295 INFO:teuthology.orchestra.run.smithi173.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-17T19:53:46.295 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 4e:16:fb:c6:94:e3 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-17T19:53:46.295 INFO:teuthology.orchestra.run.smithi173.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-17T19:53:46.295 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-17T19:53:46.295 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::4c16:fbff:fec6:94e3/64 scope link 2024-04-17T19:53:46.295 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2024-04-17T19:53:46.296 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-04-17T19:53:46.296 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T19:53:46.296 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-17T19:53:46.296 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-04-17T19:53:46.296 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-17T19:53:46.296 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-04-17T19:53:46.297 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-04-17T19:53:46.297 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-04-17T19:53:46.297 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-17T19:53:46.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:53:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T19:53:46.431 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:53:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T19:53:46.439 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-17T19:53:46.439 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2024-04-17T19:53:46.439 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link set brx.1 up 2024-04-17T19:53:46.439 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link set dev brx.1 master ceph-brx 2024-04-17T19:53:46.439 DEBUG:teuthology.orchestra.run.smithi173:> ') 2024-04-17T19:53:46.480 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:53:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-17T19:53:46.496 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:53:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T19:53:46.503 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2024-04-17T19:53:46.503 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-17T19:53:46.503 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-04-17T19:53:46.548 INFO:teuthology.orchestra.run.smithi173.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-04-17T19:53:46.549 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-17T19:53:46.549 DEBUG:teuthology.orchestra.run.smithi173:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-04-17T19:53:46.598 DEBUG:teuthology.orchestra.run.smithi173:> sudo modprobe fuse 2024-04-17T19:53:46.655 DEBUG:teuthology.orchestra.run.smithi173:> cat /proc/self/mounts | awk '{print $2}' 2024-04-17T19:53:46.702 INFO:teuthology.orchestra.run.smithi173.stdout:/sys 2024-04-17T19:53:46.702 INFO:teuthology.orchestra.run.smithi173.stdout:/proc 2024-04-17T19:53:46.702 INFO:teuthology.orchestra.run.smithi173.stdout:/dev 2024-04-17T19:53:46.702 INFO:teuthology.orchestra.run.smithi173.stdout:/dev/pts 2024-04-17T19:53:46.702 INFO:teuthology.orchestra.run.smithi173.stdout:/run 2024-04-17T19:53:46.702 INFO:teuthology.orchestra.run.smithi173.stdout:/ 2024-04-17T19:53:46.702 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/kernel/security 2024-04-17T19:53:46.702 INFO:teuthology.orchestra.run.smithi173.stdout:/dev/shm 2024-04-17T19:53:46.702 INFO:teuthology.orchestra.run.smithi173.stdout:/run/lock 2024-04-17T19:53:46.703 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/fs/cgroup 2024-04-17T19:53:46.703 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/fs/pstore 2024-04-17T19:53:46.703 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/fs/bpf 2024-04-17T19:53:46.703 INFO:teuthology.orchestra.run.smithi173.stdout:/proc/sys/fs/binfmt_misc 2024-04-17T19:53:46.703 INFO:teuthology.orchestra.run.smithi173.stdout:/dev/hugepages 2024-04-17T19:53:46.703 INFO:teuthology.orchestra.run.smithi173.stdout:/dev/mqueue 2024-04-17T19:53:46.703 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/kernel/debug 2024-04-17T19:53:46.703 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/kernel/tracing 2024-04-17T19:53:46.703 INFO:teuthology.orchestra.run.smithi173.stdout:/proc/fs/nfsd 2024-04-17T19:53:46.703 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/fs/fuse/connections 2024-04-17T19:53:46.703 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/kernel/config 2024-04-17T19:53:46.704 INFO:teuthology.orchestra.run.smithi173.stdout:/run/credentials/systemd-sysusers.service 2024-04-17T19:53:46.704 INFO:teuthology.orchestra.run.smithi173.stdout:/run/rpc_pipefs 2024-04-17T19:53:46.704 INFO:teuthology.orchestra.run.smithi173.stdout:/run/user/1000 2024-04-17T19:53:46.704 INFO:teuthology.orchestra.run.smithi173.stdout:/var/lib/ceph 2024-04-17T19:53:46.704 INFO:teuthology.orchestra.run.smithi173.stdout:/var/lib/ceph/osd/ceph-4 2024-04-17T19:53:46.704 INFO:teuthology.orchestra.run.smithi173.stdout:/var/lib/ceph/osd/ceph-5 2024-04-17T19:53:46.704 INFO:teuthology.orchestra.run.smithi173.stdout:/var/lib/ceph/osd/ceph-6 2024-04-17T19:53:46.704 INFO:teuthology.orchestra.run.smithi173.stdout:/var/lib/ceph/osd/ceph-7 2024-04-17T19:53:46.704 INFO:teuthology.orchestra.run.smithi173.stdout:/run/netns 2024-04-17T19:53:46.704 INFO:teuthology.orchestra.run.smithi173.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-17T19:53:46.704 INFO:teuthology.orchestra.run.smithi173.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-17T19:53:46.704 INFO:teuthology.orchestra.run.smithi173.stdout:/home/ubuntu/cephtest/mnt.1 2024-04-17T19:53:46.704 INFO:teuthology.orchestra.run.smithi173.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-17T19:53:46.704 INFO:teuthology.orchestra.run.smithi173.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-17T19:53:46.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:46.705 DEBUG:teuthology.orchestra.run.smithi173:> ls /sys/fs/fuse/connections 2024-04-17T19:53:46.753 INFO:teuthology.orchestra.run.smithi173.stdout:45 2024-04-17T19:53:46.753 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [45] 2024-04-17T19:53:46.754 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2024-04-17T19:53:46.798 DEBUG:teuthology.orchestra.run.smithi173:> sudo modprobe fuse 2024-04-17T19:53:46.812 DEBUG:teuthology.orchestra.run.smithi173:> cat /proc/self/mounts | awk '{print $2}' 2024-04-17T19:53:46.861 INFO:teuthology.orchestra.run.smithi173.stdout:/sys 2024-04-17T19:53:46.861 INFO:teuthology.orchestra.run.smithi173.stdout:/proc 2024-04-17T19:53:46.862 INFO:teuthology.orchestra.run.smithi173.stdout:/dev 2024-04-17T19:53:46.862 INFO:teuthology.orchestra.run.smithi173.stdout:/dev/pts 2024-04-17T19:53:46.862 INFO:teuthology.orchestra.run.smithi173.stdout:/run 2024-04-17T19:53:46.862 INFO:teuthology.orchestra.run.smithi173.stdout:/ 2024-04-17T19:53:46.862 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/kernel/security 2024-04-17T19:53:46.862 INFO:teuthology.orchestra.run.smithi173.stdout:/dev/shm 2024-04-17T19:53:46.862 INFO:teuthology.orchestra.run.smithi173.stdout:/run/lock 2024-04-17T19:53:46.862 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/fs/cgroup 2024-04-17T19:53:46.862 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/fs/pstore 2024-04-17T19:53:46.862 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/fs/bpf 2024-04-17T19:53:46.862 INFO:teuthology.orchestra.run.smithi173.stdout:/proc/sys/fs/binfmt_misc 2024-04-17T19:53:46.863 INFO:teuthology.orchestra.run.smithi173.stdout:/dev/hugepages 2024-04-17T19:53:46.863 INFO:teuthology.orchestra.run.smithi173.stdout:/dev/mqueue 2024-04-17T19:53:46.863 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/kernel/debug 2024-04-17T19:53:46.863 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/kernel/tracing 2024-04-17T19:53:46.863 INFO:teuthology.orchestra.run.smithi173.stdout:/proc/fs/nfsd 2024-04-17T19:53:46.863 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/fs/fuse/connections 2024-04-17T19:53:46.863 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/kernel/config 2024-04-17T19:53:46.863 INFO:teuthology.orchestra.run.smithi173.stdout:/run/credentials/systemd-sysusers.service 2024-04-17T19:53:46.863 INFO:teuthology.orchestra.run.smithi173.stdout:/run/rpc_pipefs 2024-04-17T19:53:46.863 INFO:teuthology.orchestra.run.smithi173.stdout:/run/user/1000 2024-04-17T19:53:46.863 INFO:teuthology.orchestra.run.smithi173.stdout:/var/lib/ceph 2024-04-17T19:53:46.863 INFO:teuthology.orchestra.run.smithi173.stdout:/var/lib/ceph/osd/ceph-4 2024-04-17T19:53:46.864 INFO:teuthology.orchestra.run.smithi173.stdout:/var/lib/ceph/osd/ceph-5 2024-04-17T19:53:46.864 INFO:teuthology.orchestra.run.smithi173.stdout:/var/lib/ceph/osd/ceph-6 2024-04-17T19:53:46.864 INFO:teuthology.orchestra.run.smithi173.stdout:/var/lib/ceph/osd/ceph-7 2024-04-17T19:53:46.864 INFO:teuthology.orchestra.run.smithi173.stdout:/run/netns 2024-04-17T19:53:46.864 INFO:teuthology.orchestra.run.smithi173.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-17T19:53:46.864 INFO:teuthology.orchestra.run.smithi173.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-17T19:53:46.864 INFO:teuthology.orchestra.run.smithi173.stdout:/home/ubuntu/cephtest/mnt.1 2024-04-17T19:53:46.864 INFO:teuthology.orchestra.run.smithi173.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-17T19:53:46.864 INFO:teuthology.orchestra.run.smithi173.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-17T19:53:46.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:46.864 DEBUG:teuthology.orchestra.run.smithi173:> ls /sys/fs/fuse/connections 2024-04-17T19:53:46.908 INFO:teuthology.orchestra.run.smithi173.stdout:45 2024-04-17T19:53:46.908 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi173.stderr:2024-04-17T19:53:46.914+0000 7fdc1313e580 -1 init, newargv = 0x7fdbf4005830 newargc=15 2024-04-17T19:53:46.908 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi173.stderr:ceph-fuse[33192]: starting ceph client 2024-04-17T19:53:46.915 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi173.stderr:ceph-fuse[33192]: starting fuse 2024-04-17T19:53:48.009 DEBUG:teuthology.orchestra.run.smithi173:> sudo modprobe fuse 2024-04-17T19:53:48.026 DEBUG:teuthology.orchestra.run.smithi173:> cat /proc/self/mounts | awk '{print $2}' 2024-04-17T19:53:48.075 INFO:teuthology.orchestra.run.smithi173.stdout:/sys 2024-04-17T19:53:48.075 INFO:teuthology.orchestra.run.smithi173.stdout:/proc 2024-04-17T19:53:48.075 INFO:teuthology.orchestra.run.smithi173.stdout:/dev 2024-04-17T19:53:48.075 INFO:teuthology.orchestra.run.smithi173.stdout:/dev/pts 2024-04-17T19:53:48.075 INFO:teuthology.orchestra.run.smithi173.stdout:/run 2024-04-17T19:53:48.075 INFO:teuthology.orchestra.run.smithi173.stdout:/ 2024-04-17T19:53:48.075 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/kernel/security 2024-04-17T19:53:48.075 INFO:teuthology.orchestra.run.smithi173.stdout:/dev/shm 2024-04-17T19:53:48.075 INFO:teuthology.orchestra.run.smithi173.stdout:/run/lock 2024-04-17T19:53:48.075 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/fs/cgroup 2024-04-17T19:53:48.076 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/fs/pstore 2024-04-17T19:53:48.076 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/fs/bpf 2024-04-17T19:53:48.076 INFO:teuthology.orchestra.run.smithi173.stdout:/proc/sys/fs/binfmt_misc 2024-04-17T19:53:48.076 INFO:teuthology.orchestra.run.smithi173.stdout:/dev/hugepages 2024-04-17T19:53:48.076 INFO:teuthology.orchestra.run.smithi173.stdout:/dev/mqueue 2024-04-17T19:53:48.076 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/kernel/debug 2024-04-17T19:53:48.076 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/kernel/tracing 2024-04-17T19:53:48.076 INFO:teuthology.orchestra.run.smithi173.stdout:/proc/fs/nfsd 2024-04-17T19:53:48.076 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/fs/fuse/connections 2024-04-17T19:53:48.076 INFO:teuthology.orchestra.run.smithi173.stdout:/sys/kernel/config 2024-04-17T19:53:48.076 INFO:teuthology.orchestra.run.smithi173.stdout:/run/credentials/systemd-sysusers.service 2024-04-17T19:53:48.076 INFO:teuthology.orchestra.run.smithi173.stdout:/run/rpc_pipefs 2024-04-17T19:53:48.076 INFO:teuthology.orchestra.run.smithi173.stdout:/run/user/1000 2024-04-17T19:53:48.076 INFO:teuthology.orchestra.run.smithi173.stdout:/var/lib/ceph 2024-04-17T19:53:48.076 INFO:teuthology.orchestra.run.smithi173.stdout:/var/lib/ceph/osd/ceph-4 2024-04-17T19:53:48.077 INFO:teuthology.orchestra.run.smithi173.stdout:/var/lib/ceph/osd/ceph-5 2024-04-17T19:53:48.077 INFO:teuthology.orchestra.run.smithi173.stdout:/var/lib/ceph/osd/ceph-6 2024-04-17T19:53:48.077 INFO:teuthology.orchestra.run.smithi173.stdout:/var/lib/ceph/osd/ceph-7 2024-04-17T19:53:48.077 INFO:teuthology.orchestra.run.smithi173.stdout:/run/netns 2024-04-17T19:53:48.077 INFO:teuthology.orchestra.run.smithi173.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-17T19:53:48.077 INFO:teuthology.orchestra.run.smithi173.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-17T19:53:48.077 INFO:teuthology.orchestra.run.smithi173.stdout:/home/ubuntu/cephtest/mnt.1 2024-04-17T19:53:48.077 INFO:teuthology.orchestra.run.smithi173.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-17T19:53:48.077 INFO:teuthology.orchestra.run.smithi173.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-17T19:53:48.077 INFO:teuthology.orchestra.run.smithi173.stdout:/home/ubuntu/cephtest/mnt.3 2024-04-17T19:53:48.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:48.078 DEBUG:teuthology.orchestra.run.smithi173:> ls /sys/fs/fuse/connections 2024-04-17T19:53:48.124 INFO:teuthology.orchestra.run.smithi173.stdout:45 2024-04-17T19:53:48.124 INFO:teuthology.orchestra.run.smithi173.stdout:46 2024-04-17T19:53:48.125 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45, 46] 2024-04-17T19:53:48.125 DEBUG:teuthology.orchestra.run.smithi173:> sudo stdin-killer -- python3 -c ' 2024-04-17T19:53:48.125 DEBUG:teuthology.orchestra.run.smithi173:> import glob 2024-04-17T19:53:48.125 DEBUG:teuthology.orchestra.run.smithi173:> import re 2024-04-17T19:53:48.125 DEBUG:teuthology.orchestra.run.smithi173:> import os 2024-04-17T19:53:48.125 DEBUG:teuthology.orchestra.run.smithi173:> import subprocess 2024-04-17T19:53:48.125 DEBUG:teuthology.orchestra.run.smithi173:> 2024-04-17T19:53:48.125 DEBUG:teuthology.orchestra.run.smithi173:> def _find_admin_socket(client_name): 2024-04-17T19:53:48.125 DEBUG:teuthology.orchestra.run.smithi173:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2024-04-17T19:53:48.125 DEBUG:teuthology.orchestra.run.smithi173:> files = glob.glob(asok_path) 2024-04-17T19:53:48.125 DEBUG:teuthology.orchestra.run.smithi173:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2024-04-17T19:53:48.126 DEBUG:teuthology.orchestra.run.smithi173:> 2024-04-17T19:53:48.126 DEBUG:teuthology.orchestra.run.smithi173:> # Given a non-glob path, it better be there 2024-04-17T19:53:48.126 DEBUG:teuthology.orchestra.run.smithi173:> if "*" not in asok_path: 2024-04-17T19:53:48.126 DEBUG:teuthology.orchestra.run.smithi173:> assert(len(files) == 1) 2024-04-17T19:53:48.126 DEBUG:teuthology.orchestra.run.smithi173:> return files[0] 2024-04-17T19:53:48.126 DEBUG:teuthology.orchestra.run.smithi173:> 2024-04-17T19:53:48.126 DEBUG:teuthology.orchestra.run.smithi173:> for f in files: 2024-04-17T19:53:48.126 DEBUG:teuthology.orchestra.run.smithi173:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-17T19:53:48.126 DEBUG:teuthology.orchestra.run.smithi173:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-17T19:53:48.126 DEBUG:teuthology.orchestra.run.smithi173:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-17T19:53:48.126 DEBUG:teuthology.orchestra.run.smithi173:> contents = proc_f.read() 2024-04-17T19:53:48.126 DEBUG:teuthology.orchestra.run.smithi173:> if mountpoint in contents: 2024-04-17T19:53:48.126 DEBUG:teuthology.orchestra.run.smithi173:> return f 2024-04-17T19:53:48.126 DEBUG:teuthology.orchestra.run.smithi173:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-17T19:53:48.126 DEBUG:teuthology.orchestra.run.smithi173:> 2024-04-17T19:53:48.126 DEBUG:teuthology.orchestra.run.smithi173:> print(_find_admin_socket("client.3")) 2024-04-17T19:53:48.127 DEBUG:teuthology.orchestra.run.smithi173:> ' 2024-04-17T19:53:48.246 INFO:teuthology.orchestra.run.smithi173.stdout:/var/run/ceph/ceph-client.3.33192.asok 2024-04-17T19:53:48.250 INFO:teuthology.orchestra.run.smithi173.stderr:2024-04-17T19:53:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-17T19:53:48.258 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.33192.asok 2024-04-17T19:53:48.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:48.258 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.33192.asok status 2024-04-17T19:53:48.438 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-04-17T19:53:48.438 INFO:teuthology.orchestra.run.smithi173.stdout: "metadata": { 2024-04-17T19:53:48.438 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_sha1": "f3a98d3f110319c567ec86bf70955c141495ccf6", 2024-04-17T19:53:48.438 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_version": "ceph version 19.0.0-3146-gf3a98d3f (f3a98d3f110319c567ec86bf70955c141495ccf6) squid (dev)", 2024-04-17T19:53:48.438 INFO:teuthology.orchestra.run.smithi173.stdout: "entity_id": "3", 2024-04-17T19:53:48.438 INFO:teuthology.orchestra.run.smithi173.stdout: "hostname": "smithi173", 2024-04-17T19:53:48.438 INFO:teuthology.orchestra.run.smithi173.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2024-04-17T19:53:48.438 INFO:teuthology.orchestra.run.smithi173.stdout: "pid": "33192", 2024-04-17T19:53:48.438 INFO:teuthology.orchestra.run.smithi173.stdout: "root": "/" 2024-04-17T19:53:48.438 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-17T19:53:48.438 INFO:teuthology.orchestra.run.smithi173.stdout: "dentry_count": 0, 2024-04-17T19:53:48.439 INFO:teuthology.orchestra.run.smithi173.stdout: "dentry_pinned_count": 0, 2024-04-17T19:53:48.439 INFO:teuthology.orchestra.run.smithi173.stdout: "id": 4556, 2024-04-17T19:53:48.439 INFO:teuthology.orchestra.run.smithi173.stdout: "inst": { 2024-04-17T19:53:48.439 INFO:teuthology.orchestra.run.smithi173.stdout: "name": { 2024-04-17T19:53:48.439 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "client", 2024-04-17T19:53:48.439 INFO:teuthology.orchestra.run.smithi173.stdout: "num": 4556 2024-04-17T19:53:48.439 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-17T19:53:48.439 INFO:teuthology.orchestra.run.smithi173.stdout: "addr": { 2024-04-17T19:53:48.439 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "v1", 2024-04-17T19:53:48.439 INFO:teuthology.orchestra.run.smithi173.stdout: "addr": "192.168.0.2:0", 2024-04-17T19:53:48.439 INFO:teuthology.orchestra.run.smithi173.stdout: "nonce": 3229372369 2024-04-17T19:53:48.439 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-04-17T19:53:48.439 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-17T19:53:48.440 INFO:teuthology.orchestra.run.smithi173.stdout: "addr": { 2024-04-17T19:53:48.440 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "v1", 2024-04-17T19:53:48.440 INFO:teuthology.orchestra.run.smithi173.stdout: "addr": "192.168.0.2:0", 2024-04-17T19:53:48.440 INFO:teuthology.orchestra.run.smithi173.stdout: "nonce": 3229372369 2024-04-17T19:53:48.440 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-04-17T19:53:48.440 INFO:teuthology.orchestra.run.smithi173.stdout: "inst_str": "client.4556 192.168.0.2:0/3229372369", 2024-04-17T19:53:48.440 INFO:teuthology.orchestra.run.smithi173.stdout: "addr_str": "192.168.0.2:0/3229372369", 2024-04-17T19:53:48.440 INFO:teuthology.orchestra.run.smithi173.stdout: "inode_count": 1, 2024-04-17T19:53:48.440 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_epoch": 9, 2024-04-17T19:53:48.440 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_epoch": 29, 2024-04-17T19:53:48.440 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_epoch_barrier": 0, 2024-04-17T19:53:48.440 INFO:teuthology.orchestra.run.smithi173.stdout: "blocklisted": false, 2024-04-17T19:53:48.440 INFO:teuthology.orchestra.run.smithi173.stdout: "fs_name": "cephfs" 2024-04-17T19:53:48.440 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-04-17T19:53:48.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:48.454 DEBUG:teuthology.orchestra.run.smithi018:> stat --file-system '--printf=%T 2024-04-17T19:53:48.454 DEBUG:teuthology.orchestra.run.smithi018:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-17T19:53:48.462 INFO:teuthology.orchestra.run.smithi018.stdout:fuseblk 2024-04-17T19:53:48.462 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-17T19:53:48.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:48.462 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-17T19:53:48.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:48.517 DEBUG:teuthology.orchestra.run.smithi018:> stat --file-system '--printf=%T 2024-04-17T19:53:48.518 DEBUG:teuthology.orchestra.run.smithi018:> ' -- /home/ubuntu/cephtest/mnt.2 2024-04-17T19:53:48.565 INFO:teuthology.orchestra.run.smithi018.stdout:fuseblk 2024-04-17T19:53:48.565 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-04-17T19:53:48.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:48.566 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-04-17T19:53:48.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:48.621 DEBUG:teuthology.orchestra.run.smithi173:> stat --file-system '--printf=%T 2024-04-17T19:53:48.621 DEBUG:teuthology.orchestra.run.smithi173:> ' -- /home/ubuntu/cephtest/mnt.1 2024-04-17T19:53:48.629 INFO:teuthology.orchestra.run.smithi173.stdout:fuseblk 2024-04-17T19:53:48.629 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-04-17T19:53:48.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:48.629 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-17T19:53:48.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:48.685 DEBUG:teuthology.orchestra.run.smithi173:> stat --file-system '--printf=%T 2024-04-17T19:53:48.686 DEBUG:teuthology.orchestra.run.smithi173:> ' -- /home/ubuntu/cephtest/mnt.3 2024-04-17T19:53:48.733 INFO:teuthology.orchestra.run.smithi173.stdout:fuseblk 2024-04-17T19:53:48.734 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2024-04-17T19:53:48.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:48.734 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-04-17T19:53:48.790 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-17T19:53:48.799 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-17T19:53:48.799 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-17T19:53:48.799 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-17T19:53:48.805 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-17T19:53:48.805 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-17T19:53:48.853 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T19:53:49.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.065+0000 7f2bcbfff640 1 Processor -- start 2024-04-17T19:53:49.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.065+0000 7f2bcbfff640 1 -- start start 2024-04-17T19:53:49.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.065+0000 7f2bcbfff640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f2bc40cfb20 0x7f2bc40cff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:49.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.065+0000 7f2bcbfff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2bc406ef30 0x7f2bc406f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:49.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.065+0000 7f2bcbfff640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bc40b53d0 con 0x7f2bc415b810 2024-04-17T19:53:49.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.065+0000 7f2bcbfff640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f2bc40b5990 con 0x7f2bc406ef30 2024-04-17T19:53:49.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.065+0000 7f2bcbfff640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f2bc40b56b0 con 0x7f2bc40cfb20 2024-04-17T19:53:49.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.065+0000 7f2bca59c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2bc406ef30 0x7f2bc406f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:49.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.065+0000 7f2bc9d9b640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f2bc415b810 0x7f2bc40cde90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:54966/0 (socket says 172.21.15.18:54966) 2024-04-17T19:53:49.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.065+0000 7f2bc9d9b640 1 -- 172.21.15.18:0/1327578110 learned_addr learned my addr 172.21.15.18:0/1327578110 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:49.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.065+0000 7f2bc959a640 1 --2- 172.21.15.18:0/1327578110 >> v2:172.21.15.173:3300/0 conn(0x7f2bc40cfb20 0x7f2bc40cff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:49.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.065+0000 7f2bca59c640 1 -- 172.21.15.18:0/1327578110 >> v2:172.21.15.173:3300/0 conn(0x7f2bc40cfb20 msgr2=0x7f2bc40cff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:49.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.065+0000 7f2bca59c640 1 --2- 172.21.15.18:0/1327578110 >> v2:172.21.15.173:3300/0 conn(0x7f2bc40cfb20 0x7f2bc40cff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:49.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.065+0000 7f2bca59c640 1 -- 172.21.15.18:0/1327578110 >> v1:172.21.15.18:6789/0 conn(0x7f2bc415b810 legacy=0x7f2bc40cde90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:49.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.065+0000 7f2bc8d99640 1 -- 172.21.15.18:0/1327578110 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3047734994 0 0) 0x7f2bc40b53d0 con 0x7f2bc415b810 2024-04-17T19:53:49.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.065+0000 7f2bca59c640 1 -- 172.21.15.18:0/1327578110 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bc406ea10 con 0x7f2bc406ef30 2024-04-17T19:53:49.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.065+0000 7f2bc959a640 1 --2- 172.21.15.18:0/1327578110 >> v2:172.21.15.173:3300/0 conn(0x7f2bc40cfb20 0x7f2bc40cff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:53:49.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.069+0000 7f2bca59c640 1 --2- 172.21.15.18:0/1327578110 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2bc406ef30 0x7f2bc406f340 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2bc40707f0 tx=0x7f2bbc01d9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a6cc4ba0c1dd196 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:49.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.069+0000 7f2bc8d99640 1 -- 172.21.15.18:0/1327578110 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc0b3070 con 0x7f2bc406ef30 2024-04-17T19:53:49.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.069+0000 7f2bc8d99640 1 -- 172.21.15.18:0/1327578110 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bbc0a6920 con 0x7f2bc406ef30 2024-04-17T19:53:49.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.069+0000 7f2bc8d99640 1 -- 172.21.15.18:0/1327578110 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc0a6cf0 con 0x7f2bc406ef30 2024-04-17T19:53:49.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.069+0000 7f2bcbfff640 1 -- 172.21.15.18:0/1327578110 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2bc406ef30 msgr2=0x7f2bc406f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:49.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.069+0000 7f2bcbfff640 1 --2- 172.21.15.18:0/1327578110 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2bc406ef30 0x7f2bc406f340 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2bc40707f0 tx=0x7f2bbc01d9b0 comp rx=0 tx=0).stop 2024-04-17T19:53:49.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.069+0000 7f2bcbfff640 1 -- 172.21.15.18:0/1327578110 shutdown_connections 2024-04-17T19:53:49.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.069+0000 7f2bcbfff640 1 --2- 172.21.15.18:0/1327578110 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2bc406ef30 0x7f2bc406f340 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:49.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.069+0000 7f2bcbfff640 1 --2- 172.21.15.18:0/1327578110 >> v2:172.21.15.173:3300/0 conn(0x7f2bc40cfb20 0x7f2bc40cff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:49.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.069+0000 7f2bcbfff640 1 -- 172.21.15.18:0/1327578110 >> 172.21.15.18:0/1327578110 conn(0x7f2bc4072bb0 msgr2=0x7f2bc4072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:49.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.069+0000 7f2bcbfff640 1 -- 172.21.15.18:0/1327578110 shutdown_connections 2024-04-17T19:53:49.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.069+0000 7f2bcbfff640 1 -- 172.21.15.18:0/1327578110 wait complete. 2024-04-17T19:53:49.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.069+0000 7f2bcbfff640 1 Processor -- start 2024-04-17T19:53:49.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.069+0000 7f2bcbfff640 1 -- start start 2024-04-17T19:53:49.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.073+0000 7f2bcbfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2bc406ef30 0x7f2bc4143c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:49.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.073+0000 7f2bcbfff640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2bc40cfb20 0x7f2bc41567f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:49.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.073+0000 7f2bcbfff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2bc415b810 0x7f2bc414c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:49.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.073+0000 7f2bcbfff640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2bc41687e0 con 0x7f2bc406ef30 2024-04-17T19:53:49.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.073+0000 7f2bcbfff640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2bc4168660 con 0x7f2bc415b810 2024-04-17T19:53:49.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.073+0000 7f2bcbfff640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f2bc4168960 con 0x7f2bc40cfb20 2024-04-17T19:53:49.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.073+0000 7f2bc9d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2bc406ef30 0x7f2bc4143c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:49.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.073+0000 7f2bc9d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2bc406ef30 0x7f2bc4143c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55556/0 (socket says 172.21.15.18:55556) 2024-04-17T19:53:49.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.073+0000 7f2bc9d9b640 1 -- 172.21.15.18:0/2221384185 learned_addr learned my addr 172.21.15.18:0/2221384185 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:49.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.073+0000 7f2bca59c640 1 --2- 172.21.15.18:0/2221384185 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2bc415b810 0x7f2bc414c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:49.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.073+0000 7f2bc9d9b640 1 -- 172.21.15.18:0/2221384185 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2bc40cfb20 msgr2=0x7f2bc41567f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:49.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.073+0000 7f2bc959a640 1 --2- 172.21.15.18:0/2221384185 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2bc40cfb20 0x7f2bc41567f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:49.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.073+0000 7f2bc9d9b640 1 --2- 172.21.15.18:0/2221384185 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2bc40cfb20 0x7f2bc41567f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:49.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.073+0000 7f2bc9d9b640 1 -- 172.21.15.18:0/2221384185 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2bc415b810 msgr2=0x7f2bc414c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:49.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.073+0000 7f2bc9d9b640 1 --2- 172.21.15.18:0/2221384185 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2bc415b810 0x7f2bc414c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:49.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.073+0000 7f2bc9d9b640 1 -- 172.21.15.18:0/2221384185 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bc415dd00 con 0x7f2bc406ef30 2024-04-17T19:53:49.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.073+0000 7f2bca59c640 1 --2- 172.21.15.18:0/2221384185 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2bc415b810 0x7f2bc414c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:53:49.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.073+0000 7f2bc9d9b640 1 --2- 172.21.15.18:0/2221384185 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2bc406ef30 0x7f2bc4143c60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2bc000c480 tx=0x7f2bc000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:49.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.073+0000 7f2bba7fc640 1 -- 172.21.15.18:0/2221384185 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc0018070 con 0x7f2bc406ef30 2024-04-17T19:53:49.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.073+0000 7f2bba7fc640 1 -- 172.21.15.18:0/2221384185 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bc00074e0 con 0x7f2bc406ef30 2024-04-17T19:53:49.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.073+0000 7f2bcbfff640 1 -- 172.21.15.18:0/2221384185 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bc41441a0 con 0x7f2bc406ef30 2024-04-17T19:53:49.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.073+0000 7f2bba7fc640 1 -- 172.21.15.18:0/2221384185 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc00049f0 con 0x7f2bc406ef30 2024-04-17T19:53:49.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.073+0000 7f2bcbfff640 1 -- 172.21.15.18:0/2221384185 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bc415dfa0 con 0x7f2bc406ef30 2024-04-17T19:53:49.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.073+0000 7f2bcbfff640 1 -- 172.21.15.18:0/2221384185 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bc4069950 con 0x7f2bc406ef30 2024-04-17T19:53:49.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.073+0000 7f2bba7fc640 1 -- 172.21.15.18:0/2221384185 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2bc001b070 con 0x7f2bc406ef30 2024-04-17T19:53:49.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.073+0000 7f2bba7fc640 1 --2- 172.21.15.18:0/2221384185 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f2ba8068380 0x7f2ba806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:49.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.077+0000 7f2bc959a640 1 --2- 172.21.15.18:0/2221384185 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f2ba8068380 0x7f2ba806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:49.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.077+0000 7f2bba7fc640 1 -- 172.21.15.18:0/2221384185 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7f2bc00861c0 con 0x7f2bc406ef30 2024-04-17T19:53:49.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.077+0000 7f2bc959a640 1 --2- 172.21.15.18:0/2221384185 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f2ba8068380 0x7f2ba806a890 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4006fd0 tx=0x7f2bb4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:49.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.081+0000 7f2bba7fc640 1 -- 172.21.15.18:0/2221384185 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2bc41441a0 con 0x7f2bc406ef30 2024-04-17T19:53:49.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.241+0000 7f2bcbfff640 1 -- 172.21.15.18:0/2221384185 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2bc40b4360 con 0x7f2bc406ef30 2024-04-17T19:53:49.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.245+0000 7f2bba7fc640 1 -- 172.21.15.18:0/2221384185 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18759 (secure 0 0 0) 0x7f2bc415dd00 con 0x7f2bc406ef30 2024-04-17T19:53:49.241 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:53:49.242 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":29,"fsid":"dd480169-5a81-4623-be5f-0499aa244b28","created":"2024-04-17T19:52:39.533760+0000","modified":"2024-04-17T19:53:45.435889+0000","last_up_change":"2024-04-17T19:52:51.229698+0000","last_in_change":"2024-04-17T19:52:42.144259+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T19:52:52.391648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T19:53:02.734240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T19:53:03.813028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T19:53:07.478812+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e232d577-2508-4ea4-b355-29fbae1ff025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6801","nonce":2323038417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6803","nonce":2323038417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6807","nonce":2323038417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6805","nonce":2323038417}]},"public_addr":"172.21.15.18:6801/2323038417","cluster_addr":"172.21.15.18:6803/2323038417","heartbeat_back_addr":"172.21.15.18:6807/2323038417","heartbeat_front_addr":"172.21.15.18:6805/2323038417","state":["exists","up"]},{"osd":1,"uuid":"31810ef3-2c71-48d6-8748-b74a2968d23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6817","nonce":1283678238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6819","nonce":1283678238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6823","nonce":1283678238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6821","nonce":1283678238}]},"public_addr":"172.21.15.18:6817/1283678238","cluster_addr":"172.21.15.18:6819/1283678238","heartbeat_back_addr":"172.21.15.18:6823/1283678238","heartbeat_front_addr":"172.21.15.18:6821/1283678238","state":["exists","up"]},{"osd":2,"uuid":"5a783cc5-a41c-4967-9e11-6b8330f97d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6809","nonce":1212875862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6811","nonce":1212875862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6815","nonce":1212875862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6813","nonce":1212875862}]},"public_addr":"172.21.15.18:6809/1212875862","cluster_addr":"172.21.15.18:6811/1212875862","heartbeat_back_addr":"172.21.15.18:6815/1212875862","heartbeat_front_addr":"172.21.15.18:6813/1212875862","state":["exists","up"]},{"osd":3,"uuid":"b7e056d9-9da5-46e1-810d-0c3e242fe5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6825","nonce":2428878428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6827","nonce":2428878428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6831","nonce":2428878428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6829","nonce":2428878428}]},"public_addr":"172.21.15.18:6825/2428878428","cluster_addr":"172.21.15.18:6827/2428878428","heartbeat_back_addr":"172.21.15.18:6831/2428878428","heartbeat_front_addr":"172.21.15.18:6829/2428878428","state":["exists","up"]},{"osd":4,"uuid":"21df023f-bc8b-4abb-93e5-0ecc91acda0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6825","nonce":1421511819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6827","nonce":1421511819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6831","nonce":1421511819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6829","nonce":1421511819}]},"public_addr":"172.21.15.173:6825/1421511819","cluster_addr":"172.21.15.173:6827/1421511819","heartbeat_back_addr":"172.21.15.173:6831/1421511819","heartbeat_front_addr":"172.21.15.173:6829/1421511819","state":["exists","up"]},{"osd":5,"uuid":"e270098a-6d33-49f8-84ed-94e09a880cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6801","nonce":4221907702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6803","nonce":4221907702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6807","nonce":4221907702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6805","nonce":4221907702}]},"public_addr":"172.21.15.173:6801/4221907702","cluster_addr":"172.21.15.173:6803/4221907702","heartbeat_back_addr":"172.21.15.173:6807/4221907702","heartbeat_front_addr":"172.21.15.173:6805/4221907702","state":["exists","up"]},{"osd":6,"uuid":"93c67c8c-268d-4e32-877c-043cd3acd87c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6809","nonce":761678552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6811","nonce":761678552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6815","nonce":761678552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6813","nonce":761678552}]},"public_addr":"172.21.15.173:6809/761678552","cluster_addr":"172.21.15.173:6811/761678552","heartbeat_back_addr":"172.21.15.173:6815/761678552","heartbeat_front_addr":"172.21.15.173:6813/761678552","state":["exists","up"]},{"osd":7,"uuid":"faf10eea-80de-40f6-abbb-34d07d3f59ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6817","nonce":383724537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6819","nonce":383724537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6823","nonce":383724537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6821","nonce":383724537}]},"public_addr":"172.21.15.173:6817/383724537","cluster_addr":"172.21.15.173:6819/383724537","heartbeat_back_addr":"172.21.15.173:6823/383724537","heartbeat_front_addr":"172.21.15.173:6821/383724537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.668924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.761747+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.768128+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.632252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.742608+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.734327+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.477107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.818292+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.31","mappings":[{"from":0,"to":7}]},{"pgid":"4.5","mappings":[{"from":3,"to":4},{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":0}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]},{"pgid":"4.1c","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T19:53:49.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.245+0000 7f2bcbfff640 1 -- 172.21.15.18:0/2221384185 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f2ba8068380 msgr2=0x7f2ba806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:49.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.245+0000 7f2bcbfff640 1 --2- 172.21.15.18:0/2221384185 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f2ba8068380 0x7f2ba806a890 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4006fd0 tx=0x7f2bb4008040 comp rx=0 tx=0).stop 2024-04-17T19:53:49.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.245+0000 7f2bcbfff640 1 -- 172.21.15.18:0/2221384185 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2bc406ef30 msgr2=0x7f2bc4143c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:49.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.245+0000 7f2bcbfff640 1 --2- 172.21.15.18:0/2221384185 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2bc406ef30 0x7f2bc4143c60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2bc000c480 tx=0x7f2bc000c940 comp rx=0 tx=0).stop 2024-04-17T19:53:49.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.245+0000 7f2bcbfff640 1 -- 172.21.15.18:0/2221384185 shutdown_connections 2024-04-17T19:53:49.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.245+0000 7f2bcbfff640 1 --2- 172.21.15.18:0/2221384185 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f2ba8068380 0x7f2ba806a890 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:49.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.245+0000 7f2bcbfff640 1 --2- 172.21.15.18:0/2221384185 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2bc415b810 0x7f2bc414c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:49.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.245+0000 7f2bcbfff640 1 --2- 172.21.15.18:0/2221384185 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2bc40cfb20 0x7f2bc41567f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:49.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.245+0000 7f2bcbfff640 1 --2- 172.21.15.18:0/2221384185 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2bc406ef30 0x7f2bc4143c60 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:49.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.245+0000 7f2bcbfff640 1 -- 172.21.15.18:0/2221384185 >> 172.21.15.18:0/2221384185 conn(0x7f2bc4072bb0 msgr2=0x7f2bc4072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:49.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.245+0000 7f2bcbfff640 1 -- 172.21.15.18:0/2221384185 shutdown_connections 2024-04-17T19:53:49.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.245+0000 7f2bcbfff640 1 -- 172.21.15.18:0/2221384185 wait complete. 2024-04-17T19:53:49.262 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T19:52:52.391648+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-17T19:53:02.734240+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-17T19:53:03.813028+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-17T19:53:07.478812+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-17T19:53:49.263 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T19:53:49.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.421+0000 7f9854d4a640 1 Processor -- start 2024-04-17T19:53:49.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.421+0000 7f9854d4a640 1 -- start start 2024-04-17T19:53:49.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.421+0000 7f9854d4a640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f985015b810 0x7f98500cde90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:49.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.421+0000 7f9854d4a640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98500b53d0 con 0x7f985006ef30 2024-04-17T19:53:49.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.421+0000 7f9854d4a640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98500b56b0 con 0x7f98500cfb20 2024-04-17T19:53:49.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.421+0000 7f9854d4a640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f98500b5990 con 0x7f985015b810 2024-04-17T19:53:49.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.421+0000 7f984e59c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f985015b810 0x7f98500cde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:49.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.421+0000 7f984dd9b640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f98500cfb20 0x7f98500cff30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.18:50572/0 (socket says 172.21.15.18:50572) 2024-04-17T19:53:49.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.421+0000 7f984dd9b640 1 -- 172.21.15.18:0/3048109174 learned_addr learned my addr 172.21.15.18:0/3048109174 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:49.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.421+0000 7f984ed9d640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f985006ef30 0x7f985006f340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:54970/0 (socket says 172.21.15.18:54970) 2024-04-17T19:53:49.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.421+0000 7f984e59c640 1 -- 172.21.15.18:0/3048109174 >> v1:172.21.15.173:6789/0 conn(0x7f98500cfb20 legacy=0x7f98500cff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:49.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.421+0000 7f984e59c640 1 -- 172.21.15.18:0/3048109174 >> v1:172.21.15.18:6789/0 conn(0x7f985006ef30 legacy=0x7f985006f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:49.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.421+0000 7f984e59c640 1 -- 172.21.15.18:0/3048109174 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f985006ea10 con 0x7f985015b810 2024-04-17T19:53:49.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.425+0000 7f984e59c640 1 --2- 172.21.15.18:0/3048109174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f985015b810 0x7f98500cde90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f98380097c0 tx=0x7f983801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=716b92fad551f27 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:49.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.425+0000 7f984d59a640 1 -- 172.21.15.18:0/3048109174 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98380b0070 con 0x7f985015b810 2024-04-17T19:53:49.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.425+0000 7f984d59a640 1 -- 172.21.15.18:0/3048109174 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98380ab600 con 0x7f985015b810 2024-04-17T19:53:49.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.425+0000 7f984d59a640 1 -- 172.21.15.18:0/3048109174 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9850070260 con 0x7f985015b810 2024-04-17T19:53:49.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.425+0000 7f9854d4a640 1 -- 172.21.15.18:0/3048109174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f985015b810 msgr2=0x7f98500cde90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:49.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.425+0000 7f9854d4a640 1 --2- 172.21.15.18:0/3048109174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f985015b810 0x7f98500cde90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f98380097c0 tx=0x7f983801c410 comp rx=0 tx=0).stop 2024-04-17T19:53:49.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.425+0000 7f9854d4a640 1 -- 172.21.15.18:0/3048109174 shutdown_connections 2024-04-17T19:53:49.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.425+0000 7f9854d4a640 1 --2- 172.21.15.18:0/3048109174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f985015b810 0x7f98500cde90 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:49.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.425+0000 7f9854d4a640 1 -- 172.21.15.18:0/3048109174 >> 172.21.15.18:0/3048109174 conn(0x7f9850072bb0 msgr2=0x7f9850072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:49.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.425+0000 7f9854d4a640 1 -- 172.21.15.18:0/3048109174 shutdown_connections 2024-04-17T19:53:49.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.425+0000 7f9854d4a640 1 -- 172.21.15.18:0/3048109174 wait complete. 2024-04-17T19:53:49.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.429+0000 7f9854d4a640 1 Processor -- start 2024-04-17T19:53:49.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.429+0000 7f9854d4a640 1 -- start start 2024-04-17T19:53:49.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.429+0000 7f9854d4a640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f985006ef30 0x7f98501412a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:49.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.429+0000 7f9854d4a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98500cfb20 0x7f9850145a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:49.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.429+0000 7f9854d4a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9850145fb0 0x7f98501429f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:49.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.429+0000 7f9854d4a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f985006d0f0 con 0x7f9850145fb0 2024-04-17T19:53:49.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.429+0000 7f9854d4a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f985006cf70 con 0x7f98500cfb20 2024-04-17T19:53:49.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.429+0000 7f9854d4a640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f985006d270 con 0x7f985006ef30 2024-04-17T19:53:49.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.429+0000 7f984ed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9850145fb0 0x7f98501429f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:49.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.429+0000 7f984ed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9850145fb0 0x7f98501429f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55570/0 (socket says 172.21.15.18:55570) 2024-04-17T19:53:49.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.429+0000 7f984ed9d640 1 -- 172.21.15.18:0/3185760455 learned_addr learned my addr 172.21.15.18:0/3185760455 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:49.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.429+0000 7f984dd9b640 1 --2- 172.21.15.18:0/3185760455 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98500cfb20 0x7f9850145a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:49.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.429+0000 7f984e59c640 1 --2- 172.21.15.18:0/3185760455 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f985006ef30 0x7f98501412a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:49.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.429+0000 7f984ed9d640 1 -- 172.21.15.18:0/3185760455 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f985006ef30 msgr2=0x7f98501412a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:49.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.429+0000 7f984ed9d640 1 --2- 172.21.15.18:0/3185760455 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f985006ef30 0x7f98501412a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:49.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.429+0000 7f984ed9d640 1 -- 172.21.15.18:0/3185760455 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98500cfb20 msgr2=0x7f9850145a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:49.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.429+0000 7f984ed9d640 1 --2- 172.21.15.18:0/3185760455 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98500cfb20 0x7f9850145a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:49.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.429+0000 7f984ed9d640 1 -- 172.21.15.18:0/3185760455 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9850146760 con 0x7f9850145fb0 2024-04-17T19:53:49.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.429+0000 7f984ed9d640 1 --2- 172.21.15.18:0/3185760455 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9850145fb0 0x7f98501429f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f984800c6f0 tx=0x7f984800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:49.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.429+0000 7f9846ffd640 1 -- 172.21.15.18:0/3185760455 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9848017070 con 0x7f9850145fb0 2024-04-17T19:53:49.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.429+0000 7f9846ffd640 1 -- 172.21.15.18:0/3185760455 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9848005db0 con 0x7f9850145fb0 2024-04-17T19:53:49.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.429+0000 7f9854d4a640 1 -- 172.21.15.18:0/3185760455 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9850146a40 con 0x7f9850145fb0 2024-04-17T19:53:49.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.429+0000 7f9846ffd640 1 -- 172.21.15.18:0/3185760455 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f984800a840 con 0x7f9850145fb0 2024-04-17T19:53:49.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.429+0000 7f9854d4a640 1 -- 172.21.15.18:0/3185760455 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9850147000 con 0x7f9850145fb0 2024-04-17T19:53:49.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.433+0000 7f9854d4a640 1 -- 172.21.15.18:0/3185760455 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9850069950 con 0x7f9850145fb0 2024-04-17T19:53:49.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.433+0000 7f9846ffd640 1 -- 172.21.15.18:0/3185760455 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f984801a070 con 0x7f9850145fb0 2024-04-17T19:53:49.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.433+0000 7f9846ffd640 1 --2- 172.21.15.18:0/3185760455 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f98300683b0 0x7f983006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:49.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.433+0000 7f9846ffd640 1 -- 172.21.15.18:0/3185760455 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7f9848086290 con 0x7f9850145fb0 2024-04-17T19:53:49.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.433+0000 7f984e59c640 1 --2- 172.21.15.18:0/3185760455 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f98300683b0 0x7f983006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:49.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.433+0000 7f984e59c640 1 --2- 172.21.15.18:0/3185760455 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f98300683b0 0x7f983006a8c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f98380ad000 tx=0x7f98380a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:49.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.437+0000 7f9846ffd640 1 -- 172.21.15.18:0/3185760455 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9848055da0 con 0x7f9850145fb0 2024-04-17T19:53:49.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.601+0000 7f9854d4a640 1 -- 172.21.15.18:0/3185760455 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f98501464f0 con 0x7f9850145fb0 2024-04-17T19:53:49.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.601+0000 7f9846ffd640 1 -- 172.21.15.18:0/3185760455 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7f984805a0a0 con 0x7f9850145fb0 2024-04-17T19:53:49.597 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-17T19:53:49.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.601+0000 7f9854d4a640 1 -- 172.21.15.18:0/3185760455 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f98300683b0 msgr2=0x7f983006a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:49.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.601+0000 7f9854d4a640 1 --2- 172.21.15.18:0/3185760455 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f98300683b0 0x7f983006a8c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f98380ad000 tx=0x7f98380a6000 comp rx=0 tx=0).stop 2024-04-17T19:53:49.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.601+0000 7f9854d4a640 1 -- 172.21.15.18:0/3185760455 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9850145fb0 msgr2=0x7f98501429f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:49.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.601+0000 7f9854d4a640 1 --2- 172.21.15.18:0/3185760455 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9850145fb0 0x7f98501429f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f984800c6f0 tx=0x7f984800cbb0 comp rx=0 tx=0).stop 2024-04-17T19:53:49.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.601+0000 7f9854d4a640 1 -- 172.21.15.18:0/3185760455 shutdown_connections 2024-04-17T19:53:49.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.601+0000 7f9854d4a640 1 --2- 172.21.15.18:0/3185760455 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f98300683b0 0x7f983006a8c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:49.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.601+0000 7f9854d4a640 1 --2- 172.21.15.18:0/3185760455 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9850145fb0 0x7f98501429f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:49.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.601+0000 7f9854d4a640 1 --2- 172.21.15.18:0/3185760455 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98500cfb20 0x7f9850145a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:49.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.601+0000 7f9854d4a640 1 --2- 172.21.15.18:0/3185760455 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f985006ef30 0x7f98501412a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:49.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.601+0000 7f9854d4a640 1 -- 172.21.15.18:0/3185760455 >> 172.21.15.18:0/3185760455 conn(0x7f9850072bb0 msgr2=0x7f985015f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:49.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.601+0000 7f9854d4a640 1 -- 172.21.15.18:0/3185760455 shutdown_connections 2024-04-17T19:53:49.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.601+0000 7f9854d4a640 1 -- 172.21.15.18:0/3185760455 wait complete. 2024-04-17T19:53:49.618 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-17T19:53:49.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.765+0000 7f8b3ec68640 1 Processor -- start 2024-04-17T19:53:49.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.765+0000 7f8b3ec68640 1 -- start start 2024-04-17T19:53:49.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.765+0000 7f8b3ec68640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b3806d660 0x7f8b38073080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:49.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.765+0000 7f8b3ec68640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b380739d0 con 0x7f8b380cf970 2024-04-17T19:53:49.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.765+0000 7f8b3ec68640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b380b6670 con 0x7f8b380735c0 2024-04-17T19:53:49.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.765+0000 7f8b3ec68640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f8b3806c760 con 0x7f8b3806d660 2024-04-17T19:53:49.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.765+0000 7f8b3d205640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f8b380cf970 0x7f8b380b58c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:54984/0 (socket says 172.21.15.18:54984) 2024-04-17T19:53:49.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.765+0000 7f8b3d205640 1 -- 172.21.15.18:0/2199632755 learned_addr learned my addr 172.21.15.18:0/2199632755 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:49.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.765+0000 7f8b3ca04640 1 --2- 172.21.15.18:0/2199632755 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b3806d660 0x7f8b38073080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:49.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.765+0000 7f8b377fe640 1 -- 172.21.15.18:0/2199632755 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1766732142 0 0) 0x7f8b300014a0 con 0x7f8b380cf970 2024-04-17T19:53:49.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.765+0000 7f8b377fe640 1 -- 172.21.15.18:0/2199632755 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b20003530 con 0x7f8b380cf970 2024-04-17T19:53:49.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.765+0000 7f8b377fe640 1 -- 172.21.15.18:0/2199632755 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4230758331 0 0) 0x7f8b20003530 con 0x7f8b380cf970 2024-04-17T19:53:49.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.765+0000 7f8b377fe640 1 -- 172.21.15.18:0/2199632755 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b3806d660 msgr2=0x7f8b38073080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:49.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.765+0000 7f8b377fe640 1 --2- 172.21.15.18:0/2199632755 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b3806d660 0x7f8b38073080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:49.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.765+0000 7f8b377fe640 1 -- 172.21.15.18:0/2199632755 >> v1:172.21.15.173:6789/0 conn(0x7f8b380735c0 legacy=0x7f8b380cf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:49.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.765+0000 7f8b377fe640 1 -- 172.21.15.18:0/2199632755 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b3806ca40 con 0x7f8b380cf970 2024-04-17T19:53:49.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.765+0000 7f8b377fe640 1 -- 172.21.15.18:0/2199632755 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3208559991 0 0) 0x7f8b30001bd0 con 0x7f8b380cf970 2024-04-17T19:53:49.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.765+0000 7f8b377fe640 1 -- 172.21.15.18:0/2199632755 >> v1:172.21.15.18:6789/0 conn(0x7f8b380cf970 legacy=0x7f8b380b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:49.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.765+0000 7f8b377fe640 1 --2- 172.21.15.18:0/2199632755 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b200039f0 0x7f8b20003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:49.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.765+0000 7f8b377fe640 1 --2- 172.21.15.18:0/2199632755 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b20004810 0x7f8b20004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:49.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.765+0000 7f8b377fe640 1 --2- 172.21.15.18:0/2199632755 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b3806d660 0x7f8b20005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:49.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.765+0000 7f8b377fe640 1 -- 172.21.15.18:0/2199632755 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8b3806c760 con 0x7f8b20004810 2024-04-17T19:53:49.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.765+0000 7f8b377fe640 1 -- 172.21.15.18:0/2199632755 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8b2000bb00 con 0x7f8b200039f0 2024-04-17T19:53:49.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.765+0000 7f8b377fe640 1 -- 172.21.15.18:0/2199632755 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f8b2000bd00 con 0x7f8b3806d660 2024-04-17T19:53:49.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.765+0000 7f8b37fff640 1 --2- 172.21.15.18:0/2199632755 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b20004810 0x7f8b20004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:49.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.765+0000 7f8b3d205640 1 --2- 172.21.15.18:0/2199632755 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b3806d660 0x7f8b20005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:49.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.765+0000 7f8b3ca04640 1 --2- 172.21.15.18:0/2199632755 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b200039f0 0x7f8b20003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:49.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.765+0000 7f8b37fff640 1 -- 172.21.15.18:0/2199632755 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b3806d660 msgr2=0x7f8b20005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:49.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.765+0000 7f8b37fff640 1 --2- 172.21.15.18:0/2199632755 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b3806d660 0x7f8b20005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:49.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.765+0000 7f8b37fff640 1 -- 172.21.15.18:0/2199632755 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b200039f0 msgr2=0x7f8b20003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:49.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.765+0000 7f8b37fff640 1 --2- 172.21.15.18:0/2199632755 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b200039f0 0x7f8b20003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:49.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.765+0000 7f8b37fff640 1 -- 172.21.15.18:0/2199632755 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b20003530 con 0x7f8b20004810 2024-04-17T19:53:49.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.765+0000 7f8b3ca04640 1 --2- 172.21.15.18:0/2199632755 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b200039f0 0x7f8b20003e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:53:49.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.769+0000 7f8b37fff640 1 --2- 172.21.15.18:0/2199632755 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b20004810 0x7f8b20004c20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8b28001750 tx=0x7f8b2801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ea0d49e874be891 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:49.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.769+0000 7f8b377fe640 1 -- 172.21.15.18:0/2199632755 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b280013a0 con 0x7f8b20004810 2024-04-17T19:53:49.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.769+0000 7f8b377fe640 1 -- 172.21.15.18:0/2199632755 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b280052f0 con 0x7f8b20004810 2024-04-17T19:53:49.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.769+0000 7f8b377fe640 1 -- 172.21.15.18:0/2199632755 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b28003840 con 0x7f8b20004810 2024-04-17T19:53:49.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.769+0000 7f8b3ec68640 1 -- 172.21.15.18:0/2199632755 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b20004810 msgr2=0x7f8b20004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:49.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.769+0000 7f8b3ec68640 1 --2- 172.21.15.18:0/2199632755 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b20004810 0x7f8b20004c20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8b28001750 tx=0x7f8b2801c3e0 comp rx=0 tx=0).stop 2024-04-17T19:53:49.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.769+0000 7f8b3d205640 1 -- 172.21.15.18:0/2199632755 reap_dead start 2024-04-17T19:53:49.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.769+0000 7f8b3ec68640 1 -- 172.21.15.18:0/2199632755 shutdown_connections 2024-04-17T19:53:49.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.769+0000 7f8b3ec68640 1 -- 172.21.15.18:0/2199632755 >> 172.21.15.18:0/2199632755 conn(0x7f8b380b3910 msgr2=0x7f8b380d12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:49.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.769+0000 7f8b3ec68640 1 -- 172.21.15.18:0/2199632755 shutdown_connections 2024-04-17T19:53:49.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.769+0000 7f8b3ec68640 1 -- 172.21.15.18:0/2199632755 wait complete. 2024-04-17T19:53:49.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.773+0000 7f8b3ec68640 1 Processor -- start 2024-04-17T19:53:49.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.773+0000 7f8b3ec68640 1 -- start start 2024-04-17T19:53:49.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.773+0000 7f8b3ec68640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b20004810 0x7f8b380cd040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:49.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.773+0000 7f8b3ec68640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b381e8220 0x7f8b381e66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:49.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.773+0000 7f8b3ec68640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b3815e040 0x7f8b3815e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:49.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.773+0000 7f8b3ec68640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8b38156240 con 0x7f8b3815e040 2024-04-17T19:53:49.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.773+0000 7f8b3ec68640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8b381560c0 con 0x7f8b20004810 2024-04-17T19:53:49.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.773+0000 7f8b3ec68640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f8b38073080 con 0x7f8b381e8220 2024-04-17T19:53:49.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.773+0000 7f8b3d205640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b3815e040 0x7f8b3815e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:49.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.773+0000 7f8b3d205640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b3815e040 0x7f8b3815e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55592/0 (socket says 172.21.15.18:55592) 2024-04-17T19:53:49.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.773+0000 7f8b3d205640 1 -- 172.21.15.18:0/2616588035 learned_addr learned my addr 172.21.15.18:0/2616588035 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:49.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.773+0000 7f8b37fff640 1 --2- 172.21.15.18:0/2616588035 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b381e8220 0x7f8b381e66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:49.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.773+0000 7f8b3ca04640 1 --2- 172.21.15.18:0/2616588035 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b20004810 0x7f8b380cd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:49.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.773+0000 7f8b3d205640 1 -- 172.21.15.18:0/2616588035 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b381e8220 msgr2=0x7f8b381e66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:49.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.773+0000 7f8b3d205640 1 --2- 172.21.15.18:0/2616588035 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b381e8220 0x7f8b381e66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:49.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.773+0000 7f8b3d205640 1 -- 172.21.15.18:0/2616588035 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b20004810 msgr2=0x7f8b380cd040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:49.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.773+0000 7f8b3d205640 1 --2- 172.21.15.18:0/2616588035 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b20004810 0x7f8b380cd040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:49.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.773+0000 7f8b3d205640 1 -- 172.21.15.18:0/2616588035 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b3815e990 con 0x7f8b3815e040 2024-04-17T19:53:49.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.773+0000 7f8b3d205640 1 --2- 172.21.15.18:0/2616588035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b3815e040 0x7f8b3815e450 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8b380d1d60 tx=0x7f8b30010920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:49.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.773+0000 7f8b357fa640 1 -- 172.21.15.18:0/2616588035 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3001a070 con 0x7f8b3815e040 2024-04-17T19:53:49.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.773+0000 7f8b357fa640 1 -- 172.21.15.18:0/2616588035 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b30007070 con 0x7f8b3815e040 2024-04-17T19:53:49.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.773+0000 7f8b3ec68640 1 -- 172.21.15.18:0/2616588035 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b381e7180 con 0x7f8b3815e040 2024-04-17T19:53:49.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.773+0000 7f8b357fa640 1 -- 172.21.15.18:0/2616588035 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b30007460 con 0x7f8b3815e040 2024-04-17T19:53:49.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.773+0000 7f8b3ec68640 1 -- 172.21.15.18:0/2616588035 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b381e7740 con 0x7f8b3815e040 2024-04-17T19:53:49.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.773+0000 7f8b3ec68640 1 -- 172.21.15.18:0/2616588035 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b381e6ef0 con 0x7f8b3815e040 2024-04-17T19:53:49.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.777+0000 7f8b357fa640 1 -- 172.21.15.18:0/2616588035 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8b3001d070 con 0x7f8b3815e040 2024-04-17T19:53:49.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.777+0000 7f8b357fa640 1 --2- 172.21.15.18:0/2616588035 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f8b240683b0 0x7f8b2406a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:49.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.777+0000 7f8b357fa640 1 -- 172.21.15.18:0/2616588035 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7f8b30088e30 con 0x7f8b3815e040 2024-04-17T19:53:49.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.777+0000 7f8b3ca04640 1 --2- 172.21.15.18:0/2616588035 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f8b240683b0 0x7f8b2406a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:49.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.777+0000 7f8b3ca04640 1 --2- 172.21.15.18:0/2616588035 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f8b240683b0 0x7f8b2406a8c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c00ac20 tx=0x7f8b2c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:49.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.781+0000 7f8b357fa640 1 -- 172.21.15.18:0/2616588035 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8b3815e990 con 0x7f8b3815e040 2024-04-17T19:53:49.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.941+0000 7f8b3ec68640 1 -- 172.21.15.18:0/2616588035 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f8b3815ad70 con 0x7f8b3815e040 2024-04-17T19:53:49.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.941+0000 7f8b357fa640 1 -- 172.21.15.18:0/2616588035 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7f8b380739d0 con 0x7f8b3815e040 2024-04-17T19:53:49.939 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-17T19:53:49.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.945+0000 7f8b3ec68640 1 -- 172.21.15.18:0/2616588035 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f8b240683b0 msgr2=0x7f8b2406a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:49.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.945+0000 7f8b3ec68640 1 --2- 172.21.15.18:0/2616588035 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f8b240683b0 0x7f8b2406a8c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c00ac20 tx=0x7f8b2c008040 comp rx=0 tx=0).stop 2024-04-17T19:53:49.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.945+0000 7f8b3ec68640 1 -- 172.21.15.18:0/2616588035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b3815e040 msgr2=0x7f8b3815e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:49.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.945+0000 7f8b3ec68640 1 --2- 172.21.15.18:0/2616588035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b3815e040 0x7f8b3815e450 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8b380d1d60 tx=0x7f8b30010920 comp rx=0 tx=0).stop 2024-04-17T19:53:49.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.945+0000 7f8b3ec68640 1 -- 172.21.15.18:0/2616588035 shutdown_connections 2024-04-17T19:53:49.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.945+0000 7f8b3ec68640 1 --2- 172.21.15.18:0/2616588035 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f8b240683b0 0x7f8b2406a8c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:49.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.945+0000 7f8b3ec68640 1 --2- 172.21.15.18:0/2616588035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b3815e040 0x7f8b3815e450 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:49.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.945+0000 7f8b3ec68640 1 --2- 172.21.15.18:0/2616588035 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8b381e8220 0x7f8b381e66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:49.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.945+0000 7f8b3ec68640 1 --2- 172.21.15.18:0/2616588035 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8b20004810 0x7f8b380cd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:49.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.945+0000 7f8b3ec68640 1 -- 172.21.15.18:0/2616588035 >> 172.21.15.18:0/2616588035 conn(0x7f8b380b3910 msgr2=0x7f8b380cd660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:49.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.945+0000 7f8b3ec68640 1 -- 172.21.15.18:0/2616588035 shutdown_connections 2024-04-17T19:53:49.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:49.945+0000 7f8b3ec68640 1 -- 172.21.15.18:0/2616588035 wait complete. 2024-04-17T19:53:49.961 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-17T19:53:50.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.117+0000 7f36a3e02640 1 Processor -- start 2024-04-17T19:53:50.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.117+0000 7f36a3e02640 1 -- start start 2024-04-17T19:53:50.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.117+0000 7f36a3e02640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f369c0cd4c0 0x7f369c15cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:50.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.117+0000 7f36a3e02640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f369c1610c0 con 0x7f369c06f900 2024-04-17T19:53:50.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.117+0000 7f36a3e02640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f369c1613a0 con 0x7f369c0d1720 2024-04-17T19:53:50.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.117+0000 7f36a3e02640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f369c161680 con 0x7f369c0cd4c0 2024-04-17T19:53:50.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.117+0000 7f36a1b9e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f369c0cd4c0 0x7f369c15cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:50.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.117+0000 7f36a139d640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f369c06f900 0x7f369c06fd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:54992/0 (socket says 172.21.15.18:54992) 2024-04-17T19:53:50.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.117+0000 7f36a139d640 1 -- 172.21.15.18:0/2954884201 learned_addr learned my addr 172.21.15.18:0/2954884201 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:50.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.117+0000 7f36a1b9e640 1 -- 172.21.15.18:0/2954884201 >> v1:172.21.15.173:6789/0 conn(0x7f369c0d1720 legacy=0x7f369c0d1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:50.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.117+0000 7f36a1b9e640 1 -- 172.21.15.18:0/2954884201 >> v1:172.21.15.18:6789/0 conn(0x7f369c06f900 legacy=0x7f369c06fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:50.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.117+0000 7f36a1b9e640 1 -- 172.21.15.18:0/2954884201 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f369c161960 con 0x7f369c0cd4c0 2024-04-17T19:53:50.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.121+0000 7f36a1b9e640 1 --2- 172.21.15.18:0/2954884201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f369c0cd4c0 0x7f369c15cfd0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f36980097c0 tx=0x7f369801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fcaaf49484aa031 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:50.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.121+0000 7f36a0b9c640 1 -- 172.21.15.18:0/2954884201 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f369c0d2a50 con 0x7f369c0cd4c0 2024-04-17T19:53:50.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.121+0000 7f36a0b9c640 1 -- 172.21.15.18:0/2954884201 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36980b0070 con 0x7f369c0cd4c0 2024-04-17T19:53:50.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.121+0000 7f36a0b9c640 1 -- 172.21.15.18:0/2954884201 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36980ab650 con 0x7f369c0cd4c0 2024-04-17T19:53:50.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.121+0000 7f36a3e02640 1 -- 172.21.15.18:0/2954884201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f369c0cd4c0 msgr2=0x7f369c15cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:50.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.121+0000 7f36a3e02640 1 --2- 172.21.15.18:0/2954884201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f369c0cd4c0 0x7f369c15cfd0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f36980097c0 tx=0x7f369801c410 comp rx=0 tx=0).stop 2024-04-17T19:53:50.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.121+0000 7f36a3e02640 1 -- 172.21.15.18:0/2954884201 shutdown_connections 2024-04-17T19:53:50.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.121+0000 7f36a3e02640 1 --2- 172.21.15.18:0/2954884201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f369c0cd4c0 0x7f369c15cfd0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:50.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.121+0000 7f36a3e02640 1 -- 172.21.15.18:0/2954884201 >> 172.21.15.18:0/2954884201 conn(0x7f369c0cf6e0 msgr2=0x7f369c0cfaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:50.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.121+0000 7f36a3e02640 1 -- 172.21.15.18:0/2954884201 shutdown_connections 2024-04-17T19:53:50.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.121+0000 7f36a3e02640 1 -- 172.21.15.18:0/2954884201 wait complete. 2024-04-17T19:53:50.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.121+0000 7f36a3e02640 1 Processor -- start 2024-04-17T19:53:50.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.125+0000 7f36a3e02640 1 -- start start 2024-04-17T19:53:50.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.125+0000 7f36a3e02640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f369c06f900 0x7f369c1f8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:50.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.125+0000 7f36a3e02640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f369c0cd4c0 0x7f369c15fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:50.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.125+0000 7f36a3e02640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f369c0d1720 0x7f369c15ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:50.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.125+0000 7f36a3e02640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f369c16b280 con 0x7f369c0d1720 2024-04-17T19:53:50.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.125+0000 7f36a3e02640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f369c16b100 con 0x7f369c06f900 2024-04-17T19:53:50.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.125+0000 7f36a3e02640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f369c16b400 con 0x7f369c0cd4c0 2024-04-17T19:53:50.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.125+0000 7f36a239f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f369c0d1720 0x7f369c15ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:50.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.125+0000 7f36a239f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f369c0d1720 0x7f369c15ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55604/0 (socket says 172.21.15.18:55604) 2024-04-17T19:53:50.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.125+0000 7f36a239f640 1 -- 172.21.15.18:0/980070895 learned_addr learned my addr 172.21.15.18:0/980070895 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:50.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.125+0000 7f36a1b9e640 1 --2- 172.21.15.18:0/980070895 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f369c06f900 0x7f369c1f8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:50.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.125+0000 7f36a139d640 1 --2- 172.21.15.18:0/980070895 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f369c0cd4c0 0x7f369c15fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:50.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.125+0000 7f36a239f640 1 -- 172.21.15.18:0/980070895 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f369c0cd4c0 msgr2=0x7f369c15fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:50.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.125+0000 7f36a239f640 1 --2- 172.21.15.18:0/980070895 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f369c0cd4c0 0x7f369c15fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:50.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.125+0000 7f36a239f640 1 -- 172.21.15.18:0/980070895 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f369c06f900 msgr2=0x7f369c1f8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:50.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.125+0000 7f36a239f640 1 --2- 172.21.15.18:0/980070895 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f369c06f900 0x7f369c1f8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:50.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.125+0000 7f36a239f640 1 -- 172.21.15.18:0/980070895 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f369c06e590 con 0x7f369c0d1720 2024-04-17T19:53:50.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.125+0000 7f36a239f640 1 --2- 172.21.15.18:0/980070895 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f369c0d1720 0x7f369c15ff60 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f369400c730 tx=0x7f369400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:50.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.125+0000 7f36927fc640 1 -- 172.21.15.18:0/980070895 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3694003b80 con 0x7f369c0d1720 2024-04-17T19:53:50.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.125+0000 7f36927fc640 1 -- 172.21.15.18:0/980070895 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3694003d20 con 0x7f369c0d1720 2024-04-17T19:53:50.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.125+0000 7f36a3e02640 1 -- 172.21.15.18:0/980070895 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f369c06e870 con 0x7f369c0d1720 2024-04-17T19:53:50.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.125+0000 7f36927fc640 1 -- 172.21.15.18:0/980070895 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3694005310 con 0x7f369c0d1720 2024-04-17T19:53:50.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.125+0000 7f36a3e02640 1 -- 172.21.15.18:0/980070895 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f369c06ee30 con 0x7f369c0d1720 2024-04-17T19:53:50.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.125+0000 7f36a3e02640 1 -- 172.21.15.18:0/980070895 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f369c153990 con 0x7f369c0d1720 2024-04-17T19:53:50.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.125+0000 7f36927fc640 1 -- 172.21.15.18:0/980070895 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f36940056c0 con 0x7f369c0d1720 2024-04-17T19:53:50.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.129+0000 7f36927fc640 1 --2- 172.21.15.18:0/980070895 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f3680068380 0x7f368006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:50.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.129+0000 7f36927fc640 1 -- 172.21.15.18:0/980070895 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7f3694086d40 con 0x7f369c0d1720 2024-04-17T19:53:50.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.129+0000 7f36a1b9e640 1 --2- 172.21.15.18:0/980070895 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f3680068380 0x7f368006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:50.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.129+0000 7f36a1b9e640 1 --2- 172.21.15.18:0/980070895 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f3680068380 0x7f368006a890 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f36980af000 tx=0x7f36980a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:50.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.133+0000 7f36927fc640 1 -- 172.21.15.18:0/980070895 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f369c153990 con 0x7f369c0d1720 2024-04-17T19:53:50.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.293+0000 7f36a3e02640 1 -- 172.21.15.18:0/980070895 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f369c06e320 con 0x7f369c0d1720 2024-04-17T19:53:50.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.293+0000 7f36927fc640 1 -- 172.21.15.18:0/980070895 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7f3694056f30 con 0x7f369c0d1720 2024-04-17T19:53:50.292 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-17T19:53:50.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.297+0000 7f36a3e02640 1 -- 172.21.15.18:0/980070895 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f3680068380 msgr2=0x7f368006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:50.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.297+0000 7f36a3e02640 1 --2- 172.21.15.18:0/980070895 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f3680068380 0x7f368006a890 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f36980af000 tx=0x7f36980a7000 comp rx=0 tx=0).stop 2024-04-17T19:53:50.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.297+0000 7f36a3e02640 1 -- 172.21.15.18:0/980070895 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f369c0d1720 msgr2=0x7f369c15ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:50.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.297+0000 7f36a3e02640 1 --2- 172.21.15.18:0/980070895 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f369c0d1720 0x7f369c15ff60 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f369400c730 tx=0x7f369400cbf0 comp rx=0 tx=0).stop 2024-04-17T19:53:50.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.297+0000 7f36a3e02640 1 -- 172.21.15.18:0/980070895 shutdown_connections 2024-04-17T19:53:50.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.297+0000 7f36a3e02640 1 --2- 172.21.15.18:0/980070895 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f3680068380 0x7f368006a890 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:50.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.297+0000 7f36a3e02640 1 --2- 172.21.15.18:0/980070895 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f369c0d1720 0x7f369c15ff60 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:50.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.297+0000 7f36a3e02640 1 --2- 172.21.15.18:0/980070895 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f369c0cd4c0 0x7f369c15fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:50.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.297+0000 7f36a3e02640 1 --2- 172.21.15.18:0/980070895 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f369c06f900 0x7f369c1f8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:50.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.297+0000 7f36a3e02640 1 -- 172.21.15.18:0/980070895 >> 172.21.15.18:0/980070895 conn(0x7f369c0cf6e0 msgr2=0x7f369c15ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:50.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.297+0000 7f36a3e02640 1 -- 172.21.15.18:0/980070895 shutdown_connections 2024-04-17T19:53:50.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.297+0000 7f36a3e02640 1 -- 172.21.15.18:0/980070895 wait complete. 2024-04-17T19:53:50.312 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-17T19:53:50.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.461+0000 7fe96e488640 1 Processor -- start 2024-04-17T19:53:50.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.461+0000 7fe96e488640 1 -- start start 2024-04-17T19:53:50.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.461+0000 7fe96e488640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe9680cf970 0x7fe9680b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:50.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.461+0000 7fe96e488640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9680b6670 con 0x7fe96806d660 2024-04-17T19:53:50.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.461+0000 7fe96e488640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe96806c760 con 0x7fe968073790 2024-04-17T19:53:50.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.461+0000 7fe96e488640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fe96806ca40 con 0x7fe9680cf970 2024-04-17T19:53:50.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.461+0000 7fe967fff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fe96806d660 0x7fe968073080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:54998/0 (socket says 172.21.15.18:54998) 2024-04-17T19:53:50.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.461+0000 7fe967fff640 1 -- 172.21.15.18:0/1186686431 learned_addr learned my addr 172.21.15.18:0/1186686431 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:50.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.461+0000 7fe96ca25640 1 --2- 172.21.15.18:0/1186686431 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe9680cf970 0x7fe9680b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:50.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.461+0000 7fe96ca25640 1 -- 172.21.15.18:0/1186686431 >> v1:172.21.15.173:6789/0 conn(0x7fe968073790 legacy=0x7fe9680cf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:50.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.461+0000 7fe96ca25640 1 -- 172.21.15.18:0/1186686431 >> v1:172.21.15.18:6789/0 conn(0x7fe96806d660 legacy=0x7fe968073080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:50.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.461+0000 7fe96ca25640 1 -- 172.21.15.18:0/1186686431 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe96806cd20 con 0x7fe9680cf970 2024-04-17T19:53:50.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.465+0000 7fe96ca25640 1 --2- 172.21.15.18:0/1186686431 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe9680cf970 0x7fe9680b58c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe9580097f0 tx=0x7fe95801d5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf4530bd51f47460 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:50.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.465+0000 7fe966ffd640 1 -- 172.21.15.18:0/1186686431 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9580ac600 con 0x7fe9680cf970 2024-04-17T19:53:50.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.465+0000 7fe966ffd640 1 -- 172.21.15.18:0/1186686431 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9580b1070 con 0x7fe9680cf970 2024-04-17T19:53:50.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.465+0000 7fe966ffd640 1 -- 172.21.15.18:0/1186686431 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9580ac9c0 con 0x7fe9680cf970 2024-04-17T19:53:50.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.465+0000 7fe96e488640 1 -- 172.21.15.18:0/1186686431 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe9680cf970 msgr2=0x7fe9680b58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:50.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.465+0000 7fe96e488640 1 --2- 172.21.15.18:0/1186686431 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe9680cf970 0x7fe9680b58c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe9580097f0 tx=0x7fe95801d5f0 comp rx=0 tx=0).stop 2024-04-17T19:53:50.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.465+0000 7fe96e488640 1 -- 172.21.15.18:0/1186686431 shutdown_connections 2024-04-17T19:53:50.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.465+0000 7fe96e488640 1 --2- 172.21.15.18:0/1186686431 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe9680cf970 0x7fe9680b58c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:50.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.465+0000 7fe96e488640 1 -- 172.21.15.18:0/1186686431 >> 172.21.15.18:0/1186686431 conn(0x7fe9680b3910 msgr2=0x7fe9680d12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:50.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.465+0000 7fe96e488640 1 -- 172.21.15.18:0/1186686431 shutdown_connections 2024-04-17T19:53:50.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.465+0000 7fe96e488640 1 -- 172.21.15.18:0/1186686431 wait complete. 2024-04-17T19:53:50.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.469+0000 7fe96e488640 1 Processor -- start 2024-04-17T19:53:50.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.469+0000 7fe96e488640 1 -- start start 2024-04-17T19:53:50.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.469+0000 7fe96e488640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe96806d660 0x7fe968146c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:50.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.469+0000 7fe96e488640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9680cf970 0x7fe968156450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:50.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.469+0000 7fe96e488640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe968158060 0x7fe96814bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:50.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.469+0000 7fe96e488640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe9681562d0 con 0x7fe968158060 2024-04-17T19:53:50.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.469+0000 7fe96e488640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe9680b6420 con 0x7fe9680cf970 2024-04-17T19:53:50.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.469+0000 7fe96e488640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fe968169660 con 0x7fe96806d660 2024-04-17T19:53:50.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.469+0000 7fe96ca25640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe968158060 0x7fe96814bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:50.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.469+0000 7fe96ca25640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe968158060 0x7fe96814bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55618/0 (socket says 172.21.15.18:55618) 2024-04-17T19:53:50.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.469+0000 7fe96ca25640 1 -- 172.21.15.18:0/4264064013 learned_addr learned my addr 172.21.15.18:0/4264064013 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:50.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.469+0000 7fe9677fe640 1 --2- 172.21.15.18:0/4264064013 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9680cf970 0x7fe968156450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:50.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.469+0000 7fe967fff640 1 --2- 172.21.15.18:0/4264064013 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe96806d660 0x7fe968146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:50.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.469+0000 7fe96ca25640 1 -- 172.21.15.18:0/4264064013 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe96806d660 msgr2=0x7fe968146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:50.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.469+0000 7fe96ca25640 1 --2- 172.21.15.18:0/4264064013 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe96806d660 0x7fe968146c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:50.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.469+0000 7fe96ca25640 1 -- 172.21.15.18:0/4264064013 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9680cf970 msgr2=0x7fe968156450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:50.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.469+0000 7fe96ca25640 1 --2- 172.21.15.18:0/4264064013 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9680cf970 0x7fe968156450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:50.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.469+0000 7fe96ca25640 1 -- 172.21.15.18:0/4264064013 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe968156fc0 con 0x7fe968158060 2024-04-17T19:53:50.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.469+0000 7fe9677fe640 1 --2- 172.21.15.18:0/4264064013 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9680cf970 0x7fe968156450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T19:53:50.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.469+0000 7fe96ca25640 1 --2- 172.21.15.18:0/4264064013 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe968158060 0x7fe96814bfb0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe95801b220 tx=0x7fe95801a390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:50.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.469+0000 7fe964ff9640 1 -- 172.21.15.18:0/4264064013 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9580bb070 con 0x7fe968158060 2024-04-17T19:53:50.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.469+0000 7fe964ff9640 1 -- 172.21.15.18:0/4264064013 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9580accb0 con 0x7fe968158060 2024-04-17T19:53:50.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.469+0000 7fe964ff9640 1 -- 172.21.15.18:0/4264064013 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9580ace60 con 0x7fe968158060 2024-04-17T19:53:50.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.473+0000 7fe96e488640 1 -- 172.21.15.18:0/4264064013 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9681572a0 con 0x7fe968158060 2024-04-17T19:53:50.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.473+0000 7fe96e488640 1 -- 172.21.15.18:0/4264064013 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe968157860 con 0x7fe968158060 2024-04-17T19:53:50.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.473+0000 7fe96e488640 1 -- 172.21.15.18:0/4264064013 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe968156d30 con 0x7fe968158060 2024-04-17T19:53:50.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.473+0000 7fe964ff9640 1 -- 172.21.15.18:0/4264064013 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe9580ab070 con 0x7fe968158060 2024-04-17T19:53:50.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.473+0000 7fe964ff9640 1 --2- 172.21.15.18:0/4264064013 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fe954068380 0x7fe95406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:50.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.473+0000 7fe964ff9640 1 -- 172.21.15.18:0/4264064013 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7fe9581208d0 con 0x7fe968158060 2024-04-17T19:53:50.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.473+0000 7fe967fff640 1 --2- 172.21.15.18:0/4264064013 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fe954068380 0x7fe95406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:50.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.473+0000 7fe967fff640 1 --2- 172.21.15.18:0/4264064013 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fe954068380 0x7fe95406a890 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe960005c10 tx=0x7fe960009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:50.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.477+0000 7fe964ff9640 1 -- 172.21.15.18:0/4264064013 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe9580171e0 con 0x7fe968158060 2024-04-17T19:53:50.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.633+0000 7fe96e488640 1 -- 172.21.15.18:0/4264064013 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fe9680d1030 con 0x7fe968158060 2024-04-17T19:53:50.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.633+0000 7fe964ff9640 1 -- 172.21.15.18:0/4264064013 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7fe9580f03e0 con 0x7fe968158060 2024-04-17T19:53:50.630 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-17T19:53:50.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.637+0000 7fe96e488640 1 -- 172.21.15.18:0/4264064013 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fe954068380 msgr2=0x7fe95406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:50.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.637+0000 7fe96e488640 1 --2- 172.21.15.18:0/4264064013 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fe954068380 0x7fe95406a890 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe960005c10 tx=0x7fe960009040 comp rx=0 tx=0).stop 2024-04-17T19:53:50.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.637+0000 7fe96e488640 1 -- 172.21.15.18:0/4264064013 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe968158060 msgr2=0x7fe96814bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:50.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.637+0000 7fe96e488640 1 --2- 172.21.15.18:0/4264064013 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe968158060 0x7fe96814bfb0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe95801b220 tx=0x7fe95801a390 comp rx=0 tx=0).stop 2024-04-17T19:53:50.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.637+0000 7fe96e488640 1 -- 172.21.15.18:0/4264064013 shutdown_connections 2024-04-17T19:53:50.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.637+0000 7fe96e488640 1 --2- 172.21.15.18:0/4264064013 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fe954068380 0x7fe95406a890 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:50.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.637+0000 7fe96e488640 1 --2- 172.21.15.18:0/4264064013 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe968158060 0x7fe96814bfb0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:50.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.637+0000 7fe96e488640 1 --2- 172.21.15.18:0/4264064013 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9680cf970 0x7fe968156450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:50.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.637+0000 7fe96e488640 1 --2- 172.21.15.18:0/4264064013 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe96806d660 0x7fe968146c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:50.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.637+0000 7fe96e488640 1 -- 172.21.15.18:0/4264064013 >> 172.21.15.18:0/4264064013 conn(0x7fe9680b3910 msgr2=0x7fe9680b0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:50.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.637+0000 7fe96e488640 1 -- 172.21.15.18:0/4264064013 shutdown_connections 2024-04-17T19:53:50.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.637+0000 7fe96e488640 1 -- 172.21.15.18:0/4264064013 wait complete. 2024-04-17T19:53:50.650 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-17T19:53:50.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.801+0000 7f1bf2a5c640 1 Processor -- start 2024-04-17T19:53:50.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.801+0000 7f1bf2a5c640 1 -- start start 2024-04-17T19:53:50.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.801+0000 7f1bf2a5c640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f1bec15e1a0 0x7f1bec0ce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:50.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.801+0000 7f1bf2a5c640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bec0d0020 con 0x7f1bec06cd60 2024-04-17T19:53:50.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.801+0000 7f1bf2a5c640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bec0cd930 con 0x7f1bec0cef10 2024-04-17T19:53:50.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.801+0000 7f1bf2a5c640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f1bec0cdc10 con 0x7f1bec15e1a0 2024-04-17T19:53:50.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.805+0000 7f1bf0ff9640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f1bec06cd60 0x7f1bec06d170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55012/0 (socket says 172.21.15.18:55012) 2024-04-17T19:53:50.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.805+0000 7f1bf0ff9640 1 -- 172.21.15.18:0/3628255746 learned_addr learned my addr 172.21.15.18:0/3628255746 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:50.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.805+0000 7f1bebfff640 1 --2- 172.21.15.18:0/3628255746 >> v2:172.21.15.173:3300/0 conn(0x7f1bec15e1a0 0x7f1bec0ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:50.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.805+0000 7f1beb7fe640 1 -- 172.21.15.18:0/3628255746 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2274101163 0 0) 0x7f1bec0d0020 con 0x7f1bec06cd60 2024-04-17T19:53:50.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.805+0000 7f1beb7fe640 1 -- 172.21.15.18:0/3628255746 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1bd8003530 con 0x7f1bec06cd60 2024-04-17T19:53:50.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.805+0000 7f1beb7fe640 1 -- 172.21.15.18:0/3628255746 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2183924463 0 0) 0x7f1bd8003530 con 0x7f1bec06cd60 2024-04-17T19:53:50.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.805+0000 7f1beb7fe640 1 -- 172.21.15.18:0/3628255746 >> v2:172.21.15.173:3300/0 conn(0x7f1bec15e1a0 msgr2=0x7f1bec0ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:50.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.805+0000 7f1beb7fe640 1 --2- 172.21.15.18:0/3628255746 >> v2:172.21.15.173:3300/0 conn(0x7f1bec15e1a0 0x7f1bec0ce9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:50.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.805+0000 7f1beb7fe640 1 -- 172.21.15.18:0/3628255746 >> v1:172.21.15.173:6789/0 conn(0x7f1bec0cef10 legacy=0x7f1bec15e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:50.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.805+0000 7f1beb7fe640 1 -- 172.21.15.18:0/3628255746 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bec0cdef0 con 0x7f1bec06cd60 2024-04-17T19:53:50.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.805+0000 7f1beb7fe640 1 -- 172.21.15.18:0/3628255746 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3208559991 0 0) 0x7f1be4001a20 con 0x7f1bec06cd60 2024-04-17T19:53:50.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.805+0000 7f1beb7fe640 1 -- 172.21.15.18:0/3628255746 >> v1:172.21.15.18:6789/0 conn(0x7f1bec06cd60 legacy=0x7f1bec06d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:50.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.805+0000 7f1beb7fe640 1 --2- 172.21.15.18:0/3628255746 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1bd80039c0 0x7f1bd8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:50.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.805+0000 7f1beb7fe640 1 --2- 172.21.15.18:0/3628255746 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bd8004810 0x7f1bd8004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:50.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.805+0000 7f1beb7fe640 1 --2- 172.21.15.18:0/3628255746 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1bd8005310 0x7f1bd800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:50.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.805+0000 7f1beb7fe640 1 -- 172.21.15.18:0/3628255746 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1bec0cdc10 con 0x7f1bd8005310 2024-04-17T19:53:50.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.805+0000 7f1beb7fe640 1 -- 172.21.15.18:0/3628255746 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd800c2b0 con 0x7f1bd8004810 2024-04-17T19:53:50.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.805+0000 7f1beb7fe640 1 -- 172.21.15.18:0/3628255746 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f1bd800c4b0 con 0x7f1bd80039c0 2024-04-17T19:53:50.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.805+0000 7f1bf0ff9640 1 --2- 172.21.15.18:0/3628255746 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1bd8005310 0x7f1bd800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:50.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.805+0000 7f1be3fff640 1 --2- 172.21.15.18:0/3628255746 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bd8004810 0x7f1bd8004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:50.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.805+0000 7f1bebfff640 1 --2- 172.21.15.18:0/3628255746 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1bd80039c0 0x7f1bd8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:50.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.805+0000 7f1bf0ff9640 1 -- 172.21.15.18:0/3628255746 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1bd80039c0 msgr2=0x7f1bd8003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:50.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.805+0000 7f1bf0ff9640 1 --2- 172.21.15.18:0/3628255746 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1bd80039c0 0x7f1bd8003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:50.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.805+0000 7f1bf0ff9640 1 -- 172.21.15.18:0/3628255746 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bd8004810 msgr2=0x7f1bd8004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:50.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.805+0000 7f1bf0ff9640 1 --2- 172.21.15.18:0/3628255746 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bd8004810 0x7f1bd8004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:50.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.805+0000 7f1bf0ff9640 1 -- 172.21.15.18:0/3628255746 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bd8003530 con 0x7f1bd8005310 2024-04-17T19:53:50.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.805+0000 7f1bf0ff9640 1 -- 172.21.15.18:0/3628255746 reap_dead start 2024-04-17T19:53:50.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.805+0000 7f1bf0ff9640 1 --2- 172.21.15.18:0/3628255746 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1bd8005310 0x7f1bd800b9d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1be400a8f0 tx=0x7f1be401fb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2c719af8fb60665 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:50.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.805+0000 7f1beb7fe640 1 -- 172.21.15.18:0/3628255746 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be400a4c0 con 0x7f1bd8005310 2024-04-17T19:53:50.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.805+0000 7f1beb7fe640 1 -- 172.21.15.18:0/3628255746 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1be40aa500 con 0x7f1bd8005310 2024-04-17T19:53:50.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.805+0000 7f1beb7fe640 1 -- 172.21.15.18:0/3628255746 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be40aa8d0 con 0x7f1bd8005310 2024-04-17T19:53:50.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.809+0000 7f1bf2a5c640 1 -- 172.21.15.18:0/3628255746 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1bd8005310 msgr2=0x7f1bd800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:50.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.809+0000 7f1bf2a5c640 1 --2- 172.21.15.18:0/3628255746 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1bd8005310 0x7f1bd800b9d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1be400a8f0 tx=0x7f1be401fb60 comp rx=0 tx=0).stop 2024-04-17T19:53:50.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.809+0000 7f1bf2a5c640 1 -- 172.21.15.18:0/3628255746 shutdown_connections 2024-04-17T19:53:50.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.809+0000 7f1bf2a5c640 1 --2- 172.21.15.18:0/3628255746 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1bd8005310 0x7f1bd800b9d0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:50.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.809+0000 7f1bf2a5c640 1 -- 172.21.15.18:0/3628255746 >> 172.21.15.18:0/3628255746 conn(0x7f1bec072bb0 msgr2=0x7f1bec072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:50.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.809+0000 7f1bf2a5c640 1 -- 172.21.15.18:0/3628255746 shutdown_connections 2024-04-17T19:53:50.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.809+0000 7f1bf2a5c640 1 -- 172.21.15.18:0/3628255746 wait complete. 2024-04-17T19:53:50.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.809+0000 7f1bf2a5c640 1 Processor -- start 2024-04-17T19:53:50.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.809+0000 7f1bf2a5c640 1 -- start start 2024-04-17T19:53:50.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.809+0000 7f1bf2a5c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1bd8005310 0x7f1bec0a9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:50.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.809+0000 7f1bf2a5c640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1bec13ba10 0x7f1bec13be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:50.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.809+0000 7f1bf2a5c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bec152f80 0x7f1bec153390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:50.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.809+0000 7f1bf2a5c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1bec15e5b0 con 0x7f1bd8005310 2024-04-17T19:53:50.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.809+0000 7f1bf2a5c640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1bec0ce4b0 con 0x7f1bec152f80 2024-04-17T19:53:50.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.809+0000 7f1bf2a5c640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f1bec15e730 con 0x7f1bec13ba10 2024-04-17T19:53:50.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.809+0000 7f1bebfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1bd8005310 0x7f1bec0a9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:50.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.809+0000 7f1bebfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1bd8005310 0x7f1bec0a9fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55628/0 (socket says 172.21.15.18:55628) 2024-04-17T19:53:50.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.809+0000 7f1bebfff640 1 -- 172.21.15.18:0/944784213 learned_addr learned my addr 172.21.15.18:0/944784213 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:50.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.809+0000 7f1bf0ff9640 1 --2- 172.21.15.18:0/944784213 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bec152f80 0x7f1bec153390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:50.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.809+0000 7f1be3fff640 1 --2- 172.21.15.18:0/944784213 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1bec13ba10 0x7f1bec13be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:50.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.809+0000 7f1bebfff640 1 -- 172.21.15.18:0/944784213 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1bec13ba10 msgr2=0x7f1bec13be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:50.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.809+0000 7f1bebfff640 1 --2- 172.21.15.18:0/944784213 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1bec13ba10 0x7f1bec13be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:50.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.809+0000 7f1bebfff640 1 -- 172.21.15.18:0/944784213 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bec152f80 msgr2=0x7f1bec153390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:50.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.809+0000 7f1bebfff640 1 --2- 172.21.15.18:0/944784213 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bec152f80 0x7f1bec153390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:50.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.809+0000 7f1bebfff640 1 -- 172.21.15.18:0/944784213 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bec1538d0 con 0x7f1bd8005310 2024-04-17T19:53:50.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.809+0000 7f1bebfff640 1 --2- 172.21.15.18:0/944784213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1bd8005310 0x7f1bec0a9fa0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc00f550 tx=0x7f1bdc00fa10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:50.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.813+0000 7f1be97fa640 1 -- 172.21.15.18:0/944784213 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc019030 con 0x7f1bd8005310 2024-04-17T19:53:50.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.813+0000 7f1be97fa640 1 -- 172.21.15.18:0/944784213 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bdc004020 con 0x7f1bd8005310 2024-04-17T19:53:50.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.813+0000 7f1bf2a5c640 1 -- 172.21.15.18:0/944784213 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bec13e590 con 0x7f1bd8005310 2024-04-17T19:53:50.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.813+0000 7f1be97fa640 1 -- 172.21.15.18:0/944784213 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bdc004410 con 0x7f1bd8005310 2024-04-17T19:53:50.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.813+0000 7f1bf2a5c640 1 -- 172.21.15.18:0/944784213 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bec13eb50 con 0x7f1bd8005310 2024-04-17T19:53:50.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.813+0000 7f1bf2a5c640 1 -- 172.21.15.18:0/944784213 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bec069950 con 0x7f1bd8005310 2024-04-17T19:53:50.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.813+0000 7f1be97fa640 1 -- 172.21.15.18:0/944784213 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1bdc012070 con 0x7f1bd8005310 2024-04-17T19:53:50.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.813+0000 7f1be97fa640 1 --2- 172.21.15.18:0/944784213 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f1bcc068380 0x7f1bcc06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:50.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.813+0000 7f1be97fa640 1 -- 172.21.15.18:0/944784213 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7f1bdc086da0 con 0x7f1bd8005310 2024-04-17T19:53:50.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.813+0000 7f1be3fff640 1 --2- 172.21.15.18:0/944784213 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f1bcc068380 0x7f1bcc06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:50.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.813+0000 7f1be3fff640 1 --2- 172.21.15.18:0/944784213 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f1bcc068380 0x7f1bcc06a890 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1bec142b70 tx=0x7f1bd4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:50.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.817+0000 7f1be97fa640 1 -- 172.21.15.18:0/944784213 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1bec1538d0 con 0x7f1bd8005310 2024-04-17T19:53:50.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.985+0000 7f1bf2a5c640 1 -- 172.21.15.18:0/944784213 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1bec0a9990 con 0x7f1bd8005310 2024-04-17T19:53:50.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.985+0000 7f1be97fa640 1 -- 172.21.15.18:0/944784213 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7f1bdc056f90 con 0x7f1bd8005310 2024-04-17T19:53:50.982 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-04-17T19:53:50.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.989+0000 7f1bf2a5c640 1 -- 172.21.15.18:0/944784213 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f1bcc068380 msgr2=0x7f1bcc06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:50.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.989+0000 7f1bf2a5c640 1 --2- 172.21.15.18:0/944784213 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f1bcc068380 0x7f1bcc06a890 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1bec142b70 tx=0x7f1bd4009040 comp rx=0 tx=0).stop 2024-04-17T19:53:50.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.989+0000 7f1bf2a5c640 1 -- 172.21.15.18:0/944784213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1bd8005310 msgr2=0x7f1bec0a9fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:50.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.989+0000 7f1bf2a5c640 1 --2- 172.21.15.18:0/944784213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1bd8005310 0x7f1bec0a9fa0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc00f550 tx=0x7f1bdc00fa10 comp rx=0 tx=0).stop 2024-04-17T19:53:50.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.989+0000 7f1bf2a5c640 1 -- 172.21.15.18:0/944784213 shutdown_connections 2024-04-17T19:53:50.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.989+0000 7f1bf2a5c640 1 --2- 172.21.15.18:0/944784213 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f1bcc068380 0x7f1bcc06a890 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:50.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.989+0000 7f1bf2a5c640 1 --2- 172.21.15.18:0/944784213 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1bec152f80 0x7f1bec153390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:50.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.989+0000 7f1bf2a5c640 1 --2- 172.21.15.18:0/944784213 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1bec13ba10 0x7f1bec13be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:50.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.989+0000 7f1bf2a5c640 1 --2- 172.21.15.18:0/944784213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1bd8005310 0x7f1bec0a9fa0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:50.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.989+0000 7f1bf2a5c640 1 -- 172.21.15.18:0/944784213 >> 172.21.15.18:0/944784213 conn(0x7f1bec072bb0 msgr2=0x7f1bec06d170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:50.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.989+0000 7f1bf2a5c640 1 -- 172.21.15.18:0/944784213 shutdown_connections 2024-04-17T19:53:50.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:50.989+0000 7f1bf2a5c640 1 -- 172.21.15.18:0/944784213 wait complete. 2024-04-17T19:53:51.002 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-17T19:53:51.003 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-17T19:53:51.008 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T19:53:51.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.193+0000 7f7259b37640 1 Processor -- start 2024-04-17T19:53:51.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.193+0000 7f7259b37640 1 -- start start 2024-04-17T19:53:51.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.197+0000 7f7259b37640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f725415e910 0x7f725415ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:51.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.197+0000 7f7259b37640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f725406cd60 0x7f725406d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:51.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.197+0000 7f7259b37640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f725406d6b0 con 0x7f725415e1a0 2024-04-17T19:53:51.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.197+0000 7f7259b37640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f72540d0020 con 0x7f725415e910 2024-04-17T19:53:51.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.197+0000 7f7259b37640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f72540cd930 con 0x7f725406cd60 2024-04-17T19:53:51.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.197+0000 7f7252ffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f725415e910 0x7f725415ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:51.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.197+0000 7f7252ffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f725415e910 0x7f725415ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55634/0 (socket says 172.21.15.18:55634) 2024-04-17T19:53:51.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.197+0000 7f7252ffd640 1 -- 172.21.15.18:0/3088104844 learned_addr learned my addr 172.21.15.18:0/3088104844 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:51.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.197+0000 7f7252ffd640 1 -- 172.21.15.18:0/3088104844 >> v2:172.21.15.173:3300/0 conn(0x7f725406cd60 msgr2=0x7f725406d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:51.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.197+0000 7f7253fff640 1 --2- 172.21.15.18:0/3088104844 >> v2:172.21.15.173:3300/0 conn(0x7f725406cd60 0x7f725406d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:51.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.197+0000 7f7252ffd640 1 --2- 172.21.15.18:0/3088104844 >> v2:172.21.15.173:3300/0 conn(0x7f725406cd60 0x7f725406d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:51.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.197+0000 7f7252ffd640 1 -- 172.21.15.18:0/3088104844 >> v1:172.21.15.173:6789/0 conn(0x7f725415e1a0 legacy=0x7f72540ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:51.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.197+0000 7f7252ffd640 1 -- 172.21.15.18:0/3088104844 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72540cdc10 con 0x7f725415e910 2024-04-17T19:53:51.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.197+0000 7f7253fff640 1 --2- 172.21.15.18:0/3088104844 >> v2:172.21.15.173:3300/0 conn(0x7f725406cd60 0x7f725406d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:53:51.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.197+0000 7f7252ffd640 1 --2- 172.21.15.18:0/3088104844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f725415e910 0x7f725415ed20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f72540d0a00 tx=0x7f724801c270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed4056d6810ca300 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:51.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.201+0000 7f72527fc640 1 -- 172.21.15.18:0/3088104844 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72480b0070 con 0x7f725415e910 2024-04-17T19:53:51.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.201+0000 7f72527fc640 1 -- 172.21.15.18:0/3088104844 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72480ab600 con 0x7f725415e910 2024-04-17T19:53:51.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.201+0000 7f72527fc640 1 -- 172.21.15.18:0/3088104844 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72480ab9d0 con 0x7f725415e910 2024-04-17T19:53:51.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.201+0000 7f7259b37640 1 -- 172.21.15.18:0/3088104844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f725415e910 msgr2=0x7f725415ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:51.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.201+0000 7f7259b37640 1 --2- 172.21.15.18:0/3088104844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f725415e910 0x7f725415ed20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f72540d0a00 tx=0x7f724801c270 comp rx=0 tx=0).stop 2024-04-17T19:53:51.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.201+0000 7f7259b37640 1 -- 172.21.15.18:0/3088104844 shutdown_connections 2024-04-17T19:53:51.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.201+0000 7f7259b37640 1 --2- 172.21.15.18:0/3088104844 >> v2:172.21.15.173:3300/0 conn(0x7f725406cd60 0x7f725406d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:51.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.201+0000 7f7259b37640 1 --2- 172.21.15.18:0/3088104844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f725415e910 0x7f725415ed20 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:51.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.201+0000 7f7259b37640 1 -- 172.21.15.18:0/3088104844 >> 172.21.15.18:0/3088104844 conn(0x7f7254072bb0 msgr2=0x7f7254072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:51.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.201+0000 7f7259b37640 1 -- 172.21.15.18:0/3088104844 shutdown_connections 2024-04-17T19:53:51.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.201+0000 7f7259b37640 1 -- 172.21.15.18:0/3088104844 wait complete. 2024-04-17T19:53:51.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.201+0000 7f7259b37640 1 Processor -- start 2024-04-17T19:53:51.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.201+0000 7f7259b37640 1 -- start start 2024-04-17T19:53:51.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.201+0000 7f7259b37640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f725406cd60 0x7f725414c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:51.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.201+0000 7f7259b37640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f725415e1a0 0x7f72541528c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:51.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.201+0000 7f7259b37640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f725415e910 0x7f7254152e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:51.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.201+0000 7f7259b37640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f725415e730 con 0x7f725415e1a0 2024-04-17T19:53:51.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.201+0000 7f7259b37640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f725415e5b0 con 0x7f725406cd60 2024-04-17T19:53:51.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.201+0000 7f7259b37640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f72540cf0e0 con 0x7f725415e910 2024-04-17T19:53:51.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.205+0000 7f7252ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f725415e1a0 0x7f72541528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:51.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.205+0000 7f7252ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f725415e1a0 0x7f72541528c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55648/0 (socket says 172.21.15.18:55648) 2024-04-17T19:53:51.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.205+0000 7f7252ffd640 1 -- 172.21.15.18:0/2767210899 learned_addr learned my addr 172.21.15.18:0/2767210899 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:51.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.205+0000 7f72537fe640 1 --2- 172.21.15.18:0/2767210899 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f725406cd60 0x7f725414c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:51.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.205+0000 7f7252ffd640 1 -- 172.21.15.18:0/2767210899 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f725415e910 msgr2=0x7f7254152e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:51.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.205+0000 7f7252ffd640 1 --2- 172.21.15.18:0/2767210899 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f725415e910 0x7f7254152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:51.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.205+0000 7f7252ffd640 1 -- 172.21.15.18:0/2767210899 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f725406cd60 msgr2=0x7f725414c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:51.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.205+0000 7f7252ffd640 1 --2- 172.21.15.18:0/2767210899 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f725406cd60 0x7f725414c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:51.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.205+0000 7f7252ffd640 1 -- 172.21.15.18:0/2767210899 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f725414ca70 con 0x7f725415e1a0 2024-04-17T19:53:51.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.205+0000 7f7252ffd640 1 --2- 172.21.15.18:0/2767210899 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f725415e1a0 0x7f72541528c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f724801a920 tx=0x7f724801aab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:51.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.205+0000 7f723bfff640 1 -- 172.21.15.18:0/2767210899 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72480ba020 con 0x7f725415e1a0 2024-04-17T19:53:51.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.205+0000 7f723bfff640 1 -- 172.21.15.18:0/2767210899 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72480b6640 con 0x7f725415e1a0 2024-04-17T19:53:51.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.205+0000 7f7259b37640 1 -- 172.21.15.18:0/2767210899 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72541589c0 con 0x7f725415e1a0 2024-04-17T19:53:51.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.205+0000 7f723bfff640 1 -- 172.21.15.18:0/2767210899 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72480b0040 con 0x7f725415e1a0 2024-04-17T19:53:51.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.205+0000 7f7259b37640 1 -- 172.21.15.18:0/2767210899 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f725415b320 con 0x7f725415e1a0 2024-04-17T19:53:51.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.205+0000 7f7259b37640 1 -- 172.21.15.18:0/2767210899 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7254069950 con 0x7f725415e1a0 2024-04-17T19:53:51.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.205+0000 7f723bfff640 1 -- 172.21.15.18:0/2767210899 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f72480bd020 con 0x7f725415e1a0 2024-04-17T19:53:51.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.205+0000 7f723bfff640 1 --2- 172.21.15.18:0/2767210899 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f72400683b0 0x7f724006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:51.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.205+0000 7f72537fe640 1 --2- 172.21.15.18:0/2767210899 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f72400683b0 0x7f724006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:51.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.205+0000 7f723bfff640 1 -- 172.21.15.18:0/2767210899 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7f72481210d0 con 0x7f725415e1a0 2024-04-17T19:53:51.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.205+0000 7f72537fe640 1 --2- 172.21.15.18:0/2767210899 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f72400683b0 0x7f724006a8c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f72540b5f30 tx=0x7f7244008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:51.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.213+0000 7f723bfff640 1 -- 172.21.15.18:0/2767210899 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f72480c4030 con 0x7f725415e1a0 2024-04-17T19:53:51.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.373+0000 7f7259b37640 1 -- 172.21.15.18:0/2767210899 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f725414cd00 con 0x7f725415e1a0 2024-04-17T19:53:51.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.373+0000 7f723bfff640 1 -- 172.21.15.18:0/2767210899 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18759 (secure 0 0 0) 0x7f725406d6b0 con 0x7f725415e1a0 2024-04-17T19:53:51.372 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:53:51.372 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":29,"fsid":"dd480169-5a81-4623-be5f-0499aa244b28","created":"2024-04-17T19:52:39.533760+0000","modified":"2024-04-17T19:53:45.435889+0000","last_up_change":"2024-04-17T19:52:51.229698+0000","last_in_change":"2024-04-17T19:52:42.144259+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T19:52:52.391648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T19:53:02.734240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T19:53:03.813028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T19:53:07.478812+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e232d577-2508-4ea4-b355-29fbae1ff025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6801","nonce":2323038417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6803","nonce":2323038417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6807","nonce":2323038417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6805","nonce":2323038417}]},"public_addr":"172.21.15.18:6801/2323038417","cluster_addr":"172.21.15.18:6803/2323038417","heartbeat_back_addr":"172.21.15.18:6807/2323038417","heartbeat_front_addr":"172.21.15.18:6805/2323038417","state":["exists","up"]},{"osd":1,"uuid":"31810ef3-2c71-48d6-8748-b74a2968d23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6817","nonce":1283678238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6819","nonce":1283678238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6823","nonce":1283678238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6821","nonce":1283678238}]},"public_addr":"172.21.15.18:6817/1283678238","cluster_addr":"172.21.15.18:6819/1283678238","heartbeat_back_addr":"172.21.15.18:6823/1283678238","heartbeat_front_addr":"172.21.15.18:6821/1283678238","state":["exists","up"]},{"osd":2,"uuid":"5a783cc5-a41c-4967-9e11-6b8330f97d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6809","nonce":1212875862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6811","nonce":1212875862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6815","nonce":1212875862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6813","nonce":1212875862}]},"public_addr":"172.21.15.18:6809/1212875862","cluster_addr":"172.21.15.18:6811/1212875862","heartbeat_back_addr":"172.21.15.18:6815/1212875862","heartbeat_front_addr":"172.21.15.18:6813/1212875862","state":["exists","up"]},{"osd":3,"uuid":"b7e056d9-9da5-46e1-810d-0c3e242fe5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6825","nonce":2428878428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6827","nonce":2428878428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6831","nonce":2428878428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6829","nonce":2428878428}]},"public_addr":"172.21.15.18:6825/2428878428","cluster_addr":"172.21.15.18:6827/2428878428","heartbeat_back_addr":"172.21.15.18:6831/2428878428","heartbeat_front_addr":"172.21.15.18:6829/2428878428","state":["exists","up"]},{"osd":4,"uuid":"21df023f-bc8b-4abb-93e5-0ecc91acda0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6825","nonce":1421511819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6827","nonce":1421511819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6831","nonce":1421511819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6829","nonce":1421511819}]},"public_addr":"172.21.15.173:6825/1421511819","cluster_addr":"172.21.15.173:6827/1421511819","heartbeat_back_addr":"172.21.15.173:6831/1421511819","heartbeat_front_addr":"172.21.15.173:6829/1421511819","state":["exists","up"]},{"osd":5,"uuid":"e270098a-6d33-49f8-84ed-94e09a880cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6801","nonce":4221907702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6803","nonce":4221907702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6807","nonce":4221907702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6805","nonce":4221907702}]},"public_addr":"172.21.15.173:6801/4221907702","cluster_addr":"172.21.15.173:6803/4221907702","heartbeat_back_addr":"172.21.15.173:6807/4221907702","heartbeat_front_addr":"172.21.15.173:6805/4221907702","state":["exists","up"]},{"osd":6,"uuid":"93c67c8c-268d-4e32-877c-043cd3acd87c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6809","nonce":761678552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6811","nonce":761678552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6815","nonce":761678552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6813","nonce":761678552}]},"public_addr":"172.21.15.173:6809/761678552","cluster_addr":"172.21.15.173:6811/761678552","heartbeat_back_addr":"172.21.15.173:6815/761678552","heartbeat_front_addr":"172.21.15.173:6813/761678552","state":["exists","up"]},{"osd":7,"uuid":"faf10eea-80de-40f6-abbb-34d07d3f59ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6817","nonce":383724537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6819","nonce":383724537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6823","nonce":383724537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6821","nonce":383724537}]},"public_addr":"172.21.15.173:6817/383724537","cluster_addr":"172.21.15.173:6819/383724537","heartbeat_back_addr":"172.21.15.173:6823/383724537","heartbeat_front_addr":"172.21.15.173:6821/383724537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.668924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.761747+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.768128+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.632252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.742608+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.734327+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.477107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.818292+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.31","mappings":[{"from":0,"to":7}]},{"pgid":"4.5","mappings":[{"from":3,"to":4},{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":0}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]},{"pgid":"4.1c","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T19:53:51.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.377+0000 7f7259b37640 1 -- 172.21.15.18:0/2767210899 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f72400683b0 msgr2=0x7f724006a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:51.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.377+0000 7f7259b37640 1 --2- 172.21.15.18:0/2767210899 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f72400683b0 0x7f724006a8c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f72540b5f30 tx=0x7f7244008040 comp rx=0 tx=0).stop 2024-04-17T19:53:51.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.377+0000 7f7259b37640 1 -- 172.21.15.18:0/2767210899 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f725415e1a0 msgr2=0x7f72541528c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:51.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.377+0000 7f7259b37640 1 --2- 172.21.15.18:0/2767210899 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f725415e1a0 0x7f72541528c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f724801a920 tx=0x7f724801aab0 comp rx=0 tx=0).stop 2024-04-17T19:53:51.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.377+0000 7f7259b37640 1 -- 172.21.15.18:0/2767210899 shutdown_connections 2024-04-17T19:53:51.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.377+0000 7f7259b37640 1 --2- 172.21.15.18:0/2767210899 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f72400683b0 0x7f724006a8c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:51.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.377+0000 7f7259b37640 1 --2- 172.21.15.18:0/2767210899 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f725415e910 0x7f7254152e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:51.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.377+0000 7f7259b37640 1 --2- 172.21.15.18:0/2767210899 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f725415e1a0 0x7f72541528c0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:51.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.377+0000 7f7259b37640 1 --2- 172.21.15.18:0/2767210899 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f725406cd60 0x7f725414c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:51.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.377+0000 7f7259b37640 1 -- 172.21.15.18:0/2767210899 >> 172.21.15.18:0/2767210899 conn(0x7f7254072bb0 msgr2=0x7f7254067ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:51.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.377+0000 7f7259b37640 1 -- 172.21.15.18:0/2767210899 shutdown_connections 2024-04-17T19:53:51.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.377+0000 7f7259b37640 1 -- 172.21.15.18:0/2767210899 wait complete. 2024-04-17T19:53:51.391 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T19:52:52.391648+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-17T19:53:02.734240+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-17T19:53:03.813028+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-17T19:53:07.478812+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-17T19:53:51.392 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T19:53:51.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.537+0000 7fa1294be640 1 Processor -- start 2024-04-17T19:53:51.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.537+0000 7fa1294be640 1 -- start start 2024-04-17T19:53:51.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.537+0000 7fa1294be640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa1240d3b80 0x7fa1240cff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:51.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.537+0000 7fa1294be640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1240d0860 con 0x7fa12406d1b0 2024-04-17T19:53:51.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.537+0000 7fa1294be640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa124163fe0 con 0x7fa1240d0450 2024-04-17T19:53:51.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.537+0000 7fa1294be640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7fa1240d3f90 con 0x7fa1240d3b80 2024-04-17T19:53:51.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.537+0000 7fa1237fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fa12406d1b0 0x7fa1241638d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55020/0 (socket says 172.21.15.18:55020) 2024-04-17T19:53:51.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.537+0000 7fa1237fe640 1 -- 172.21.15.18:0/1438425955 learned_addr learned my addr 172.21.15.18:0/1438425955 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:51.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.537+0000 7fa1227fc640 1 -- 172.21.15.18:0/1438425955 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2984980600 0 0) 0x7fa11c0014a0 con 0x7fa12406d1b0 2024-04-17T19:53:51.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.537+0000 7fa122ffd640 1 --2- 172.21.15.18:0/1438425955 >> v2:172.21.15.173:3300/0 conn(0x7fa1240d3b80 0x7fa1240cff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:51.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.537+0000 7fa1227fc640 1 -- 172.21.15.18:0/1438425955 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa110003530 con 0x7fa12406d1b0 2024-04-17T19:53:51.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.537+0000 7fa1227fc640 1 -- 172.21.15.18:0/1438425955 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 139679513 0 0) 0x7fa110003530 con 0x7fa12406d1b0 2024-04-17T19:53:51.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.537+0000 7fa1227fc640 1 -- 172.21.15.18:0/1438425955 >> v2:172.21.15.173:3300/0 conn(0x7fa1240d3b80 msgr2=0x7fa1240cff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:51.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.537+0000 7fa1227fc640 1 --2- 172.21.15.18:0/1438425955 >> v2:172.21.15.173:3300/0 conn(0x7fa1240d3b80 0x7fa1240cff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:51.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.537+0000 7fa1227fc640 1 -- 172.21.15.18:0/1438425955 >> v1:172.21.15.173:6789/0 conn(0x7fa1240d0450 legacy=0x7fa1241631c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:51.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.537+0000 7fa1227fc640 1 -- 172.21.15.18:0/1438425955 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1240d41b0 con 0x7fa12406d1b0 2024-04-17T19:53:51.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.537+0000 7fa1227fc640 1 -- 172.21.15.18:0/1438425955 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3208559991 0 0) 0x7fa11c001bf0 con 0x7fa12406d1b0 2024-04-17T19:53:51.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.537+0000 7fa1227fc640 1 -- 172.21.15.18:0/1438425955 >> v1:172.21.15.18:6789/0 conn(0x7fa12406d1b0 legacy=0x7fa1241638d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:51.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.537+0000 7fa1227fc640 1 --2- 172.21.15.18:0/1438425955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa110003a10 0x7fa110003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:51.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.537+0000 7fa1227fc640 1 --2- 172.21.15.18:0/1438425955 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa110004810 0x7fa110004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:51.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.537+0000 7fa1227fc640 1 --2- 172.21.15.18:0/1438425955 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa110005280 0x7fa11000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:51.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.537+0000 7fa1227fc640 1 -- 172.21.15.18:0/1438425955 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa1240d3f90 con 0x7fa110003a10 2024-04-17T19:53:51.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.537+0000 7fa1227fc640 1 -- 172.21.15.18:0/1438425955 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa11000c1a0 con 0x7fa110005280 2024-04-17T19:53:51.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.537+0000 7fa1227fc640 1 -- 172.21.15.18:0/1438425955 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fa11000c3a0 con 0x7fa110004810 2024-04-17T19:53:51.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.537+0000 7fa122ffd640 1 --2- 172.21.15.18:0/1438425955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa110003a10 0x7fa110003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:51.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.541+0000 7fa11a7fc640 1 --2- 172.21.15.18:0/1438425955 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa110004810 0x7fa110004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:51.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.541+0000 7fa122ffd640 1 -- 172.21.15.18:0/1438425955 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa110004810 msgr2=0x7fa110004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:51.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.541+0000 7fa122ffd640 1 --2- 172.21.15.18:0/1438425955 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa110004810 0x7fa110004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:51.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.541+0000 7fa122ffd640 1 -- 172.21.15.18:0/1438425955 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa110005280 msgr2=0x7fa11000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:51.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.541+0000 7fa122ffd640 1 --2- 172.21.15.18:0/1438425955 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa110005280 0x7fa11000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:51.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.541+0000 7fa1237fe640 1 -- 172.21.15.18:0/1438425955 reap_dead start 2024-04-17T19:53:51.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.541+0000 7fa122ffd640 1 -- 172.21.15.18:0/1438425955 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa110003530 con 0x7fa110003a10 2024-04-17T19:53:51.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.541+0000 7fa122ffd640 1 --2- 172.21.15.18:0/1438425955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa110003a10 0x7fa110003e80 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa114009ab0 tx=0x7fa11401ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f534c9036422b32b server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:51.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.541+0000 7fa1227fc640 1 -- 172.21.15.18:0/1438425955 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1140096b0 con 0x7fa110003a10 2024-04-17T19:53:51.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.541+0000 7fa1227fc640 1 -- 172.21.15.18:0/1438425955 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1140a6470 con 0x7fa110003a10 2024-04-17T19:53:51.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.541+0000 7fa1227fc640 1 -- 172.21.15.18:0/1438425955 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1140a6860 con 0x7fa110003a10 2024-04-17T19:53:51.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.541+0000 7fa1294be640 1 -- 172.21.15.18:0/1438425955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa110003a10 msgr2=0x7fa110003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:51.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.541+0000 7fa1294be640 1 --2- 172.21.15.18:0/1438425955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa110003a10 0x7fa110003e80 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa114009ab0 tx=0x7fa11401ca90 comp rx=0 tx=0).stop 2024-04-17T19:53:51.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.541+0000 7fa1294be640 1 -- 172.21.15.18:0/1438425955 shutdown_connections 2024-04-17T19:53:51.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.541+0000 7fa1294be640 1 --2- 172.21.15.18:0/1438425955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa110003a10 0x7fa110003e80 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:51.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.541+0000 7fa1294be640 1 -- 172.21.15.18:0/1438425955 >> 172.21.15.18:0/1438425955 conn(0x7fa1240d4ed0 msgr2=0x7fa1240d52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:51.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.541+0000 7fa1294be640 1 -- 172.21.15.18:0/1438425955 shutdown_connections 2024-04-17T19:53:51.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.541+0000 7fa1294be640 1 -- 172.21.15.18:0/1438425955 wait complete. 2024-04-17T19:53:51.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.545+0000 7fa1294be640 1 Processor -- start 2024-04-17T19:53:51.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.545+0000 7fa1294be640 1 -- start start 2024-04-17T19:53:51.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.545+0000 7fa1294be640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa110003a10 0x7fa124158590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:51.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.545+0000 7fa1294be640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1240c8a00 0x7fa1240cd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:51.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.545+0000 7fa1294be640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1240c8e10 0x7fa1240cd610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:51.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.545+0000 7fa1294be640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa12415fdd0 con 0x7fa1240c8a00 2024-04-17T19:53:51.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.545+0000 7fa1294be640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa124160bc0 con 0x7fa1240c8e10 2024-04-17T19:53:51.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.545+0000 7fa1294be640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fa12415ff50 con 0x7fa110003a10 2024-04-17T19:53:51.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.545+0000 7fa11a7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1240c8a00 0x7fa1240cd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:51.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.545+0000 7fa11a7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1240c8a00 0x7fa1240cd0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55664/0 (socket says 172.21.15.18:55664) 2024-04-17T19:53:51.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.545+0000 7fa11a7fc640 1 -- 172.21.15.18:0/3062028318 learned_addr learned my addr 172.21.15.18:0/3062028318 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:51.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.545+0000 7fa1237fe640 1 --2- 172.21.15.18:0/3062028318 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1240c8e10 0x7fa1240cd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:51.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.545+0000 7fa122ffd640 1 --2- 172.21.15.18:0/3062028318 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa110003a10 0x7fa124158590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:51.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.545+0000 7fa11a7fc640 1 -- 172.21.15.18:0/3062028318 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa110003a10 msgr2=0x7fa124158590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:51.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.545+0000 7fa11a7fc640 1 --2- 172.21.15.18:0/3062028318 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa110003a10 0x7fa124158590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:51.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.545+0000 7fa11a7fc640 1 -- 172.21.15.18:0/3062028318 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1240c8e10 msgr2=0x7fa1240cd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:51.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.545+0000 7fa11a7fc640 1 --2- 172.21.15.18:0/3062028318 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1240c8e10 0x7fa1240cd610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:51.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.545+0000 7fa11a7fc640 1 -- 172.21.15.18:0/3062028318 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1240c9570 con 0x7fa1240c8a00 2024-04-17T19:53:51.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.545+0000 7fa11a7fc640 1 --2- 172.21.15.18:0/3062028318 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1240c8a00 0x7fa1240cd0d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa10c00e4d0 tx=0x7fa10c00e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:51.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.545+0000 7fa11bfff640 1 -- 172.21.15.18:0/3062028318 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa10c0053a0 con 0x7fa1240c8a00 2024-04-17T19:53:51.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.545+0000 7fa11bfff640 1 -- 172.21.15.18:0/3062028318 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa10c018070 con 0x7fa1240c8a00 2024-04-17T19:53:51.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.545+0000 7fa1294be640 1 -- 172.21.15.18:0/3062028318 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1240c9850 con 0x7fa1240c8a00 2024-04-17T19:53:51.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.545+0000 7fa11bfff640 1 -- 172.21.15.18:0/3062028318 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa10c003840 con 0x7fa1240c8a00 2024-04-17T19:53:51.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.549+0000 7fa1294be640 1 -- 172.21.15.18:0/3062028318 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1240c9e10 con 0x7fa1240c8a00 2024-04-17T19:53:51.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.549+0000 7fa1294be640 1 -- 172.21.15.18:0/3062028318 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa124069950 con 0x7fa1240c8a00 2024-04-17T19:53:51.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.549+0000 7fa11bfff640 1 -- 172.21.15.18:0/3062028318 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa10c0039e0 con 0x7fa1240c8a00 2024-04-17T19:53:51.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.549+0000 7fa11bfff640 1 --2- 172.21.15.18:0/3062028318 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fa1040683b0 0x7fa10406a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:51.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.549+0000 7fa122ffd640 1 --2- 172.21.15.18:0/3062028318 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fa1040683b0 0x7fa10406a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:51.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.549+0000 7fa11bfff640 1 -- 172.21.15.18:0/3062028318 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7fa10c087240 con 0x7fa1240c8a00 2024-04-17T19:53:51.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.549+0000 7fa122ffd640 1 --2- 172.21.15.18:0/3062028318 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fa1040683b0 0x7fa10406a8c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa1140ad000 tx=0x7fa1140046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:51.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.553+0000 7fa11bfff640 1 -- 172.21.15.18:0/3062028318 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa10c01a310 con 0x7fa1240c8a00 2024-04-17T19:53:51.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.717+0000 7fa1294be640 1 -- 172.21.15.18:0/3062028318 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa1240d3540 con 0x7fa1240c8a00 2024-04-17T19:53:51.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.717+0000 7fa11bfff640 1 -- 172.21.15.18:0/3062028318 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7fa10c057380 con 0x7fa1240c8a00 2024-04-17T19:53:51.715 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-17T19:53:51.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.721+0000 7fa1294be640 1 -- 172.21.15.18:0/3062028318 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fa1040683b0 msgr2=0x7fa10406a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:51.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.721+0000 7fa1294be640 1 --2- 172.21.15.18:0/3062028318 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fa1040683b0 0x7fa10406a8c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa1140ad000 tx=0x7fa1140046d0 comp rx=0 tx=0).stop 2024-04-17T19:53:51.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.721+0000 7fa1294be640 1 -- 172.21.15.18:0/3062028318 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1240c8a00 msgr2=0x7fa1240cd0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:51.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.721+0000 7fa1294be640 1 --2- 172.21.15.18:0/3062028318 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1240c8a00 0x7fa1240cd0d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa10c00e4d0 tx=0x7fa10c00e990 comp rx=0 tx=0).stop 2024-04-17T19:53:51.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.721+0000 7fa1294be640 1 -- 172.21.15.18:0/3062028318 shutdown_connections 2024-04-17T19:53:51.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.721+0000 7fa1294be640 1 --2- 172.21.15.18:0/3062028318 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fa1040683b0 0x7fa10406a8c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:51.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.721+0000 7fa1294be640 1 --2- 172.21.15.18:0/3062028318 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1240c8e10 0x7fa1240cd610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:51.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.721+0000 7fa1294be640 1 --2- 172.21.15.18:0/3062028318 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1240c8a00 0x7fa1240cd0d0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:51.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.721+0000 7fa1294be640 1 --2- 172.21.15.18:0/3062028318 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa110003a10 0x7fa124158590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:51.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.721+0000 7fa1294be640 1 -- 172.21.15.18:0/3062028318 >> 172.21.15.18:0/3062028318 conn(0x7fa1240d4ed0 msgr2=0x7fa1240b71d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:51.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.721+0000 7fa1294be640 1 -- 172.21.15.18:0/3062028318 shutdown_connections 2024-04-17T19:53:51.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.721+0000 7fa1294be640 1 -- 172.21.15.18:0/3062028318 wait complete. 2024-04-17T19:53:51.736 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-17T19:53:51.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.889+0000 7f797c953640 1 Processor -- start 2024-04-17T19:53:51.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.889+0000 7f797c953640 1 -- start start 2024-04-17T19:53:51.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.889+0000 7f797c953640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f797806cd60 0x7f797806d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:51.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.889+0000 7f797c953640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f797815fc90 con 0x7f797815c7c0 2024-04-17T19:53:51.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.889+0000 7f797c953640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f797806d6b0 con 0x7f797815d7c0 2024-04-17T19:53:51.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.889+0000 7f797c953640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f7978142870 con 0x7f797806cd60 2024-04-17T19:53:51.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.889+0000 7f7975d9b640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f797815c7c0 0x7f797815cbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55024/0 (socket says 172.21.15.18:55024) 2024-04-17T19:53:51.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.889+0000 7f7975d9b640 1 -- 172.21.15.18:0/2071280700 learned_addr learned my addr 172.21.15.18:0/2071280700 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:51.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.889+0000 7f797559a640 1 -- 172.21.15.18:0/2071280700 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 175635855 0 0) 0x7f797815fc90 con 0x7f797815c7c0 2024-04-17T19:53:51.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.889+0000 7f797659c640 1 --2- 172.21.15.18:0/2071280700 >> v2:172.21.15.173:3300/0 conn(0x7f797806cd60 0x7f797806d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:51.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.889+0000 7f797559a640 1 -- 172.21.15.18:0/2071280700 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7960003530 con 0x7f797815c7c0 2024-04-17T19:53:51.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.893+0000 7f797559a640 1 -- 172.21.15.18:0/2071280700 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 53899557 0 0) 0x7f7960003530 con 0x7f797815c7c0 2024-04-17T19:53:51.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.893+0000 7f797559a640 1 -- 172.21.15.18:0/2071280700 >> v2:172.21.15.173:3300/0 conn(0x7f797806cd60 msgr2=0x7f797806d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:51.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.893+0000 7f797559a640 1 --2- 172.21.15.18:0/2071280700 >> v2:172.21.15.173:3300/0 conn(0x7f797806cd60 0x7f797806d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:51.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.893+0000 7f797559a640 1 -- 172.21.15.18:0/2071280700 >> v1:172.21.15.173:6789/0 conn(0x7f797815d7c0 legacy=0x7f797815dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:51.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.893+0000 7f797559a640 1 -- 172.21.15.18:0/2071280700 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f797815ff00 con 0x7f797815c7c0 2024-04-17T19:53:51.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.893+0000 7f797559a640 1 -- 172.21.15.18:0/2071280700 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3208559991 0 0) 0x7f796c0016a0 con 0x7f797815c7c0 2024-04-17T19:53:51.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.893+0000 7f797559a640 1 -- 172.21.15.18:0/2071280700 >> v1:172.21.15.18:6789/0 conn(0x7f797815c7c0 legacy=0x7f797815cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:51.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.893+0000 7f797559a640 1 --2- 172.21.15.18:0/2071280700 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f79600039c0 0x7f7960003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:51.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.893+0000 7f797559a640 1 --2- 172.21.15.18:0/2071280700 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7960004810 0x7f7960004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:51.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.893+0000 7f797559a640 1 --2- 172.21.15.18:0/2071280700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7960005260 0x7f796000dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:51.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.893+0000 7f797559a640 1 -- 172.21.15.18:0/2071280700 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7978142870 con 0x7f7960004810 2024-04-17T19:53:51.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.893+0000 7f797559a640 1 -- 172.21.15.18:0/2071280700 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f796000e400 con 0x7f7960005260 2024-04-17T19:53:51.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.893+0000 7f797559a640 1 -- 172.21.15.18:0/2071280700 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f796000e600 con 0x7f79600039c0 2024-04-17T19:53:51.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.893+0000 7f7975d9b640 1 --2- 172.21.15.18:0/2071280700 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7960004810 0x7f7960004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:51.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.893+0000 7f797659c640 1 --2- 172.21.15.18:0/2071280700 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f79600039c0 0x7f7960003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:51.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.893+0000 7f7975d9b640 1 -- 172.21.15.18:0/2071280700 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f79600039c0 msgr2=0x7f7960003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:51.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.893+0000 7f7975d9b640 1 --2- 172.21.15.18:0/2071280700 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f79600039c0 0x7f7960003e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:51.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.893+0000 7f7975d9b640 1 -- 172.21.15.18:0/2071280700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7960005260 msgr2=0x7f796000dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:51.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.893+0000 7f7975d9b640 1 --2- 172.21.15.18:0/2071280700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7960005260 0x7f796000dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:51.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.893+0000 7f7975d9b640 1 -- 172.21.15.18:0/2071280700 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7960003530 con 0x7f7960004810 2024-04-17T19:53:51.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.893+0000 7f7976d9d640 1 -- 172.21.15.18:0/2071280700 reap_dead start 2024-04-17T19:53:51.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.893+0000 7f7975d9b640 1 --2- 172.21.15.18:0/2071280700 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7960004810 0x7f7960004c20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f797815c640 tx=0x7f797815d3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=947072b173345f9d server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:51.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.893+0000 7f797559a640 1 -- 172.21.15.18:0/2071280700 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f796c007d60 con 0x7f7960004810 2024-04-17T19:53:51.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.893+0000 7f797559a640 1 -- 172.21.15.18:0/2071280700 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f796c0a9020 con 0x7f7960004810 2024-04-17T19:53:51.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.893+0000 7f797559a640 1 -- 172.21.15.18:0/2071280700 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f796c005ae0 con 0x7f7960004810 2024-04-17T19:53:51.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.893+0000 7f797c953640 1 -- 172.21.15.18:0/2071280700 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7960004810 msgr2=0x7f7960004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:51.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.893+0000 7f797c953640 1 --2- 172.21.15.18:0/2071280700 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7960004810 0x7f7960004c20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f797815c640 tx=0x7f797815d3e0 comp rx=0 tx=0).stop 2024-04-17T19:53:51.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.893+0000 7f797c953640 1 -- 172.21.15.18:0/2071280700 shutdown_connections 2024-04-17T19:53:51.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.893+0000 7f797c953640 1 --2- 172.21.15.18:0/2071280700 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7960004810 0x7f7960004c20 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:51.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.893+0000 7f797c953640 1 -- 172.21.15.18:0/2071280700 >> 172.21.15.18:0/2071280700 conn(0x7f7978072bb0 msgr2=0x7f7978072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:51.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.893+0000 7f797c953640 1 -- 172.21.15.18:0/2071280700 shutdown_connections 2024-04-17T19:53:51.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.893+0000 7f797c953640 1 -- 172.21.15.18:0/2071280700 wait complete. 2024-04-17T19:53:51.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.897+0000 7f797c953640 1 Processor -- start 2024-04-17T19:53:51.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.897+0000 7f797c953640 1 -- start start 2024-04-17T19:53:51.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.897+0000 7f797c953640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7960004810 0x7f7978149480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:51.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.897+0000 7f797c953640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f797814af70 0x7f79780afeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:51.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.897+0000 7f797c953640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f797814c970 0x7f797814cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:51.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.897+0000 7f797c953640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f79781609e0 con 0x7f7960004810 2024-04-17T19:53:51.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.897+0000 7f797c953640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f797815dbd0 con 0x7f797814c970 2024-04-17T19:53:51.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.897+0000 7f797c953640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f797814d770 con 0x7f797814af70 2024-04-17T19:53:51.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.897+0000 7f797659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7960004810 0x7f7978149480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:51.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.897+0000 7f797659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7960004810 0x7f7978149480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55676/0 (socket says 172.21.15.18:55676) 2024-04-17T19:53:51.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.897+0000 7f797659c640 1 -- 172.21.15.18:0/217710721 learned_addr learned my addr 172.21.15.18:0/217710721 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:51.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.897+0000 7f7976d9d640 1 --2- 172.21.15.18:0/217710721 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f797814c970 0x7f797814cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:51.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.897+0000 7f7975d9b640 1 --2- 172.21.15.18:0/217710721 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f797814af70 0x7f79780afeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:51.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.897+0000 7f797659c640 1 -- 172.21.15.18:0/217710721 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f797814af70 msgr2=0x7f79780afeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:51.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.897+0000 7f797659c640 1 --2- 172.21.15.18:0/217710721 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f797814af70 0x7f79780afeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:51.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.897+0000 7f797659c640 1 -- 172.21.15.18:0/217710721 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f797814c970 msgr2=0x7f797814cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:51.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.897+0000 7f797659c640 1 --2- 172.21.15.18:0/217710721 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f797814c970 0x7f797814cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:51.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.897+0000 7f797659c640 1 -- 172.21.15.18:0/217710721 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f797814d2c0 con 0x7f7960004810 2024-04-17T19:53:51.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.897+0000 7f7975d9b640 1 --2- 172.21.15.18:0/217710721 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f797814af70 0x7f79780afeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:53:51.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.897+0000 7f797659c640 1 --2- 172.21.15.18:0/217710721 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7960004810 0x7f7978149480 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7970010890 tx=0x7f7970010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:51.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.897+0000 7f7966ffd640 1 -- 172.21.15.18:0/217710721 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f797000f040 con 0x7f7960004810 2024-04-17T19:53:51.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.897+0000 7f7966ffd640 1 -- 172.21.15.18:0/217710721 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f797000eb60 con 0x7f7960004810 2024-04-17T19:53:51.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.897+0000 7f797c953640 1 -- 172.21.15.18:0/217710721 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79781499c0 con 0x7f7960004810 2024-04-17T19:53:51.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.897+0000 7f7966ffd640 1 -- 172.21.15.18:0/217710721 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f797001c400 con 0x7f7960004810 2024-04-17T19:53:51.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.897+0000 7f797c953640 1 -- 172.21.15.18:0/217710721 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f797814a1b0 con 0x7f7960004810 2024-04-17T19:53:51.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.901+0000 7f797c953640 1 -- 172.21.15.18:0/217710721 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7978069950 con 0x7f7960004810 2024-04-17T19:53:51.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.901+0000 7f7966ffd640 1 -- 172.21.15.18:0/217710721 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f797001c5a0 con 0x7f7960004810 2024-04-17T19:53:51.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.901+0000 7f7966ffd640 1 --2- 172.21.15.18:0/217710721 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f79580683b0 0x7f795806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:51.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.901+0000 7f7966ffd640 1 -- 172.21.15.18:0/217710721 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7f7970087400 con 0x7f7960004810 2024-04-17T19:53:51.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.901+0000 7f7975d9b640 1 --2- 172.21.15.18:0/217710721 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f79580683b0 0x7f795806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:51.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.901+0000 7f7975d9b640 1 --2- 172.21.15.18:0/217710721 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f79580683b0 0x7f795806a8c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f796c0aa000 tx=0x7f796c001a70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:51.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:51.905+0000 7f7966ffd640 1 -- 172.21.15.18:0/217710721 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7970018030 con 0x7f7960004810 2024-04-17T19:53:52.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.061+0000 7f797c953640 1 -- 172.21.15.18:0/217710721 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f79780b4b80 con 0x7f7960004810 2024-04-17T19:53:52.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.061+0000 7f7966ffd640 1 -- 172.21.15.18:0/217710721 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7f79700575f0 con 0x7f7960004810 2024-04-17T19:53:52.059 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-17T19:53:52.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.065+0000 7f797c953640 1 -- 172.21.15.18:0/217710721 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f79580683b0 msgr2=0x7f795806a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:52.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.065+0000 7f797c953640 1 --2- 172.21.15.18:0/217710721 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f79580683b0 0x7f795806a8c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f796c0aa000 tx=0x7f796c001a70 comp rx=0 tx=0).stop 2024-04-17T19:53:52.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.065+0000 7f797c953640 1 -- 172.21.15.18:0/217710721 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7960004810 msgr2=0x7f7978149480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:52.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.065+0000 7f797c953640 1 --2- 172.21.15.18:0/217710721 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7960004810 0x7f7978149480 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7970010890 tx=0x7f7970010d50 comp rx=0 tx=0).stop 2024-04-17T19:53:52.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.065+0000 7f797c953640 1 -- 172.21.15.18:0/217710721 shutdown_connections 2024-04-17T19:53:52.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.065+0000 7f797c953640 1 --2- 172.21.15.18:0/217710721 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f79580683b0 0x7f795806a8c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:52.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.065+0000 7f797c953640 1 --2- 172.21.15.18:0/217710721 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f797814c970 0x7f797814cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:52.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.065+0000 7f797c953640 1 --2- 172.21.15.18:0/217710721 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f797814af70 0x7f79780afeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:52.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.065+0000 7f797c953640 1 --2- 172.21.15.18:0/217710721 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7960004810 0x7f7978149480 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:52.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.065+0000 7f797c953640 1 -- 172.21.15.18:0/217710721 >> 172.21.15.18:0/217710721 conn(0x7f7978072bb0 msgr2=0x7f79780b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:52.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.065+0000 7f797c953640 1 -- 172.21.15.18:0/217710721 shutdown_connections 2024-04-17T19:53:52.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.065+0000 7f797c953640 1 -- 172.21.15.18:0/217710721 wait complete. 2024-04-17T19:53:52.079 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-17T19:53:52.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.241+0000 7f928a794640 1 Processor -- start 2024-04-17T19:53:52.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.241+0000 7f928a794640 1 -- start start 2024-04-17T19:53:52.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.241+0000 7f928a794640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f928415e1a0 0x7f92840ce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:52.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.241+0000 7f928a794640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92840d0020 con 0x7f928406cd60 2024-04-17T19:53:52.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.241+0000 7f928a794640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92840cd930 con 0x7f92840cef10 2024-04-17T19:53:52.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.241+0000 7f928a794640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f92840cdc10 con 0x7f928415e1a0 2024-04-17T19:53:52.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.241+0000 7f9283fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f928415e1a0 0x7f92840ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:52.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.241+0000 7f9288d31640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f928406cd60 0x7f928406d170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55026/0 (socket says 172.21.15.18:55026) 2024-04-17T19:53:52.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.241+0000 7f9288d31640 1 -- 172.21.15.18:0/659470952 learned_addr learned my addr 172.21.15.18:0/659470952 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:52.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.241+0000 7f9283fff640 1 -- 172.21.15.18:0/659470952 >> v1:172.21.15.173:6789/0 conn(0x7f92840cef10 legacy=0x7f928415e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:52.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.241+0000 7f9283fff640 1 -- 172.21.15.18:0/659470952 >> v1:172.21.15.18:6789/0 conn(0x7f928406cd60 legacy=0x7f928406d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:52.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.241+0000 7f9283fff640 1 -- 172.21.15.18:0/659470952 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92840cdef0 con 0x7f928415e1a0 2024-04-17T19:53:52.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.241+0000 7f9282ffd640 1 -- 172.21.15.18:0/659470952 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 336332006 0 0) 0x7f92840d0020 con 0x7f928406cd60 2024-04-17T19:53:52.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.245+0000 7f9283fff640 1 --2- 172.21.15.18:0/659470952 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f928415e1a0 0x7f92840ce9d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f92740097c0 tx=0x7f927401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=967bc2a05460c9cc server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:52.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.245+0000 7f9282ffd640 1 -- 172.21.15.18:0/659470952 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92740b1070 con 0x7f928415e1a0 2024-04-17T19:53:52.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.245+0000 7f9282ffd640 1 -- 172.21.15.18:0/659470952 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92740a8050 con 0x7f928415e1a0 2024-04-17T19:53:52.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.245+0000 7f9282ffd640 1 -- 172.21.15.18:0/659470952 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92740ac860 con 0x7f928415e1a0 2024-04-17T19:53:52.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.245+0000 7f928a794640 1 -- 172.21.15.18:0/659470952 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f928415e1a0 msgr2=0x7f92840ce9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:52.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.245+0000 7f928a794640 1 --2- 172.21.15.18:0/659470952 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f928415e1a0 0x7f92840ce9d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f92740097c0 tx=0x7f927401c3e0 comp rx=0 tx=0).stop 2024-04-17T19:53:52.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.245+0000 7f928a794640 1 -- 172.21.15.18:0/659470952 shutdown_connections 2024-04-17T19:53:52.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.245+0000 7f928a794640 1 --2- 172.21.15.18:0/659470952 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f928415e1a0 0x7f92840ce9d0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:52.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.245+0000 7f928a794640 1 -- 172.21.15.18:0/659470952 >> 172.21.15.18:0/659470952 conn(0x7f9284072bb0 msgr2=0x7f9284072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:52.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.245+0000 7f928a794640 1 -- 172.21.15.18:0/659470952 shutdown_connections 2024-04-17T19:53:52.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.245+0000 7f928a794640 1 -- 172.21.15.18:0/659470952 wait complete. 2024-04-17T19:53:52.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.249+0000 7f928a794640 1 Processor -- start 2024-04-17T19:53:52.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.249+0000 7f928a794640 1 -- start start 2024-04-17T19:53:52.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.249+0000 7f928a794640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f928406cd60 0x7f928413e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:52.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.249+0000 7f928a794640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92840cef10 0x7f9284140b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:52.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.249+0000 7f928a794640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f928415e1a0 0x7f9284142910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:52.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.249+0000 7f928a794640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f928415f1a0 con 0x7f92840cef10 2024-04-17T19:53:52.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.249+0000 7f928a794640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f928415f020 con 0x7f928406cd60 2024-04-17T19:53:52.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.249+0000 7f928a794640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f9284157a10 con 0x7f928415e1a0 2024-04-17T19:53:52.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.249+0000 7f92837fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92840cef10 0x7f9284140b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:52.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.249+0000 7f92837fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92840cef10 0x7f9284140b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55692/0 (socket says 172.21.15.18:55692) 2024-04-17T19:53:52.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.249+0000 7f92837fe640 1 -- 172.21.15.18:0/1782723808 learned_addr learned my addr 172.21.15.18:0/1782723808 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:52.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.249+0000 7f9283fff640 1 --2- 172.21.15.18:0/1782723808 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f928406cd60 0x7f928413e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:52.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.249+0000 7f9288d31640 1 --2- 172.21.15.18:0/1782723808 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f928415e1a0 0x7f9284142910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:52.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.249+0000 7f92837fe640 1 -- 172.21.15.18:0/1782723808 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f928415e1a0 msgr2=0x7f9284142910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:52.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.249+0000 7f92837fe640 1 --2- 172.21.15.18:0/1782723808 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f928415e1a0 0x7f9284142910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:52.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.249+0000 7f92837fe640 1 -- 172.21.15.18:0/1782723808 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f928406cd60 msgr2=0x7f928413e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:52.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.249+0000 7f92837fe640 1 --2- 172.21.15.18:0/1782723808 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f928406cd60 0x7f928413e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:52.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.249+0000 7f92837fe640 1 -- 172.21.15.18:0/1782723808 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f928413e680 con 0x7f92840cef10 2024-04-17T19:53:52.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.249+0000 7f92837fe640 1 --2- 172.21.15.18:0/1782723808 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92840cef10 0x7f9284140b70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f926c00c3c0 tx=0x7f926c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:52.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.249+0000 7f9280ff9640 1 -- 172.21.15.18:0/1782723808 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f926c017070 con 0x7f92840cef10 2024-04-17T19:53:52.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.249+0000 7f9280ff9640 1 -- 172.21.15.18:0/1782723808 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f926c0052d0 con 0x7f92840cef10 2024-04-17T19:53:52.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.249+0000 7f928a794640 1 -- 172.21.15.18:0/1782723808 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92841416e0 con 0x7f92840cef10 2024-04-17T19:53:52.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.249+0000 7f9280ff9640 1 -- 172.21.15.18:0/1782723808 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f926c003820 con 0x7f92840cef10 2024-04-17T19:53:52.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.249+0000 7f928a794640 1 -- 172.21.15.18:0/1782723808 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9284141ca0 con 0x7f92840cef10 2024-04-17T19:53:52.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.253+0000 7f928a794640 1 -- 172.21.15.18:0/1782723808 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9284069950 con 0x7f92840cef10 2024-04-17T19:53:52.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.253+0000 7f9280ff9640 1 -- 172.21.15.18:0/1782723808 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f926c01a070 con 0x7f92840cef10 2024-04-17T19:53:52.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.253+0000 7f9280ff9640 1 --2- 172.21.15.18:0/1782723808 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f9264068380 0x7f926406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:52.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.253+0000 7f9280ff9640 1 -- 172.21.15.18:0/1782723808 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7f926c086120 con 0x7f92840cef10 2024-04-17T19:53:52.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.253+0000 7f9283fff640 1 --2- 172.21.15.18:0/1782723808 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f9264068380 0x7f926406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:52.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.253+0000 7f9283fff640 1 --2- 172.21.15.18:0/1782723808 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f9264068380 0x7f926406a890 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f92740ae000 tx=0x7f92740a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:52.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.257+0000 7f9280ff9640 1 -- 172.21.15.18:0/1782723808 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f928413e680 con 0x7f92840cef10 2024-04-17T19:53:52.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.413+0000 7f928a794640 1 -- 172.21.15.18:0/1782723808 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f9284141470 con 0x7f92840cef10 2024-04-17T19:53:52.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.413+0000 7f9280ff9640 1 -- 172.21.15.18:0/1782723808 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7f926c005480 con 0x7f92840cef10 2024-04-17T19:53:52.411 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-17T19:53:52.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.417+0000 7f928a794640 1 -- 172.21.15.18:0/1782723808 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f9264068380 msgr2=0x7f926406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:52.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.417+0000 7f928a794640 1 --2- 172.21.15.18:0/1782723808 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f9264068380 0x7f926406a890 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f92740ae000 tx=0x7f92740a7000 comp rx=0 tx=0).stop 2024-04-17T19:53:52.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.417+0000 7f928a794640 1 -- 172.21.15.18:0/1782723808 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92840cef10 msgr2=0x7f9284140b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:52.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.417+0000 7f928a794640 1 --2- 172.21.15.18:0/1782723808 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92840cef10 0x7f9284140b70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f926c00c3c0 tx=0x7f926c00c880 comp rx=0 tx=0).stop 2024-04-17T19:53:52.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.417+0000 7f928a794640 1 -- 172.21.15.18:0/1782723808 shutdown_connections 2024-04-17T19:53:52.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.417+0000 7f928a794640 1 --2- 172.21.15.18:0/1782723808 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f9264068380 0x7f926406a890 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:52.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.417+0000 7f928a794640 1 --2- 172.21.15.18:0/1782723808 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f928415e1a0 0x7f9284142910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:52.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.417+0000 7f928a794640 1 --2- 172.21.15.18:0/1782723808 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92840cef10 0x7f9284140b70 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:52.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.417+0000 7f928a794640 1 --2- 172.21.15.18:0/1782723808 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f928406cd60 0x7f928413e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:52.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.417+0000 7f928a794640 1 -- 172.21.15.18:0/1782723808 >> 172.21.15.18:0/1782723808 conn(0x7f9284072bb0 msgr2=0x7f928414b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:52.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.417+0000 7f928a794640 1 -- 172.21.15.18:0/1782723808 shutdown_connections 2024-04-17T19:53:52.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.417+0000 7f928a794640 1 -- 172.21.15.18:0/1782723808 wait complete. 2024-04-17T19:53:52.431 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-17T19:53:52.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.585+0000 7f2b9cb64640 1 Processor -- start 2024-04-17T19:53:52.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.589+0000 7f2b9cb64640 1 -- start start 2024-04-17T19:53:52.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.589+0000 7f2b9cb64640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f2b9815e1a0 0x7f2b980ce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:52.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.589+0000 7f2b9cb64640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2b9806cd60 0x7f2b9806d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:52.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.589+0000 7f2b9cb64640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b9806d6b0 con 0x7f2b980cef10 2024-04-17T19:53:52.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.589+0000 7f2b9cb64640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f2b980d0020 con 0x7f2b9806cd60 2024-04-17T19:53:52.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.589+0000 7f2b9cb64640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f2b980cd930 con 0x7f2b9815e1a0 2024-04-17T19:53:52.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.589+0000 7f2b96d9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2b9806cd60 0x7f2b9806d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:52.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.589+0000 7f2b96d9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2b9806cd60 0x7f2b9806d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55700/0 (socket says 172.21.15.18:55700) 2024-04-17T19:53:52.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.589+0000 7f2b96d9d640 1 -- 172.21.15.18:0/1155197027 learned_addr learned my addr 172.21.15.18:0/1155197027 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:52.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.589+0000 7f2b9659c640 1 --2- 172.21.15.18:0/1155197027 >> v2:172.21.15.173:3300/0 conn(0x7f2b9815e1a0 0x7f2b980ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:52.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.589+0000 7f2b96d9d640 1 -- 172.21.15.18:0/1155197027 >> v2:172.21.15.173:3300/0 conn(0x7f2b9815e1a0 msgr2=0x7f2b980ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:52.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.589+0000 7f2b96d9d640 1 --2- 172.21.15.18:0/1155197027 >> v2:172.21.15.173:3300/0 conn(0x7f2b9815e1a0 0x7f2b980ce9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:52.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.589+0000 7f2b96d9d640 1 -- 172.21.15.18:0/1155197027 >> v1:172.21.15.173:6789/0 conn(0x7f2b980cef10 legacy=0x7f2b9815e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:52.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.589+0000 7f2b96d9d640 1 -- 172.21.15.18:0/1155197027 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b980cdc10 con 0x7f2b9806cd60 2024-04-17T19:53:52.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.593+0000 7f2b96d9d640 1 --2- 172.21.15.18:0/1155197027 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b9806cd60 0x7f2b9806d170 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2b9806fdc0 tx=0x7f2b9001c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d85fa2497bb3f42e server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:52.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.593+0000 7f2b9559a640 1 -- 172.21.15.18:0/1155197027 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b900a55d0 con 0x7f2b9806cd60 2024-04-17T19:53:52.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.593+0000 7f2b9559a640 1 -- 172.21.15.18:0/1155197027 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b900a5770 con 0x7f2b9806cd60 2024-04-17T19:53:52.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.593+0000 7f2b9559a640 1 -- 172.21.15.18:0/1155197027 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b900a5b40 con 0x7f2b9806cd60 2024-04-17T19:53:52.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.593+0000 7f2b9cb64640 1 -- 172.21.15.18:0/1155197027 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b9806cd60 msgr2=0x7f2b9806d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:52.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.593+0000 7f2b9cb64640 1 --2- 172.21.15.18:0/1155197027 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b9806cd60 0x7f2b9806d170 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2b9806fdc0 tx=0x7f2b9001c710 comp rx=0 tx=0).stop 2024-04-17T19:53:52.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.593+0000 7f2b9cb64640 1 -- 172.21.15.18:0/1155197027 shutdown_connections 2024-04-17T19:53:52.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.593+0000 7f2b9cb64640 1 --2- 172.21.15.18:0/1155197027 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b9806cd60 0x7f2b9806d170 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:52.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.593+0000 7f2b9cb64640 1 --2- 172.21.15.18:0/1155197027 >> v2:172.21.15.173:3300/0 conn(0x7f2b9815e1a0 0x7f2b980ce9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:52.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.593+0000 7f2b9cb64640 1 -- 172.21.15.18:0/1155197027 >> 172.21.15.18:0/1155197027 conn(0x7f2b98072bb0 msgr2=0x7f2b98072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:52.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.593+0000 7f2b9cb64640 1 -- 172.21.15.18:0/1155197027 shutdown_connections 2024-04-17T19:53:52.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.593+0000 7f2b9cb64640 1 -- 172.21.15.18:0/1155197027 wait complete. 2024-04-17T19:53:52.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.593+0000 7f2b9cb64640 1 Processor -- start 2024-04-17T19:53:52.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.593+0000 7f2b9cb64640 1 -- start start 2024-04-17T19:53:52.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.597+0000 7f2b9cb64640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2b9806cd60 0x7f2b98152390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:52.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.597+0000 7f2b9cb64640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b980cef10 0x7f2b981528d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:52.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.597+0000 7f2b9cb64640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2b9815e1a0 0x7f2b981557a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:52.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.597+0000 7f2b9cb64640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2b9815e730 con 0x7f2b980cef10 2024-04-17T19:53:52.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.597+0000 7f2b9cb64640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2b9815e5b0 con 0x7f2b9806cd60 2024-04-17T19:53:52.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.597+0000 7f2b9cb64640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f2b9815f020 con 0x7f2b9815e1a0 2024-04-17T19:53:52.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.597+0000 7f2b95d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b980cef10 0x7f2b981528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:52.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.597+0000 7f2b95d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b980cef10 0x7f2b981528d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55712/0 (socket says 172.21.15.18:55712) 2024-04-17T19:53:52.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.597+0000 7f2b95d9b640 1 -- 172.21.15.18:0/1064813109 learned_addr learned my addr 172.21.15.18:0/1064813109 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:52.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.597+0000 7f2b9659c640 1 --2- 172.21.15.18:0/1064813109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2b9806cd60 0x7f2b98152390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:52.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.597+0000 7f2b96d9d640 1 --2- 172.21.15.18:0/1064813109 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2b9815e1a0 0x7f2b981557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:52.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.597+0000 7f2b95d9b640 1 -- 172.21.15.18:0/1064813109 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2b9815e1a0 msgr2=0x7f2b981557a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:52.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.597+0000 7f2b95d9b640 1 --2- 172.21.15.18:0/1064813109 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2b9815e1a0 0x7f2b981557a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:52.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.597+0000 7f2b95d9b640 1 -- 172.21.15.18:0/1064813109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2b9806cd60 msgr2=0x7f2b98152390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:52.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.597+0000 7f2b95d9b640 1 --2- 172.21.15.18:0/1064813109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2b9806cd60 0x7f2b98152390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:52.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.597+0000 7f2b95d9b640 1 -- 172.21.15.18:0/1064813109 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b9814c3f0 con 0x7f2b980cef10 2024-04-17T19:53:52.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.597+0000 7f2b95d9b640 1 --2- 172.21.15.18:0/1064813109 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b980cef10 0x7f2b981528d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2b8800b410 tx=0x7f2b8800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:52.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.597+0000 7f2b8effd640 1 -- 172.21.15.18:0/1064813109 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b88015030 con 0x7f2b980cef10 2024-04-17T19:53:52.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.597+0000 7f2b8effd640 1 -- 172.21.15.18:0/1064813109 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b88004020 con 0x7f2b980cef10 2024-04-17T19:53:52.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.597+0000 7f2b9cb64640 1 -- 172.21.15.18:0/1064813109 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b9814c8f0 con 0x7f2b980cef10 2024-04-17T19:53:52.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.597+0000 7f2b8effd640 1 -- 172.21.15.18:0/1064813109 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b88004410 con 0x7f2b980cef10 2024-04-17T19:53:52.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.597+0000 7f2b9cb64640 1 -- 172.21.15.18:0/1064813109 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b9814ceb0 con 0x7f2b980cef10 2024-04-17T19:53:52.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.597+0000 7f2b9cb64640 1 -- 172.21.15.18:0/1064813109 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b9814c660 con 0x7f2b980cef10 2024-04-17T19:53:52.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.597+0000 7f2b8effd640 1 -- 172.21.15.18:0/1064813109 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2b88018070 con 0x7f2b980cef10 2024-04-17T19:53:52.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.597+0000 7f2b8effd640 1 --2- 172.21.15.18:0/1064813109 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f2b78068380 0x7f2b7806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:52.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.597+0000 7f2b8effd640 1 -- 172.21.15.18:0/1064813109 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7f2b88086820 con 0x7f2b980cef10 2024-04-17T19:53:52.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.597+0000 7f2b9659c640 1 --2- 172.21.15.18:0/1064813109 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f2b78068380 0x7f2b7806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:52.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.601+0000 7f2b9659c640 1 --2- 172.21.15.18:0/1064813109 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f2b78068380 0x7f2b7806a890 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2b980b5f30 tx=0x7f2b80008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:52.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.605+0000 7f2b8effd640 1 -- 172.21.15.18:0/1064813109 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2b88056aa0 con 0x7f2b980cef10 2024-04-17T19:53:52.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.757+0000 7f2b9cb64640 1 -- 172.21.15.18:0/1064813109 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f2b98069950 con 0x7f2b980cef10 2024-04-17T19:53:52.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.761+0000 7f2b8effd640 1 -- 172.21.15.18:0/1064813109 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7f2b880563a0 con 0x7f2b980cef10 2024-04-17T19:53:52.756 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-17T19:53:52.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.761+0000 7f2b9cb64640 1 -- 172.21.15.18:0/1064813109 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f2b78068380 msgr2=0x7f2b7806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:52.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.761+0000 7f2b9cb64640 1 --2- 172.21.15.18:0/1064813109 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f2b78068380 0x7f2b7806a890 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2b980b5f30 tx=0x7f2b80008040 comp rx=0 tx=0).stop 2024-04-17T19:53:52.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.761+0000 7f2b9cb64640 1 -- 172.21.15.18:0/1064813109 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b980cef10 msgr2=0x7f2b981528d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:52.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.761+0000 7f2b9cb64640 1 --2- 172.21.15.18:0/1064813109 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b980cef10 0x7f2b981528d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2b8800b410 tx=0x7f2b8800b8d0 comp rx=0 tx=0).stop 2024-04-17T19:53:52.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.761+0000 7f2b9cb64640 1 -- 172.21.15.18:0/1064813109 shutdown_connections 2024-04-17T19:53:52.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.761+0000 7f2b9cb64640 1 --2- 172.21.15.18:0/1064813109 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f2b78068380 0x7f2b7806a890 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:52.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.761+0000 7f2b9cb64640 1 --2- 172.21.15.18:0/1064813109 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2b9815e1a0 0x7f2b981557a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:52.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.761+0000 7f2b9cb64640 1 --2- 172.21.15.18:0/1064813109 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b980cef10 0x7f2b981528d0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:52.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.761+0000 7f2b9cb64640 1 --2- 172.21.15.18:0/1064813109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2b9806cd60 0x7f2b98152390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:52.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.761+0000 7f2b9cb64640 1 -- 172.21.15.18:0/1064813109 >> 172.21.15.18:0/1064813109 conn(0x7f2b98072bb0 msgr2=0x7f2b9806e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:52.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.761+0000 7f2b9cb64640 1 -- 172.21.15.18:0/1064813109 shutdown_connections 2024-04-17T19:53:52.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.761+0000 7f2b9cb64640 1 -- 172.21.15.18:0/1064813109 wait complete. 2024-04-17T19:53:52.777 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-17T19:53:52.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.921+0000 7fe27920a640 1 Processor -- start 2024-04-17T19:53:52.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.921+0000 7fe27920a640 1 -- start start 2024-04-17T19:53:52.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.921+0000 7fe27920a640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe27406cd60 0x7fe27406d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:52.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.921+0000 7fe27920a640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe27415c7c0 0x7fe27415cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:52.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.921+0000 7fe27920a640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe27415fc90 con 0x7fe27406f9f0 2024-04-17T19:53:52.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.921+0000 7fe27920a640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fe27415e7d0 con 0x7fe27406cd60 2024-04-17T19:53:52.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.921+0000 7fe27920a640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7fe27406d6b0 con 0x7fe27415c7c0 2024-04-17T19:53:52.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.921+0000 7fe272d9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe27406cd60 0x7fe27406d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:52.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.921+0000 7fe272d9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe27406cd60 0x7fe27406d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55728/0 (socket says 172.21.15.18:55728) 2024-04-17T19:53:52.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.921+0000 7fe272d9d640 1 -- 172.21.15.18:0/3354411113 learned_addr learned my addr 172.21.15.18:0/3354411113 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:52.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.921+0000 7fe26a59c640 1 --2- 172.21.15.18:0/3354411113 >> v2:172.21.15.173:3300/0 conn(0x7fe27415c7c0 0x7fe27415cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:52.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.925+0000 7fe272d9d640 1 -- 172.21.15.18:0/3354411113 >> v2:172.21.15.173:3300/0 conn(0x7fe27415c7c0 msgr2=0x7fe27415cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:52.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.925+0000 7fe272d9d640 1 --2- 172.21.15.18:0/3354411113 >> v2:172.21.15.173:3300/0 conn(0x7fe27415c7c0 0x7fe27415cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:52.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.925+0000 7fe272d9d640 1 -- 172.21.15.18:0/3354411113 >> v1:172.21.15.173:6789/0 conn(0x7fe27406f9f0 legacy=0x7fe27406fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:52.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.925+0000 7fe272d9d640 1 -- 172.21.15.18:0/3354411113 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe274142870 con 0x7fe27406cd60 2024-04-17T19:53:52.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.925+0000 7fe272d9d640 1 --2- 172.21.15.18:0/3354411113 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe27406cd60 0x7fe27406d170 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe2740b48b0 tx=0x7fe26401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99694fdabc508f36 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:52.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.925+0000 7fe27259c640 1 -- 172.21.15.18:0/3354411113 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2640b1070 con 0x7fe27406cd60 2024-04-17T19:53:52.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.925+0000 7fe27259c640 1 -- 172.21.15.18:0/3354411113 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2640a8050 con 0x7fe27406cd60 2024-04-17T19:53:52.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.925+0000 7fe27259c640 1 -- 172.21.15.18:0/3354411113 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2640ac860 con 0x7fe27406cd60 2024-04-17T19:53:52.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.925+0000 7fe27920a640 1 -- 172.21.15.18:0/3354411113 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe27406cd60 msgr2=0x7fe27406d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:52.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.925+0000 7fe27920a640 1 --2- 172.21.15.18:0/3354411113 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe27406cd60 0x7fe27406d170 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe2740b48b0 tx=0x7fe26401c3e0 comp rx=0 tx=0).stop 2024-04-17T19:53:52.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.925+0000 7fe27920a640 1 -- 172.21.15.18:0/3354411113 shutdown_connections 2024-04-17T19:53:52.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.925+0000 7fe27920a640 1 --2- 172.21.15.18:0/3354411113 >> v2:172.21.15.173:3300/0 conn(0x7fe27415c7c0 0x7fe27415cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:52.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.925+0000 7fe27920a640 1 --2- 172.21.15.18:0/3354411113 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe27406cd60 0x7fe27406d170 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:52.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.925+0000 7fe27920a640 1 -- 172.21.15.18:0/3354411113 >> 172.21.15.18:0/3354411113 conn(0x7fe274072bb0 msgr2=0x7fe274072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:52.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.925+0000 7fe27920a640 1 -- 172.21.15.18:0/3354411113 shutdown_connections 2024-04-17T19:53:52.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.925+0000 7fe27920a640 1 -- 172.21.15.18:0/3354411113 wait complete. 2024-04-17T19:53:52.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.929+0000 7fe27920a640 1 Processor -- start 2024-04-17T19:53:52.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.929+0000 7fe27920a640 1 -- start start 2024-04-17T19:53:52.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.929+0000 7fe27920a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe27406cd60 0x7fe274152410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:52.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.929+0000 7fe27920a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe27406f9f0 0x7fe2740b07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:52.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.929+0000 7fe27920a640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe27415c7c0 0x7fe2740b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:52.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.929+0000 7fe27920a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe2741609e0 con 0x7fe27406f9f0 2024-04-17T19:53:52.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.929+0000 7fe27920a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe27415d4f0 con 0x7fe27406cd60 2024-04-17T19:53:52.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.929+0000 7fe27920a640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fe274137d70 con 0x7fe27415c7c0 2024-04-17T19:53:52.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.929+0000 7fe26a59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe27406f9f0 0x7fe2740b07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:52.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.929+0000 7fe26a59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe27406f9f0 0x7fe2740b07e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55732/0 (socket says 172.21.15.18:55732) 2024-04-17T19:53:52.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.929+0000 7fe26a59c640 1 -- 172.21.15.18:0/3272180453 learned_addr learned my addr 172.21.15.18:0/3272180453 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:52.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.929+0000 7fe27359e640 1 --2- 172.21.15.18:0/3272180453 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe27415c7c0 0x7fe2740b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:52.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.929+0000 7fe272d9d640 1 --2- 172.21.15.18:0/3272180453 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe27406cd60 0x7fe274152410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:52.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.929+0000 7fe26a59c640 1 -- 172.21.15.18:0/3272180453 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe27415c7c0 msgr2=0x7fe2740b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:52.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.929+0000 7fe26a59c640 1 --2- 172.21.15.18:0/3272180453 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe27415c7c0 0x7fe2740b0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:52.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.929+0000 7fe26a59c640 1 -- 172.21.15.18:0/3272180453 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe27406cd60 msgr2=0x7fe274152410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:52.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.929+0000 7fe26a59c640 1 --2- 172.21.15.18:0/3272180453 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe27406cd60 0x7fe274152410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:52.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.929+0000 7fe26a59c640 1 -- 172.21.15.18:0/3272180453 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe274133100 con 0x7fe27406f9f0 2024-04-17T19:53:52.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.929+0000 7fe26a59c640 1 --2- 172.21.15.18:0/3272180453 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe27406f9f0 0x7fe2740b07e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe25c00d7d0 tx=0x7fe25c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:52.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.929+0000 7fe26bfff640 1 -- 172.21.15.18:0/3272180453 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe25c00b6c0 con 0x7fe27406f9f0 2024-04-17T19:53:52.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.929+0000 7fe26bfff640 1 -- 172.21.15.18:0/3272180453 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe25c019070 con 0x7fe27406f9f0 2024-04-17T19:53:52.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.929+0000 7fe27920a640 1 -- 172.21.15.18:0/3272180453 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2740b2110 con 0x7fe27406f9f0 2024-04-17T19:53:52.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.929+0000 7fe26bfff640 1 -- 172.21.15.18:0/3272180453 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe25c00ba80 con 0x7fe27406f9f0 2024-04-17T19:53:52.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.929+0000 7fe27920a640 1 -- 172.21.15.18:0/3272180453 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe274141a80 con 0x7fe27406f9f0 2024-04-17T19:53:52.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.933+0000 7fe27920a640 1 -- 172.21.15.18:0/3272180453 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe274069950 con 0x7fe27406f9f0 2024-04-17T19:53:52.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.933+0000 7fe26bfff640 1 -- 172.21.15.18:0/3272180453 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe25c00bc20 con 0x7fe27406f9f0 2024-04-17T19:53:52.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.933+0000 7fe26bfff640 1 --2- 172.21.15.18:0/3272180453 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fe254068380 0x7fe25406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:52.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.933+0000 7fe26bfff640 1 -- 172.21.15.18:0/3272180453 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7fe25c0872a0 con 0x7fe27406f9f0 2024-04-17T19:53:52.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.933+0000 7fe272d9d640 1 --2- 172.21.15.18:0/3272180453 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fe254068380 0x7fe25406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:52.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.933+0000 7fe272d9d640 1 --2- 172.21.15.18:0/3272180453 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fe254068380 0x7fe25406a890 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe2640ae000 tx=0x7fe264008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:52.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:52.937+0000 7fe26bfff640 1 -- 172.21.15.18:0/3272180453 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe25c057380 con 0x7fe27406f9f0 2024-04-17T19:53:53.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:53.109+0000 7fe27920a640 1 -- 172.21.15.18:0/3272180453 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe2740b4b80 con 0x7fe27406f9f0 2024-04-17T19:53:53.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:53.109+0000 7fe26bfff640 1 -- 172.21.15.18:0/3272180453 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7fe25c056c80 con 0x7fe27406f9f0 2024-04-17T19:53:53.107 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-04-17T19:53:53.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:53.113+0000 7fe27920a640 1 -- 172.21.15.18:0/3272180453 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fe254068380 msgr2=0x7fe25406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:53.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:53.113+0000 7fe27920a640 1 --2- 172.21.15.18:0/3272180453 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fe254068380 0x7fe25406a890 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe2640ae000 tx=0x7fe264008040 comp rx=0 tx=0).stop 2024-04-17T19:53:53.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:53.113+0000 7fe27920a640 1 -- 172.21.15.18:0/3272180453 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe27406f9f0 msgr2=0x7fe2740b07e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:53.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:53.113+0000 7fe27920a640 1 --2- 172.21.15.18:0/3272180453 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe27406f9f0 0x7fe2740b07e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe25c00d7d0 tx=0x7fe25c00dc90 comp rx=0 tx=0).stop 2024-04-17T19:53:53.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:53.113+0000 7fe27920a640 1 -- 172.21.15.18:0/3272180453 shutdown_connections 2024-04-17T19:53:53.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:53.113+0000 7fe27920a640 1 --2- 172.21.15.18:0/3272180453 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fe254068380 0x7fe25406a890 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:53.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:53.113+0000 7fe27920a640 1 --2- 172.21.15.18:0/3272180453 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe27415c7c0 0x7fe2740b0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:53.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:53.113+0000 7fe27920a640 1 --2- 172.21.15.18:0/3272180453 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe27406f9f0 0x7fe2740b07e0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:53.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:53.113+0000 7fe27920a640 1 --2- 172.21.15.18:0/3272180453 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe27406cd60 0x7fe274152410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:53.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:53.113+0000 7fe27920a640 1 -- 172.21.15.18:0/3272180453 >> 172.21.15.18:0/3272180453 conn(0x7fe274072bb0 msgr2=0x7fe27406fe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:53.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:53.113+0000 7fe27920a640 1 -- 172.21.15.18:0/3272180453 shutdown_connections 2024-04-17T19:53:53.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:53.113+0000 7fe27920a640 1 -- 172.21.15.18:0/3272180453 wait complete. 2024-04-17T19:53:53.128 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi018.front.sepia.ceph.com... 2024-04-17T19:53:53.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:53.128 DEBUG:teuthology.orchestra.run.smithi018:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-17T19:53:53.139 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi018.stderr:ceph-fuse[35523]: fuse finished with error 0 and tester_r 0 2024-04-17T19:53:53.141 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T19:53:59.242 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi018.front.sepia.ceph.com 2024-04-17T19:53:59.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:53:59.243 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-17T19:53:59.251 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-17T19:53:59.251 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-17T19:53:59.297 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-17T19:53:59.297 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-17T19:53:59.345 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T19:53:59.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.552+0000 7f63ba3cf640 1 Processor -- start 2024-04-17T19:53:59.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.552+0000 7f63ba3cf640 1 -- start start 2024-04-17T19:53:59.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.556+0000 7f63ba3cf640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63b406cd60 0x7f63b406d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:59.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.556+0000 7f63ba3cf640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f63b415d7c0 0x7f63b415dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:59.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.556+0000 7f63ba3cf640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63b415fc90 con 0x7f63b415c7c0 2024-04-17T19:53:59.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.556+0000 7f63ba3cf640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f63b406d6b0 con 0x7f63b415d7c0 2024-04-17T19:53:59.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.556+0000 7f63ba3cf640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f63b4142870 con 0x7f63b406cd60 2024-04-17T19:53:59.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.556+0000 7f63ab7fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f63b415c7c0 0x7f63b415cbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:51090/0 (socket says 172.21.15.18:51090) 2024-04-17T19:53:59.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.556+0000 7f63ab7fe640 1 -- 172.21.15.18:0/3958558948 learned_addr learned my addr 172.21.15.18:0/3958558948 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:59.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.556+0000 7f63b3fff640 1 --2- 172.21.15.18:0/3958558948 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63b406cd60 0x7f63b406d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:59.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.556+0000 7f63b896c640 1 --2- 172.21.15.18:0/3958558948 >> v2:172.21.15.173:3300/0 conn(0x7f63b415d7c0 0x7f63b415dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:59.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.556+0000 7f63b37fe640 1 -- 172.21.15.18:0/3958558948 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2370386699 0 0) 0x7f63b415fc90 con 0x7f63b415c7c0 2024-04-17T19:53:59.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.556+0000 7f63b37fe640 1 -- 172.21.15.18:0/3958558948 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63a0003530 con 0x7f63b415c7c0 2024-04-17T19:53:59.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.556+0000 7f63b37fe640 1 -- 172.21.15.18:0/3958558948 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1628019378 0 0) 0x7f63a0003530 con 0x7f63b415c7c0 2024-04-17T19:53:59.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.556+0000 7f63b37fe640 1 -- 172.21.15.18:0/3958558948 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63b406cd60 msgr2=0x7f63b406d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:59.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.556+0000 7f63b37fe640 1 --2- 172.21.15.18:0/3958558948 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63b406cd60 0x7f63b406d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:59.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.556+0000 7f63b37fe640 1 -- 172.21.15.18:0/3958558948 >> v2:172.21.15.173:3300/0 conn(0x7f63b415d7c0 msgr2=0x7f63b415dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:59.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.556+0000 7f63b37fe640 1 --2- 172.21.15.18:0/3958558948 >> v2:172.21.15.173:3300/0 conn(0x7f63b415d7c0 0x7f63b415dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:59.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.556+0000 7f63b37fe640 1 -- 172.21.15.18:0/3958558948 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63b415ff00 con 0x7f63b415c7c0 2024-04-17T19:53:59.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.556+0000 7f63b37fe640 1 -- 172.21.15.18:0/3958558948 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3208559991 0 0) 0x7f639c001680 con 0x7f63b415c7c0 2024-04-17T19:53:59.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.556+0000 7f63b37fe640 1 -- 172.21.15.18:0/3958558948 >> v1:172.21.15.18:6789/0 conn(0x7f63b415c7c0 legacy=0x7f63b415cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:59.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.556+0000 7f63b37fe640 1 --2- 172.21.15.18:0/3958558948 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63b406cd60 0x7f63a00039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:59.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.556+0000 7f63b37fe640 1 --2- 172.21.15.18:0/3958558948 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63a0003f40 0x7f63a0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:59.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.556+0000 7f63b37fe640 1 --2- 172.21.15.18:0/3958558948 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63a0004d50 0x7f63a0005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:59.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.556+0000 7f63b37fe640 1 -- 172.21.15.18:0/3958558948 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f63b406d6b0 con 0x7f63a0004d50 2024-04-17T19:53:59.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.556+0000 7f63b37fe640 1 -- 172.21.15.18:0/3958558948 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f63b4142870 con 0x7f63a0003f40 2024-04-17T19:53:59.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.556+0000 7f63b37fe640 1 -- 172.21.15.18:0/3958558948 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f63a000ba20 con 0x7f63b406cd60 2024-04-17T19:53:59.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.556+0000 7f63b896c640 1 --2- 172.21.15.18:0/3958558948 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63a0004d50 0x7f63a0005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:59.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.556+0000 7f63b3fff640 1 --2- 172.21.15.18:0/3958558948 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63b406cd60 0x7f63a00039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:59.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.556+0000 7f63ab7fe640 1 --2- 172.21.15.18:0/3958558948 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63a0003f40 0x7f63a0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:59.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.556+0000 7f63b896c640 1 -- 172.21.15.18:0/3958558948 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63b406cd60 msgr2=0x7f63a00039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:59.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.556+0000 7f63b896c640 1 --2- 172.21.15.18:0/3958558948 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63b406cd60 0x7f63a00039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:59.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.556+0000 7f63b896c640 1 -- 172.21.15.18:0/3958558948 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63a0003f40 msgr2=0x7f63a0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:59.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.556+0000 7f63b896c640 1 --2- 172.21.15.18:0/3958558948 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63a0003f40 0x7f63a0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:59.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.556+0000 7f63b896c640 1 -- 172.21.15.18:0/3958558948 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63a0003530 con 0x7f63a0004d50 2024-04-17T19:53:59.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.556+0000 7f63ab7fe640 1 --2- 172.21.15.18:0/3958558948 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63a0003f40 0x7f63a0004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:53:59.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.560+0000 7f63b896c640 1 --2- 172.21.15.18:0/3958558948 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63a0004d50 0x7f63a0005160 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f63b40d0990 tx=0x7f63ac01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21aea2279975bbc4 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:59.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.560+0000 7f63b37fe640 1 -- 172.21.15.18:0/3958558948 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ac0b2070 con 0x7f63a0004d50 2024-04-17T19:53:59.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.560+0000 7f63b37fe640 1 -- 172.21.15.18:0/3958558948 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63ac0a5c70 con 0x7f63a0004d50 2024-04-17T19:53:59.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.560+0000 7f63b37fe640 1 -- 172.21.15.18:0/3958558948 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ac009c10 con 0x7f63a0004d50 2024-04-17T19:53:59.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.560+0000 7f63ba3cf640 1 -- 172.21.15.18:0/3958558948 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63a0004d50 msgr2=0x7f63a0005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:59.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.560+0000 7f63ba3cf640 1 --2- 172.21.15.18:0/3958558948 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63a0004d50 0x7f63a0005160 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f63b40d0990 tx=0x7f63ac01cc60 comp rx=0 tx=0).stop 2024-04-17T19:53:59.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.560+0000 7f63b896c640 1 -- 172.21.15.18:0/3958558948 reap_dead start 2024-04-17T19:53:59.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.560+0000 7f63ba3cf640 1 -- 172.21.15.18:0/3958558948 shutdown_connections 2024-04-17T19:53:59.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.560+0000 7f63ba3cf640 1 -- 172.21.15.18:0/3958558948 >> 172.21.15.18:0/3958558948 conn(0x7f63b4072bb0 msgr2=0x7f63b4072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:59.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.560+0000 7f63ba3cf640 1 -- 172.21.15.18:0/3958558948 shutdown_connections 2024-04-17T19:53:59.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.560+0000 7f63ba3cf640 1 -- 172.21.15.18:0/3958558948 wait complete. 2024-04-17T19:53:59.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.560+0000 7f63ba3cf640 1 Processor -- start 2024-04-17T19:53:59.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.560+0000 7f63ba3cf640 1 -- start start 2024-04-17T19:53:59.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.564+0000 7f63ba3cf640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63a0004d50 0x7f63b413b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:59.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.564+0000 7f63ba3cf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63b41f75a0 0x7f63b4156160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:59.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.564+0000 7f63ba3cf640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63b41f6a00 0x7f63b41f6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:59.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.564+0000 7f63ba3cf640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f63b415d4f0 con 0x7f63b41f75a0 2024-04-17T19:53:59.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.564+0000 7f63ba3cf640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f63b41604c0 con 0x7f63a0004d50 2024-04-17T19:53:59.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.564+0000 7f63ba3cf640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f63b41609e0 con 0x7f63b41f6a00 2024-04-17T19:53:59.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.564+0000 7f63ab7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63b41f75a0 0x7f63b4156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:59.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.564+0000 7f63ab7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63b41f75a0 0x7f63b4156160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49142/0 (socket says 172.21.15.18:49142) 2024-04-17T19:53:59.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.564+0000 7f63ab7fe640 1 -- 172.21.15.18:0/3711096305 learned_addr learned my addr 172.21.15.18:0/3711096305 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:59.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.564+0000 7f63b896c640 1 --2- 172.21.15.18:0/3711096305 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63b41f6a00 0x7f63b41f6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:59.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.564+0000 7f63b3fff640 1 --2- 172.21.15.18:0/3711096305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63a0004d50 0x7f63b413b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:59.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.564+0000 7f63ab7fe640 1 -- 172.21.15.18:0/3711096305 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63b41f6a00 msgr2=0x7f63b41f6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:59.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.564+0000 7f63ab7fe640 1 --2- 172.21.15.18:0/3711096305 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63b41f6a00 0x7f63b41f6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:59.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.564+0000 7f63ab7fe640 1 -- 172.21.15.18:0/3711096305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63a0004d50 msgr2=0x7f63b413b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:59.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.564+0000 7f63ab7fe640 1 --2- 172.21.15.18:0/3711096305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63a0004d50 0x7f63b413b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:59.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.564+0000 7f63ab7fe640 1 -- 172.21.15.18:0/3711096305 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63b41f7350 con 0x7f63b41f75a0 2024-04-17T19:53:59.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.564+0000 7f63ab7fe640 1 --2- 172.21.15.18:0/3711096305 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63b41f75a0 0x7f63b4156160 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f639c001210 tx=0x7f639c00dd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:59.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.564+0000 7f63b17fa640 1 -- 172.21.15.18:0/3711096305 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f639c019070 con 0x7f63b41f75a0 2024-04-17T19:53:59.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.564+0000 7f63b17fa640 1 -- 172.21.15.18:0/3711096305 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f639c0074e0 con 0x7f63b41f75a0 2024-04-17T19:53:59.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.564+0000 7f63ba3cf640 1 -- 172.21.15.18:0/3711096305 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63b41566a0 con 0x7f63b41f75a0 2024-04-17T19:53:59.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.564+0000 7f63b17fa640 1 -- 172.21.15.18:0/3711096305 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f639c004a10 con 0x7f63b41f75a0 2024-04-17T19:53:59.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.564+0000 7f63ba3cf640 1 -- 172.21.15.18:0/3711096305 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63b413bbe0 con 0x7f63b41f75a0 2024-04-17T19:53:59.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.564+0000 7f63ba3cf640 1 -- 172.21.15.18:0/3711096305 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63b413bde0 con 0x7f63b41f75a0 2024-04-17T19:53:59.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.568+0000 7f63b17fa640 1 -- 172.21.15.18:0/3711096305 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f639c01c070 con 0x7f63b41f75a0 2024-04-17T19:53:59.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.568+0000 7f63b17fa640 1 --2- 172.21.15.18:0/3711096305 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f63940683b0 0x7f639406a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:59.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.568+0000 7f63b17fa640 1 -- 172.21.15.18:0/3711096305 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7f639c086d00 con 0x7f63b41f75a0 2024-04-17T19:53:59.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.568+0000 7f63b3fff640 1 --2- 172.21.15.18:0/3711096305 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f63940683b0 0x7f639406a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:59.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.568+0000 7f63b3fff640 1 --2- 172.21.15.18:0/3711096305 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f63940683b0 0x7f639406a8c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f63b40b0750 tx=0x7f63a4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:59.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.572+0000 7f63b17fa640 1 -- 172.21.15.18:0/3711096305 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f639c023020 con 0x7f63b41f75a0 2024-04-17T19:53:59.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.732+0000 7f63ba3cf640 1 -- 172.21.15.18:0/3711096305 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f63b4069950 con 0x7f63b41f75a0 2024-04-17T19:53:59.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.736+0000 7f63b17fa640 1 -- 172.21.15.18:0/3711096305 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18759 (secure 0 0 0) 0x7f63b41f7350 con 0x7f63b41f75a0 2024-04-17T19:53:59.733 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:53:59.733 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":29,"fsid":"dd480169-5a81-4623-be5f-0499aa244b28","created":"2024-04-17T19:52:39.533760+0000","modified":"2024-04-17T19:53:45.435889+0000","last_up_change":"2024-04-17T19:52:51.229698+0000","last_in_change":"2024-04-17T19:52:42.144259+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T19:52:52.391648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T19:53:02.734240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T19:53:03.813028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T19:53:07.478812+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e232d577-2508-4ea4-b355-29fbae1ff025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6801","nonce":2323038417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6803","nonce":2323038417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6807","nonce":2323038417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6805","nonce":2323038417}]},"public_addr":"172.21.15.18:6801/2323038417","cluster_addr":"172.21.15.18:6803/2323038417","heartbeat_back_addr":"172.21.15.18:6807/2323038417","heartbeat_front_addr":"172.21.15.18:6805/2323038417","state":["exists","up"]},{"osd":1,"uuid":"31810ef3-2c71-48d6-8748-b74a2968d23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6817","nonce":1283678238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6819","nonce":1283678238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6823","nonce":1283678238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6821","nonce":1283678238}]},"public_addr":"172.21.15.18:6817/1283678238","cluster_addr":"172.21.15.18:6819/1283678238","heartbeat_back_addr":"172.21.15.18:6823/1283678238","heartbeat_front_addr":"172.21.15.18:6821/1283678238","state":["exists","up"]},{"osd":2,"uuid":"5a783cc5-a41c-4967-9e11-6b8330f97d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6809","nonce":1212875862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6811","nonce":1212875862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6815","nonce":1212875862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6813","nonce":1212875862}]},"public_addr":"172.21.15.18:6809/1212875862","cluster_addr":"172.21.15.18:6811/1212875862","heartbeat_back_addr":"172.21.15.18:6815/1212875862","heartbeat_front_addr":"172.21.15.18:6813/1212875862","state":["exists","up"]},{"osd":3,"uuid":"b7e056d9-9da5-46e1-810d-0c3e242fe5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6825","nonce":2428878428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6827","nonce":2428878428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6831","nonce":2428878428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6829","nonce":2428878428}]},"public_addr":"172.21.15.18:6825/2428878428","cluster_addr":"172.21.15.18:6827/2428878428","heartbeat_back_addr":"172.21.15.18:6831/2428878428","heartbeat_front_addr":"172.21.15.18:6829/2428878428","state":["exists","up"]},{"osd":4,"uuid":"21df023f-bc8b-4abb-93e5-0ecc91acda0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6825","nonce":1421511819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6827","nonce":1421511819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6831","nonce":1421511819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6829","nonce":1421511819}]},"public_addr":"172.21.15.173:6825/1421511819","cluster_addr":"172.21.15.173:6827/1421511819","heartbeat_back_addr":"172.21.15.173:6831/1421511819","heartbeat_front_addr":"172.21.15.173:6829/1421511819","state":["exists","up"]},{"osd":5,"uuid":"e270098a-6d33-49f8-84ed-94e09a880cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6801","nonce":4221907702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6803","nonce":4221907702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6807","nonce":4221907702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6805","nonce":4221907702}]},"public_addr":"172.21.15.173:6801/4221907702","cluster_addr":"172.21.15.173:6803/4221907702","heartbeat_back_addr":"172.21.15.173:6807/4221907702","heartbeat_front_addr":"172.21.15.173:6805/4221907702","state":["exists","up"]},{"osd":6,"uuid":"93c67c8c-268d-4e32-877c-043cd3acd87c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6809","nonce":761678552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6811","nonce":761678552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6815","nonce":761678552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6813","nonce":761678552}]},"public_addr":"172.21.15.173:6809/761678552","cluster_addr":"172.21.15.173:6811/761678552","heartbeat_back_addr":"172.21.15.173:6815/761678552","heartbeat_front_addr":"172.21.15.173:6813/761678552","state":["exists","up"]},{"osd":7,"uuid":"faf10eea-80de-40f6-abbb-34d07d3f59ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6817","nonce":383724537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6819","nonce":383724537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6823","nonce":383724537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6821","nonce":383724537}]},"public_addr":"172.21.15.173:6817/383724537","cluster_addr":"172.21.15.173:6819/383724537","heartbeat_back_addr":"172.21.15.173:6823/383724537","heartbeat_front_addr":"172.21.15.173:6821/383724537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.668924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.761747+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.768128+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.632252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.742608+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.734327+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.477107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.818292+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.31","mappings":[{"from":0,"to":7}]},{"pgid":"4.5","mappings":[{"from":3,"to":4},{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":0}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]},{"pgid":"4.1c","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T19:53:59.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.736+0000 7f63ba3cf640 1 -- 172.21.15.18:0/3711096305 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f63940683b0 msgr2=0x7f639406a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:59.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.736+0000 7f63ba3cf640 1 --2- 172.21.15.18:0/3711096305 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f63940683b0 0x7f639406a8c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f63b40b0750 tx=0x7f63a4008040 comp rx=0 tx=0).stop 2024-04-17T19:53:59.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.736+0000 7f63ba3cf640 1 -- 172.21.15.18:0/3711096305 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63b41f75a0 msgr2=0x7f63b4156160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:59.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.736+0000 7f63ba3cf640 1 --2- 172.21.15.18:0/3711096305 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63b41f75a0 0x7f63b4156160 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f639c001210 tx=0x7f639c00dd60 comp rx=0 tx=0).stop 2024-04-17T19:53:59.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.736+0000 7f63ba3cf640 1 -- 172.21.15.18:0/3711096305 shutdown_connections 2024-04-17T19:53:59.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.736+0000 7f63ba3cf640 1 --2- 172.21.15.18:0/3711096305 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f63940683b0 0x7f639406a8c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:59.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.736+0000 7f63ba3cf640 1 --2- 172.21.15.18:0/3711096305 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63b41f6a00 0x7f63b41f6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:59.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.736+0000 7f63ba3cf640 1 --2- 172.21.15.18:0/3711096305 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63b41f75a0 0x7f63b4156160 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:59.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.736+0000 7f63ba3cf640 1 --2- 172.21.15.18:0/3711096305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63a0004d50 0x7f63b413b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:59.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.736+0000 7f63ba3cf640 1 -- 172.21.15.18:0/3711096305 >> 172.21.15.18:0/3711096305 conn(0x7f63b4072bb0 msgr2=0x7f63b40b11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:59.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.736+0000 7f63ba3cf640 1 -- 172.21.15.18:0/3711096305 shutdown_connections 2024-04-17T19:53:59.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.736+0000 7f63ba3cf640 1 -- 172.21.15.18:0/3711096305 wait complete. 2024-04-17T19:53:59.754 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T19:52:52.391648+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-17T19:53:02.734240+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-17T19:53:03.813028+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-17T19:53:07.478812+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-17T19:53:59.754 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T19:53:59.848 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T19:53:59.850 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T19:53:59.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.908+0000 7f0df8af0640 1 Processor -- start 2024-04-17T19:53:59.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.908+0000 7f0df8af0640 1 -- start start 2024-04-17T19:53:59.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.912+0000 7f0df8af0640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0df40b6850 0x7f0df40b6c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:59.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.912+0000 7f0df8af0640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0df40b71a0 con 0x7f0df40cf0f0 2024-04-17T19:53:59.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.912+0000 7f0df8af0640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0df40cdc10 con 0x7f0df40cece0 2024-04-17T19:53:59.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.912+0000 7f0df8af0640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f0df40ce4b0 con 0x7f0df40b6850 2024-04-17T19:53:59.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.912+0000 7f0df1d9b640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f0df40cf0f0 0x7f0df40b1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:51104/0 (socket says 172.21.15.18:51104) 2024-04-17T19:53:59.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.912+0000 7f0df1d9b640 1 -- 172.21.15.18:0/1476356836 learned_addr learned my addr 172.21.15.18:0/1476356836 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:53:59.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.912+0000 7f0df2d9d640 1 --2- 172.21.15.18:0/1476356836 >> v2:172.21.15.173:3300/0 conn(0x7f0df40b6850 0x7f0df40b6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:59.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.912+0000 7f0df159a640 1 -- 172.21.15.18:0/1476356836 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1216309664 0 0) 0x7f0de8001120 con 0x7f0df40cf0f0 2024-04-17T19:53:59.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.912+0000 7f0df159a640 1 -- 172.21.15.18:0/1476356836 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ddc003530 con 0x7f0df40cf0f0 2024-04-17T19:53:59.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.912+0000 7f0df159a640 1 -- 172.21.15.18:0/1476356836 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1868937438 0 0) 0x7f0ddc003530 con 0x7f0df40cf0f0 2024-04-17T19:53:59.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.912+0000 7f0df159a640 1 -- 172.21.15.18:0/1476356836 >> v2:172.21.15.173:3300/0 conn(0x7f0df40b6850 msgr2=0x7f0df40b6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:59.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.912+0000 7f0df159a640 1 --2- 172.21.15.18:0/1476356836 >> v2:172.21.15.173:3300/0 conn(0x7f0df40b6850 0x7f0df40b6c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:59.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.912+0000 7f0df159a640 1 -- 172.21.15.18:0/1476356836 >> v1:172.21.15.173:6789/0 conn(0x7f0df40cece0 legacy=0x7f0df4161500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:59.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.912+0000 7f0df159a640 1 -- 172.21.15.18:0/1476356836 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0df40cdef0 con 0x7f0df40cf0f0 2024-04-17T19:53:59.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.912+0000 7f0df2d9d640 1 --2- 172.21.15.18:0/1476356836 >> v2:172.21.15.173:3300/0 conn(0x7f0df40b6850 0x7f0df40b6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:53:59.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.912+0000 7f0df159a640 1 -- 172.21.15.18:0/1476356836 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3208559991 0 0) 0x7f0de8001850 con 0x7f0df40cf0f0 2024-04-17T19:53:59.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.912+0000 7f0df159a640 1 -- 172.21.15.18:0/1476356836 >> v1:172.21.15.18:6789/0 conn(0x7f0df40cf0f0 legacy=0x7f0df40b1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:59.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.912+0000 7f0df159a640 1 --2- 172.21.15.18:0/1476356836 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ddc0039c0 0x7f0ddc003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:59.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.912+0000 7f0df159a640 1 --2- 172.21.15.18:0/1476356836 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ddc004810 0x7f0ddc004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:59.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.912+0000 7f0df159a640 1 --2- 172.21.15.18:0/1476356836 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ddc005280 0x7f0ddc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:59.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.912+0000 7f0df159a640 1 -- 172.21.15.18:0/1476356836 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0ddc00c1e0 con 0x7f0ddc005280 2024-04-17T19:53:59.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.912+0000 7f0df159a640 1 -- 172.21.15.18:0/1476356836 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0ddc00c390 con 0x7f0ddc0039c0 2024-04-17T19:53:59.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.912+0000 7f0df159a640 1 -- 172.21.15.18:0/1476356836 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f0ddc00c590 con 0x7f0ddc004810 2024-04-17T19:53:59.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.912+0000 7f0df2d9d640 1 --2- 172.21.15.18:0/1476356836 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ddc005280 0x7f0ddc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:59.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.912+0000 7f0df259c640 1 --2- 172.21.15.18:0/1476356836 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ddc0039c0 0x7f0ddc003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:59.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.912+0000 7f0df1d9b640 1 --2- 172.21.15.18:0/1476356836 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ddc004810 0x7f0ddc004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:59.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.912+0000 7f0df2d9d640 1 -- 172.21.15.18:0/1476356836 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ddc004810 msgr2=0x7f0ddc004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:59.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.912+0000 7f0df2d9d640 1 --2- 172.21.15.18:0/1476356836 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ddc004810 0x7f0ddc004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:59.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.912+0000 7f0df2d9d640 1 -- 172.21.15.18:0/1476356836 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ddc0039c0 msgr2=0x7f0ddc003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:53:59.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.912+0000 7f0df2d9d640 1 --2- 172.21.15.18:0/1476356836 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ddc0039c0 0x7f0ddc003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:59.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.912+0000 7f0df2d9d640 1 -- 172.21.15.18:0/1476356836 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ddc003530 con 0x7f0ddc005280 2024-04-17T19:53:59.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.912+0000 7f0df259c640 1 --2- 172.21.15.18:0/1476356836 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ddc0039c0 0x7f0ddc003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:53:59.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.912+0000 7f0df2d9d640 1 -- 172.21.15.18:0/1476356836 reap_dead start 2024-04-17T19:53:59.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.912+0000 7f0df2d9d640 1 --2- 172.21.15.18:0/1476356836 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ddc005280 0x7f0ddc00b9d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f0dec0073e0 tx=0x7f0dec01cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e6bd260d7d4d0ac server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:59.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.912+0000 7f0df159a640 1 -- 172.21.15.18:0/1476356836 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dec009c80 con 0x7f0ddc005280 2024-04-17T19:53:59.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.912+0000 7f0df159a640 1 -- 172.21.15.18:0/1476356836 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dec0a5da0 con 0x7f0ddc005280 2024-04-17T19:53:59.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.912+0000 7f0df159a640 1 -- 172.21.15.18:0/1476356836 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dec0ad680 con 0x7f0ddc005280 2024-04-17T19:53:59.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.916+0000 7f0df8af0640 1 -- 172.21.15.18:0/1476356836 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ddc005280 msgr2=0x7f0ddc00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:59.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.916+0000 7f0df8af0640 1 --2- 172.21.15.18:0/1476356836 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ddc005280 0x7f0ddc00b9d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f0dec0073e0 tx=0x7f0dec01cf40 comp rx=0 tx=0).stop 2024-04-17T19:53:59.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.916+0000 7f0df8af0640 1 -- 172.21.15.18:0/1476356836 shutdown_connections 2024-04-17T19:53:59.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.916+0000 7f0df8af0640 1 --2- 172.21.15.18:0/1476356836 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ddc005280 0x7f0ddc00b9d0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:59.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.916+0000 7f0df8af0640 1 -- 172.21.15.18:0/1476356836 >> 172.21.15.18:0/1476356836 conn(0x7f0df409aa70 msgr2=0x7f0df409ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:53:59.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.916+0000 7f0df8af0640 1 -- 172.21.15.18:0/1476356836 shutdown_connections 2024-04-17T19:53:59.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.916+0000 7f0df8af0640 1 -- 172.21.15.18:0/1476356836 wait complete. 2024-04-17T19:53:59.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.916+0000 7f0df8af0640 1 Processor -- start 2024-04-17T19:53:59.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.916+0000 7f0df8af0640 1 -- start start 2024-04-17T19:53:59.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.920+0000 7f0df8af0640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ddc005280 0x7f0df4152bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:59.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.920+0000 7f0df8af0640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0df40c9800 0x7f0df40c5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:59.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.920+0000 7f0df8af0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0df415f7a0 0x7f0df415fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:59.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.920+0000 7f0df8af0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0df40cda30 con 0x7f0df415f7a0 2024-04-17T19:53:59.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.920+0000 7f0df8af0640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0df40b2600 con 0x7f0df40c9800 2024-04-17T19:53:59.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.920+0000 7f0df8af0640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f0df40b2780 con 0x7f0ddc005280 2024-04-17T19:53:59.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.920+0000 7f0df2d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0df415f7a0 0x7f0df415fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:59.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.920+0000 7f0df2d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0df415f7a0 0x7f0df415fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49152/0 (socket says 172.21.15.18:49152) 2024-04-17T19:53:59.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.920+0000 7f0df2d9d640 1 -- 172.21.15.18:0/4118338150 learned_addr learned my addr 172.21.15.18:0/4118338150 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:53:59.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.920+0000 7f0df1d9b640 1 --2- 172.21.15.18:0/4118338150 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0df40c9800 0x7f0df40c5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:59.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.920+0000 7f0df259c640 1 --2- 172.21.15.18:0/4118338150 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ddc005280 0x7f0df4152bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:59.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.920+0000 7f0df2d9d640 1 -- 172.21.15.18:0/4118338150 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ddc005280 msgr2=0x7f0df4152bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:59.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.920+0000 7f0df2d9d640 1 --2- 172.21.15.18:0/4118338150 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ddc005280 0x7f0df4152bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:59.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.920+0000 7f0df2d9d640 1 -- 172.21.15.18:0/4118338150 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0df40c9800 msgr2=0x7f0df40c5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:53:59.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.920+0000 7f0df2d9d640 1 --2- 172.21.15.18:0/4118338150 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0df40c9800 0x7f0df40c5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:53:59.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.920+0000 7f0df2d9d640 1 -- 172.21.15.18:0/4118338150 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0df4160530 con 0x7f0df415f7a0 2024-04-17T19:53:59.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.920+0000 7f0df2d9d640 1 --2- 172.21.15.18:0/4118338150 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0df415f7a0 0x7f0df415fbb0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0dec01d7e0 tx=0x7f0ddc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:59.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.920+0000 7f0de2ffd640 1 -- 172.21.15.18:0/4118338150 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dec0b7440 con 0x7f0df415f7a0 2024-04-17T19:53:59.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.920+0000 7f0de2ffd640 1 -- 172.21.15.18:0/4118338150 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dec0b75e0 con 0x7f0df415f7a0 2024-04-17T19:53:59.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.920+0000 7f0df8af0640 1 -- 172.21.15.18:0/4118338150 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0df40c8d20 con 0x7f0df415f7a0 2024-04-17T19:53:59.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.920+0000 7f0de2ffd640 1 -- 172.21.15.18:0/4118338150 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dec0b79d0 con 0x7f0df415f7a0 2024-04-17T19:53:59.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.920+0000 7f0df8af0640 1 -- 172.21.15.18:0/4118338150 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0df40c63c0 con 0x7f0df415f7a0 2024-04-17T19:53:59.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.920+0000 7f0df8af0640 1 -- 172.21.15.18:0/4118338150 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0df41602a0 con 0x7f0df415f7a0 2024-04-17T19:53:59.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.920+0000 7f0de2ffd640 1 -- 172.21.15.18:0/4118338150 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0dec0ac3e0 con 0x7f0df415f7a0 2024-04-17T19:53:59.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.920+0000 7f0de2ffd640 1 --2- 172.21.15.18:0/4118338150 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0dd4068380 0x7f0dd406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:53:59.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.920+0000 7f0de2ffd640 1 -- 172.21.15.18:0/4118338150 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7f0dec1213d0 con 0x7f0df415f7a0 2024-04-17T19:53:59.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.920+0000 7f0df259c640 1 --2- 172.21.15.18:0/4118338150 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0dd4068380 0x7f0dd406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:53:59.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.920+0000 7f0df259c640 1 --2- 172.21.15.18:0/4118338150 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0dd4068380 0x7f0dd406a890 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0de4005450 tx=0x7f0de4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:53:59.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:53:59.924+0000 7f0de2ffd640 1 -- 172.21.15.18:0/4118338150 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0dec016c50 con 0x7f0df415f7a0 2024-04-17T19:54:00.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.080+0000 7f0df8af0640 1 -- 172.21.15.18:0/4118338150 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0df4069950 con 0x7f0df415f7a0 2024-04-17T19:54:00.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.080+0000 7f0de2ffd640 1 -- 172.21.15.18:0/4118338150 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7f0dec0f15b0 con 0x7f0df415f7a0 2024-04-17T19:54:00.079 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-17T19:54:00.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.084+0000 7f0df8af0640 1 -- 172.21.15.18:0/4118338150 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0dd4068380 msgr2=0x7f0dd406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:00.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.084+0000 7f0df8af0640 1 --2- 172.21.15.18:0/4118338150 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0dd4068380 0x7f0dd406a890 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0de4005450 tx=0x7f0de4009040 comp rx=0 tx=0).stop 2024-04-17T19:54:00.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.084+0000 7f0df8af0640 1 -- 172.21.15.18:0/4118338150 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0df415f7a0 msgr2=0x7f0df415fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:00.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.084+0000 7f0df8af0640 1 --2- 172.21.15.18:0/4118338150 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0df415f7a0 0x7f0df415fbb0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0dec01d7e0 tx=0x7f0ddc005840 comp rx=0 tx=0).stop 2024-04-17T19:54:00.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.084+0000 7f0df8af0640 1 -- 172.21.15.18:0/4118338150 shutdown_connections 2024-04-17T19:54:00.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.084+0000 7f0df8af0640 1 --2- 172.21.15.18:0/4118338150 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0dd4068380 0x7f0dd406a890 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:00.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.084+0000 7f0df8af0640 1 --2- 172.21.15.18:0/4118338150 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0df415f7a0 0x7f0df415fbb0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:00.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.084+0000 7f0df8af0640 1 --2- 172.21.15.18:0/4118338150 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0df40c9800 0x7f0df40c5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:00.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.084+0000 7f0df8af0640 1 --2- 172.21.15.18:0/4118338150 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ddc005280 0x7f0df4152bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:00.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.084+0000 7f0df8af0640 1 -- 172.21.15.18:0/4118338150 >> 172.21.15.18:0/4118338150 conn(0x7f0df409aa70 msgr2=0x7f0df40ae8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:00.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.084+0000 7f0df8af0640 1 -- 172.21.15.18:0/4118338150 shutdown_connections 2024-04-17T19:54:00.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.084+0000 7f0df8af0640 1 -- 172.21.15.18:0/4118338150 wait complete. 2024-04-17T19:54:00.100 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-17T19:54:00.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.308+0000 7ffbb8f29640 1 Processor -- start 2024-04-17T19:54:00.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.308+0000 7ffbb8f29640 1 -- start start 2024-04-17T19:54:00.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.308+0000 7ffbb8f29640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ffbb415d3b0 0x7ffbb40b6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:00.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.308+0000 7ffbb8f29640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbb40b61a0 con 0x7ffbb40713e0 2024-04-17T19:54:00.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.308+0000 7ffbb8f29640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbb40d1cc0 con 0x7ffbb40d16b0 2024-04-17T19:54:00.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.308+0000 7ffbb8f29640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7ffbb40d1fa0 con 0x7ffbb415d3b0 2024-04-17T19:54:00.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.308+0000 7ffbb1d9b640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7ffbb40713e0 0x7ffbb40b6680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:51112/0 (socket says 172.21.15.18:51112) 2024-04-17T19:54:00.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.308+0000 7ffbb1d9b640 1 -- 172.21.15.18:0/2860917675 learned_addr learned my addr 172.21.15.18:0/2860917675 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:54:00.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.308+0000 7ffbb2d9d640 1 --2- 172.21.15.18:0/2860917675 >> v2:172.21.15.173:3300/0 conn(0x7ffbb415d3b0 0x7ffbb40b6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:00.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.308+0000 7ffbb159a640 1 -- 172.21.15.18:0/2860917675 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 752657676 0 0) 0x7ffbb40b61a0 con 0x7ffbb40713e0 2024-04-17T19:54:00.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.308+0000 7ffbb159a640 1 -- 172.21.15.18:0/2860917675 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb9c003530 con 0x7ffbb40713e0 2024-04-17T19:54:00.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.308+0000 7ffbb159a640 1 -- 172.21.15.18:0/2860917675 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3986210421 0 0) 0x7ffb9c003530 con 0x7ffbb40713e0 2024-04-17T19:54:00.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.308+0000 7ffbb159a640 1 -- 172.21.15.18:0/2860917675 >> v2:172.21.15.173:3300/0 conn(0x7ffbb415d3b0 msgr2=0x7ffbb40b6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:00.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.308+0000 7ffbb159a640 1 --2- 172.21.15.18:0/2860917675 >> v2:172.21.15.173:3300/0 conn(0x7ffbb415d3b0 0x7ffbb40b6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:00.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.308+0000 7ffbb159a640 1 -- 172.21.15.18:0/2860917675 >> v1:172.21.15.173:6789/0 conn(0x7ffbb40d16b0 legacy=0x7ffbb4070cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:00.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.308+0000 7ffbb159a640 1 -- 172.21.15.18:0/2860917675 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbb40d2280 con 0x7ffbb40713e0 2024-04-17T19:54:00.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.312+0000 7ffbb159a640 1 -- 172.21.15.18:0/2860917675 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3208559991 0 0) 0x7ffba8001680 con 0x7ffbb40713e0 2024-04-17T19:54:00.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.312+0000 7ffbb159a640 1 -- 172.21.15.18:0/2860917675 >> v1:172.21.15.18:6789/0 conn(0x7ffbb40713e0 legacy=0x7ffbb40b6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:00.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.312+0000 7ffbb159a640 1 --2- 172.21.15.18:0/2860917675 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffb9c0039c0 0x7ffb9c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:00.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.312+0000 7ffbb159a640 1 --2- 172.21.15.18:0/2860917675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb9c004810 0x7ffb9c004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:00.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.312+0000 7ffbb159a640 1 --2- 172.21.15.18:0/2860917675 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffb9c0051d0 0x7ffb9c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:00.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.312+0000 7ffbb159a640 1 -- 172.21.15.18:0/2860917675 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb40d1fa0 con 0x7ffb9c004810 2024-04-17T19:54:00.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.312+0000 7ffbb159a640 1 -- 172.21.15.18:0/2860917675 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ffb9c00c160 con 0x7ffb9c0051d0 2024-04-17T19:54:00.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.312+0000 7ffbb159a640 1 -- 172.21.15.18:0/2860917675 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7ffb9c00c360 con 0x7ffb9c0039c0 2024-04-17T19:54:00.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.312+0000 7ffbb1d9b640 1 --2- 172.21.15.18:0/2860917675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb9c004810 0x7ffb9c004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:00.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.312+0000 7ffbb2d9d640 1 --2- 172.21.15.18:0/2860917675 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffb9c0051d0 0x7ffb9c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:00.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.312+0000 7ffbb259c640 1 --2- 172.21.15.18:0/2860917675 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffb9c0039c0 0x7ffb9c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:00.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.312+0000 7ffbb1d9b640 1 -- 172.21.15.18:0/2860917675 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffb9c0039c0 msgr2=0x7ffb9c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:00.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.312+0000 7ffbb1d9b640 1 --2- 172.21.15.18:0/2860917675 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffb9c0039c0 0x7ffb9c003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:00.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.312+0000 7ffbb1d9b640 1 -- 172.21.15.18:0/2860917675 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffb9c0051d0 msgr2=0x7ffb9c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:00.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.312+0000 7ffbb1d9b640 1 --2- 172.21.15.18:0/2860917675 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffb9c0051d0 0x7ffb9c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:00.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.312+0000 7ffbb1d9b640 1 -- 172.21.15.18:0/2860917675 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb9c003530 con 0x7ffb9c004810 2024-04-17T19:54:00.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.312+0000 7ffbb2d9d640 1 -- 172.21.15.18:0/2860917675 reap_dead start 2024-04-17T19:54:00.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.312+0000 7ffbb1d9b640 1 --2- 172.21.15.18:0/2860917675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb9c004810 0x7ffb9c004c20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ffba800c240 tx=0x7ffba801cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=636e03a389ab65ff server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:00.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.312+0000 7ffbb159a640 1 -- 172.21.15.18:0/2860917675 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffba8007d20 con 0x7ffb9c004810 2024-04-17T19:54:00.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.312+0000 7ffbb159a640 1 -- 172.21.15.18:0/2860917675 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffba80a9070 con 0x7ffb9c004810 2024-04-17T19:54:00.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.312+0000 7ffbb159a640 1 -- 172.21.15.18:0/2860917675 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffba80a5e00 con 0x7ffb9c004810 2024-04-17T19:54:00.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.312+0000 7ffbb8f29640 1 -- 172.21.15.18:0/2860917675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb9c004810 msgr2=0x7ffb9c004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:00.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.312+0000 7ffbb8f29640 1 --2- 172.21.15.18:0/2860917675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb9c004810 0x7ffb9c004c20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ffba800c240 tx=0x7ffba801cc40 comp rx=0 tx=0).stop 2024-04-17T19:54:00.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.312+0000 7ffbb8f29640 1 -- 172.21.15.18:0/2860917675 shutdown_connections 2024-04-17T19:54:00.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.312+0000 7ffbb8f29640 1 --2- 172.21.15.18:0/2860917675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb9c004810 0x7ffb9c004c20 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:00.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.312+0000 7ffbb8f29640 1 -- 172.21.15.18:0/2860917675 >> 172.21.15.18:0/2860917675 conn(0x7ffbb40d2bf0 msgr2=0x7ffbb40d3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:00.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.312+0000 7ffbb8f29640 1 -- 172.21.15.18:0/2860917675 shutdown_connections 2024-04-17T19:54:00.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.312+0000 7ffbb8f29640 1 -- 172.21.15.18:0/2860917675 wait complete. 2024-04-17T19:54:00.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.316+0000 7ffbb8f29640 1 Processor -- start 2024-04-17T19:54:00.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.316+0000 7ffbb8f29640 1 -- start start 2024-04-17T19:54:00.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.316+0000 7ffbb8f29640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffb9c004810 0x7ffbb4152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:00.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.316+0000 7ffbb8f29640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffbb415a0a0 0x7ffbb40b3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:00.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.316+0000 7ffbb8f29640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffbb415e160 0x7ffbb415e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:00.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.316+0000 7ffbb8f29640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb4070cd0 con 0x7ffbb415e160 2024-04-17T19:54:00.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.316+0000 7ffbb8f29640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb40d2560 con 0x7ffb9c004810 2024-04-17T19:54:00.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.316+0000 7ffbb8f29640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7ffbb4070e50 con 0x7ffbb415a0a0 2024-04-17T19:54:00.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.316+0000 7ffbb2d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffbb415e160 0x7ffbb415e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:00.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.316+0000 7ffbb2d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffbb415e160 0x7ffbb415e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49180/0 (socket says 172.21.15.18:49180) 2024-04-17T19:54:00.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.316+0000 7ffbb2d9d640 1 -- 172.21.15.18:0/2845468221 learned_addr learned my addr 172.21.15.18:0/2845468221 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:00.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.316+0000 7ffbb259c640 1 --2- 172.21.15.18:0/2845468221 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffb9c004810 0x7ffbb4152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:00.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.316+0000 7ffbb2d9d640 1 -- 172.21.15.18:0/2845468221 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffbb415a0a0 msgr2=0x7ffbb40b3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:00.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.316+0000 7ffbb2d9d640 1 --2- 172.21.15.18:0/2845468221 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffbb415a0a0 0x7ffbb40b3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:00.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.316+0000 7ffbb2d9d640 1 -- 172.21.15.18:0/2845468221 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffb9c004810 msgr2=0x7ffbb4152ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:00.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.316+0000 7ffbb2d9d640 1 --2- 172.21.15.18:0/2845468221 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffb9c004810 0x7ffbb4152ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:00.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.316+0000 7ffbb2d9d640 1 -- 172.21.15.18:0/2845468221 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbb40cacd0 con 0x7ffbb415e160 2024-04-17T19:54:00.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.316+0000 7ffbb2d9d640 1 --2- 172.21.15.18:0/2845468221 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffbb415e160 0x7ffbb415e570 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ffbb40d0740 tx=0x7ffbac0115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:00.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.316+0000 7ffba2ffd640 1 -- 172.21.15.18:0/2845468221 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbac011e10 con 0x7ffbb415e160 2024-04-17T19:54:00.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.316+0000 7ffba2ffd640 1 -- 172.21.15.18:0/2845468221 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbac01b070 con 0x7ffbb415e160 2024-04-17T19:54:00.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.316+0000 7ffbb8f29640 1 -- 172.21.15.18:0/2845468221 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbb40b48d0 con 0x7ffbb415e160 2024-04-17T19:54:00.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.320+0000 7ffba2ffd640 1 -- 172.21.15.18:0/2845468221 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbac0039a0 con 0x7ffbb415e160 2024-04-17T19:54:00.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.320+0000 7ffbb8f29640 1 -- 172.21.15.18:0/2845468221 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbb40b4e90 con 0x7ffbb415e160 2024-04-17T19:54:00.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.320+0000 7ffbb8f29640 1 -- 172.21.15.18:0/2845468221 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbb40caa40 con 0x7ffbb415e160 2024-04-17T19:54:00.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.320+0000 7ffba2ffd640 1 -- 172.21.15.18:0/2845468221 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ffbac003b40 con 0x7ffbb415e160 2024-04-17T19:54:00.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.320+0000 7ffba2ffd640 1 --2- 172.21.15.18:0/2845468221 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7ffb94068380 0x7ffb9406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:00.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.320+0000 7ffbb259c640 1 --2- 172.21.15.18:0/2845468221 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7ffb94068380 0x7ffb9406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:00.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.320+0000 7ffba2ffd640 1 -- 172.21.15.18:0/2845468221 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7ffbac087730 con 0x7ffbb415e160 2024-04-17T19:54:00.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.320+0000 7ffbb259c640 1 --2- 172.21.15.18:0/2845468221 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7ffb94068380 0x7ffb9406a890 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ffba40015a0 tx=0x7ffba4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:00.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.324+0000 7ffba2ffd640 1 -- 172.21.15.18:0/2845468221 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ffbac0577f0 con 0x7ffbb415e160 2024-04-17T19:54:00.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.492+0000 7ffbb8f29640 1 -- 172.21.15.18:0/2845468221 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ffbb4069950 con 0x7ffbb415e160 2024-04-17T19:54:00.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.496+0000 7ffba2ffd640 1 -- 172.21.15.18:0/2845468221 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7ffbac0570f0 con 0x7ffbb415e160 2024-04-17T19:54:00.493 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-17T19:54:00.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.496+0000 7ffbb8f29640 1 -- 172.21.15.18:0/2845468221 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7ffb94068380 msgr2=0x7ffb9406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:00.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.496+0000 7ffbb8f29640 1 --2- 172.21.15.18:0/2845468221 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7ffb94068380 0x7ffb9406a890 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ffba40015a0 tx=0x7ffba4009040 comp rx=0 tx=0).stop 2024-04-17T19:54:00.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.496+0000 7ffbb8f29640 1 -- 172.21.15.18:0/2845468221 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffbb415e160 msgr2=0x7ffbb415e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:00.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.496+0000 7ffbb8f29640 1 --2- 172.21.15.18:0/2845468221 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffbb415e160 0x7ffbb415e570 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ffbb40d0740 tx=0x7ffbac0115a0 comp rx=0 tx=0).stop 2024-04-17T19:54:00.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.496+0000 7ffbb8f29640 1 -- 172.21.15.18:0/2845468221 shutdown_connections 2024-04-17T19:54:00.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.496+0000 7ffbb8f29640 1 --2- 172.21.15.18:0/2845468221 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7ffb94068380 0x7ffb9406a890 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:00.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.496+0000 7ffbb8f29640 1 --2- 172.21.15.18:0/2845468221 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffbb415e160 0x7ffbb415e570 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:00.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.496+0000 7ffbb8f29640 1 --2- 172.21.15.18:0/2845468221 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffbb415a0a0 0x7ffbb40b3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:00.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.496+0000 7ffbb8f29640 1 --2- 172.21.15.18:0/2845468221 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffb9c004810 0x7ffbb4152ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:00.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.496+0000 7ffbb8f29640 1 -- 172.21.15.18:0/2845468221 >> 172.21.15.18:0/2845468221 conn(0x7ffbb40d2bf0 msgr2=0x7ffbb40c9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:00.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.496+0000 7ffbb8f29640 1 -- 172.21.15.18:0/2845468221 shutdown_connections 2024-04-17T19:54:00.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.496+0000 7ffbb8f29640 1 -- 172.21.15.18:0/2845468221 wait complete. 2024-04-17T19:54:00.516 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-17T19:54:00.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.676+0000 7f05f0a6d640 1 Processor -- start 2024-04-17T19:54:00.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.676+0000 7f05f0a6d640 1 -- start start 2024-04-17T19:54:00.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.680+0000 7f05f0a6d640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05ec0d16b0 0x7f05ec15d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:00.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.680+0000 7f05f0a6d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f05ec070cd0 0x7f05ec0710e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:00.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.680+0000 7f05f0a6d640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05ec071620 con 0x7f05ec0cd570 2024-04-17T19:54:00.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.680+0000 7f05f0a6d640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f05ec0b61a0 con 0x7f05ec070cd0 2024-04-17T19:54:00.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.680+0000 7f05f0a6d640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f05ec0d1cc0 con 0x7f05ec0d16b0 2024-04-17T19:54:00.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.680+0000 7f05e9d9b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f05ec070cd0 0x7f05ec0710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:00.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.680+0000 7f05ead9d640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f05ec0cd570 0x7f05ec0cd980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:51118/0 (socket says 172.21.15.18:51118) 2024-04-17T19:54:00.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.680+0000 7f05ead9d640 1 -- 172.21.15.18:0/150661722 learned_addr learned my addr 172.21.15.18:0/150661722 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:54:00.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.680+0000 7f05ea59c640 1 --2- 172.21.15.18:0/150661722 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05ec0d16b0 0x7f05ec15d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:00.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.680+0000 7f05e9d9b640 1 -- 172.21.15.18:0/150661722 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05ec0d16b0 msgr2=0x7f05ec15d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:00.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.680+0000 7f05e9d9b640 1 --2- 172.21.15.18:0/150661722 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05ec0d16b0 0x7f05ec15d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:00.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.680+0000 7f05e9d9b640 1 -- 172.21.15.18:0/150661722 >> v1:172.21.15.18:6789/0 conn(0x7f05ec0cd570 legacy=0x7f05ec0cd980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:00.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.680+0000 7f05e9d9b640 1 -- 172.21.15.18:0/150661722 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05ec0d1fa0 con 0x7f05ec070cd0 2024-04-17T19:54:00.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.680+0000 7f05e959a640 1 -- 172.21.15.18:0/150661722 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2080896414 0 0) 0x7f05e40014a0 con 0x7f05ec0cd570 2024-04-17T19:54:00.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.684+0000 7f05e9d9b640 1 --2- 172.21.15.18:0/150661722 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05ec070cd0 0x7f05ec0710e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f05e00097c0 tx=0x7f05e001ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f06aca8c24a8075 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:00.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.684+0000 7f05e959a640 1 -- 172.21.15.18:0/150661722 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e00b5070 con 0x7f05ec070cd0 2024-04-17T19:54:00.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.684+0000 7f05e959a640 1 -- 172.21.15.18:0/150661722 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05e00a8990 con 0x7f05ec070cd0 2024-04-17T19:54:00.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.684+0000 7f05e959a640 1 -- 172.21.15.18:0/150661722 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e00a8d60 con 0x7f05ec070cd0 2024-04-17T19:54:00.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.684+0000 7f05f0a6d640 1 -- 172.21.15.18:0/150661722 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05ec070cd0 msgr2=0x7f05ec0710e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:00.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.684+0000 7f05f0a6d640 1 --2- 172.21.15.18:0/150661722 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05ec070cd0 0x7f05ec0710e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f05e00097c0 tx=0x7f05e001ec90 comp rx=0 tx=0).stop 2024-04-17T19:54:00.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.684+0000 7f05f0a6d640 1 -- 172.21.15.18:0/150661722 shutdown_connections 2024-04-17T19:54:00.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.684+0000 7f05f0a6d640 1 --2- 172.21.15.18:0/150661722 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05ec070cd0 0x7f05ec0710e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:00.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.684+0000 7f05f0a6d640 1 --2- 172.21.15.18:0/150661722 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05ec0d16b0 0x7f05ec15d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:00.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.684+0000 7f05f0a6d640 1 -- 172.21.15.18:0/150661722 >> 172.21.15.18:0/150661722 conn(0x7f05ec0d2bf0 msgr2=0x7f05ec0d3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:00.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.684+0000 7f05f0a6d640 1 -- 172.21.15.18:0/150661722 shutdown_connections 2024-04-17T19:54:00.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.684+0000 7f05f0a6d640 1 -- 172.21.15.18:0/150661722 wait complete. 2024-04-17T19:54:00.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.684+0000 7f05f0a6d640 1 Processor -- start 2024-04-17T19:54:00.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.684+0000 7f05f0a6d640 1 -- start start 2024-04-17T19:54:00.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.688+0000 7f05f0a6d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05ec070cd0 0x7f05ec1e70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:00.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.688+0000 7f05f0a6d640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05ec0cd570 0x7f05ec1e5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:00.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.688+0000 7f05f0a6d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05ec0d16b0 0x7f05ec1e3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:00.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.688+0000 7f05f0a6d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f05ec0d2560 con 0x7f05ec0d16b0 2024-04-17T19:54:00.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.688+0000 7f05f0a6d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f05ec0d3a80 con 0x7f05ec070cd0 2024-04-17T19:54:00.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.688+0000 7f05f0a6d640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f05ec0b7690 con 0x7f05ec0cd570 2024-04-17T19:54:00.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.688+0000 7f05ead9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05ec0d16b0 0x7f05ec1e3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:00.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.688+0000 7f05ead9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05ec0d16b0 0x7f05ec1e3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49194/0 (socket says 172.21.15.18:49194) 2024-04-17T19:54:00.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.688+0000 7f05ead9d640 1 -- 172.21.15.18:0/747680287 learned_addr learned my addr 172.21.15.18:0/747680287 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:00.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.688+0000 7f05ea59c640 1 --2- 172.21.15.18:0/747680287 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05ec070cd0 0x7f05ec1e70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:00.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.688+0000 7f05e9d9b640 1 --2- 172.21.15.18:0/747680287 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05ec0cd570 0x7f05ec1e5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:00.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.688+0000 7f05ead9d640 1 -- 172.21.15.18:0/747680287 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05ec0cd570 msgr2=0x7f05ec1e5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:00.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.688+0000 7f05ead9d640 1 --2- 172.21.15.18:0/747680287 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05ec0cd570 0x7f05ec1e5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:00.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.688+0000 7f05ead9d640 1 -- 172.21.15.18:0/747680287 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05ec070cd0 msgr2=0x7f05ec1e70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:00.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.688+0000 7f05ead9d640 1 --2- 172.21.15.18:0/747680287 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05ec070cd0 0x7f05ec1e70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:00.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.688+0000 7f05ead9d640 1 -- 172.21.15.18:0/747680287 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05ec1e4280 con 0x7f05ec0d16b0 2024-04-17T19:54:00.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.688+0000 7f05ead9d640 1 --2- 172.21.15.18:0/747680287 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05ec0d16b0 0x7f05ec1e3d40 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f05e400c6a0 tx=0x7f05e400cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:00.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.688+0000 7f05daffd640 1 -- 172.21.15.18:0/747680287 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e4018070 con 0x7f05ec0d16b0 2024-04-17T19:54:00.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.688+0000 7f05daffd640 1 -- 172.21.15.18:0/747680287 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05e4004d70 con 0x7f05ec0d16b0 2024-04-17T19:54:00.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.688+0000 7f05f0a6d640 1 -- 172.21.15.18:0/747680287 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05ec1e79b0 con 0x7f05ec0d16b0 2024-04-17T19:54:00.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.688+0000 7f05daffd640 1 -- 172.21.15.18:0/747680287 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e400a880 con 0x7f05ec0d16b0 2024-04-17T19:54:00.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.688+0000 7f05f0a6d640 1 -- 172.21.15.18:0/747680287 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05ec1e5370 con 0x7f05ec0d16b0 2024-04-17T19:54:00.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.688+0000 7f05f0a6d640 1 -- 172.21.15.18:0/747680287 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05ec1e7720 con 0x7f05ec0d16b0 2024-04-17T19:54:00.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.688+0000 7f05daffd640 1 -- 172.21.15.18:0/747680287 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f05e401b070 con 0x7f05ec0d16b0 2024-04-17T19:54:00.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.688+0000 7f05daffd640 1 --2- 172.21.15.18:0/747680287 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f05cc0683b0 0x7f05cc06a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:00.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.692+0000 7f05daffd640 1 -- 172.21.15.18:0/747680287 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7f05e40861c0 con 0x7f05ec0d16b0 2024-04-17T19:54:00.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.692+0000 7f05ea59c640 1 --2- 172.21.15.18:0/747680287 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f05cc0683b0 0x7f05cc06a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:00.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.692+0000 7f05ea59c640 1 --2- 172.21.15.18:0/747680287 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f05cc0683b0 0x7f05cc06a8c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f05dc00b930 tx=0x7f05dc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:00.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.696+0000 7f05daffd640 1 -- 172.21.15.18:0/747680287 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f05ec1e4280 con 0x7f05ec0d16b0 2024-04-17T19:54:00.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.856+0000 7f05f0a6d640 1 -- 172.21.15.18:0/747680287 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f05ec1e7ed0 con 0x7f05ec0d16b0 2024-04-17T19:54:00.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.856+0000 7f05daffd640 1 -- 172.21.15.18:0/747680287 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7f05ec1e7ed0 con 0x7f05ec0d16b0 2024-04-17T19:54:00.856 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-17T19:54:00.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.860+0000 7f05f0a6d640 1 -- 172.21.15.18:0/747680287 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f05cc0683b0 msgr2=0x7f05cc06a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:00.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.860+0000 7f05f0a6d640 1 --2- 172.21.15.18:0/747680287 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f05cc0683b0 0x7f05cc06a8c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f05dc00b930 tx=0x7f05dc008040 comp rx=0 tx=0).stop 2024-04-17T19:54:00.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.860+0000 7f05f0a6d640 1 -- 172.21.15.18:0/747680287 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05ec0d16b0 msgr2=0x7f05ec1e3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:00.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.860+0000 7f05f0a6d640 1 --2- 172.21.15.18:0/747680287 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05ec0d16b0 0x7f05ec1e3d40 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f05e400c6a0 tx=0x7f05e400cb60 comp rx=0 tx=0).stop 2024-04-17T19:54:00.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.860+0000 7f05f0a6d640 1 -- 172.21.15.18:0/747680287 shutdown_connections 2024-04-17T19:54:00.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.860+0000 7f05f0a6d640 1 --2- 172.21.15.18:0/747680287 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f05cc0683b0 0x7f05cc06a8c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:00.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.860+0000 7f05f0a6d640 1 --2- 172.21.15.18:0/747680287 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f05ec0d16b0 0x7f05ec1e3d40 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:00.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.860+0000 7f05f0a6d640 1 --2- 172.21.15.18:0/747680287 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05ec0cd570 0x7f05ec1e5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:00.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.860+0000 7f05f0a6d640 1 --2- 172.21.15.18:0/747680287 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05ec070cd0 0x7f05ec1e70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:00.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.860+0000 7f05f0a6d640 1 -- 172.21.15.18:0/747680287 >> 172.21.15.18:0/747680287 conn(0x7f05ec0d2bf0 msgr2=0x7f05ec15c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:00.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.860+0000 7f05f0a6d640 1 -- 172.21.15.18:0/747680287 shutdown_connections 2024-04-17T19:54:00.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:00.860+0000 7f05f0a6d640 1 -- 172.21.15.18:0/747680287 wait complete. 2024-04-17T19:54:00.879 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-17T19:54:01.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.028+0000 7fc948ebe640 1 Processor -- start 2024-04-17T19:54:01.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.028+0000 7fc948ebe640 1 -- start start 2024-04-17T19:54:01.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.028+0000 7fc948ebe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc94415e910 0x7fc94415ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:01.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.028+0000 7fc948ebe640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc94406cd60 0x7fc94406d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:01.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.028+0000 7fc948ebe640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc94406d6b0 con 0x7fc94415e1a0 2024-04-17T19:54:01.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.028+0000 7fc948ebe640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fc9440d0020 con 0x7fc94415e910 2024-04-17T19:54:01.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.028+0000 7fc948ebe640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7fc9440cd930 con 0x7fc94406cd60 2024-04-17T19:54:01.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.028+0000 7fc941d9b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc94415e910 0x7fc94415ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:01.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.028+0000 7fc94259c640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fc94415e1a0 0x7fc9440ce9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:51124/0 (socket says 172.21.15.18:51124) 2024-04-17T19:54:01.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.028+0000 7fc941d9b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc94415e910 0x7fc94415ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49196/0 (socket says 172.21.15.18:49196) 2024-04-17T19:54:01.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.028+0000 7fc94259c640 1 -- 172.21.15.18:0/1724945794 learned_addr learned my addr 172.21.15.18:0/1724945794 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:54:01.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.028+0000 7fc942d9d640 1 --2- 172.21.15.18:0/1724945794 >> v2:172.21.15.173:3300/0 conn(0x7fc94406cd60 0x7fc94406d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:01.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.028+0000 7fc941d9b640 1 -- 172.21.15.18:0/1724945794 >> v2:172.21.15.173:3300/0 conn(0x7fc94406cd60 msgr2=0x7fc94406d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:01.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.028+0000 7fc941d9b640 1 --2- 172.21.15.18:0/1724945794 >> v2:172.21.15.173:3300/0 conn(0x7fc94406cd60 0x7fc94406d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:01.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.028+0000 7fc941d9b640 1 -- 172.21.15.18:0/1724945794 >> v1:172.21.15.18:6789/0 conn(0x7fc94415e1a0 legacy=0x7fc9440ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:01.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.028+0000 7fc941d9b640 1 -- 172.21.15.18:0/1724945794 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9440cdc10 con 0x7fc94415e910 2024-04-17T19:54:01.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.028+0000 7fc94159a640 1 -- 172.21.15.18:0/1724945794 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 539480992 0 0) 0x7fc934001120 con 0x7fc94415e1a0 2024-04-17T19:54:01.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.032+0000 7fc941d9b640 1 --2- 172.21.15.18:0/1724945794 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc94415e910 0x7fc94415ed20 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc9440d0a00 tx=0x7fc93801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26424b3efbaba7c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:01.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.032+0000 7fc94159a640 1 -- 172.21.15.18:0/1724945794 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9380b0070 con 0x7fc94415e910 2024-04-17T19:54:01.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.032+0000 7fc94159a640 1 -- 172.21.15.18:0/1724945794 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9380ab600 con 0x7fc94415e910 2024-04-17T19:54:01.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.032+0000 7fc94159a640 1 -- 172.21.15.18:0/1724945794 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9380ab9d0 con 0x7fc94415e910 2024-04-17T19:54:01.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.032+0000 7fc948ebe640 1 -- 172.21.15.18:0/1724945794 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc94415e910 msgr2=0x7fc94415ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:01.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.032+0000 7fc948ebe640 1 --2- 172.21.15.18:0/1724945794 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc94415e910 0x7fc94415ed20 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc9440d0a00 tx=0x7fc93801c3f0 comp rx=0 tx=0).stop 2024-04-17T19:54:01.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.032+0000 7fc948ebe640 1 -- 172.21.15.18:0/1724945794 shutdown_connections 2024-04-17T19:54:01.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.032+0000 7fc948ebe640 1 --2- 172.21.15.18:0/1724945794 >> v2:172.21.15.173:3300/0 conn(0x7fc94406cd60 0x7fc94406d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:01.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.032+0000 7fc948ebe640 1 --2- 172.21.15.18:0/1724945794 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc94415e910 0x7fc94415ed20 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:01.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.032+0000 7fc948ebe640 1 -- 172.21.15.18:0/1724945794 >> 172.21.15.18:0/1724945794 conn(0x7fc944072bb0 msgr2=0x7fc944072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:01.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.032+0000 7fc948ebe640 1 -- 172.21.15.18:0/1724945794 shutdown_connections 2024-04-17T19:54:01.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.032+0000 7fc948ebe640 1 -- 172.21.15.18:0/1724945794 wait complete. 2024-04-17T19:54:01.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.036+0000 7fc948ebe640 1 Processor -- start 2024-04-17T19:54:01.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.036+0000 7fc948ebe640 1 -- start start 2024-04-17T19:54:01.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.036+0000 7fc948ebe640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc94406cd60 0x7fc9441fc890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:01.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.036+0000 7fc948ebe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc94415e1a0 0x7fc94414ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:01.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.036+0000 7fc948ebe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc9440ab0e0 0x7fc9440b4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:01.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.036+0000 7fc948ebe640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc94415e730 con 0x7fc94415e1a0 2024-04-17T19:54:01.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.036+0000 7fc948ebe640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc94415e5b0 con 0x7fc9440ab0e0 2024-04-17T19:54:01.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.036+0000 7fc948ebe640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fc9440cf0e0 con 0x7fc94406cd60 2024-04-17T19:54:01.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.036+0000 7fc941d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc94415e1a0 0x7fc94414ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:01.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.036+0000 7fc941d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc94415e1a0 0x7fc94414ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49204/0 (socket says 172.21.15.18:49204) 2024-04-17T19:54:01.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.036+0000 7fc941d9b640 1 -- 172.21.15.18:0/2384260003 learned_addr learned my addr 172.21.15.18:0/2384260003 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:01.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.036+0000 7fc941d9b640 1 -- 172.21.15.18:0/2384260003 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc94406cd60 msgr2=0x7fc9441fc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:01.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.036+0000 7fc941d9b640 1 --2- 172.21.15.18:0/2384260003 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc94406cd60 0x7fc9441fc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:01.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.036+0000 7fc941d9b640 1 -- 172.21.15.18:0/2384260003 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc9440ab0e0 msgr2=0x7fc9440b4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:01.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.036+0000 7fc941d9b640 1 --2- 172.21.15.18:0/2384260003 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc9440ab0e0 0x7fc9440b4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:01.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.036+0000 7fc941d9b640 1 -- 172.21.15.18:0/2384260003 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9440aa040 con 0x7fc94415e1a0 2024-04-17T19:54:01.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.036+0000 7fc941d9b640 1 --2- 172.21.15.18:0/2384260003 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc94415e1a0 0x7fc94414ef40 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc9380ae040 tx=0x7fc93801ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:01.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.036+0000 7fc932ffd640 1 -- 172.21.15.18:0/2384260003 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9380b0050 con 0x7fc94415e1a0 2024-04-17T19:54:01.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.036+0000 7fc932ffd640 1 -- 172.21.15.18:0/2384260003 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9380bc070 con 0x7fc94415e1a0 2024-04-17T19:54:01.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.036+0000 7fc948ebe640 1 -- 172.21.15.18:0/2384260003 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9440aa320 con 0x7fc94415e1a0 2024-04-17T19:54:01.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.036+0000 7fc932ffd640 1 -- 172.21.15.18:0/2384260003 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9380b5830 con 0x7fc94415e1a0 2024-04-17T19:54:01.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.036+0000 7fc948ebe640 1 -- 172.21.15.18:0/2384260003 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9440aa8e0 con 0x7fc94415e1a0 2024-04-17T19:54:01.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.036+0000 7fc948ebe640 1 -- 172.21.15.18:0/2384260003 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc944069950 con 0x7fc94415e1a0 2024-04-17T19:54:01.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.036+0000 7fc932ffd640 1 -- 172.21.15.18:0/2384260003 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc9380b59d0 con 0x7fc94415e1a0 2024-04-17T19:54:01.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.040+0000 7fc932ffd640 1 --2- 172.21.15.18:0/2384260003 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fc9240683b0 0x7fc92406a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:01.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.040+0000 7fc94259c640 1 --2- 172.21.15.18:0/2384260003 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fc9240683b0 0x7fc92406a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:01.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.040+0000 7fc932ffd640 1 -- 172.21.15.18:0/2384260003 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7fc938121470 con 0x7fc94415e1a0 2024-04-17T19:54:01.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.040+0000 7fc94259c640 1 --2- 172.21.15.18:0/2384260003 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fc9240683b0 0x7fc92406a8c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc9440b5f30 tx=0x7fc934007970 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:01.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.044+0000 7fc932ffd640 1 -- 172.21.15.18:0/2384260003 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc938016070 con 0x7fc94415e1a0 2024-04-17T19:54:01.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.200+0000 7fc948ebe640 1 -- 172.21.15.18:0/2384260003 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fc9440ce9d0 con 0x7fc94415e1a0 2024-04-17T19:54:01.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.204+0000 7fc932ffd640 1 -- 172.21.15.18:0/2384260003 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7fc9380f15d0 con 0x7fc94415e1a0 2024-04-17T19:54:01.201 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-17T19:54:01.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.204+0000 7fc948ebe640 1 -- 172.21.15.18:0/2384260003 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fc9240683b0 msgr2=0x7fc92406a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:01.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.204+0000 7fc948ebe640 1 --2- 172.21.15.18:0/2384260003 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fc9240683b0 0x7fc92406a8c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc9440b5f30 tx=0x7fc934007970 comp rx=0 tx=0).stop 2024-04-17T19:54:01.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.204+0000 7fc948ebe640 1 -- 172.21.15.18:0/2384260003 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc94415e1a0 msgr2=0x7fc94414ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:01.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.204+0000 7fc948ebe640 1 --2- 172.21.15.18:0/2384260003 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc94415e1a0 0x7fc94414ef40 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc9380ae040 tx=0x7fc93801ac30 comp rx=0 tx=0).stop 2024-04-17T19:54:01.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.204+0000 7fc948ebe640 1 -- 172.21.15.18:0/2384260003 shutdown_connections 2024-04-17T19:54:01.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.204+0000 7fc948ebe640 1 --2- 172.21.15.18:0/2384260003 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fc9240683b0 0x7fc92406a8c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:01.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.204+0000 7fc948ebe640 1 --2- 172.21.15.18:0/2384260003 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc9440ab0e0 0x7fc9440b4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:01.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.204+0000 7fc948ebe640 1 --2- 172.21.15.18:0/2384260003 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc94415e1a0 0x7fc94414ef40 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:01.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.204+0000 7fc948ebe640 1 --2- 172.21.15.18:0/2384260003 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc94406cd60 0x7fc9441fc890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:01.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.204+0000 7fc948ebe640 1 -- 172.21.15.18:0/2384260003 >> 172.21.15.18:0/2384260003 conn(0x7fc944072bb0 msgr2=0x7fc9440b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:01.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.204+0000 7fc948ebe640 1 -- 172.21.15.18:0/2384260003 shutdown_connections 2024-04-17T19:54:01.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.204+0000 7fc948ebe640 1 -- 172.21.15.18:0/2384260003 wait complete. 2024-04-17T19:54:01.223 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-17T19:54:01.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.364+0000 7f88c4cfe640 1 Processor -- start 2024-04-17T19:54:01.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.364+0000 7f88c4cfe640 1 -- start start 2024-04-17T19:54:01.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.368+0000 7f88c4cfe640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f88c015e1a0 0x7f88c00ce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:01.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.368+0000 7f88c4cfe640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88c00d0020 con 0x7f88c00cef10 2024-04-17T19:54:01.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.368+0000 7f88c4cfe640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88c00cd930 con 0x7f88c006cd60 2024-04-17T19:54:01.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.368+0000 7f88c4cfe640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f88c00cdc10 con 0x7f88c015e1a0 2024-04-17T19:54:01.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.368+0000 7f88bdd9b640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f88c00cef10 0x7f88c015e910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:51128/0 (socket says 172.21.15.18:51128) 2024-04-17T19:54:01.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.368+0000 7f88bdd9b640 1 -- 172.21.15.18:0/176660941 learned_addr learned my addr 172.21.15.18:0/176660941 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:54:01.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.368+0000 7f88be59c640 1 --2- 172.21.15.18:0/176660941 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f88c015e1a0 0x7f88c00ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:01.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.368+0000 7f88bd59a640 1 -- 172.21.15.18:0/176660941 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3135817420 0 0) 0x7f88c00d0020 con 0x7f88c00cef10 2024-04-17T19:54:01.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.368+0000 7f88bd59a640 1 -- 172.21.15.18:0/176660941 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f88a8003530 con 0x7f88c00cef10 2024-04-17T19:54:01.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.368+0000 7f88bd59a640 1 -- 172.21.15.18:0/176660941 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 323961785 0 0) 0x7f88a8003530 con 0x7f88c00cef10 2024-04-17T19:54:01.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.368+0000 7f88bd59a640 1 -- 172.21.15.18:0/176660941 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f88c015e1a0 msgr2=0x7f88c00ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:01.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.368+0000 7f88bd59a640 1 --2- 172.21.15.18:0/176660941 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f88c015e1a0 0x7f88c00ce9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:01.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.368+0000 7f88bd59a640 1 -- 172.21.15.18:0/176660941 >> v1:172.21.15.173:6789/0 conn(0x7f88c006cd60 legacy=0x7f88c006d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:01.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.368+0000 7f88bd59a640 1 -- 172.21.15.18:0/176660941 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88c00cdef0 con 0x7f88c00cef10 2024-04-17T19:54:01.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.368+0000 7f88bd59a640 1 -- 172.21.15.18:0/176660941 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3208559991 0 0) 0x7f88b4001680 con 0x7f88c00cef10 2024-04-17T19:54:01.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.368+0000 7f88bd59a640 1 -- 172.21.15.18:0/176660941 >> v1:172.21.15.18:6789/0 conn(0x7f88c00cef10 legacy=0x7f88c015e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:01.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.368+0000 7f88bd59a640 1 --2- 172.21.15.18:0/176660941 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f88c015e1a0 0x7f88a80039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:01.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.368+0000 7f88bd59a640 1 --2- 172.21.15.18:0/176660941 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88a8003f70 0x7f88a8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:01.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.368+0000 7f88bd59a640 1 --2- 172.21.15.18:0/176660941 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88a8004d50 0x7f88a8005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:01.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.368+0000 7f88bd59a640 1 -- 172.21.15.18:0/176660941 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f88c00cdc10 con 0x7f88a8004d50 2024-04-17T19:54:01.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.368+0000 7f88bd59a640 1 -- 172.21.15.18:0/176660941 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f88a800bc10 con 0x7f88a8003f70 2024-04-17T19:54:01.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.368+0000 7f88bd59a640 1 -- 172.21.15.18:0/176660941 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f88a800be10 con 0x7f88c015e1a0 2024-04-17T19:54:01.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.368+0000 7f88bed9d640 1 --2- 172.21.15.18:0/176660941 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88a8004d50 0x7f88a8005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:01.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.368+0000 7f88bdd9b640 1 --2- 172.21.15.18:0/176660941 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88a8003f70 0x7f88a8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:01.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.368+0000 7f88be59c640 1 --2- 172.21.15.18:0/176660941 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f88c015e1a0 0x7f88a80039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:01.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.368+0000 7f88bed9d640 1 -- 172.21.15.18:0/176660941 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f88c015e1a0 msgr2=0x7f88a80039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:01.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.368+0000 7f88bed9d640 1 --2- 172.21.15.18:0/176660941 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f88c015e1a0 0x7f88a80039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:01.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.368+0000 7f88bed9d640 1 -- 172.21.15.18:0/176660941 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88a8003f70 msgr2=0x7f88a8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:01.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.368+0000 7f88bed9d640 1 --2- 172.21.15.18:0/176660941 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88a8003f70 0x7f88a8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:01.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.368+0000 7f88bed9d640 1 -- 172.21.15.18:0/176660941 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88a8003530 con 0x7f88a8004d50 2024-04-17T19:54:01.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.368+0000 7f88be59c640 1 --2- 172.21.15.18:0/176660941 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f88c015e1a0 0x7f88a80039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:54:01.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.372+0000 7f88bed9d640 1 --2- 172.21.15.18:0/176660941 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88a8004d50 0x7f88a8005160 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f88b8001e70 tx=0x7f88b801c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f6d91e487567837 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:01.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.372+0000 7f88bd59a640 1 -- 172.21.15.18:0/176660941 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b8001a90 con 0x7f88a8004d50 2024-04-17T19:54:01.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.372+0000 7f88bd59a640 1 -- 172.21.15.18:0/176660941 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88b8003b80 con 0x7f88a8004d50 2024-04-17T19:54:01.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.372+0000 7f88bd59a640 1 -- 172.21.15.18:0/176660941 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b8005080 con 0x7f88a8004d50 2024-04-17T19:54:01.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.372+0000 7f88c4cfe640 1 -- 172.21.15.18:0/176660941 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88a8004d50 msgr2=0x7f88a8005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:01.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.372+0000 7f88c4cfe640 1 --2- 172.21.15.18:0/176660941 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88a8004d50 0x7f88a8005160 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f88b8001e70 tx=0x7f88b801c780 comp rx=0 tx=0).stop 2024-04-17T19:54:01.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.372+0000 7f88bed9d640 1 -- 172.21.15.18:0/176660941 reap_dead start 2024-04-17T19:54:01.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.372+0000 7f88c4cfe640 1 -- 172.21.15.18:0/176660941 shutdown_connections 2024-04-17T19:54:01.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.372+0000 7f88c4cfe640 1 -- 172.21.15.18:0/176660941 >> 172.21.15.18:0/176660941 conn(0x7f88c0072bb0 msgr2=0x7f88c0072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:01.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.372+0000 7f88c4cfe640 1 -- 172.21.15.18:0/176660941 shutdown_connections 2024-04-17T19:54:01.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.372+0000 7f88c4cfe640 1 -- 172.21.15.18:0/176660941 wait complete. 2024-04-17T19:54:01.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.372+0000 7f88c4cfe640 1 Processor -- start 2024-04-17T19:54:01.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.372+0000 7f88c4cfe640 1 -- start start 2024-04-17T19:54:01.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.376+0000 7f88c4cfe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88a8004d50 0x7f88c00aa0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:01.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.376+0000 7f88c4cfe640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f88c015cfa0 0x7f88c0152170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:01.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.376+0000 7f88c4cfe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88c01526b0 0x7f88c0141a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:01.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.376+0000 7f88c4cfe640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f88c015e5b0 con 0x7f88c01526b0 2024-04-17T19:54:01.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.376+0000 7f88c4cfe640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f88c00ce4b0 con 0x7f88a8004d50 2024-04-17T19:54:01.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.376+0000 7f88c4cfe640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f88c015e730 con 0x7f88c015cfa0 2024-04-17T19:54:01.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.376+0000 7f88bed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88c01526b0 0x7f88c0141a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:01.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.376+0000 7f88bed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88c01526b0 0x7f88c0141a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49222/0 (socket says 172.21.15.18:49222) 2024-04-17T19:54:01.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.376+0000 7f88bed9d640 1 -- 172.21.15.18:0/3070192407 learned_addr learned my addr 172.21.15.18:0/3070192407 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:01.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.376+0000 7f88be59c640 1 --2- 172.21.15.18:0/3070192407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88a8004d50 0x7f88c00aa0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:01.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.376+0000 7f88bdd9b640 1 --2- 172.21.15.18:0/3070192407 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f88c015cfa0 0x7f88c0152170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:01.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.376+0000 7f88bed9d640 1 -- 172.21.15.18:0/3070192407 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f88c015cfa0 msgr2=0x7f88c0152170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:01.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.376+0000 7f88bed9d640 1 --2- 172.21.15.18:0/3070192407 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f88c015cfa0 0x7f88c0152170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:01.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.376+0000 7f88bed9d640 1 -- 172.21.15.18:0/3070192407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88a8004d50 msgr2=0x7f88c00aa0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:01.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.376+0000 7f88bed9d640 1 --2- 172.21.15.18:0/3070192407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88a8004d50 0x7f88c00aa0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:01.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.376+0000 7f88bed9d640 1 -- 172.21.15.18:0/3070192407 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88c0152ac0 con 0x7f88c01526b0 2024-04-17T19:54:01.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.376+0000 7f88bdd9b640 1 --2- 172.21.15.18:0/3070192407 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f88c015cfa0 0x7f88c0152170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:54:01.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.376+0000 7f88bed9d640 1 --2- 172.21.15.18:0/3070192407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88c01526b0 0x7f88c0141a70 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f88b8098080 tx=0x7f88a8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:01.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.376+0000 7f88aeffd640 1 -- 172.21.15.18:0/3070192407 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b80bc070 con 0x7f88c01526b0 2024-04-17T19:54:01.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.376+0000 7f88aeffd640 1 -- 172.21.15.18:0/3070192407 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88b8005820 con 0x7f88c01526b0 2024-04-17T19:54:01.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.376+0000 7f88c4cfe640 1 -- 172.21.15.18:0/3070192407 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88c00aa600 con 0x7f88c01526b0 2024-04-17T19:54:01.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.376+0000 7f88aeffd640 1 -- 172.21.15.18:0/3070192407 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b8007dc0 con 0x7f88c01526b0 2024-04-17T19:54:01.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.376+0000 7f88c4cfe640 1 -- 172.21.15.18:0/3070192407 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88c0159410 con 0x7f88c01526b0 2024-04-17T19:54:01.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.376+0000 7f88c4cfe640 1 -- 172.21.15.18:0/3070192407 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88c0069950 con 0x7f88c01526b0 2024-04-17T19:54:01.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.380+0000 7f88aeffd640 1 -- 172.21.15.18:0/3070192407 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f88b80b1040 con 0x7f88c01526b0 2024-04-17T19:54:01.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.380+0000 7f88aeffd640 1 --2- 172.21.15.18:0/3070192407 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f88a00683b0 0x7f88a006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:01.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.380+0000 7f88aeffd640 1 -- 172.21.15.18:0/3070192407 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7f88b8120a40 con 0x7f88c01526b0 2024-04-17T19:54:01.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.380+0000 7f88be59c640 1 --2- 172.21.15.18:0/3070192407 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f88a00683b0 0x7f88a006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:01.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.380+0000 7f88be59c640 1 --2- 172.21.15.18:0/3070192407 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f88a00683b0 0x7f88a006a8c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f88c00b5f30 tx=0x7f88b0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:01.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.384+0000 7f88aeffd640 1 -- 172.21.15.18:0/3070192407 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f88c0152ac0 con 0x7f88c01526b0 2024-04-17T19:54:01.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.556+0000 7f88c4cfe640 1 -- 172.21.15.18:0/3070192407 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f88c006d310 con 0x7f88c01526b0 2024-04-17T19:54:01.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.556+0000 7f88aeffd640 1 -- 172.21.15.18:0/3070192407 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7f88b80ad020 con 0x7f88c01526b0 2024-04-17T19:54:01.555 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-04-17T19:54:01.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.560+0000 7f88c4cfe640 1 -- 172.21.15.18:0/3070192407 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f88a00683b0 msgr2=0x7f88a006a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:01.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.560+0000 7f88c4cfe640 1 --2- 172.21.15.18:0/3070192407 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f88a00683b0 0x7f88a006a8c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f88c00b5f30 tx=0x7f88b0008040 comp rx=0 tx=0).stop 2024-04-17T19:54:01.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.560+0000 7f88c4cfe640 1 -- 172.21.15.18:0/3070192407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88c01526b0 msgr2=0x7f88c0141a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:01.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.560+0000 7f88c4cfe640 1 --2- 172.21.15.18:0/3070192407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88c01526b0 0x7f88c0141a70 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f88b8098080 tx=0x7f88a8005840 comp rx=0 tx=0).stop 2024-04-17T19:54:01.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.560+0000 7f88c4cfe640 1 -- 172.21.15.18:0/3070192407 shutdown_connections 2024-04-17T19:54:01.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.560+0000 7f88c4cfe640 1 --2- 172.21.15.18:0/3070192407 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f88a00683b0 0x7f88a006a8c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:01.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.560+0000 7f88c4cfe640 1 --2- 172.21.15.18:0/3070192407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88c01526b0 0x7f88c0141a70 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:01.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.560+0000 7f88c4cfe640 1 --2- 172.21.15.18:0/3070192407 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f88c015cfa0 0x7f88c0152170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:01.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.560+0000 7f88c4cfe640 1 --2- 172.21.15.18:0/3070192407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f88a8004d50 0x7f88c00aa0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:01.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.560+0000 7f88c4cfe640 1 -- 172.21.15.18:0/3070192407 >> 172.21.15.18:0/3070192407 conn(0x7f88c0072bb0 msgr2=0x7f88c0156ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:01.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.560+0000 7f88c4cfe640 1 -- 172.21.15.18:0/3070192407 shutdown_connections 2024-04-17T19:54:01.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.560+0000 7f88c4cfe640 1 -- 172.21.15.18:0/3070192407 wait complete. 2024-04-17T19:54:01.576 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-17T19:54:01.576 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-17T19:54:01.582 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T19:54:01.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.776+0000 7f4e5ad83640 1 Processor -- start 2024-04-17T19:54:01.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.776+0000 7f4e5ad83640 1 -- start start 2024-04-17T19:54:01.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.776+0000 7f4e5ad83640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4e540cece0 0x7f4e54161500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:01.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.776+0000 7f4e5ad83640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f4e540cf0f0 0x7f4e540b1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:01.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.776+0000 7f4e5ad83640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e540cdc10 con 0x7f4e54161a40 2024-04-17T19:54:01.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.776+0000 7f4e5ad83640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f4e540ce4b0 con 0x7f4e540cf0f0 2024-04-17T19:54:01.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.776+0000 7f4e5ad83640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f4e54161070 con 0x7f4e540cece0 2024-04-17T19:54:01.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.776+0000 7f4e59320640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f4e54161a40 0x7f4e540b6850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:51132/0 (socket says 172.21.15.18:51132) 2024-04-17T19:54:01.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.776+0000 7f4e59320640 1 -- 172.21.15.18:0/2877193640 learned_addr learned my addr 172.21.15.18:0/2877193640 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:54:01.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.776+0000 7f4e58b1f640 1 --2- 172.21.15.18:0/2877193640 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4e540cece0 0x7f4e54161500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:01.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.776+0000 7f4e53fff640 1 --2- 172.21.15.18:0/2877193640 >> v2:172.21.15.173:3300/0 conn(0x7f4e540cf0f0 0x7f4e540b1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:01.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.776+0000 7f4e537fe640 1 -- 172.21.15.18:0/2877193640 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2621592466 0 0) 0x7f4e540cdc10 con 0x7f4e54161a40 2024-04-17T19:54:01.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.776+0000 7f4e537fe640 1 -- 172.21.15.18:0/2877193640 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e40003530 con 0x7f4e54161a40 2024-04-17T19:54:01.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.780+0000 7f4e537fe640 1 -- 172.21.15.18:0/2877193640 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 887657555 0 0) 0x7f4e40003530 con 0x7f4e54161a40 2024-04-17T19:54:01.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.780+0000 7f4e537fe640 1 -- 172.21.15.18:0/2877193640 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4e540cece0 msgr2=0x7f4e54161500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:01.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.780+0000 7f4e537fe640 1 --2- 172.21.15.18:0/2877193640 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4e540cece0 0x7f4e54161500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:01.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.780+0000 7f4e537fe640 1 -- 172.21.15.18:0/2877193640 >> v2:172.21.15.173:3300/0 conn(0x7f4e540cf0f0 msgr2=0x7f4e540b1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:01.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.780+0000 7f4e537fe640 1 --2- 172.21.15.18:0/2877193640 >> v2:172.21.15.173:3300/0 conn(0x7f4e540cf0f0 0x7f4e540b1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:01.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.780+0000 7f4e537fe640 1 -- 172.21.15.18:0/2877193640 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e540cdef0 con 0x7f4e54161a40 2024-04-17T19:54:01.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.780+0000 7f4e537fe640 1 -- 172.21.15.18:0/2877193640 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3208559991 0 0) 0x7f4e44001680 con 0x7f4e54161a40 2024-04-17T19:54:01.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.780+0000 7f4e537fe640 1 -- 172.21.15.18:0/2877193640 >> v1:172.21.15.18:6789/0 conn(0x7f4e54161a40 legacy=0x7f4e540b6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:01.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.780+0000 7f4e537fe640 1 --2- 172.21.15.18:0/2877193640 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e400039c0 0x7f4e40003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:01.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.780+0000 7f4e537fe640 1 --2- 172.21.15.18:0/2877193640 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4e540cece0 0x7f4e40004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:01.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.780+0000 7f4e537fe640 1 --2- 172.21.15.18:0/2877193640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e40004d50 0x7f4e40005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:01.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.780+0000 7f4e537fe640 1 -- 172.21.15.18:0/2877193640 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4e4000b9d0 con 0x7f4e40004d50 2024-04-17T19:54:01.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.780+0000 7f4e537fe640 1 -- 172.21.15.18:0/2877193640 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4e4000bb50 con 0x7f4e400039c0 2024-04-17T19:54:01.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.780+0000 7f4e537fe640 1 -- 172.21.15.18:0/2877193640 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f4e4000bcd0 con 0x7f4e540cece0 2024-04-17T19:54:01.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.780+0000 7f4e59320640 1 --2- 172.21.15.18:0/2877193640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e40004d50 0x7f4e40005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:01.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.780+0000 7f4e53fff640 1 --2- 172.21.15.18:0/2877193640 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4e540cece0 0x7f4e40004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:01.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.780+0000 7f4e58b1f640 1 --2- 172.21.15.18:0/2877193640 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e400039c0 0x7f4e40003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:01.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.780+0000 7f4e59320640 1 -- 172.21.15.18:0/2877193640 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4e540cece0 msgr2=0x7f4e40004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:01.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.780+0000 7f4e59320640 1 --2- 172.21.15.18:0/2877193640 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4e540cece0 0x7f4e40004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:01.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.780+0000 7f4e59320640 1 -- 172.21.15.18:0/2877193640 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e400039c0 msgr2=0x7f4e40003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:01.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.780+0000 7f4e59320640 1 --2- 172.21.15.18:0/2877193640 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e400039c0 0x7f4e40003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:01.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.780+0000 7f4e59320640 1 -- 172.21.15.18:0/2877193640 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e40003530 con 0x7f4e40004d50 2024-04-17T19:54:01.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.780+0000 7f4e58b1f640 1 --2- 172.21.15.18:0/2877193640 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e400039c0 0x7f4e40003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:54:01.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.780+0000 7f4e59320640 1 --2- 172.21.15.18:0/2877193640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e40004d50 0x7f4e40005160 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4e44001060 tx=0x7f4e4401cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c39e41ca876cfd2e server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:01.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.780+0000 7f4e537fe640 1 -- 172.21.15.18:0/2877193640 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e44007d80 con 0x7f4e40004d50 2024-04-17T19:54:01.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.780+0000 7f4e537fe640 1 -- 172.21.15.18:0/2877193640 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e440a9020 con 0x7f4e40004d50 2024-04-17T19:54:01.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.780+0000 7f4e537fe640 1 -- 172.21.15.18:0/2877193640 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e440a5b60 con 0x7f4e40004d50 2024-04-17T19:54:01.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.780+0000 7f4e5ad83640 1 -- 172.21.15.18:0/2877193640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e40004d50 msgr2=0x7f4e40005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:01.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.780+0000 7f4e5ad83640 1 --2- 172.21.15.18:0/2877193640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e40004d50 0x7f4e40005160 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4e44001060 tx=0x7f4e4401cc40 comp rx=0 tx=0).stop 2024-04-17T19:54:01.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.780+0000 7f4e59320640 1 -- 172.21.15.18:0/2877193640 reap_dead start 2024-04-17T19:54:01.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.780+0000 7f4e5ad83640 1 -- 172.21.15.18:0/2877193640 shutdown_connections 2024-04-17T19:54:01.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.780+0000 7f4e5ad83640 1 -- 172.21.15.18:0/2877193640 >> 172.21.15.18:0/2877193640 conn(0x7f4e5409aa70 msgr2=0x7f4e5409ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:01.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.780+0000 7f4e5ad83640 1 -- 172.21.15.18:0/2877193640 shutdown_connections 2024-04-17T19:54:01.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.780+0000 7f4e5ad83640 1 -- 172.21.15.18:0/2877193640 wait complete. 2024-04-17T19:54:01.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.784+0000 7f4e5ad83640 1 Processor -- start 2024-04-17T19:54:01.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.784+0000 7f4e5ad83640 1 -- start start 2024-04-17T19:54:01.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.784+0000 7f4e5ad83640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e40004d50 0x7f4e54151d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:01.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.784+0000 7f4e5ad83640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e54160070 0x7f4e5414ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:01.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.784+0000 7f4e5ad83640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4e540d0ba0 0x7f4e540d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:01.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.784+0000 7f4e5ad83640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4e540b2780 con 0x7f4e40004d50 2024-04-17T19:54:01.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.784+0000 7f4e5ad83640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4e540b2600 con 0x7f4e54160070 2024-04-17T19:54:01.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.784+0000 7f4e5ad83640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f4e540b6f60 con 0x7f4e540d0ba0 2024-04-17T19:54:01.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.784+0000 7f4e58b1f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e40004d50 0x7f4e54151d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:01.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.784+0000 7f4e58b1f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e40004d50 0x7f4e54151d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49254/0 (socket says 172.21.15.18:49254) 2024-04-17T19:54:01.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.784+0000 7f4e58b1f640 1 -- 172.21.15.18:0/172793385 learned_addr learned my addr 172.21.15.18:0/172793385 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:01.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.784+0000 7f4e59320640 1 --2- 172.21.15.18:0/172793385 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4e540d0ba0 0x7f4e540d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:01.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.784+0000 7f4e53fff640 1 --2- 172.21.15.18:0/172793385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e54160070 0x7f4e5414ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:01.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.784+0000 7f4e58b1f640 1 -- 172.21.15.18:0/172793385 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4e540d0ba0 msgr2=0x7f4e540d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:01.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.784+0000 7f4e58b1f640 1 --2- 172.21.15.18:0/172793385 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4e540d0ba0 0x7f4e540d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:01.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.784+0000 7f4e58b1f640 1 -- 172.21.15.18:0/172793385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e54160070 msgr2=0x7f4e5414ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:01.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.784+0000 7f4e58b1f640 1 --2- 172.21.15.18:0/172793385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e54160070 0x7f4e5414ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:01.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.784+0000 7f4e58b1f640 1 -- 172.21.15.18:0/172793385 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e540d14f0 con 0x7f4e40004d50 2024-04-17T19:54:01.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.784+0000 7f4e58b1f640 1 --2- 172.21.15.18:0/172793385 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e40004d50 0x7f4e54151d60 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c010900 tx=0x7f4e4c010dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:01.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.788+0000 7f4e517fa640 1 -- 172.21.15.18:0/172793385 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c00f040 con 0x7f4e40004d50 2024-04-17T19:54:01.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.788+0000 7f4e517fa640 1 -- 172.21.15.18:0/172793385 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e4c004220 con 0x7f4e40004d50 2024-04-17T19:54:01.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.788+0000 7f4e5ad83640 1 -- 172.21.15.18:0/172793385 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e5414f340 con 0x7f4e40004d50 2024-04-17T19:54:01.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.788+0000 7f4e517fa640 1 -- 172.21.15.18:0/172793385 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c00e900 con 0x7f4e40004d50 2024-04-17T19:54:01.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.788+0000 7f4e5ad83640 1 -- 172.21.15.18:0/172793385 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e5414f900 con 0x7f4e40004d50 2024-04-17T19:54:01.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.788+0000 7f4e5ad83640 1 -- 172.21.15.18:0/172793385 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e54069950 con 0x7f4e40004d50 2024-04-17T19:54:01.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.788+0000 7f4e517fa640 1 -- 172.21.15.18:0/172793385 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4e4c00eaa0 con 0x7f4e40004d50 2024-04-17T19:54:01.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.788+0000 7f4e517fa640 1 --2- 172.21.15.18:0/172793385 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f4e340683b0 0x7f4e3406a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:01.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.788+0000 7f4e517fa640 1 -- 172.21.15.18:0/172793385 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7f4e4c087130 con 0x7f4e40004d50 2024-04-17T19:54:01.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.788+0000 7f4e53fff640 1 --2- 172.21.15.18:0/172793385 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f4e340683b0 0x7f4e3406a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:01.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.788+0000 7f4e53fff640 1 --2- 172.21.15.18:0/172793385 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f4e340683b0 0x7f4e3406a8c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4e540d25d0 tx=0x7f4e3c00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:01.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.792+0000 7f4e517fa640 1 -- 172.21.15.18:0/172793385 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4e540d14f0 con 0x7f4e40004d50 2024-04-17T19:54:01.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.956+0000 7f4e5ad83640 1 -- 172.21.15.18:0/172793385 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4e5406f020 con 0x7f4e40004d50 2024-04-17T19:54:01.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.960+0000 7f4e517fa640 1 -- 172.21.15.18:0/172793385 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18759 (secure 0 0 0) 0x7f4e4c018030 con 0x7f4e40004d50 2024-04-17T19:54:01.957 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:54:01.957 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":29,"fsid":"dd480169-5a81-4623-be5f-0499aa244b28","created":"2024-04-17T19:52:39.533760+0000","modified":"2024-04-17T19:53:45.435889+0000","last_up_change":"2024-04-17T19:52:51.229698+0000","last_in_change":"2024-04-17T19:52:42.144259+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T19:52:52.391648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T19:53:02.734240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T19:53:03.813028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T19:53:07.478812+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e232d577-2508-4ea4-b355-29fbae1ff025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6801","nonce":2323038417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6803","nonce":2323038417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6807","nonce":2323038417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6805","nonce":2323038417}]},"public_addr":"172.21.15.18:6801/2323038417","cluster_addr":"172.21.15.18:6803/2323038417","heartbeat_back_addr":"172.21.15.18:6807/2323038417","heartbeat_front_addr":"172.21.15.18:6805/2323038417","state":["exists","up"]},{"osd":1,"uuid":"31810ef3-2c71-48d6-8748-b74a2968d23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6817","nonce":1283678238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6819","nonce":1283678238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6823","nonce":1283678238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6821","nonce":1283678238}]},"public_addr":"172.21.15.18:6817/1283678238","cluster_addr":"172.21.15.18:6819/1283678238","heartbeat_back_addr":"172.21.15.18:6823/1283678238","heartbeat_front_addr":"172.21.15.18:6821/1283678238","state":["exists","up"]},{"osd":2,"uuid":"5a783cc5-a41c-4967-9e11-6b8330f97d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6809","nonce":1212875862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6811","nonce":1212875862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6815","nonce":1212875862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6813","nonce":1212875862}]},"public_addr":"172.21.15.18:6809/1212875862","cluster_addr":"172.21.15.18:6811/1212875862","heartbeat_back_addr":"172.21.15.18:6815/1212875862","heartbeat_front_addr":"172.21.15.18:6813/1212875862","state":["exists","up"]},{"osd":3,"uuid":"b7e056d9-9da5-46e1-810d-0c3e242fe5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6825","nonce":2428878428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6827","nonce":2428878428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6831","nonce":2428878428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6829","nonce":2428878428}]},"public_addr":"172.21.15.18:6825/2428878428","cluster_addr":"172.21.15.18:6827/2428878428","heartbeat_back_addr":"172.21.15.18:6831/2428878428","heartbeat_front_addr":"172.21.15.18:6829/2428878428","state":["exists","up"]},{"osd":4,"uuid":"21df023f-bc8b-4abb-93e5-0ecc91acda0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6825","nonce":1421511819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6827","nonce":1421511819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6831","nonce":1421511819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6829","nonce":1421511819}]},"public_addr":"172.21.15.173:6825/1421511819","cluster_addr":"172.21.15.173:6827/1421511819","heartbeat_back_addr":"172.21.15.173:6831/1421511819","heartbeat_front_addr":"172.21.15.173:6829/1421511819","state":["exists","up"]},{"osd":5,"uuid":"e270098a-6d33-49f8-84ed-94e09a880cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6801","nonce":4221907702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6803","nonce":4221907702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6807","nonce":4221907702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6805","nonce":4221907702}]},"public_addr":"172.21.15.173:6801/4221907702","cluster_addr":"172.21.15.173:6803/4221907702","heartbeat_back_addr":"172.21.15.173:6807/4221907702","heartbeat_front_addr":"172.21.15.173:6805/4221907702","state":["exists","up"]},{"osd":6,"uuid":"93c67c8c-268d-4e32-877c-043cd3acd87c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6809","nonce":761678552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6811","nonce":761678552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6815","nonce":761678552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6813","nonce":761678552}]},"public_addr":"172.21.15.173:6809/761678552","cluster_addr":"172.21.15.173:6811/761678552","heartbeat_back_addr":"172.21.15.173:6815/761678552","heartbeat_front_addr":"172.21.15.173:6813/761678552","state":["exists","up"]},{"osd":7,"uuid":"faf10eea-80de-40f6-abbb-34d07d3f59ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6817","nonce":383724537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6819","nonce":383724537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6823","nonce":383724537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6821","nonce":383724537}]},"public_addr":"172.21.15.173:6817/383724537","cluster_addr":"172.21.15.173:6819/383724537","heartbeat_back_addr":"172.21.15.173:6823/383724537","heartbeat_front_addr":"172.21.15.173:6821/383724537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.668924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.761747+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.768128+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.632252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.742608+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.734327+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.477107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.818292+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.31","mappings":[{"from":0,"to":7}]},{"pgid":"4.5","mappings":[{"from":3,"to":4},{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":0}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]},{"pgid":"4.1c","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T19:54:01.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.960+0000 7f4e5ad83640 1 -- 172.21.15.18:0/172793385 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f4e340683b0 msgr2=0x7f4e3406a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:01.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.960+0000 7f4e5ad83640 1 --2- 172.21.15.18:0/172793385 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f4e340683b0 0x7f4e3406a8c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4e540d25d0 tx=0x7f4e3c00b040 comp rx=0 tx=0).stop 2024-04-17T19:54:01.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.960+0000 7f4e5ad83640 1 -- 172.21.15.18:0/172793385 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e40004d50 msgr2=0x7f4e54151d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:01.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.960+0000 7f4e5ad83640 1 --2- 172.21.15.18:0/172793385 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e40004d50 0x7f4e54151d60 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c010900 tx=0x7f4e4c010dc0 comp rx=0 tx=0).stop 2024-04-17T19:54:01.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.960+0000 7f4e5ad83640 1 -- 172.21.15.18:0/172793385 shutdown_connections 2024-04-17T19:54:01.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.960+0000 7f4e5ad83640 1 --2- 172.21.15.18:0/172793385 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f4e340683b0 0x7f4e3406a8c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:01.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.960+0000 7f4e5ad83640 1 --2- 172.21.15.18:0/172793385 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4e540d0ba0 0x7f4e540d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:01.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.960+0000 7f4e5ad83640 1 --2- 172.21.15.18:0/172793385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e54160070 0x7f4e5414ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:01.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.960+0000 7f4e5ad83640 1 --2- 172.21.15.18:0/172793385 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e40004d50 0x7f4e54151d60 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:01.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.960+0000 7f4e5ad83640 1 -- 172.21.15.18:0/172793385 >> 172.21.15.18:0/172793385 conn(0x7f4e5409aa70 msgr2=0x7f4e540b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:01.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.960+0000 7f4e5ad83640 1 -- 172.21.15.18:0/172793385 shutdown_connections 2024-04-17T19:54:01.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:01.960+0000 7f4e5ad83640 1 -- 172.21.15.18:0/172793385 wait complete. 2024-04-17T19:54:01.980 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T19:52:52.391648+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-17T19:53:02.734240+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-17T19:53:03.813028+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-17T19:53:07.478812+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-17T19:54:01.980 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T19:54:02.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.136+0000 7fb72bda4640 1 Processor -- start 2024-04-17T19:54:02.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.136+0000 7fb72bda4640 1 -- start start 2024-04-17T19:54:02.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.136+0000 7fb72bda4640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb72415e910 0x7fb72415ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:02.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.136+0000 7fb72bda4640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb72406cd60 0x7fb72406d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:02.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.136+0000 7fb72bda4640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb72406d6b0 con 0x7fb72415e1a0 2024-04-17T19:54:02.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.136+0000 7fb72bda4640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7fb7240d0020 con 0x7fb72406cd60 2024-04-17T19:54:02.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.136+0000 7fb72bda4640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fb7240cd930 con 0x7fb72415e910 2024-04-17T19:54:02.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.136+0000 7fb729b40640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fb72415e1a0 0x7fb7240ce9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:51142/0 (socket says 172.21.15.18:51142) 2024-04-17T19:54:02.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.136+0000 7fb729b40640 1 -- 172.21.15.18:0/823866496 learned_addr learned my addr 172.21.15.18:0/823866496 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:54:02.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.136+0000 7fb72933f640 1 --2- 172.21.15.18:0/823866496 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb72415e910 0x7fb72415ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:02.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.136+0000 7fb72a341640 1 --2- 172.21.15.18:0/823866496 >> v2:172.21.15.173:3300/0 conn(0x7fb72406cd60 0x7fb72406d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:02.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.136+0000 7fb728b3e640 1 -- 172.21.15.18:0/823866496 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3096662724 0 0) 0x7fb720001120 con 0x7fb72415e1a0 2024-04-17T19:54:02.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.136+0000 7fb728b3e640 1 -- 172.21.15.18:0/823866496 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb710003530 con 0x7fb72415e1a0 2024-04-17T19:54:02.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.136+0000 7fb72933f640 1 -- 172.21.15.18:0/823866496 >> v2:172.21.15.173:3300/0 conn(0x7fb72406cd60 msgr2=0x7fb72406d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:02.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.136+0000 7fb72933f640 1 --2- 172.21.15.18:0/823866496 >> v2:172.21.15.173:3300/0 conn(0x7fb72406cd60 0x7fb72406d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:02.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.136+0000 7fb72933f640 1 -- 172.21.15.18:0/823866496 >> v1:172.21.15.18:6789/0 conn(0x7fb72415e1a0 legacy=0x7fb7240ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:02.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.136+0000 7fb72933f640 1 -- 172.21.15.18:0/823866496 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7240cdc10 con 0x7fb72415e910 2024-04-17T19:54:02.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.140+0000 7fb72933f640 1 --2- 172.21.15.18:0/823866496 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb72415e910 0x7fb72415ed20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb7140097c0 tx=0x7fb71401c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28ca7433e3fce02c server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:02.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.140+0000 7fb728b3e640 1 -- 172.21.15.18:0/823866496 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7140b0070 con 0x7fb72415e910 2024-04-17T19:54:02.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.140+0000 7fb728b3e640 1 -- 172.21.15.18:0/823866496 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7140ab600 con 0x7fb72415e910 2024-04-17T19:54:02.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.140+0000 7fb728b3e640 1 -- 172.21.15.18:0/823866496 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7140ab9b0 con 0x7fb72415e910 2024-04-17T19:54:02.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.140+0000 7fb72bda4640 1 -- 172.21.15.18:0/823866496 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb72415e910 msgr2=0x7fb72415ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:02.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.140+0000 7fb72bda4640 1 --2- 172.21.15.18:0/823866496 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb72415e910 0x7fb72415ed20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb7140097c0 tx=0x7fb71401c410 comp rx=0 tx=0).stop 2024-04-17T19:54:02.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.140+0000 7fb72bda4640 1 -- 172.21.15.18:0/823866496 shutdown_connections 2024-04-17T19:54:02.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.140+0000 7fb72bda4640 1 --2- 172.21.15.18:0/823866496 >> v2:172.21.15.173:3300/0 conn(0x7fb72406cd60 0x7fb72406d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:02.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.140+0000 7fb72bda4640 1 --2- 172.21.15.18:0/823866496 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb72415e910 0x7fb72415ed20 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:02.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.140+0000 7fb72bda4640 1 -- 172.21.15.18:0/823866496 >> 172.21.15.18:0/823866496 conn(0x7fb724072bb0 msgr2=0x7fb724072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:02.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.140+0000 7fb72bda4640 1 -- 172.21.15.18:0/823866496 shutdown_connections 2024-04-17T19:54:02.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.140+0000 7fb72bda4640 1 -- 172.21.15.18:0/823866496 wait complete. 2024-04-17T19:54:02.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.144+0000 7fb72bda4640 1 Processor -- start 2024-04-17T19:54:02.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.144+0000 7fb72bda4640 1 -- start start 2024-04-17T19:54:02.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.144+0000 7fb72bda4640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb72406cd60 0x7fb7240a9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:02.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.144+0000 7fb72bda4640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb72415e1a0 0x7fb72413d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:02.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.144+0000 7fb72bda4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb72415e910 0x7fb7241536c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:02.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.144+0000 7fb72bda4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb72415e730 con 0x7fb72415e910 2024-04-17T19:54:02.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.144+0000 7fb72bda4640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb72415e5b0 con 0x7fb72415e1a0 2024-04-17T19:54:02.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.144+0000 7fb72bda4640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fb7240cf0e0 con 0x7fb72406cd60 2024-04-17T19:54:02.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.144+0000 7fb72a341640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb72415e910 0x7fb7241536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:02.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.144+0000 7fb72a341640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb72415e910 0x7fb7241536c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49256/0 (socket says 172.21.15.18:49256) 2024-04-17T19:54:02.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.144+0000 7fb72a341640 1 -- 172.21.15.18:0/763054972 learned_addr learned my addr 172.21.15.18:0/763054972 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:02.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.144+0000 7fb72933f640 1 --2- 172.21.15.18:0/763054972 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb72415e1a0 0x7fb72413d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:02.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.144+0000 7fb729b40640 1 --2- 172.21.15.18:0/763054972 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb72406cd60 0x7fb7240a9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:02.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.144+0000 7fb72a341640 1 -- 172.21.15.18:0/763054972 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb72406cd60 msgr2=0x7fb7240a9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:02.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.144+0000 7fb72a341640 1 --2- 172.21.15.18:0/763054972 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb72406cd60 0x7fb7240a9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:02.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.144+0000 7fb72a341640 1 -- 172.21.15.18:0/763054972 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb72415e1a0 msgr2=0x7fb72413d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:02.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.144+0000 7fb72a341640 1 --2- 172.21.15.18:0/763054972 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb72415e1a0 0x7fb72413d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:02.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.144+0000 7fb72a341640 1 -- 172.21.15.18:0/763054972 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7240692b0 con 0x7fb72415e910 2024-04-17T19:54:02.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.144+0000 7fb72a341640 1 --2- 172.21.15.18:0/763054972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb72415e910 0x7fb7241536c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb71c00efc0 tx=0x7fb71c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:02.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.144+0000 7fb71a7fc640 1 -- 172.21.15.18:0/763054972 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb71c018020 con 0x7fb72415e910 2024-04-17T19:54:02.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.144+0000 7fb71a7fc640 1 -- 172.21.15.18:0/763054972 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb71c014480 con 0x7fb72415e910 2024-04-17T19:54:02.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.144+0000 7fb71a7fc640 1 -- 172.21.15.18:0/763054972 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb71c014870 con 0x7fb72415e910 2024-04-17T19:54:02.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.144+0000 7fb72bda4640 1 -- 172.21.15.18:0/763054972 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb72413d840 con 0x7fb72415e910 2024-04-17T19:54:02.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.144+0000 7fb72bda4640 1 -- 172.21.15.18:0/763054972 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7241fc370 con 0x7fb72415e910 2024-04-17T19:54:02.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.148+0000 7fb72bda4640 1 -- 172.21.15.18:0/763054972 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb724069950 con 0x7fb72415e910 2024-04-17T19:54:02.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.148+0000 7fb71a7fc640 1 -- 172.21.15.18:0/763054972 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb71c01b020 con 0x7fb72415e910 2024-04-17T19:54:02.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.148+0000 7fb71a7fc640 1 --2- 172.21.15.18:0/763054972 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fb7080683b0 0x7fb70806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:02.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.148+0000 7fb71a7fc640 1 -- 172.21.15.18:0/763054972 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7fb71c087b60 con 0x7fb72415e910 2024-04-17T19:54:02.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.148+0000 7fb729b40640 1 --2- 172.21.15.18:0/763054972 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fb7080683b0 0x7fb70806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:02.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.148+0000 7fb729b40640 1 --2- 172.21.15.18:0/763054972 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fb7080683b0 0x7fb70806a8c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb720005890 tx=0x7fb720009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:02.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.152+0000 7fb71a7fc640 1 -- 172.21.15.18:0/763054972 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb71c022030 con 0x7fb72415e910 2024-04-17T19:54:02.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.308+0000 7fb72bda4640 1 -- 172.21.15.18:0/763054972 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb7240709b0 con 0x7fb72415e910 2024-04-17T19:54:02.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.312+0000 7fb71a7fc640 1 -- 172.21.15.18:0/763054972 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7fb71c010040 con 0x7fb72415e910 2024-04-17T19:54:02.309 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-17T19:54:02.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.312+0000 7fb72bda4640 1 -- 172.21.15.18:0/763054972 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fb7080683b0 msgr2=0x7fb70806a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:02.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.312+0000 7fb72bda4640 1 --2- 172.21.15.18:0/763054972 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fb7080683b0 0x7fb70806a8c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb720005890 tx=0x7fb720009040 comp rx=0 tx=0).stop 2024-04-17T19:54:02.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.312+0000 7fb72bda4640 1 -- 172.21.15.18:0/763054972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb72415e910 msgr2=0x7fb7241536c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:02.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.312+0000 7fb72bda4640 1 --2- 172.21.15.18:0/763054972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb72415e910 0x7fb7241536c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb71c00efc0 tx=0x7fb71c00c490 comp rx=0 tx=0).stop 2024-04-17T19:54:02.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.312+0000 7fb72bda4640 1 -- 172.21.15.18:0/763054972 shutdown_connections 2024-04-17T19:54:02.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.312+0000 7fb72bda4640 1 --2- 172.21.15.18:0/763054972 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fb7080683b0 0x7fb70806a8c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:02.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.312+0000 7fb72bda4640 1 --2- 172.21.15.18:0/763054972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb72415e910 0x7fb7241536c0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:02.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.312+0000 7fb72bda4640 1 --2- 172.21.15.18:0/763054972 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb72415e1a0 0x7fb72413d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:02.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.312+0000 7fb72bda4640 1 --2- 172.21.15.18:0/763054972 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb72406cd60 0x7fb7240a9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:02.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.312+0000 7fb72bda4640 1 -- 172.21.15.18:0/763054972 >> 172.21.15.18:0/763054972 conn(0x7fb724072bb0 msgr2=0x7fb724167650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:02.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.312+0000 7fb72bda4640 1 -- 172.21.15.18:0/763054972 shutdown_connections 2024-04-17T19:54:02.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.312+0000 7fb72bda4640 1 -- 172.21.15.18:0/763054972 wait complete. 2024-04-17T19:54:02.329 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-17T19:54:02.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.484+0000 7f17c7dfb640 1 Processor -- start 2024-04-17T19:54:02.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.484+0000 7f17c7dfb640 1 -- start start 2024-04-17T19:54:02.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.484+0000 7f17c7dfb640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f17c00b6f60 0x7f17c015d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:02.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.484+0000 7f17c7dfb640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f17c00cf6c0 0x7f17c00cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:02.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.484+0000 7f17c7dfb640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17c006e9a0 con 0x7f17c00d24a0 2024-04-17T19:54:02.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.484+0000 7f17c7dfb640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f17c006ec80 con 0x7f17c00b6f60 2024-04-17T19:54:02.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.484+0000 7f17c7dfb640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f17c00d19c0 con 0x7f17c00cf6c0 2024-04-17T19:54:02.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.484+0000 7f17c5b97640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f17c00d24a0 0x7f17c00b6850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:51158/0 (socket says 172.21.15.18:51158) 2024-04-17T19:54:02.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.484+0000 7f17c5b97640 1 -- 172.21.15.18:0/235781274 learned_addr learned my addr 172.21.15.18:0/235781274 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:54:02.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.488+0000 7f17c5396640 1 --2- 172.21.15.18:0/235781274 >> v2:172.21.15.173:3300/0 conn(0x7f17c00b6f60 0x7f17c015d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:02.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.488+0000 7f17c6398640 1 --2- 172.21.15.18:0/235781274 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f17c00cf6c0 0x7f17c00cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:02.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.488+0000 7f17c4b95640 1 -- 172.21.15.18:0/235781274 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 138846580 0 0) 0x7f17c006e9a0 con 0x7f17c00d24a0 2024-04-17T19:54:02.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.488+0000 7f17c4b95640 1 -- 172.21.15.18:0/235781274 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f17ac005740 con 0x7f17c00d24a0 2024-04-17T19:54:02.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.488+0000 7f17c4b95640 1 -- 172.21.15.18:0/235781274 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3267511961 0 0) 0x7f17ac005740 con 0x7f17c00d24a0 2024-04-17T19:54:02.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.488+0000 7f17c4b95640 1 -- 172.21.15.18:0/235781274 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f17c00cf6c0 msgr2=0x7f17c00cfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:02.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.488+0000 7f17c4b95640 1 --2- 172.21.15.18:0/235781274 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f17c00cf6c0 0x7f17c00cfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:02.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.488+0000 7f17c4b95640 1 -- 172.21.15.18:0/235781274 >> v2:172.21.15.173:3300/0 conn(0x7f17c00b6f60 msgr2=0x7f17c015d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:02.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.488+0000 7f17c4b95640 1 --2- 172.21.15.18:0/235781274 >> v2:172.21.15.173:3300/0 conn(0x7f17c00b6f60 0x7f17c015d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:02.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.488+0000 7f17c4b95640 1 -- 172.21.15.18:0/235781274 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17c00d1ca0 con 0x7f17c00d24a0 2024-04-17T19:54:02.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.488+0000 7f17c4b95640 1 -- 172.21.15.18:0/235781274 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3208559991 0 0) 0x7f17bc001680 con 0x7f17c00d24a0 2024-04-17T19:54:02.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.488+0000 7f17c4b95640 1 -- 172.21.15.18:0/235781274 >> v1:172.21.15.18:6789/0 conn(0x7f17c00d24a0 legacy=0x7f17c00b6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:02.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.488+0000 7f17c4b95640 1 --2- 172.21.15.18:0/235781274 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17ac005bd0 0x7f17ac006040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:02.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.488+0000 7f17c4b95640 1 --2- 172.21.15.18:0/235781274 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17ac006a20 0x7f17ac006e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:02.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.488+0000 7f17c4b95640 1 --2- 172.21.15.18:0/235781274 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f17c00cf6c0 0x7f17ac007370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:02.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.488+0000 7f17c4b95640 1 -- 172.21.15.18:0/235781274 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f17c006ec80 con 0x7f17ac005bd0 2024-04-17T19:54:02.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.488+0000 7f17c4b95640 1 -- 172.21.15.18:0/235781274 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f17c00d19c0 con 0x7f17ac006a20 2024-04-17T19:54:02.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.488+0000 7f17c4b95640 1 -- 172.21.15.18:0/235781274 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f17ac00dbe0 con 0x7f17c00cf6c0 2024-04-17T19:54:02.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.488+0000 7f17c5b97640 1 --2- 172.21.15.18:0/235781274 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17ac005bd0 0x7f17ac006040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:02.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.488+0000 7f17c5396640 1 --2- 172.21.15.18:0/235781274 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17ac006a20 0x7f17ac006e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:02.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.488+0000 7f17c6398640 1 --2- 172.21.15.18:0/235781274 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f17c00cf6c0 0x7f17ac007370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:02.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.488+0000 7f17c5b97640 1 -- 172.21.15.18:0/235781274 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f17c00cf6c0 msgr2=0x7f17ac007370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:02.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.488+0000 7f17c5b97640 1 --2- 172.21.15.18:0/235781274 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f17c00cf6c0 0x7f17ac007370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:02.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.488+0000 7f17c5b97640 1 -- 172.21.15.18:0/235781274 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17ac006a20 msgr2=0x7f17ac006e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:02.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.488+0000 7f17c5b97640 1 --2- 172.21.15.18:0/235781274 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17ac006a20 0x7f17ac006e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:02.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.488+0000 7f17c5b97640 1 -- 172.21.15.18:0/235781274 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17ac005740 con 0x7f17ac005bd0 2024-04-17T19:54:02.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.488+0000 7f17c5b97640 1 --2- 172.21.15.18:0/235781274 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17ac005bd0 0x7f17ac006040 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f17bc001060 tx=0x7f17bc01cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83f4d6b4eea6c092 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:02.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.488+0000 7f17c4b95640 1 -- 172.21.15.18:0/235781274 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17bc007d80 con 0x7f17ac005bd0 2024-04-17T19:54:02.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.488+0000 7f17c4b95640 1 -- 172.21.15.18:0/235781274 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17bc0a9020 con 0x7f17ac005bd0 2024-04-17T19:54:02.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.488+0000 7f17c4b95640 1 -- 172.21.15.18:0/235781274 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17bc005b00 con 0x7f17ac005bd0 2024-04-17T19:54:02.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.492+0000 7f17c7dfb640 1 -- 172.21.15.18:0/235781274 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17ac005bd0 msgr2=0x7f17ac006040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:02.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.492+0000 7f17c7dfb640 1 --2- 172.21.15.18:0/235781274 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17ac005bd0 0x7f17ac006040 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f17bc001060 tx=0x7f17bc01cc40 comp rx=0 tx=0).stop 2024-04-17T19:54:02.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.492+0000 7f17c6398640 1 -- 172.21.15.18:0/235781274 reap_dead start 2024-04-17T19:54:02.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.492+0000 7f17c7dfb640 1 -- 172.21.15.18:0/235781274 shutdown_connections 2024-04-17T19:54:02.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.492+0000 7f17c7dfb640 1 -- 172.21.15.18:0/235781274 >> 172.21.15.18:0/235781274 conn(0x7f17c009aa70 msgr2=0x7f17c009ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:02.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.492+0000 7f17c7dfb640 1 -- 172.21.15.18:0/235781274 shutdown_connections 2024-04-17T19:54:02.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.492+0000 7f17c7dfb640 1 -- 172.21.15.18:0/235781274 wait complete. 2024-04-17T19:54:02.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.492+0000 7f17c7dfb640 1 Processor -- start 2024-04-17T19:54:02.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.492+0000 7f17c7dfb640 1 -- start start 2024-04-17T19:54:02.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.492+0000 7f17c7dfb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17c0153320 0x7f17c01426b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:02.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.492+0000 7f17c7dfb640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17c00cdad0 0x7f17c0152970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:02.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.492+0000 7f17c7dfb640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f17c01451d0 0x7f17c0070c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:02.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.492+0000 7f17c7dfb640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f17c006c5e0 con 0x7f17c0153320 2024-04-17T19:54:02.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.492+0000 7f17c7dfb640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f17c006ef60 con 0x7f17c00cdad0 2024-04-17T19:54:02.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.492+0000 7f17c7dfb640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f17c006c760 con 0x7f17c01451d0 2024-04-17T19:54:02.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.492+0000 7f17c5b97640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17c0153320 0x7f17c01426b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:02.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.492+0000 7f17c5b97640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17c0153320 0x7f17c01426b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49266/0 (socket says 172.21.15.18:49266) 2024-04-17T19:54:02.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.492+0000 7f17c5b97640 1 -- 172.21.15.18:0/4192472608 learned_addr learned my addr 172.21.15.18:0/4192472608 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:02.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.496+0000 7f17c5396640 1 --2- 172.21.15.18:0/4192472608 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17c00cdad0 0x7f17c0152970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:02.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.496+0000 7f17c6398640 1 --2- 172.21.15.18:0/4192472608 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f17c01451d0 0x7f17c0070c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:02.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.496+0000 7f17c5b97640 1 -- 172.21.15.18:0/4192472608 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f17c01451d0 msgr2=0x7f17c0070c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:02.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.496+0000 7f17c5b97640 1 --2- 172.21.15.18:0/4192472608 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f17c01451d0 0x7f17c0070c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:02.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.496+0000 7f17c5b97640 1 -- 172.21.15.18:0/4192472608 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17c00cdad0 msgr2=0x7f17c0152970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:02.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.496+0000 7f17c5b97640 1 --2- 172.21.15.18:0/4192472608 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17c00cdad0 0x7f17c0152970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:02.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.496+0000 7f17c5b97640 1 -- 172.21.15.18:0/4192472608 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17c015d890 con 0x7f17c0153320 2024-04-17T19:54:02.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.496+0000 7f17c5396640 1 --2- 172.21.15.18:0/4192472608 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17c00cdad0 0x7f17c0152970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:54:02.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.496+0000 7f17c5b97640 1 --2- 172.21.15.18:0/4192472608 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17c0153320 0x7f17c01426b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f17bc0ab040 tx=0x7f17ac007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:02.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.496+0000 7f17b67fc640 1 -- 172.21.15.18:0/4192472608 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17bc004ab0 con 0x7f17c0153320 2024-04-17T19:54:02.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.496+0000 7f17b67fc640 1 -- 172.21.15.18:0/4192472608 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17bc0b2070 con 0x7f17c0153320 2024-04-17T19:54:02.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.496+0000 7f17c7dfb640 1 -- 172.21.15.18:0/4192472608 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17c00cc250 con 0x7f17c0153320 2024-04-17T19:54:02.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.496+0000 7f17b67fc640 1 -- 172.21.15.18:0/4192472608 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17bc0a57f0 con 0x7f17c0153320 2024-04-17T19:54:02.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.496+0000 7f17c7dfb640 1 -- 172.21.15.18:0/4192472608 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17c00cc530 con 0x7f17c0153320 2024-04-17T19:54:02.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.496+0000 7f17c7dfb640 1 -- 172.21.15.18:0/4192472608 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17c0069950 con 0x7f17c0153320 2024-04-17T19:54:02.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.496+0000 7f17b67fc640 1 -- 172.21.15.18:0/4192472608 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f17bc0a5990 con 0x7f17c0153320 2024-04-17T19:54:02.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.496+0000 7f17b67fc640 1 --2- 172.21.15.18:0/4192472608 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f17a4068380 0x7f17a406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:02.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.496+0000 7f17c5396640 1 --2- 172.21.15.18:0/4192472608 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f17a4068380 0x7f17a406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:02.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.496+0000 7f17b67fc640 1 -- 172.21.15.18:0/4192472608 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7f17bc1201d0 con 0x7f17c0153320 2024-04-17T19:54:02.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.496+0000 7f17c5396640 1 --2- 172.21.15.18:0/4192472608 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f17a4068380 0x7f17a406a890 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f17b0009160 tx=0x7f17b0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:02.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.500+0000 7f17b67fc640 1 -- 172.21.15.18:0/4192472608 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f17bc016950 con 0x7f17c0153320 2024-04-17T19:54:02.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.660+0000 7f17c7dfb640 1 -- 172.21.15.18:0/4192472608 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f17c006e370 con 0x7f17c0153320 2024-04-17T19:54:02.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.660+0000 7f17b67fc640 1 -- 172.21.15.18:0/4192472608 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7f17bc0f03d0 con 0x7f17c0153320 2024-04-17T19:54:02.659 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-17T19:54:02.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.664+0000 7f17c7dfb640 1 -- 172.21.15.18:0/4192472608 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f17a4068380 msgr2=0x7f17a406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:02.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.664+0000 7f17c7dfb640 1 --2- 172.21.15.18:0/4192472608 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f17a4068380 0x7f17a406a890 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f17b0009160 tx=0x7f17b0008040 comp rx=0 tx=0).stop 2024-04-17T19:54:02.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.664+0000 7f17c7dfb640 1 -- 172.21.15.18:0/4192472608 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17c0153320 msgr2=0x7f17c01426b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:02.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.664+0000 7f17c7dfb640 1 --2- 172.21.15.18:0/4192472608 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17c0153320 0x7f17c01426b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f17bc0ab040 tx=0x7f17ac007a50 comp rx=0 tx=0).stop 2024-04-17T19:54:02.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.664+0000 7f17c7dfb640 1 -- 172.21.15.18:0/4192472608 shutdown_connections 2024-04-17T19:54:02.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.664+0000 7f17c7dfb640 1 --2- 172.21.15.18:0/4192472608 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f17a4068380 0x7f17a406a890 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:02.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.664+0000 7f17c7dfb640 1 --2- 172.21.15.18:0/4192472608 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f17c01451d0 0x7f17c0070c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:02.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.664+0000 7f17c7dfb640 1 --2- 172.21.15.18:0/4192472608 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17c00cdad0 0x7f17c0152970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:02.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.664+0000 7f17c7dfb640 1 --2- 172.21.15.18:0/4192472608 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17c0153320 0x7f17c01426b0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:02.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.664+0000 7f17c7dfb640 1 -- 172.21.15.18:0/4192472608 >> 172.21.15.18:0/4192472608 conn(0x7f17c009aa70 msgr2=0x7f17c01578a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:02.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.664+0000 7f17c7dfb640 1 -- 172.21.15.18:0/4192472608 shutdown_connections 2024-04-17T19:54:02.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.664+0000 7f17c7dfb640 1 -- 172.21.15.18:0/4192472608 wait complete. 2024-04-17T19:54:02.680 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-17T19:54:02.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.828+0000 7fe9f19ef640 1 Processor -- start 2024-04-17T19:54:02.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.828+0000 7fe9f19ef640 1 -- start start 2024-04-17T19:54:02.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.828+0000 7fe9f19ef640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe9ec15e1a0 0x7fe9ec0ce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:02.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.828+0000 7fe9f19ef640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe9ec0cef10 0x7fe9ec15e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:02.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.828+0000 7fe9f19ef640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9ec0d0020 con 0x7fe9ec15ee50 2024-04-17T19:54:02.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.828+0000 7fe9f19ef640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fe9ec0cd930 con 0x7fe9ec0cef10 2024-04-17T19:54:02.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.828+0000 7fe9f19ef640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fe9ec0cdc10 con 0x7fe9ec15e1a0 2024-04-17T19:54:02.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.828+0000 7fe9e3fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe9ec0cef10 0x7fe9ec15e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:02.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.828+0000 7fe9eb7fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fe9ec15ee50 0x7fe9ec06cd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:51172/0 (socket says 172.21.15.18:51172) 2024-04-17T19:54:02.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.828+0000 7fe9eb7fe640 1 -- 172.21.15.18:0/2527729306 learned_addr learned my addr 172.21.15.18:0/2527729306 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:54:02.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.828+0000 7fe9eaffd640 1 --2- 172.21.15.18:0/2527729306 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe9ec15e1a0 0x7fe9ec0ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:02.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.828+0000 7fe9e3fff640 1 -- 172.21.15.18:0/2527729306 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe9ec15e1a0 msgr2=0x7fe9ec0ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:02.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.828+0000 7fe9e3fff640 1 --2- 172.21.15.18:0/2527729306 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe9ec15e1a0 0x7fe9ec0ce9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:02.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.828+0000 7fe9e3fff640 1 -- 172.21.15.18:0/2527729306 >> v1:172.21.15.18:6789/0 conn(0x7fe9ec15ee50 legacy=0x7fe9ec06cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:02.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.828+0000 7fe9e3fff640 1 -- 172.21.15.18:0/2527729306 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9ec0cdef0 con 0x7fe9ec0cef10 2024-04-17T19:54:02.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.828+0000 7fe9ea7fc640 1 -- 172.21.15.18:0/2527729306 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 375751086 0 0) 0x7fe9ec0d0020 con 0x7fe9ec15ee50 2024-04-17T19:54:02.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.832+0000 7fe9e3fff640 1 --2- 172.21.15.18:0/2527729306 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9ec0cef10 0x7fe9ec15e910 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe9d40097c0 tx=0x7fe9d401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56ae346db330d14f server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:02.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.832+0000 7fe9ea7fc640 1 -- 172.21.15.18:0/2527729306 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d40b0070 con 0x7fe9ec0cef10 2024-04-17T19:54:02.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.832+0000 7fe9ea7fc640 1 -- 172.21.15.18:0/2527729306 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9d40ab600 con 0x7fe9ec0cef10 2024-04-17T19:54:02.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.832+0000 7fe9ea7fc640 1 -- 172.21.15.18:0/2527729306 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d40ab9d0 con 0x7fe9ec0cef10 2024-04-17T19:54:02.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.832+0000 7fe9f19ef640 1 -- 172.21.15.18:0/2527729306 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9ec0cef10 msgr2=0x7fe9ec15e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:02.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.832+0000 7fe9f19ef640 1 --2- 172.21.15.18:0/2527729306 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9ec0cef10 0x7fe9ec15e910 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe9d40097c0 tx=0x7fe9d401c410 comp rx=0 tx=0).stop 2024-04-17T19:54:02.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.832+0000 7fe9f19ef640 1 -- 172.21.15.18:0/2527729306 shutdown_connections 2024-04-17T19:54:02.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.832+0000 7fe9f19ef640 1 --2- 172.21.15.18:0/2527729306 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9ec0cef10 0x7fe9ec15e910 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:02.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.832+0000 7fe9f19ef640 1 --2- 172.21.15.18:0/2527729306 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe9ec15e1a0 0x7fe9ec0ce9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:02.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.832+0000 7fe9f19ef640 1 -- 172.21.15.18:0/2527729306 >> 172.21.15.18:0/2527729306 conn(0x7fe9ec072bb0 msgr2=0x7fe9ec072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:02.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.832+0000 7fe9f19ef640 1 -- 172.21.15.18:0/2527729306 shutdown_connections 2024-04-17T19:54:02.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.832+0000 7fe9f19ef640 1 -- 172.21.15.18:0/2527729306 wait complete. 2024-04-17T19:54:02.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.832+0000 7fe9f19ef640 1 Processor -- start 2024-04-17T19:54:02.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.832+0000 7fe9f19ef640 1 -- start start 2024-04-17T19:54:02.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.836+0000 7fe9f19ef640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe9ec0cef10 0x7fe9ec0a9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:02.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.836+0000 7fe9f19ef640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9ec15e1a0 0x7fe9ec155fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:02.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.836+0000 7fe9f19ef640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9ec15ee50 0x7fe9ec14efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:02.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.836+0000 7fe9f19ef640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe9ec157b90 con 0x7fe9ec15ee50 2024-04-17T19:54:02.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.836+0000 7fe9f19ef640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe9ec157a10 con 0x7fe9ec15e1a0 2024-04-17T19:54:02.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.836+0000 7fe9f19ef640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fe9ec06d470 con 0x7fe9ec0cef10 2024-04-17T19:54:02.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.836+0000 7fe9eb7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9ec15ee50 0x7fe9ec14efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:02.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.836+0000 7fe9eb7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9ec15ee50 0x7fe9ec14efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49294/0 (socket says 172.21.15.18:49294) 2024-04-17T19:54:02.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.836+0000 7fe9eb7fe640 1 -- 172.21.15.18:0/3038993812 learned_addr learned my addr 172.21.15.18:0/3038993812 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:02.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.836+0000 7fe9e3fff640 1 --2- 172.21.15.18:0/3038993812 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9ec15e1a0 0x7fe9ec155fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:02.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.836+0000 7fe9eb7fe640 1 -- 172.21.15.18:0/3038993812 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe9ec0cef10 msgr2=0x7fe9ec0a9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:02.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.836+0000 7fe9eb7fe640 1 --2- 172.21.15.18:0/3038993812 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe9ec0cef10 0x7fe9ec0a9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:02.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.836+0000 7fe9eb7fe640 1 -- 172.21.15.18:0/3038993812 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9ec15e1a0 msgr2=0x7fe9ec155fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:02.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.836+0000 7fe9eb7fe640 1 --2- 172.21.15.18:0/3038993812 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9ec15e1a0 0x7fe9ec155fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:02.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.836+0000 7fe9eb7fe640 1 -- 172.21.15.18:0/3038993812 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9ec154260 con 0x7fe9ec15ee50 2024-04-17T19:54:02.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.836+0000 7fe9eb7fe640 1 --2- 172.21.15.18:0/3038993812 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9ec15ee50 0x7fe9ec14efe0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe9e400c730 tx=0x7fe9e400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:02.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.836+0000 7fe9e8ff9640 1 -- 172.21.15.18:0/3038993812 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e4018070 con 0x7fe9ec15ee50 2024-04-17T19:54:02.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.836+0000 7fe9e8ff9640 1 -- 172.21.15.18:0/3038993812 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9e400ce40 con 0x7fe9ec15ee50 2024-04-17T19:54:02.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.836+0000 7fe9f19ef640 1 -- 172.21.15.18:0/3038993812 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9ec15a620 con 0x7fe9ec15ee50 2024-04-17T19:54:02.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.836+0000 7fe9e8ff9640 1 -- 172.21.15.18:0/3038993812 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e400a860 con 0x7fe9ec15ee50 2024-04-17T19:54:02.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.836+0000 7fe9f19ef640 1 -- 172.21.15.18:0/3038993812 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9ec15abe0 con 0x7fe9ec15ee50 2024-04-17T19:54:02.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.836+0000 7fe9f19ef640 1 -- 172.21.15.18:0/3038993812 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9ec069950 con 0x7fe9ec15ee50 2024-04-17T19:54:02.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.836+0000 7fe9e8ff9640 1 -- 172.21.15.18:0/3038993812 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe9e401b070 con 0x7fe9ec15ee50 2024-04-17T19:54:02.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.836+0000 7fe9e8ff9640 1 --2- 172.21.15.18:0/3038993812 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fe9cc068380 0x7fe9cc06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:02.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.836+0000 7fe9e8ff9640 1 -- 172.21.15.18:0/3038993812 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7fe9e40862c0 con 0x7fe9ec15ee50 2024-04-17T19:54:02.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.836+0000 7fe9eaffd640 1 --2- 172.21.15.18:0/3038993812 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fe9cc068380 0x7fe9cc06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:02.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.840+0000 7fe9eaffd640 1 --2- 172.21.15.18:0/3038993812 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fe9cc068380 0x7fe9cc06a890 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec0b5f30 tx=0x7fe9dc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:02.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:02.844+0000 7fe9e8ff9640 1 -- 172.21.15.18:0/3038993812 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe9e40564b0 con 0x7fe9ec15ee50 2024-04-17T19:54:03.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.004+0000 7fe9f19ef640 1 -- 172.21.15.18:0/3038993812 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe9ec15a3b0 con 0x7fe9ec15ee50 2024-04-17T19:54:03.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.008+0000 7fe9e8ff9640 1 -- 172.21.15.18:0/3038993812 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7fe9e4055db0 con 0x7fe9ec15ee50 2024-04-17T19:54:03.004 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-17T19:54:03.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.008+0000 7fe9f19ef640 1 -- 172.21.15.18:0/3038993812 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fe9cc068380 msgr2=0x7fe9cc06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:03.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.008+0000 7fe9f19ef640 1 --2- 172.21.15.18:0/3038993812 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fe9cc068380 0x7fe9cc06a890 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec0b5f30 tx=0x7fe9dc008040 comp rx=0 tx=0).stop 2024-04-17T19:54:03.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.008+0000 7fe9f19ef640 1 -- 172.21.15.18:0/3038993812 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9ec15ee50 msgr2=0x7fe9ec14efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:03.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.008+0000 7fe9f19ef640 1 --2- 172.21.15.18:0/3038993812 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9ec15ee50 0x7fe9ec14efe0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe9e400c730 tx=0x7fe9e400cbf0 comp rx=0 tx=0).stop 2024-04-17T19:54:03.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.008+0000 7fe9f19ef640 1 -- 172.21.15.18:0/3038993812 shutdown_connections 2024-04-17T19:54:03.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.008+0000 7fe9f19ef640 1 --2- 172.21.15.18:0/3038993812 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fe9cc068380 0x7fe9cc06a890 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:03.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.008+0000 7fe9f19ef640 1 --2- 172.21.15.18:0/3038993812 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9ec15ee50 0x7fe9ec14efe0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:03.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.008+0000 7fe9f19ef640 1 --2- 172.21.15.18:0/3038993812 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9ec15e1a0 0x7fe9ec155fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:03.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.008+0000 7fe9f19ef640 1 --2- 172.21.15.18:0/3038993812 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe9ec0cef10 0x7fe9ec0a9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:03.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.008+0000 7fe9f19ef640 1 -- 172.21.15.18:0/3038993812 >> 172.21.15.18:0/3038993812 conn(0x7fe9ec072bb0 msgr2=0x7fe9ec072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:03.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.008+0000 7fe9f19ef640 1 -- 172.21.15.18:0/3038993812 shutdown_connections 2024-04-17T19:54:03.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.008+0000 7fe9f19ef640 1 -- 172.21.15.18:0/3038993812 wait complete. 2024-04-17T19:54:03.026 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-17T19:54:03.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.172+0000 7fa0f0496640 1 Processor -- start 2024-04-17T19:54:03.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.172+0000 7fa0f0496640 1 -- start start 2024-04-17T19:54:03.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.172+0000 7fa0f0496640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa0e80b0120 0x7fa0e815f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:03.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.172+0000 7fa0f0496640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa0e80b44b0 0x7fa0e80b48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:03.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.172+0000 7fa0f0496640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0e81607b0 con 0x7fa0e806cd60 2024-04-17T19:54:03.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.172+0000 7fa0f0496640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fa0e80b0530 con 0x7fa0e80b0120 2024-04-17T19:54:03.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.172+0000 7fa0f0496640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fa0e815ff10 con 0x7fa0e80b44b0 2024-04-17T19:54:03.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.172+0000 7fa0ee232640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa0e80b0120 0x7fa0e815f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:03.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.172+0000 7fa0eda31640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fa0e806cd60 0x7fa0e806d170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:51182/0 (socket says 172.21.15.18:51182) 2024-04-17T19:54:03.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.172+0000 7fa0eda31640 1 -- 172.21.15.18:0/1316469552 learned_addr learned my addr 172.21.15.18:0/1316469552 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:54:03.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.172+0000 7fa0ee232640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa0e80b0120 0x7fa0e815f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49304/0 (socket says 172.21.15.18:49304) 2024-04-17T19:54:03.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.172+0000 7fa0eea33640 1 --2- 172.21.15.18:0/1316469552 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa0e80b44b0 0x7fa0e80b48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:03.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.172+0000 7fa0ee232640 1 -- 172.21.15.18:0/1316469552 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa0e80b44b0 msgr2=0x7fa0e80b48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:03.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.172+0000 7fa0ee232640 1 --2- 172.21.15.18:0/1316469552 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa0e80b44b0 0x7fa0e80b48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:03.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.172+0000 7fa0ee232640 1 -- 172.21.15.18:0/1316469552 >> v1:172.21.15.18:6789/0 conn(0x7fa0e806cd60 legacy=0x7fa0e806d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:03.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.172+0000 7fa0ee232640 1 -- 172.21.15.18:0/1316469552 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0e81601f0 con 0x7fa0e80b0120 2024-04-17T19:54:03.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.176+0000 7fa0ee232640 1 --2- 172.21.15.18:0/1316469552 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa0e80b0120 0x7fa0e815f830 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa0e00097c0 tx=0x7fa0e001c2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=175ff5ce5c8612d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:03.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.176+0000 7fa0ed230640 1 -- 172.21.15.18:0/1316469552 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e00b0070 con 0x7fa0e80b0120 2024-04-17T19:54:03.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.176+0000 7fa0ed230640 1 -- 172.21.15.18:0/1316469552 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0e00ab600 con 0x7fa0e80b0120 2024-04-17T19:54:03.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.176+0000 7fa0ed230640 1 -- 172.21.15.18:0/1316469552 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e00ab9d0 con 0x7fa0e80b0120 2024-04-17T19:54:03.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.176+0000 7fa0f0496640 1 -- 172.21.15.18:0/1316469552 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa0e80b0120 msgr2=0x7fa0e815f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:03.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.176+0000 7fa0f0496640 1 --2- 172.21.15.18:0/1316469552 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa0e80b0120 0x7fa0e815f830 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa0e00097c0 tx=0x7fa0e001c2a0 comp rx=0 tx=0).stop 2024-04-17T19:54:03.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.176+0000 7fa0f0496640 1 -- 172.21.15.18:0/1316469552 shutdown_connections 2024-04-17T19:54:03.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.176+0000 7fa0f0496640 1 --2- 172.21.15.18:0/1316469552 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa0e80b44b0 0x7fa0e80b48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:03.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.176+0000 7fa0f0496640 1 --2- 172.21.15.18:0/1316469552 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa0e80b0120 0x7fa0e815f830 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:03.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.176+0000 7fa0f0496640 1 -- 172.21.15.18:0/1316469552 >> 172.21.15.18:0/1316469552 conn(0x7fa0e8072bb0 msgr2=0x7fa0e8072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:03.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.176+0000 7fa0f0496640 1 -- 172.21.15.18:0/1316469552 shutdown_connections 2024-04-17T19:54:03.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.176+0000 7fa0f0496640 1 -- 172.21.15.18:0/1316469552 wait complete. 2024-04-17T19:54:03.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.180+0000 7fa0f0496640 1 Processor -- start 2024-04-17T19:54:03.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.180+0000 7fa0f0496640 1 -- start start 2024-04-17T19:54:03.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.180+0000 7fa0f0496640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa0e806cd60 0x7fa0e813cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:03.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.180+0000 7fa0f0496640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa0e80b0120 0x7fa0e814ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:03.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.180+0000 7fa0f0496640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa0e80b44b0 0x7fa0e814d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:03.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.180+0000 7fa0f0496640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e80b4e00 con 0x7fa0e80b44b0 2024-04-17T19:54:03.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.180+0000 7fa0f0496640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e80b3f90 con 0x7fa0e806cd60 2024-04-17T19:54:03.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.180+0000 7fa0f0496640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fa0e80b4f80 con 0x7fa0e80b0120 2024-04-17T19:54:03.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.180+0000 7fa0eea33640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa0e80b44b0 0x7fa0e814d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:03.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.180+0000 7fa0eea33640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa0e80b44b0 0x7fa0e814d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49314/0 (socket says 172.21.15.18:49314) 2024-04-17T19:54:03.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.180+0000 7fa0eea33640 1 -- 172.21.15.18:0/902880605 learned_addr learned my addr 172.21.15.18:0/902880605 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:03.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.180+0000 7fa0ee232640 1 --2- 172.21.15.18:0/902880605 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa0e806cd60 0x7fa0e813cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:03.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.180+0000 7fa0eda31640 1 --2- 172.21.15.18:0/902880605 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa0e80b0120 0x7fa0e814ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:03.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.180+0000 7fa0eea33640 1 -- 172.21.15.18:0/902880605 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa0e80b0120 msgr2=0x7fa0e814ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:03.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.180+0000 7fa0eea33640 1 --2- 172.21.15.18:0/902880605 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa0e80b0120 0x7fa0e814ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:03.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.180+0000 7fa0eea33640 1 -- 172.21.15.18:0/902880605 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa0e806cd60 msgr2=0x7fa0e813cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:03.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.180+0000 7fa0eea33640 1 --2- 172.21.15.18:0/902880605 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa0e806cd60 0x7fa0e813cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:03.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.180+0000 7fa0eea33640 1 -- 172.21.15.18:0/902880605 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0e8150190 con 0x7fa0e80b44b0 2024-04-17T19:54:03.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.180+0000 7fa0ee232640 1 --2- 172.21.15.18:0/902880605 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa0e806cd60 0x7fa0e813cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:54:03.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.180+0000 7fa0eea33640 1 --2- 172.21.15.18:0/902880605 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa0e80b44b0 0x7fa0e814d340 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa0e4007d80 tx=0x7fa0e400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:03.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.180+0000 7fa0deffd640 1 -- 172.21.15.18:0/902880605 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e4014420 con 0x7fa0e80b44b0 2024-04-17T19:54:03.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.180+0000 7fa0deffd640 1 -- 172.21.15.18:0/902880605 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0e4019070 con 0x7fa0e80b44b0 2024-04-17T19:54:03.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.180+0000 7fa0f0496640 1 -- 172.21.15.18:0/902880605 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0e8150470 con 0x7fa0e80b44b0 2024-04-17T19:54:03.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.180+0000 7fa0deffd640 1 -- 172.21.15.18:0/902880605 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e4014800 con 0x7fa0e80b44b0 2024-04-17T19:54:03.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.180+0000 7fa0f0496640 1 -- 172.21.15.18:0/902880605 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0e813d850 con 0x7fa0e80b44b0 2024-04-17T19:54:03.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.184+0000 7fa0f0496640 1 -- 172.21.15.18:0/902880605 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0e813dab0 con 0x7fa0e80b44b0 2024-04-17T19:54:03.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.184+0000 7fa0deffd640 1 -- 172.21.15.18:0/902880605 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa0e40149a0 con 0x7fa0e80b44b0 2024-04-17T19:54:03.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.184+0000 7fa0deffd640 1 --2- 172.21.15.18:0/902880605 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fa0cc068380 0x7fa0cc06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:03.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.184+0000 7fa0ee232640 1 --2- 172.21.15.18:0/902880605 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fa0cc068380 0x7fa0cc06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:03.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.184+0000 7fa0deffd640 1 -- 172.21.15.18:0/902880605 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7fa0e4087500 con 0x7fa0e80b44b0 2024-04-17T19:54:03.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.184+0000 7fa0ee232640 1 --2- 172.21.15.18:0/902880605 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fa0cc068380 0x7fa0cc06a890 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa0e00ad000 tx=0x7fa0e00a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:03.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.188+0000 7fa0deffd640 1 -- 172.21.15.18:0/902880605 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa0e4057780 con 0x7fa0e80b44b0 2024-04-17T19:54:03.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.344+0000 7fa0f0496640 1 -- 172.21.15.18:0/902880605 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fa0e8069950 con 0x7fa0e80b44b0 2024-04-17T19:54:03.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.344+0000 7fa0deffd640 1 -- 172.21.15.18:0/902880605 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7fa0e4057080 con 0x7fa0e80b44b0 2024-04-17T19:54:03.342 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-17T19:54:03.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.344+0000 7fa0f0496640 1 -- 172.21.15.18:0/902880605 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fa0cc068380 msgr2=0x7fa0cc06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:03.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.344+0000 7fa0f0496640 1 --2- 172.21.15.18:0/902880605 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fa0cc068380 0x7fa0cc06a890 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa0e00ad000 tx=0x7fa0e00a6000 comp rx=0 tx=0).stop 2024-04-17T19:54:03.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.344+0000 7fa0f0496640 1 -- 172.21.15.18:0/902880605 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa0e80b44b0 msgr2=0x7fa0e814d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:03.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.344+0000 7fa0f0496640 1 --2- 172.21.15.18:0/902880605 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa0e80b44b0 0x7fa0e814d340 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa0e4007d80 tx=0x7fa0e400e4b0 comp rx=0 tx=0).stop 2024-04-17T19:54:03.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.344+0000 7fa0f0496640 1 -- 172.21.15.18:0/902880605 shutdown_connections 2024-04-17T19:54:03.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.344+0000 7fa0f0496640 1 --2- 172.21.15.18:0/902880605 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fa0cc068380 0x7fa0cc06a890 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:03.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.344+0000 7fa0f0496640 1 --2- 172.21.15.18:0/902880605 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa0e80b44b0 0x7fa0e814d340 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:03.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.344+0000 7fa0f0496640 1 --2- 172.21.15.18:0/902880605 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa0e80b0120 0x7fa0e814ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:03.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.344+0000 7fa0f0496640 1 --2- 172.21.15.18:0/902880605 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa0e806cd60 0x7fa0e813cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:03.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.344+0000 7fa0f0496640 1 -- 172.21.15.18:0/902880605 >> 172.21.15.18:0/902880605 conn(0x7fa0e8072bb0 msgr2=0x7fa0e814f870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:03.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.344+0000 7fa0f0496640 1 -- 172.21.15.18:0/902880605 shutdown_connections 2024-04-17T19:54:03.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.344+0000 7fa0f0496640 1 -- 172.21.15.18:0/902880605 wait complete. 2024-04-17T19:54:03.362 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-17T19:54:03.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.520+0000 7f2956c72640 1 Processor -- start 2024-04-17T19:54:03.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.520+0000 7f2956c72640 1 -- start start 2024-04-17T19:54:03.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.520+0000 7f2956c72640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f29500cece0 0x7f2950161500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:03.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.520+0000 7f2956c72640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f2950161a40 0x7f29500b6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:03.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.520+0000 7f2956c72640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29500cdc10 con 0x7f29500cf0f0 2024-04-17T19:54:03.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.520+0000 7f2956c72640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f29500ce4b0 con 0x7f2950161a40 2024-04-17T19:54:03.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.520+0000 7f2956c72640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f2950161070 con 0x7f29500cece0 2024-04-17T19:54:03.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.520+0000 7f294ffff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f29500cf0f0 0x7f29500b1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:51186/0 (socket says 172.21.15.18:51186) 2024-04-17T19:54:03.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.520+0000 7f294ffff640 1 -- 172.21.15.18:0/1231466656 learned_addr learned my addr 172.21.15.18:0/1231466656 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:54:03.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.520+0000 7f295520f640 1 --2- 172.21.15.18:0/1231466656 >> v2:172.21.15.173:3300/0 conn(0x7f2950161a40 0x7f29500b6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:03.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.520+0000 7f2954a0e640 1 --2- 172.21.15.18:0/1231466656 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f29500cece0 0x7f2950161500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:03.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.520+0000 7f294f7fe640 1 -- 172.21.15.18:0/1231466656 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3532918137 0 0) 0x7f29500cdc10 con 0x7f29500cf0f0 2024-04-17T19:54:03.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.520+0000 7f294f7fe640 1 -- 172.21.15.18:0/1231466656 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f293c003530 con 0x7f29500cf0f0 2024-04-17T19:54:03.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.520+0000 7f294f7fe640 1 -- 172.21.15.18:0/1231466656 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2888898770 0 0) 0x7f293c003530 con 0x7f29500cf0f0 2024-04-17T19:54:03.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.520+0000 7f294f7fe640 1 -- 172.21.15.18:0/1231466656 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f29500cece0 msgr2=0x7f2950161500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:03.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.520+0000 7f294f7fe640 1 --2- 172.21.15.18:0/1231466656 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f29500cece0 0x7f2950161500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:03.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.520+0000 7f294f7fe640 1 -- 172.21.15.18:0/1231466656 >> v2:172.21.15.173:3300/0 conn(0x7f2950161a40 msgr2=0x7f29500b6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:03.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.520+0000 7f294f7fe640 1 --2- 172.21.15.18:0/1231466656 >> v2:172.21.15.173:3300/0 conn(0x7f2950161a40 0x7f29500b6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:03.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.520+0000 7f294f7fe640 1 -- 172.21.15.18:0/1231466656 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29500cdef0 con 0x7f29500cf0f0 2024-04-17T19:54:03.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.520+0000 7f294f7fe640 1 -- 172.21.15.18:0/1231466656 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3208559991 0 0) 0x7f2938001680 con 0x7f29500cf0f0 2024-04-17T19:54:03.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.520+0000 7f294f7fe640 1 -- 172.21.15.18:0/1231466656 >> v1:172.21.15.18:6789/0 conn(0x7f29500cf0f0 legacy=0x7f29500b1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:03.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.520+0000 7f294f7fe640 1 --2- 172.21.15.18:0/1231466656 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f293c0039c0 0x7f293c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:03.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.520+0000 7f294f7fe640 1 --2- 172.21.15.18:0/1231466656 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f29500cece0 0x7f293c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:03.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.520+0000 7f294f7fe640 1 --2- 172.21.15.18:0/1231466656 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f293c004d50 0x7f293c005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:03.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.520+0000 7f294f7fe640 1 -- 172.21.15.18:0/1231466656 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f293c00b9d0 con 0x7f293c0039c0 2024-04-17T19:54:03.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.520+0000 7f294f7fe640 1 -- 172.21.15.18:0/1231466656 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f293c00bb50 con 0x7f293c004d50 2024-04-17T19:54:03.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.520+0000 7f294f7fe640 1 -- 172.21.15.18:0/1231466656 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f293c00bcd0 con 0x7f29500cece0 2024-04-17T19:54:03.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.520+0000 7f2954a0e640 1 --2- 172.21.15.18:0/1231466656 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f293c0039c0 0x7f293c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:03.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.520+0000 7f294ffff640 1 --2- 172.21.15.18:0/1231466656 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f29500cece0 0x7f293c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:03.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.520+0000 7f295520f640 1 --2- 172.21.15.18:0/1231466656 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f293c004d50 0x7f293c005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:03.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.520+0000 7f2954a0e640 1 -- 172.21.15.18:0/1231466656 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f29500cece0 msgr2=0x7f293c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:03.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.520+0000 7f2954a0e640 1 --2- 172.21.15.18:0/1231466656 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f29500cece0 0x7f293c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:03.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.520+0000 7f2954a0e640 1 -- 172.21.15.18:0/1231466656 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f293c004d50 msgr2=0x7f293c005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:03.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.520+0000 7f2954a0e640 1 --2- 172.21.15.18:0/1231466656 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f293c004d50 0x7f293c005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:03.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.520+0000 7f2954a0e640 1 -- 172.21.15.18:0/1231466656 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f293c003530 con 0x7f293c0039c0 2024-04-17T19:54:03.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.524+0000 7f2954a0e640 1 --2- 172.21.15.18:0/1231466656 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f293c0039c0 0x7f293c003e30 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2940009fc0 tx=0x7f294001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62ac518333874653 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:03.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.524+0000 7f294f7fe640 1 -- 172.21.15.18:0/1231466656 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29400b2070 con 0x7f293c0039c0 2024-04-17T19:54:03.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.524+0000 7f294f7fe640 1 -- 172.21.15.18:0/1231466656 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29400a5a50 con 0x7f293c0039c0 2024-04-17T19:54:03.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.524+0000 7f294f7fe640 1 -- 172.21.15.18:0/1231466656 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2940009c10 con 0x7f293c0039c0 2024-04-17T19:54:03.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.524+0000 7f2956c72640 1 -- 172.21.15.18:0/1231466656 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f293c0039c0 msgr2=0x7f293c003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:03.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.524+0000 7f2956c72640 1 --2- 172.21.15.18:0/1231466656 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f293c0039c0 0x7f293c003e30 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2940009fc0 tx=0x7f294001cc60 comp rx=0 tx=0).stop 2024-04-17T19:54:03.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.524+0000 7f295520f640 1 -- 172.21.15.18:0/1231466656 reap_dead start 2024-04-17T19:54:03.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.524+0000 7f2956c72640 1 -- 172.21.15.18:0/1231466656 shutdown_connections 2024-04-17T19:54:03.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.524+0000 7f2956c72640 1 -- 172.21.15.18:0/1231466656 >> 172.21.15.18:0/1231466656 conn(0x7f295009aa70 msgr2=0x7f295009ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:03.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.524+0000 7f2956c72640 1 -- 172.21.15.18:0/1231466656 shutdown_connections 2024-04-17T19:54:03.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.524+0000 7f2956c72640 1 -- 172.21.15.18:0/1231466656 wait complete. 2024-04-17T19:54:03.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.528+0000 7f2956c72640 1 Processor -- start 2024-04-17T19:54:03.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.528+0000 7f2956c72640 1 -- start start 2024-04-17T19:54:03.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.528+0000 7f2956c72640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f293c0039c0 0x7f295006ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:03.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.528+0000 7f2956c72640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f295006d780 0x7f295006db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:03.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.528+0000 7f2956c72640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29500b0150 0x7f29500b0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:03.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.528+0000 7f2956c72640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f29500b2810 con 0x7f29500b0150 2024-04-17T19:54:03.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.528+0000 7f2956c72640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f29500b1c60 con 0x7f293c0039c0 2024-04-17T19:54:03.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.528+0000 7f2956c72640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f29500b71a0 con 0x7f295006d780 2024-04-17T19:54:03.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.528+0000 7f295520f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29500b0150 0x7f29500b0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:03.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.528+0000 7f295520f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29500b0150 0x7f29500b0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:49344/0 (socket says 172.21.15.18:49344) 2024-04-17T19:54:03.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.528+0000 7f295520f640 1 -- 172.21.15.18:0/4011734622 learned_addr learned my addr 172.21.15.18:0/4011734622 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:03.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.528+0000 7f294ffff640 1 --2- 172.21.15.18:0/4011734622 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f295006d780 0x7f295006db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:03.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.528+0000 7f2954a0e640 1 --2- 172.21.15.18:0/4011734622 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f293c0039c0 0x7f295006ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:03.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.528+0000 7f295520f640 1 -- 172.21.15.18:0/4011734622 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f295006d780 msgr2=0x7f295006db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:03.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.528+0000 7f295520f640 1 --2- 172.21.15.18:0/4011734622 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f295006d780 0x7f295006db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:03.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.528+0000 7f295520f640 1 -- 172.21.15.18:0/4011734622 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f293c0039c0 msgr2=0x7f295006ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:03.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.528+0000 7f295520f640 1 --2- 172.21.15.18:0/4011734622 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f293c0039c0 0x7f295006ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:03.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.528+0000 7f295520f640 1 -- 172.21.15.18:0/4011734622 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29500b0aa0 con 0x7f29500b0150 2024-04-17T19:54:03.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.528+0000 7f295520f640 1 --2- 172.21.15.18:0/4011734622 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29500b0150 0x7f29500b0560 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f29500b1100 tx=0x7f2948011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:03.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.528+0000 7f294d7fa640 1 -- 172.21.15.18:0/4011734622 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2948003620 con 0x7f29500b0150 2024-04-17T19:54:03.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.528+0000 7f294d7fa640 1 -- 172.21.15.18:0/4011734622 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f294801b070 con 0x7f29500b0150 2024-04-17T19:54:03.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.528+0000 7f2956c72640 1 -- 172.21.15.18:0/4011734622 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f295006e3d0 con 0x7f29500b0150 2024-04-17T19:54:03.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.528+0000 7f294d7fa640 1 -- 172.21.15.18:0/4011734622 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2948003a00 con 0x7f29500b0150 2024-04-17T19:54:03.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.528+0000 7f2956c72640 1 -- 172.21.15.18:0/4011734622 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f295006e990 con 0x7f29500b0150 2024-04-17T19:54:03.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.528+0000 7f2956c72640 1 -- 172.21.15.18:0/4011734622 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f295006e140 con 0x7f29500b0150 2024-04-17T19:54:03.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.532+0000 7f294d7fa640 1 -- 172.21.15.18:0/4011734622 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2948003ba0 con 0x7f29500b0150 2024-04-17T19:54:03.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.532+0000 7f294d7fa640 1 --2- 172.21.15.18:0/4011734622 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f2930068380 0x7f293006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:03.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.532+0000 7f294d7fa640 1 -- 172.21.15.18:0/4011734622 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7f2948086940 con 0x7f29500b0150 2024-04-17T19:54:03.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.532+0000 7f2954a0e640 1 --2- 172.21.15.18:0/4011734622 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f2930068380 0x7f293006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:03.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.532+0000 7f2954a0e640 1 --2- 172.21.15.18:0/4011734622 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f2930068380 0x7f293006a890 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f29400af000 tx=0x7f2940004ac0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:03.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.536+0000 7f294d7fa640 1 -- 172.21.15.18:0/4011734622 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2948024060 con 0x7f29500b0150 2024-04-17T19:54:03.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.712+0000 7f2956c72640 1 -- 172.21.15.18:0/4011734622 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f2950069950 con 0x7f29500b0150 2024-04-17T19:54:03.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.712+0000 7f294d7fa640 1 -- 172.21.15.18:0/4011734622 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7f29500b0aa0 con 0x7f29500b0150 2024-04-17T19:54:03.710 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-04-17T19:54:03.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.716+0000 7f2956c72640 1 -- 172.21.15.18:0/4011734622 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f2930068380 msgr2=0x7f293006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:03.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.716+0000 7f2956c72640 1 --2- 172.21.15.18:0/4011734622 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f2930068380 0x7f293006a890 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f29400af000 tx=0x7f2940004ac0 comp rx=0 tx=0).stop 2024-04-17T19:54:03.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.716+0000 7f2956c72640 1 -- 172.21.15.18:0/4011734622 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29500b0150 msgr2=0x7f29500b0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:03.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.716+0000 7f2956c72640 1 --2- 172.21.15.18:0/4011734622 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29500b0150 0x7f29500b0560 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f29500b1100 tx=0x7f2948011920 comp rx=0 tx=0).stop 2024-04-17T19:54:03.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.716+0000 7f2956c72640 1 -- 172.21.15.18:0/4011734622 shutdown_connections 2024-04-17T19:54:03.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.716+0000 7f2956c72640 1 --2- 172.21.15.18:0/4011734622 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f2930068380 0x7f293006a890 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:03.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.716+0000 7f2956c72640 1 --2- 172.21.15.18:0/4011734622 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29500b0150 0x7f29500b0560 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:03.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.716+0000 7f2956c72640 1 --2- 172.21.15.18:0/4011734622 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f295006d780 0x7f295006db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:03.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.716+0000 7f2956c72640 1 --2- 172.21.15.18:0/4011734622 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f293c0039c0 0x7f295006ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:03.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.716+0000 7f2956c72640 1 -- 172.21.15.18:0/4011734622 >> 172.21.15.18:0/4011734622 conn(0x7f295009aa70 msgr2=0x7f29500b1340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:03.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.716+0000 7f2956c72640 1 -- 172.21.15.18:0/4011734622 shutdown_connections 2024-04-17T19:54:03.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:03.716+0000 7f2956c72640 1 -- 172.21.15.18:0/4011734622 wait complete. 2024-04-17T19:54:03.733 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi018.front.sepia.ceph.com... 2024-04-17T19:54:03.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:54:03.733 DEBUG:teuthology.orchestra.run.smithi018:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-04-17T19:54:03.744 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi018.stderr:ceph-fuse[35668]: fuse finished with error 0 and tester_r 0 2024-04-17T19:54:03.745 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T19:54:09.847 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi018.front.sepia.ceph.com 2024-04-17T19:54:09.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:54:09.848 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-04-17T19:54:09.855 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-17T19:54:09.856 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-17T19:54:09.862 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-17T19:54:09.862 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-17T19:54:09.910 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T19:54:10.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.076+0000 7fef18064640 1 Processor -- start 2024-04-17T19:54:10.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.076+0000 7fef18064640 1 -- start start 2024-04-17T19:54:10.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.076+0000 7fef18064640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fef1015e1a0 0x7fef100ce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:10.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.076+0000 7fef18064640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fef1006cd60 0x7fef1006d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:10.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.076+0000 7fef18064640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef1006d6b0 con 0x7fef100cef10 2024-04-17T19:54:10.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.076+0000 7fef18064640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fef100d0020 con 0x7fef1006cd60 2024-04-17T19:54:10.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.076+0000 7fef18064640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7fef100cd930 con 0x7fef1015e1a0 2024-04-17T19:54:10.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.076+0000 7fef16601640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fef1006cd60 0x7fef1006d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:10.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.076+0000 7fef16601640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fef1006cd60 0x7fef1006d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53162/0 (socket says 172.21.15.18:53162) 2024-04-17T19:54:10.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.076+0000 7fef16601640 1 -- 172.21.15.18:0/208990888 learned_addr learned my addr 172.21.15.18:0/208990888 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:10.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.076+0000 7fef15e00640 1 --2- 172.21.15.18:0/208990888 >> v2:172.21.15.173:3300/0 conn(0x7fef1015e1a0 0x7fef100ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:10.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.076+0000 7fef16601640 1 -- 172.21.15.18:0/208990888 >> v2:172.21.15.173:3300/0 conn(0x7fef1015e1a0 msgr2=0x7fef100ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:10.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.076+0000 7fef16601640 1 --2- 172.21.15.18:0/208990888 >> v2:172.21.15.173:3300/0 conn(0x7fef1015e1a0 0x7fef100ce9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:10.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.076+0000 7fef16601640 1 -- 172.21.15.18:0/208990888 >> v1:172.21.15.173:6789/0 conn(0x7fef100cef10 legacy=0x7fef1015e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:10.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.076+0000 7fef16601640 1 -- 172.21.15.18:0/208990888 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef100cdc10 con 0x7fef1006cd60 2024-04-17T19:54:10.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.080+0000 7fef16601640 1 --2- 172.21.15.18:0/208990888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef1006cd60 0x7fef1006d170 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fef1006fdc0 tx=0x7fef0801c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d14e57239756116 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:10.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.080+0000 7fef14dfe640 1 -- 172.21.15.18:0/208990888 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef080b0070 con 0x7fef1006cd60 2024-04-17T19:54:10.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.080+0000 7fef14dfe640 1 -- 172.21.15.18:0/208990888 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef080ab600 con 0x7fef1006cd60 2024-04-17T19:54:10.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.080+0000 7fef14dfe640 1 -- 172.21.15.18:0/208990888 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef080ab9d0 con 0x7fef1006cd60 2024-04-17T19:54:10.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.080+0000 7fef18064640 1 -- 172.21.15.18:0/208990888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef1006cd60 msgr2=0x7fef1006d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:10.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.080+0000 7fef18064640 1 --2- 172.21.15.18:0/208990888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef1006cd60 0x7fef1006d170 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fef1006fdc0 tx=0x7fef0801c240 comp rx=0 tx=0).stop 2024-04-17T19:54:10.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.080+0000 7fef18064640 1 -- 172.21.15.18:0/208990888 shutdown_connections 2024-04-17T19:54:10.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.080+0000 7fef18064640 1 --2- 172.21.15.18:0/208990888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef1006cd60 0x7fef1006d170 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:10.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.080+0000 7fef18064640 1 --2- 172.21.15.18:0/208990888 >> v2:172.21.15.173:3300/0 conn(0x7fef1015e1a0 0x7fef100ce9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:10.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.080+0000 7fef18064640 1 -- 172.21.15.18:0/208990888 >> 172.21.15.18:0/208990888 conn(0x7fef10072bb0 msgr2=0x7fef10072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:10.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.080+0000 7fef18064640 1 -- 172.21.15.18:0/208990888 shutdown_connections 2024-04-17T19:54:10.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.080+0000 7fef18064640 1 -- 172.21.15.18:0/208990888 wait complete. 2024-04-17T19:54:10.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.084+0000 7fef18064640 1 Processor -- start 2024-04-17T19:54:10.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.084+0000 7fef18064640 1 -- start start 2024-04-17T19:54:10.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.084+0000 7fef18064640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef1006cd60 0x7fef100adfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:10.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.084+0000 7fef18064640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fef100cef10 0x7fef1014f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:10.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.084+0000 7fef18064640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef1015e1a0 0x7fef100b4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:10.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.084+0000 7fef18064640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fef1015e730 con 0x7fef1015e1a0 2024-04-17T19:54:10.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.084+0000 7fef18064640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fef1015e5b0 con 0x7fef1006cd60 2024-04-17T19:54:10.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.084+0000 7fef18064640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fef1015f020 con 0x7fef100cef10 2024-04-17T19:54:10.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.084+0000 7fef16601640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef1015e1a0 0x7fef100b4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:10.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.084+0000 7fef16601640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef1015e1a0 0x7fef100b4830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53174/0 (socket says 172.21.15.18:53174) 2024-04-17T19:54:10.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.084+0000 7fef16601640 1 -- 172.21.15.18:0/3140948688 learned_addr learned my addr 172.21.15.18:0/3140948688 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:10.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.084+0000 7fef15e00640 1 --2- 172.21.15.18:0/3140948688 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef1006cd60 0x7fef100adfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:10.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.084+0000 7fef155ff640 1 --2- 172.21.15.18:0/3140948688 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fef100cef10 0x7fef1014f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:10.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.084+0000 7fef16601640 1 -- 172.21.15.18:0/3140948688 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fef100cef10 msgr2=0x7fef1014f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:10.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.084+0000 7fef16601640 1 --2- 172.21.15.18:0/3140948688 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fef100cef10 0x7fef1014f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:10.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.084+0000 7fef16601640 1 -- 172.21.15.18:0/3140948688 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef1006cd60 msgr2=0x7fef100adfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:10.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.084+0000 7fef16601640 1 --2- 172.21.15.18:0/3140948688 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef1006cd60 0x7fef100adfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:10.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.084+0000 7fef16601640 1 -- 172.21.15.18:0/3140948688 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef10070960 con 0x7fef1015e1a0 2024-04-17T19:54:10.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.084+0000 7fef16601640 1 --2- 172.21.15.18:0/3140948688 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef1015e1a0 0x7fef100b4830 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fef080ae040 tx=0x7fef08018fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:10.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.084+0000 7fef0e7fc640 1 -- 172.21.15.18:0/3140948688 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef080b0040 con 0x7fef1015e1a0 2024-04-17T19:54:10.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.084+0000 7fef0e7fc640 1 -- 172.21.15.18:0/3140948688 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef080b9070 con 0x7fef1015e1a0 2024-04-17T19:54:10.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.084+0000 7fef18064640 1 -- 172.21.15.18:0/3140948688 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef1014f710 con 0x7fef1015e1a0 2024-04-17T19:54:10.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.084+0000 7fef0e7fc640 1 -- 172.21.15.18:0/3140948688 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef080b4640 con 0x7fef1015e1a0 2024-04-17T19:54:10.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.084+0000 7fef18064640 1 -- 172.21.15.18:0/3140948688 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef100b5760 con 0x7fef1015e1a0 2024-04-17T19:54:10.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.088+0000 7fef18064640 1 -- 172.21.15.18:0/3140948688 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef100b51f0 con 0x7fef1015e1a0 2024-04-17T19:54:10.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.088+0000 7fef0e7fc640 1 -- 172.21.15.18:0/3140948688 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fef080b47e0 con 0x7fef1015e1a0 2024-04-17T19:54:10.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.088+0000 7fef0e7fc640 1 --2- 172.21.15.18:0/3140948688 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7feefc068380 0x7feefc06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:10.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.088+0000 7fef0e7fc640 1 -- 172.21.15.18:0/3140948688 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7fef08120a50 con 0x7fef1015e1a0 2024-04-17T19:54:10.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.088+0000 7fef15e00640 1 --2- 172.21.15.18:0/3140948688 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7feefc068380 0x7feefc06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:10.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.088+0000 7fef15e00640 1 --2- 172.21.15.18:0/3140948688 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7feefc068380 0x7feefc06a890 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fef00003fd0 tx=0x7fef000039a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:10.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.092+0000 7fef0e7fc640 1 -- 172.21.15.18:0/3140948688 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fef1006d6b0 con 0x7fef1015e1a0 2024-04-17T19:54:10.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.256+0000 7fef18064640 1 -- 172.21.15.18:0/3140948688 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fef10069950 con 0x7fef1015e1a0 2024-04-17T19:54:10.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.260+0000 7fef0e7fc640 1 -- 172.21.15.18:0/3140948688 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18759 (secure 0 0 0) 0x7fef080f0c40 con 0x7fef1015e1a0 2024-04-17T19:54:10.256 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:54:10.257 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":29,"fsid":"dd480169-5a81-4623-be5f-0499aa244b28","created":"2024-04-17T19:52:39.533760+0000","modified":"2024-04-17T19:53:45.435889+0000","last_up_change":"2024-04-17T19:52:51.229698+0000","last_in_change":"2024-04-17T19:52:42.144259+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T19:52:52.391648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T19:53:02.734240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T19:53:03.813028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T19:53:07.478812+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e232d577-2508-4ea4-b355-29fbae1ff025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6801","nonce":2323038417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6803","nonce":2323038417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6807","nonce":2323038417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6805","nonce":2323038417}]},"public_addr":"172.21.15.18:6801/2323038417","cluster_addr":"172.21.15.18:6803/2323038417","heartbeat_back_addr":"172.21.15.18:6807/2323038417","heartbeat_front_addr":"172.21.15.18:6805/2323038417","state":["exists","up"]},{"osd":1,"uuid":"31810ef3-2c71-48d6-8748-b74a2968d23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6817","nonce":1283678238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6819","nonce":1283678238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6823","nonce":1283678238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6821","nonce":1283678238}]},"public_addr":"172.21.15.18:6817/1283678238","cluster_addr":"172.21.15.18:6819/1283678238","heartbeat_back_addr":"172.21.15.18:6823/1283678238","heartbeat_front_addr":"172.21.15.18:6821/1283678238","state":["exists","up"]},{"osd":2,"uuid":"5a783cc5-a41c-4967-9e11-6b8330f97d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6809","nonce":1212875862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6811","nonce":1212875862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6815","nonce":1212875862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6813","nonce":1212875862}]},"public_addr":"172.21.15.18:6809/1212875862","cluster_addr":"172.21.15.18:6811/1212875862","heartbeat_back_addr":"172.21.15.18:6815/1212875862","heartbeat_front_addr":"172.21.15.18:6813/1212875862","state":["exists","up"]},{"osd":3,"uuid":"b7e056d9-9da5-46e1-810d-0c3e242fe5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6825","nonce":2428878428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6827","nonce":2428878428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6831","nonce":2428878428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6829","nonce":2428878428}]},"public_addr":"172.21.15.18:6825/2428878428","cluster_addr":"172.21.15.18:6827/2428878428","heartbeat_back_addr":"172.21.15.18:6831/2428878428","heartbeat_front_addr":"172.21.15.18:6829/2428878428","state":["exists","up"]},{"osd":4,"uuid":"21df023f-bc8b-4abb-93e5-0ecc91acda0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6825","nonce":1421511819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6827","nonce":1421511819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6831","nonce":1421511819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6829","nonce":1421511819}]},"public_addr":"172.21.15.173:6825/1421511819","cluster_addr":"172.21.15.173:6827/1421511819","heartbeat_back_addr":"172.21.15.173:6831/1421511819","heartbeat_front_addr":"172.21.15.173:6829/1421511819","state":["exists","up"]},{"osd":5,"uuid":"e270098a-6d33-49f8-84ed-94e09a880cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6801","nonce":4221907702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6803","nonce":4221907702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6807","nonce":4221907702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6805","nonce":4221907702}]},"public_addr":"172.21.15.173:6801/4221907702","cluster_addr":"172.21.15.173:6803/4221907702","heartbeat_back_addr":"172.21.15.173:6807/4221907702","heartbeat_front_addr":"172.21.15.173:6805/4221907702","state":["exists","up"]},{"osd":6,"uuid":"93c67c8c-268d-4e32-877c-043cd3acd87c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6809","nonce":761678552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6811","nonce":761678552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6815","nonce":761678552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6813","nonce":761678552}]},"public_addr":"172.21.15.173:6809/761678552","cluster_addr":"172.21.15.173:6811/761678552","heartbeat_back_addr":"172.21.15.173:6815/761678552","heartbeat_front_addr":"172.21.15.173:6813/761678552","state":["exists","up"]},{"osd":7,"uuid":"faf10eea-80de-40f6-abbb-34d07d3f59ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6817","nonce":383724537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6819","nonce":383724537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6823","nonce":383724537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6821","nonce":383724537}]},"public_addr":"172.21.15.173:6817/383724537","cluster_addr":"172.21.15.173:6819/383724537","heartbeat_back_addr":"172.21.15.173:6823/383724537","heartbeat_front_addr":"172.21.15.173:6821/383724537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.668924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.761747+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.768128+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.632252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.742608+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.734327+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.477107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.818292+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.31","mappings":[{"from":0,"to":7}]},{"pgid":"4.5","mappings":[{"from":3,"to":4},{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":0}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]},{"pgid":"4.1c","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T19:54:10.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.260+0000 7fef18064640 1 -- 172.21.15.18:0/3140948688 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7feefc068380 msgr2=0x7feefc06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:10.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.260+0000 7fef18064640 1 --2- 172.21.15.18:0/3140948688 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7feefc068380 0x7feefc06a890 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fef00003fd0 tx=0x7fef000039a0 comp rx=0 tx=0).stop 2024-04-17T19:54:10.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.260+0000 7fef18064640 1 -- 172.21.15.18:0/3140948688 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef1015e1a0 msgr2=0x7fef100b4830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:10.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.260+0000 7fef18064640 1 --2- 172.21.15.18:0/3140948688 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef1015e1a0 0x7fef100b4830 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fef080ae040 tx=0x7fef08018fe0 comp rx=0 tx=0).stop 2024-04-17T19:54:10.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.260+0000 7fef18064640 1 -- 172.21.15.18:0/3140948688 shutdown_connections 2024-04-17T19:54:10.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.260+0000 7fef18064640 1 --2- 172.21.15.18:0/3140948688 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7feefc068380 0x7feefc06a890 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:10.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.260+0000 7fef18064640 1 --2- 172.21.15.18:0/3140948688 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef1015e1a0 0x7fef100b4830 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:10.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.260+0000 7fef18064640 1 --2- 172.21.15.18:0/3140948688 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fef100cef10 0x7fef1014f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:10.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.260+0000 7fef18064640 1 --2- 172.21.15.18:0/3140948688 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef1006cd60 0x7fef100adfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:10.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.260+0000 7fef18064640 1 -- 172.21.15.18:0/3140948688 >> 172.21.15.18:0/3140948688 conn(0x7fef10072bb0 msgr2=0x7fef100b1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:10.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.260+0000 7fef18064640 1 -- 172.21.15.18:0/3140948688 shutdown_connections 2024-04-17T19:54:10.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.260+0000 7fef18064640 1 -- 172.21.15.18:0/3140948688 wait complete. 2024-04-17T19:54:10.281 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T19:52:52.391648+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-17T19:53:02.734240+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-17T19:53:03.813028+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-17T19:53:07.478812+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-17T19:54:10.281 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T19:54:10.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.444+0000 7f8656f96640 1 Processor -- start 2024-04-17T19:54:10.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.444+0000 7f8656f96640 1 -- start start 2024-04-17T19:54:10.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.444+0000 7f8656f96640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f865009b180 0x7f86500b2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:10.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.444+0000 7f8656f96640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86500b13d0 con 0x7f865006ed50 2024-04-17T19:54:10.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.444+0000 7f8656f96640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86500d1aa0 con 0x7f86500aea10 2024-04-17T19:54:10.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.444+0000 7f8656f96640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f86500d1850 con 0x7f865009b180 2024-04-17T19:54:10.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.444+0000 7f864ffff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f865009b180 0x7f86500b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:10.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.444+0000 7f864ffff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f865009b180 0x7f86500b2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53180/0 (socket says 172.21.15.18:53180) 2024-04-17T19:54:10.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.444+0000 7f8654d32640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f865006ed50 0x7f865009aa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:33598/0 (socket says 172.21.15.18:33598) 2024-04-17T19:54:10.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.444+0000 7f864ffff640 1 -- 172.21.15.18:0/614413988 learned_addr learned my addr 172.21.15.18:0/614413988 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:10.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.444+0000 7f864ffff640 1 -- 172.21.15.18:0/614413988 >> v1:172.21.15.173:6789/0 conn(0x7f86500aea10 legacy=0x7f86500b26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:10.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.444+0000 7f864ffff640 1 -- 172.21.15.18:0/614413988 >> v1:172.21.15.18:6789/0 conn(0x7f865006ed50 legacy=0x7f865009aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:10.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.444+0000 7f864ffff640 1 -- 172.21.15.18:0/614413988 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86500d1d80 con 0x7f865009b180 2024-04-17T19:54:10.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.448+0000 7f864ffff640 1 --2- 172.21.15.18:0/614413988 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f865009b180 0x7f86500b2190 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8644009870 tx=0x7f864401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56436dbaf0a5c823 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:10.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.448+0000 7f864f7fe640 1 -- 172.21.15.18:0/614413988 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86440ab650 con 0x7f865009b180 2024-04-17T19:54:10.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.448+0000 7f864f7fe640 1 -- 172.21.15.18:0/614413988 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86440b0070 con 0x7f865009b180 2024-04-17T19:54:10.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.448+0000 7f864f7fe640 1 -- 172.21.15.18:0/614413988 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86440aba10 con 0x7f865009b180 2024-04-17T19:54:10.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.448+0000 7f8656f96640 1 -- 172.21.15.18:0/614413988 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f865009b180 msgr2=0x7f86500b2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:10.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.448+0000 7f8656f96640 1 --2- 172.21.15.18:0/614413988 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f865009b180 0x7f86500b2190 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8644009870 tx=0x7f864401c560 comp rx=0 tx=0).stop 2024-04-17T19:54:10.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.448+0000 7f8656f96640 1 -- 172.21.15.18:0/614413988 shutdown_connections 2024-04-17T19:54:10.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.448+0000 7f8656f96640 1 --2- 172.21.15.18:0/614413988 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f865009b180 0x7f86500b2190 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:10.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.448+0000 7f8656f96640 1 -- 172.21.15.18:0/614413988 >> 172.21.15.18:0/614413988 conn(0x7f86500b6990 msgr2=0x7f86500b6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:10.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.448+0000 7f8656f96640 1 -- 172.21.15.18:0/614413988 shutdown_connections 2024-04-17T19:54:10.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.448+0000 7f8656f96640 1 -- 172.21.15.18:0/614413988 wait complete. 2024-04-17T19:54:10.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.448+0000 7f8656f96640 1 Processor -- start 2024-04-17T19:54:10.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.448+0000 7f8656f96640 1 -- start start 2024-04-17T19:54:10.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.452+0000 7f8656f96640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f865006ed50 0x7f865014e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:10.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.452+0000 7f8656f96640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86500aea10 0x7f865015d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:10.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.452+0000 7f8656f96640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f865014fe70 0x7f8650150280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:10.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.452+0000 7f8656f96640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f865016d5b0 con 0x7f86500aea10 2024-04-17T19:54:10.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.452+0000 7f8656f96640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f865016d430 con 0x7f865014fe70 2024-04-17T19:54:10.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.452+0000 7f8656f96640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f865016d730 con 0x7f865006ed50 2024-04-17T19:54:10.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.452+0000 7f864ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86500aea10 0x7f865015d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:10.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.452+0000 7f864ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86500aea10 0x7f865015d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53194/0 (socket says 172.21.15.18:53194) 2024-04-17T19:54:10.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.452+0000 7f864ffff640 1 -- 172.21.15.18:0/2355916936 learned_addr learned my addr 172.21.15.18:0/2355916936 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:10.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.452+0000 7f8655533640 1 --2- 172.21.15.18:0/2355916936 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f865014fe70 0x7f8650150280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:10.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.452+0000 7f8654d32640 1 --2- 172.21.15.18:0/2355916936 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f865006ed50 0x7f865014e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:10.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.452+0000 7f864ffff640 1 -- 172.21.15.18:0/2355916936 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f865006ed50 msgr2=0x7f865014e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:10.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.452+0000 7f864ffff640 1 --2- 172.21.15.18:0/2355916936 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f865006ed50 0x7f865014e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:10.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.452+0000 7f864ffff640 1 -- 172.21.15.18:0/2355916936 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f865014fe70 msgr2=0x7f8650150280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:10.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.452+0000 7f864ffff640 1 --2- 172.21.15.18:0/2355916936 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f865014fe70 0x7f8650150280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:10.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.452+0000 7f864ffff640 1 -- 172.21.15.18:0/2355916936 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86501507c0 con 0x7f86500aea10 2024-04-17T19:54:10.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.452+0000 7f8654d32640 1 --2- 172.21.15.18:0/2355916936 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f865006ed50 0x7f865014e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:54:10.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.452+0000 7f864ffff640 1 --2- 172.21.15.18:0/2355916936 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86500aea10 0x7f865015d760 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f86440ad040 tx=0x7f8644019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:10.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.452+0000 7f864d7fa640 1 -- 172.21.15.18:0/2355916936 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86440be5f0 con 0x7f86500aea10 2024-04-17T19:54:10.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.452+0000 7f864d7fa640 1 -- 172.21.15.18:0/2355916936 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86440be7b0 con 0x7f86500aea10 2024-04-17T19:54:10.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.452+0000 7f8656f96640 1 -- 172.21.15.18:0/2355916936 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f865015dca0 con 0x7f86500aea10 2024-04-17T19:54:10.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.452+0000 7f864d7fa640 1 -- 172.21.15.18:0/2355916936 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86440beba0 con 0x7f86500aea10 2024-04-17T19:54:10.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.452+0000 7f8656f96640 1 -- 172.21.15.18:0/2355916936 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f865015e400 con 0x7f86500aea10 2024-04-17T19:54:10.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.452+0000 7f8656f96640 1 -- 172.21.15.18:0/2355916936 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f865015de70 con 0x7f86500aea10 2024-04-17T19:54:10.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.452+0000 7f864d7fa640 1 -- 172.21.15.18:0/2355916936 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f86440b4600 con 0x7f86500aea10 2024-04-17T19:54:10.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.456+0000 7f864d7fa640 1 --2- 172.21.15.18:0/2355916936 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f863c0683b0 0x7f863c06a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:10.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.456+0000 7f864d7fa640 1 -- 172.21.15.18:0/2355916936 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7f86441218e0 con 0x7f86500aea10 2024-04-17T19:54:10.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.456+0000 7f8654d32640 1 --2- 172.21.15.18:0/2355916936 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f863c0683b0 0x7f863c06a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:10.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.456+0000 7f8654d32640 1 --2- 172.21.15.18:0/2355916936 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f863c0683b0 0x7f863c06a8c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8640000f70 tx=0x7f8640009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:10.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.460+0000 7f864d7fa640 1 -- 172.21.15.18:0/2355916936 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f86440c4060 con 0x7f86500aea10 2024-04-17T19:54:10.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.624+0000 7f8656f96640 1 -- 172.21.15.18:0/2355916936 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f86501597d0 con 0x7f86500aea10 2024-04-17T19:54:10.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.624+0000 7f864d7fa640 1 -- 172.21.15.18:0/2355916936 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7f86501507c0 con 0x7f86500aea10 2024-04-17T19:54:10.623 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-17T19:54:10.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.628+0000 7f8656f96640 1 -- 172.21.15.18:0/2355916936 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f863c0683b0 msgr2=0x7f863c06a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:10.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.628+0000 7f8656f96640 1 --2- 172.21.15.18:0/2355916936 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f863c0683b0 0x7f863c06a8c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8640000f70 tx=0x7f8640009040 comp rx=0 tx=0).stop 2024-04-17T19:54:10.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.628+0000 7f8656f96640 1 -- 172.21.15.18:0/2355916936 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86500aea10 msgr2=0x7f865015d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:10.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.628+0000 7f8656f96640 1 --2- 172.21.15.18:0/2355916936 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86500aea10 0x7f865015d760 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f86440ad040 tx=0x7f8644019300 comp rx=0 tx=0).stop 2024-04-17T19:54:10.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.628+0000 7f8656f96640 1 -- 172.21.15.18:0/2355916936 shutdown_connections 2024-04-17T19:54:10.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.628+0000 7f8656f96640 1 --2- 172.21.15.18:0/2355916936 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f863c0683b0 0x7f863c06a8c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:10.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.628+0000 7f8656f96640 1 --2- 172.21.15.18:0/2355916936 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f865014fe70 0x7f8650150280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:10.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.628+0000 7f8656f96640 1 --2- 172.21.15.18:0/2355916936 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86500aea10 0x7f865015d760 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:10.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.628+0000 7f8656f96640 1 --2- 172.21.15.18:0/2355916936 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f865006ed50 0x7f865014e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:10.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.628+0000 7f8656f96640 1 -- 172.21.15.18:0/2355916936 >> 172.21.15.18:0/2355916936 conn(0x7f86500b6990 msgr2=0x7f865015c290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:10.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.628+0000 7f8656f96640 1 -- 172.21.15.18:0/2355916936 shutdown_connections 2024-04-17T19:54:10.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.628+0000 7f8656f96640 1 -- 172.21.15.18:0/2355916936 wait complete. 2024-04-17T19:54:10.646 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-17T19:54:10.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.808+0000 7f0fcd18a640 1 Processor -- start 2024-04-17T19:54:10.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.808+0000 7f0fcd18a640 1 -- start start 2024-04-17T19:54:10.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.812+0000 7f0fcd18a640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0fc815e1a0 0x7f0fc80ce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:10.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.812+0000 7f0fcd18a640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0fc80cef10 0x7f0fc815e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:10.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.812+0000 7f0fcd18a640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0fc815ee50 0x7f0fc806cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:10.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.812+0000 7f0fcd18a640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f0fc80d0020 con 0x7f0fc815e1a0 2024-04-17T19:54:10.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.812+0000 7f0fcd18a640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f0fc80cd930 con 0x7f0fc80cef10 2024-04-17T19:54:10.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.812+0000 7f0fcd18a640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f0fc80cdc10 con 0x7f0fc815ee50 2024-04-17T19:54:10.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.812+0000 7f0fc6d9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0fc815e1a0 0x7f0fc80ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:10.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.812+0000 7f0fc6d9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0fc815e1a0 0x7f0fc80ce9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53208/0 (socket says 172.21.15.18:53208) 2024-04-17T19:54:10.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.812+0000 7f0fc6d9d640 1 -- 172.21.15.18:0/405593276 learned_addr learned my addr 172.21.15.18:0/405593276 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:10.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.812+0000 7f0fc659c640 1 --2- 172.21.15.18:0/405593276 >> v2:172.21.15.173:3300/0 conn(0x7f0fc80cef10 0x7f0fc815e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:10.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.812+0000 7f0fc759e640 1 --2- 172.21.15.18:0/405593276 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0fc815ee50 0x7f0fc806cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:10.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.812+0000 7f0fc6d9d640 1 -- 172.21.15.18:0/405593276 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0fc815ee50 msgr2=0x7f0fc806cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:10.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.812+0000 7f0fc6d9d640 1 --2- 172.21.15.18:0/405593276 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0fc815ee50 0x7f0fc806cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:10.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.812+0000 7f0fc6d9d640 1 -- 172.21.15.18:0/405593276 >> v2:172.21.15.173:3300/0 conn(0x7f0fc80cef10 msgr2=0x7f0fc815e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:10.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.812+0000 7f0fc6d9d640 1 --2- 172.21.15.18:0/405593276 >> v2:172.21.15.173:3300/0 conn(0x7f0fc80cef10 0x7f0fc815e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:10.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.812+0000 7f0fc6d9d640 1 -- 172.21.15.18:0/405593276 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fc80cdef0 con 0x7f0fc815e1a0 2024-04-17T19:54:10.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.816+0000 7f0fc6d9d640 1 --2- 172.21.15.18:0/405593276 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0fc815e1a0 0x7f0fc80ce9d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f0fc80b6110 tx=0x7f0fb801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=955a5847674c7fe9 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:10.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.816+0000 7f0fc5d9b640 1 -- 172.21.15.18:0/405593276 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb80b0070 con 0x7f0fc815e1a0 2024-04-17T19:54:10.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.816+0000 7f0fc5d9b640 1 -- 172.21.15.18:0/405593276 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fb80ab600 con 0x7f0fc815e1a0 2024-04-17T19:54:10.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.816+0000 7f0fc5d9b640 1 -- 172.21.15.18:0/405593276 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb80ab9d0 con 0x7f0fc815e1a0 2024-04-17T19:54:10.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.816+0000 7f0fcd18a640 1 -- 172.21.15.18:0/405593276 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0fc815e1a0 msgr2=0x7f0fc80ce9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:10.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.816+0000 7f0fcd18a640 1 --2- 172.21.15.18:0/405593276 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0fc815e1a0 0x7f0fc80ce9d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f0fc80b6110 tx=0x7f0fb801c490 comp rx=0 tx=0).stop 2024-04-17T19:54:10.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.816+0000 7f0fcd18a640 1 -- 172.21.15.18:0/405593276 shutdown_connections 2024-04-17T19:54:10.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.816+0000 7f0fcd18a640 1 --2- 172.21.15.18:0/405593276 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0fc815ee50 0x7f0fc806cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:10.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.816+0000 7f0fcd18a640 1 --2- 172.21.15.18:0/405593276 >> v2:172.21.15.173:3300/0 conn(0x7f0fc80cef10 0x7f0fc815e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:10.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.816+0000 7f0fcd18a640 1 --2- 172.21.15.18:0/405593276 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0fc815e1a0 0x7f0fc80ce9d0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:10.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.816+0000 7f0fcd18a640 1 -- 172.21.15.18:0/405593276 >> 172.21.15.18:0/405593276 conn(0x7f0fc8072bb0 msgr2=0x7f0fc8072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:10.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.816+0000 7f0fcd18a640 1 -- 172.21.15.18:0/405593276 shutdown_connections 2024-04-17T19:54:10.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.816+0000 7f0fcd18a640 1 -- 172.21.15.18:0/405593276 wait complete. 2024-04-17T19:54:10.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.816+0000 7f0fcd18a640 1 Processor -- start 2024-04-17T19:54:10.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.816+0000 7f0fcd18a640 1 -- start start 2024-04-17T19:54:10.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.820+0000 7f0fcd18a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0fc80cef10 0x7f0fc80ac8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:10.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.820+0000 7f0fcd18a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0fc815e1a0 0x7f0fc80cbe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:10.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.820+0000 7f0fcd18a640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0fc815ee50 0x7f0fc80ae550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:10.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.820+0000 7f0fcd18a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc8157b90 con 0x7f0fc80cef10 2024-04-17T19:54:10.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.820+0000 7f0fcd18a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc8157a10 con 0x7f0fc815e1a0 2024-04-17T19:54:10.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.820+0000 7f0fcd18a640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f0fc806f0f0 con 0x7f0fc815ee50 2024-04-17T19:54:10.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.820+0000 7f0fc6d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0fc80cef10 0x7f0fc80ac8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:10.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.820+0000 7f0fc6d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0fc80cef10 0x7f0fc80ac8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53220/0 (socket says 172.21.15.18:53220) 2024-04-17T19:54:10.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.820+0000 7f0fc6d9d640 1 -- 172.21.15.18:0/3132077212 learned_addr learned my addr 172.21.15.18:0/3132077212 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:10.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.820+0000 7f0fc659c640 1 --2- 172.21.15.18:0/3132077212 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0fc815e1a0 0x7f0fc80cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:10.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.820+0000 7f0fc759e640 1 --2- 172.21.15.18:0/3132077212 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0fc815ee50 0x7f0fc80ae550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:10.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.820+0000 7f0fc6d9d640 1 -- 172.21.15.18:0/3132077212 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0fc815ee50 msgr2=0x7f0fc80ae550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:10.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.820+0000 7f0fc6d9d640 1 --2- 172.21.15.18:0/3132077212 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0fc815ee50 0x7f0fc80ae550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:10.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.820+0000 7f0fc6d9d640 1 -- 172.21.15.18:0/3132077212 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0fc815e1a0 msgr2=0x7f0fc80cbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:10.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.820+0000 7f0fc6d9d640 1 --2- 172.21.15.18:0/3132077212 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0fc815e1a0 0x7f0fc80cbe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:10.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.820+0000 7f0fc6d9d640 1 -- 172.21.15.18:0/3132077212 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fc80ad4b0 con 0x7f0fc80cef10 2024-04-17T19:54:10.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.820+0000 7f0fc759e640 1 --2- 172.21.15.18:0/3132077212 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0fc815ee50 0x7f0fc80ae550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:54:10.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.820+0000 7f0fc6d9d640 1 --2- 172.21.15.18:0/3132077212 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0fc80cef10 0x7f0fc80ac8a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f0fb80ae040 tx=0x7f0fb8019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:10.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.820+0000 7f0faf7fe640 1 -- 172.21.15.18:0/3132077212 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb80b0040 con 0x7f0fc80cef10 2024-04-17T19:54:10.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.820+0000 7f0faf7fe640 1 -- 172.21.15.18:0/3132077212 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fb80b9070 con 0x7f0fc80cef10 2024-04-17T19:54:10.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.820+0000 7f0fcd18a640 1 -- 172.21.15.18:0/3132077212 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fc80ad790 con 0x7f0fc80cef10 2024-04-17T19:54:10.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.820+0000 7f0faf7fe640 1 -- 172.21.15.18:0/3132077212 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb80b4680 con 0x7f0fc80cef10 2024-04-17T19:54:10.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.820+0000 7f0fcd18a640 1 -- 172.21.15.18:0/3132077212 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fc80add50 con 0x7f0fc80cef10 2024-04-17T19:54:10.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.820+0000 7f0fcd18a640 1 -- 172.21.15.18:0/3132077212 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fc8069950 con 0x7f0fc80cef10 2024-04-17T19:54:10.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.820+0000 7f0faf7fe640 1 -- 172.21.15.18:0/3132077212 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0fb80ab4c0 con 0x7f0fc80cef10 2024-04-17T19:54:10.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.824+0000 7f0faf7fe640 1 --2- 172.21.15.18:0/3132077212 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0fb4068380 0x7f0fb406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:10.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.824+0000 7f0faf7fe640 1 -- 172.21.15.18:0/3132077212 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7f0fb8120840 con 0x7f0fc80cef10 2024-04-17T19:54:10.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.824+0000 7f0fc659c640 1 --2- 172.21.15.18:0/3132077212 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0fb4068380 0x7f0fb406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:10.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.824+0000 7f0fc659c640 1 --2- 172.21.15.18:0/3132077212 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0fb4068380 0x7f0fb406a890 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0fc81fc220 tx=0x7f0fbc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:10.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.828+0000 7f0faf7fe640 1 -- 172.21.15.18:0/3132077212 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0fb8016110 con 0x7f0fc80cef10 2024-04-17T19:54:10.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.988+0000 7f0fcd18a640 1 -- 172.21.15.18:0/3132077212 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f0fc80b1470 con 0x7f0fc80cef10 2024-04-17T19:54:10.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.992+0000 7f0faf7fe640 1 -- 172.21.15.18:0/3132077212 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7f0fb80f0b50 con 0x7f0fc80cef10 2024-04-17T19:54:10.989 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-17T19:54:10.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.992+0000 7f0fcd18a640 1 -- 172.21.15.18:0/3132077212 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0fb4068380 msgr2=0x7f0fb406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:10.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.992+0000 7f0fcd18a640 1 --2- 172.21.15.18:0/3132077212 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0fb4068380 0x7f0fb406a890 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0fc81fc220 tx=0x7f0fbc008040 comp rx=0 tx=0).stop 2024-04-17T19:54:10.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.992+0000 7f0fcd18a640 1 -- 172.21.15.18:0/3132077212 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0fc80cef10 msgr2=0x7f0fc80ac8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:10.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.992+0000 7f0fcd18a640 1 --2- 172.21.15.18:0/3132077212 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0fc80cef10 0x7f0fc80ac8a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f0fb80ae040 tx=0x7f0fb8019230 comp rx=0 tx=0).stop 2024-04-17T19:54:10.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.992+0000 7f0fcd18a640 1 -- 172.21.15.18:0/3132077212 shutdown_connections 2024-04-17T19:54:10.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.992+0000 7f0fcd18a640 1 --2- 172.21.15.18:0/3132077212 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0fb4068380 0x7f0fb406a890 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:10.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.992+0000 7f0fcd18a640 1 --2- 172.21.15.18:0/3132077212 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0fc815ee50 0x7f0fc80ae550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:10.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.992+0000 7f0fcd18a640 1 --2- 172.21.15.18:0/3132077212 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0fc815e1a0 0x7f0fc80cbe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:10.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.992+0000 7f0fcd18a640 1 --2- 172.21.15.18:0/3132077212 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0fc80cef10 0x7f0fc80ac8a0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:10.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.992+0000 7f0fcd18a640 1 -- 172.21.15.18:0/3132077212 >> 172.21.15.18:0/3132077212 conn(0x7f0fc8072bb0 msgr2=0x7f0fc80b0780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:10.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.992+0000 7f0fcd18a640 1 -- 172.21.15.18:0/3132077212 shutdown_connections 2024-04-17T19:54:10.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:10.992+0000 7f0fcd18a640 1 -- 172.21.15.18:0/3132077212 wait complete. 2024-04-17T19:54:11.011 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-17T19:54:11.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.168+0000 7f4d5a73b640 1 Processor -- start 2024-04-17T19:54:11.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.168+0000 7f4d5a73b640 1 -- start start 2024-04-17T19:54:11.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.168+0000 7f4d5a73b640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4d5406ed50 0x7f4d5409aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:11.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.168+0000 7f4d5a73b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4d540b31a0 0x7f4d5409afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:11.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.168+0000 7f4d5a73b640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d540b13d0 con 0x7f4d540aea10 2024-04-17T19:54:11.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.168+0000 7f4d5a73b640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f4d540d1850 con 0x7f4d540b31a0 2024-04-17T19:54:11.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.168+0000 7f4d5a73b640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f4d540d1aa0 con 0x7f4d5406ed50 2024-04-17T19:54:11.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.168+0000 7f4d58cd8640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4d540b31a0 0x7f4d5409afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:11.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.168+0000 7f4d58cd8640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4d540b31a0 0x7f4d5409afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53226/0 (socket says 172.21.15.18:53226) 2024-04-17T19:54:11.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.168+0000 7f4d58cd8640 1 -- 172.21.15.18:0/1441749067 learned_addr learned my addr 172.21.15.18:0/1441749067 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:11.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.168+0000 7f4d53fff640 1 --2- 172.21.15.18:0/1441749067 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4d5406ed50 0x7f4d5409aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:11.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.168+0000 7f4d58cd8640 1 -- 172.21.15.18:0/1441749067 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4d5406ed50 msgr2=0x7f4d5409aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:11.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.168+0000 7f4d58cd8640 1 --2- 172.21.15.18:0/1441749067 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4d5406ed50 0x7f4d5409aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:11.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.168+0000 7f4d58cd8640 1 -- 172.21.15.18:0/1441749067 >> v1:172.21.15.173:6789/0 conn(0x7f4d540aea10 legacy=0x7f4d54163080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:11.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.168+0000 7f4d58cd8640 1 -- 172.21.15.18:0/1441749067 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d540d1d80 con 0x7f4d540b31a0 2024-04-17T19:54:11.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.172+0000 7f4d58cd8640 1 --2- 172.21.15.18:0/1441749067 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d540b31a0 0x7f4d5409afb0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c009e50 tx=0x7f4d4c01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebc5617a27f3a0f server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:11.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.172+0000 7f4d52ffd640 1 -- 172.21.15.18:0/1441749067 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c0a5700 con 0x7f4d540b31a0 2024-04-17T19:54:11.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.172+0000 7f4d52ffd640 1 -- 172.21.15.18:0/1441749067 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d4c0a58a0 con 0x7f4d540b31a0 2024-04-17T19:54:11.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.172+0000 7f4d52ffd640 1 -- 172.21.15.18:0/1441749067 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c0a5c70 con 0x7f4d540b31a0 2024-04-17T19:54:11.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.172+0000 7f4d5a73b640 1 -- 172.21.15.18:0/1441749067 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d540b31a0 msgr2=0x7f4d5409afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:11.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.172+0000 7f4d5a73b640 1 --2- 172.21.15.18:0/1441749067 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d540b31a0 0x7f4d5409afb0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c009e50 tx=0x7f4d4c01ca30 comp rx=0 tx=0).stop 2024-04-17T19:54:11.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.172+0000 7f4d5a73b640 1 -- 172.21.15.18:0/1441749067 shutdown_connections 2024-04-17T19:54:11.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.172+0000 7f4d5a73b640 1 --2- 172.21.15.18:0/1441749067 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d540b31a0 0x7f4d5409afb0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:11.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.172+0000 7f4d5a73b640 1 --2- 172.21.15.18:0/1441749067 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4d5406ed50 0x7f4d5409aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:11.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.172+0000 7f4d5a73b640 1 -- 172.21.15.18:0/1441749067 >> 172.21.15.18:0/1441749067 conn(0x7f4d540b6990 msgr2=0x7f4d540b6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:11.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.172+0000 7f4d5a73b640 1 -- 172.21.15.18:0/1441749067 shutdown_connections 2024-04-17T19:54:11.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.172+0000 7f4d5a73b640 1 -- 172.21.15.18:0/1441749067 wait complete. 2024-04-17T19:54:11.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.176+0000 7f4d5a73b640 1 Processor -- start 2024-04-17T19:54:11.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.176+0000 7f4d5a73b640 1 -- start start 2024-04-17T19:54:11.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.176+0000 7f4d5a73b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d5406ed50 0x7f4d54154760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:11.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.176+0000 7f4d5a73b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d540aea10 0x7f4d541521c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:11.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.176+0000 7f4d5a73b640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4d540b31a0 0x7f4d541527f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:11.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.176+0000 7f4d5a73b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4d5416c5a0 con 0x7f4d540aea10 2024-04-17T19:54:11.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.176+0000 7f4d5a73b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4d5416c420 con 0x7f4d5406ed50 2024-04-17T19:54:11.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.176+0000 7f4d5a73b640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f4d5416c720 con 0x7f4d540b31a0 2024-04-17T19:54:11.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.176+0000 7f4d537fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d540aea10 0x7f4d541521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:11.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.176+0000 7f4d537fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d540aea10 0x7f4d541521c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53240/0 (socket says 172.21.15.18:53240) 2024-04-17T19:54:11.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.176+0000 7f4d537fe640 1 -- 172.21.15.18:0/1634861295 learned_addr learned my addr 172.21.15.18:0/1634861295 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:11.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.176+0000 7f4d53fff640 1 --2- 172.21.15.18:0/1634861295 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d5406ed50 0x7f4d54154760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:11.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.176+0000 7f4d58cd8640 1 --2- 172.21.15.18:0/1634861295 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4d540b31a0 0x7f4d541527f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:11.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.176+0000 7f4d537fe640 1 -- 172.21.15.18:0/1634861295 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4d540b31a0 msgr2=0x7f4d541527f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:11.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.176+0000 7f4d537fe640 1 --2- 172.21.15.18:0/1634861295 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4d540b31a0 0x7f4d541527f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:11.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.176+0000 7f4d537fe640 1 -- 172.21.15.18:0/1634861295 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d5406ed50 msgr2=0x7f4d54154760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:11.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.176+0000 7f4d537fe640 1 --2- 172.21.15.18:0/1634861295 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d5406ed50 0x7f4d54154760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:11.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.176+0000 7f4d537fe640 1 -- 172.21.15.18:0/1634861295 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d54161e10 con 0x7f4d540aea10 2024-04-17T19:54:11.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.176+0000 7f4d537fe640 1 --2- 172.21.15.18:0/1634861295 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d540aea10 0x7f4d541521c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f4d4800c420 tx=0x7f4d4800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:11.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.176+0000 7f4d50ff9640 1 -- 172.21.15.18:0/1634861295 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d480052d0 con 0x7f4d540aea10 2024-04-17T19:54:11.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.176+0000 7f4d50ff9640 1 -- 172.21.15.18:0/1634861295 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d48005470 con 0x7f4d540aea10 2024-04-17T19:54:11.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.176+0000 7f4d5a73b640 1 -- 172.21.15.18:0/1634861295 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d54160810 con 0x7f4d540aea10 2024-04-17T19:54:11.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.176+0000 7f4d50ff9640 1 -- 172.21.15.18:0/1634861295 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d48007260 con 0x7f4d540aea10 2024-04-17T19:54:11.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.176+0000 7f4d5a73b640 1 -- 172.21.15.18:0/1634861295 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d541fc9d0 con 0x7f4d540aea10 2024-04-17T19:54:11.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.176+0000 7f4d5a73b640 1 -- 172.21.15.18:0/1634861295 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d54069950 con 0x7f4d540aea10 2024-04-17T19:54:11.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.180+0000 7f4d50ff9640 1 -- 172.21.15.18:0/1634861295 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4d48007400 con 0x7f4d540aea10 2024-04-17T19:54:11.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.180+0000 7f4d50ff9640 1 --2- 172.21.15.18:0/1634861295 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f4d400683b0 0x7f4d4006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:11.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.180+0000 7f4d50ff9640 1 -- 172.21.15.18:0/1634861295 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7f4d48086150 con 0x7f4d540aea10 2024-04-17T19:54:11.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.180+0000 7f4d53fff640 1 --2- 172.21.15.18:0/1634861295 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f4d400683b0 0x7f4d4006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:11.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.180+0000 7f4d53fff640 1 --2- 172.21.15.18:0/1634861295 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f4d400683b0 0x7f4d4006a8c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4d4400b930 tx=0x7f4d44008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:11.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.184+0000 7f4d50ff9640 1 -- 172.21.15.18:0/1634861295 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4d54161e10 con 0x7f4d540aea10 2024-04-17T19:54:11.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.348+0000 7f4d5a73b640 1 -- 172.21.15.18:0/1634861295 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4d5406e920 con 0x7f4d540aea10 2024-04-17T19:54:11.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.348+0000 7f4d50ff9640 1 -- 172.21.15.18:0/1634861295 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7f4d540b13d0 con 0x7f4d540aea10 2024-04-17T19:54:11.346 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-17T19:54:11.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.352+0000 7f4d5a73b640 1 -- 172.21.15.18:0/1634861295 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f4d400683b0 msgr2=0x7f4d4006a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:11.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.352+0000 7f4d5a73b640 1 --2- 172.21.15.18:0/1634861295 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f4d400683b0 0x7f4d4006a8c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4d4400b930 tx=0x7f4d44008040 comp rx=0 tx=0).stop 2024-04-17T19:54:11.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.352+0000 7f4d5a73b640 1 -- 172.21.15.18:0/1634861295 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d540aea10 msgr2=0x7f4d541521c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:11.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.352+0000 7f4d5a73b640 1 --2- 172.21.15.18:0/1634861295 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d540aea10 0x7f4d541521c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f4d4800c420 tx=0x7f4d4800c8e0 comp rx=0 tx=0).stop 2024-04-17T19:54:11.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.352+0000 7f4d5a73b640 1 -- 172.21.15.18:0/1634861295 shutdown_connections 2024-04-17T19:54:11.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.352+0000 7f4d5a73b640 1 --2- 172.21.15.18:0/1634861295 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f4d400683b0 0x7f4d4006a8c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:11.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.352+0000 7f4d5a73b640 1 --2- 172.21.15.18:0/1634861295 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4d540b31a0 0x7f4d541527f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:11.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.352+0000 7f4d5a73b640 1 --2- 172.21.15.18:0/1634861295 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d540aea10 0x7f4d541521c0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:11.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.352+0000 7f4d5a73b640 1 --2- 172.21.15.18:0/1634861295 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d5406ed50 0x7f4d54154760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:11.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.352+0000 7f4d5a73b640 1 -- 172.21.15.18:0/1634861295 >> 172.21.15.18:0/1634861295 conn(0x7f4d540b6990 msgr2=0x7f4d54070e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:11.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.352+0000 7f4d5a73b640 1 -- 172.21.15.18:0/1634861295 shutdown_connections 2024-04-17T19:54:11.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.352+0000 7f4d5a73b640 1 -- 172.21.15.18:0/1634861295 wait complete. 2024-04-17T19:54:11.367 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-17T19:54:11.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.528+0000 7fa61e6f2640 1 Processor -- start 2024-04-17T19:54:11.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.528+0000 7fa61e6f2640 1 -- start start 2024-04-17T19:54:11.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.528+0000 7fa61e6f2640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa61815e1a0 0x7fa6180ce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:11.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.528+0000 7fa61e6f2640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa61806cd60 0x7fa61806d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:11.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.528+0000 7fa61e6f2640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa61806d6b0 con 0x7fa6180cef10 2024-04-17T19:54:11.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.528+0000 7fa61e6f2640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7fa6180d0020 con 0x7fa61806cd60 2024-04-17T19:54:11.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.528+0000 7fa61e6f2640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fa6180cd930 con 0x7fa61815e1a0 2024-04-17T19:54:11.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.528+0000 7fa6177fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fa6180cef10 0x7fa61815e910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:33600/0 (socket says 172.21.15.18:33600) 2024-04-17T19:54:11.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.528+0000 7fa6177fe640 1 -- 172.21.15.18:0/3902033143 learned_addr learned my addr 172.21.15.18:0/3902033143 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:54:11.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.528+0000 7fa61cc8f640 1 --2- 172.21.15.18:0/3902033143 >> v2:172.21.15.173:3300/0 conn(0x7fa61806cd60 0x7fa61806d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:11.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.528+0000 7fa617fff640 1 --2- 172.21.15.18:0/3902033143 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa61815e1a0 0x7fa6180ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:11.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.528+0000 7fa616ffd640 1 -- 172.21.15.18:0/3902033143 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1174031223 0 0) 0x7fa60c001120 con 0x7fa6180cef10 2024-04-17T19:54:11.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.528+0000 7fa616ffd640 1 -- 172.21.15.18:0/3902033143 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa600003530 con 0x7fa6180cef10 2024-04-17T19:54:11.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.528+0000 7fa616ffd640 1 -- 172.21.15.18:0/3902033143 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3644980466 0 0) 0x7fa600003530 con 0x7fa6180cef10 2024-04-17T19:54:11.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.528+0000 7fa616ffd640 1 -- 172.21.15.18:0/3902033143 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa61815e1a0 msgr2=0x7fa6180ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:11.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.528+0000 7fa616ffd640 1 --2- 172.21.15.18:0/3902033143 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa61815e1a0 0x7fa6180ce9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:11.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.528+0000 7fa616ffd640 1 -- 172.21.15.18:0/3902033143 >> v2:172.21.15.173:3300/0 conn(0x7fa61806cd60 msgr2=0x7fa61806d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:11.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.528+0000 7fa616ffd640 1 --2- 172.21.15.18:0/3902033143 >> v2:172.21.15.173:3300/0 conn(0x7fa61806cd60 0x7fa61806d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:11.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.528+0000 7fa616ffd640 1 -- 172.21.15.18:0/3902033143 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6180cdc10 con 0x7fa6180cef10 2024-04-17T19:54:11.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.528+0000 7fa616ffd640 1 -- 172.21.15.18:0/3902033143 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3208559991 0 0) 0x7fa60c001850 con 0x7fa6180cef10 2024-04-17T19:54:11.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.528+0000 7fa616ffd640 1 -- 172.21.15.18:0/3902033143 >> v1:172.21.15.18:6789/0 conn(0x7fa6180cef10 legacy=0x7fa61815e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:11.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.528+0000 7fa616ffd640 1 --2- 172.21.15.18:0/3902033143 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa61815e1a0 0x7fa6000039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:11.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.528+0000 7fa616ffd640 1 --2- 172.21.15.18:0/3902033143 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa600003f40 0x7fa600004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:11.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.528+0000 7fa616ffd640 1 --2- 172.21.15.18:0/3902033143 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa600004d50 0x7fa600005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:11.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.528+0000 7fa616ffd640 1 -- 172.21.15.18:0/3902033143 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa6180d0020 con 0x7fa600004d50 2024-04-17T19:54:11.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.532+0000 7fa616ffd640 1 -- 172.21.15.18:0/3902033143 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa6180cd930 con 0x7fa600003f40 2024-04-17T19:54:11.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.532+0000 7fa616ffd640 1 -- 172.21.15.18:0/3902033143 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fa60000bad0 con 0x7fa61815e1a0 2024-04-17T19:54:11.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.532+0000 7fa61cc8f640 1 --2- 172.21.15.18:0/3902033143 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa600004d50 0x7fa600005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:11.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.532+0000 7fa6177fe640 1 --2- 172.21.15.18:0/3902033143 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa600003f40 0x7fa600004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:11.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.532+0000 7fa617fff640 1 --2- 172.21.15.18:0/3902033143 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa61815e1a0 0x7fa6000039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:11.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.532+0000 7fa61cc8f640 1 -- 172.21.15.18:0/3902033143 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa61815e1a0 msgr2=0x7fa6000039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:11.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.532+0000 7fa61cc8f640 1 --2- 172.21.15.18:0/3902033143 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa61815e1a0 0x7fa6000039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:11.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.532+0000 7fa61cc8f640 1 -- 172.21.15.18:0/3902033143 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa600003f40 msgr2=0x7fa600004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:11.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.532+0000 7fa61cc8f640 1 --2- 172.21.15.18:0/3902033143 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa600003f40 0x7fa600004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:11.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.532+0000 7fa61cc8f640 1 -- 172.21.15.18:0/3902033143 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa600003530 con 0x7fa600004d50 2024-04-17T19:54:11.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.532+0000 7fa61cc8f640 1 --2- 172.21.15.18:0/3902033143 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa600004d50 0x7fa600005160 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa610009fc0 tx=0x7fa61001ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fcdfc30f99a5837 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:11.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.532+0000 7fa616ffd640 1 -- 172.21.15.18:0/3902033143 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6100b2070 con 0x7fa600004d50 2024-04-17T19:54:11.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.532+0000 7fa616ffd640 1 -- 172.21.15.18:0/3902033143 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6100a5cd0 con 0x7fa600004d50 2024-04-17T19:54:11.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.532+0000 7fa616ffd640 1 -- 172.21.15.18:0/3902033143 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa610009c10 con 0x7fa600004d50 2024-04-17T19:54:11.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.532+0000 7fa61e6f2640 1 -- 172.21.15.18:0/3902033143 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa600004d50 msgr2=0x7fa600005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:11.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.532+0000 7fa61e6f2640 1 --2- 172.21.15.18:0/3902033143 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa600004d50 0x7fa600005160 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa610009fc0 tx=0x7fa61001ccc0 comp rx=0 tx=0).stop 2024-04-17T19:54:11.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.532+0000 7fa61cc8f640 1 -- 172.21.15.18:0/3902033143 reap_dead start 2024-04-17T19:54:11.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.532+0000 7fa61e6f2640 1 -- 172.21.15.18:0/3902033143 shutdown_connections 2024-04-17T19:54:11.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.532+0000 7fa61e6f2640 1 -- 172.21.15.18:0/3902033143 >> 172.21.15.18:0/3902033143 conn(0x7fa618072bb0 msgr2=0x7fa618072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:11.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.532+0000 7fa61e6f2640 1 -- 172.21.15.18:0/3902033143 shutdown_connections 2024-04-17T19:54:11.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.532+0000 7fa61e6f2640 1 -- 172.21.15.18:0/3902033143 wait complete. 2024-04-17T19:54:11.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.536+0000 7fa61e6f2640 1 Processor -- start 2024-04-17T19:54:11.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.536+0000 7fa61e6f2640 1 -- start start 2024-04-17T19:54:11.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.536+0000 7fa61e6f2640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa600004d50 0x7fa6181e7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:11.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.536+0000 7fa61e6f2640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa61813d1c0 0x7fa61814ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:11.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.536+0000 7fa61e6f2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa61813e990 0x7fa6181e65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:11.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.536+0000 7fa61e6f2640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa6180ce4b0 con 0x7fa61813e990 2024-04-17T19:54:11.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.536+0000 7fa61e6f2640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa6180ce1d0 con 0x7fa61813d1c0 2024-04-17T19:54:11.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.536+0000 7fa61e6f2640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fa61815e5b0 con 0x7fa600004d50 2024-04-17T19:54:11.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.536+0000 7fa61cc8f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa61813e990 0x7fa6181e65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:11.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.536+0000 7fa61cc8f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa61813e990 0x7fa6181e65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53262/0 (socket says 172.21.15.18:53262) 2024-04-17T19:54:11.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.536+0000 7fa61cc8f640 1 -- 172.21.15.18:0/3647675423 learned_addr learned my addr 172.21.15.18:0/3647675423 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:11.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.536+0000 7fa6177fe640 1 --2- 172.21.15.18:0/3647675423 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa61813d1c0 0x7fa61814ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:11.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.536+0000 7fa617fff640 1 --2- 172.21.15.18:0/3647675423 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa600004d50 0x7fa6181e7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:11.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.536+0000 7fa61cc8f640 1 -- 172.21.15.18:0/3647675423 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa600004d50 msgr2=0x7fa6181e7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:11.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.536+0000 7fa61cc8f640 1 --2- 172.21.15.18:0/3647675423 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa600004d50 0x7fa6181e7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:11.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.536+0000 7fa61cc8f640 1 -- 172.21.15.18:0/3647675423 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa61813d1c0 msgr2=0x7fa61814ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:11.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.536+0000 7fa61cc8f640 1 --2- 172.21.15.18:0/3647675423 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa61813d1c0 0x7fa61814ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:11.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.536+0000 7fa61cc8f640 1 -- 172.21.15.18:0/3647675423 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6181e8320 con 0x7fa61813e990 2024-04-17T19:54:11.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.536+0000 7fa617fff640 1 --2- 172.21.15.18:0/3647675423 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa600004d50 0x7fa6181e7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:54:11.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.536+0000 7fa61cc8f640 1 --2- 172.21.15.18:0/3647675423 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa61813e990 0x7fa6181e65a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa610002240 tx=0x7fa610009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:11.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.536+0000 7fa614ff9640 1 -- 172.21.15.18:0/3647675423 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6100bd070 con 0x7fa61813e990 2024-04-17T19:54:11.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.536+0000 7fa614ff9640 1 -- 172.21.15.18:0/3647675423 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6100a5ad0 con 0x7fa61813e990 2024-04-17T19:54:11.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.536+0000 7fa614ff9640 1 -- 172.21.15.18:0/3647675423 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6100b2040 con 0x7fa61813e990 2024-04-17T19:54:11.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.536+0000 7fa61e6f2640 1 -- 172.21.15.18:0/3647675423 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa61813d8f0 con 0x7fa61813e990 2024-04-17T19:54:11.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.536+0000 7fa61e6f2640 1 -- 172.21.15.18:0/3647675423 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa61813deb0 con 0x7fa61813e990 2024-04-17T19:54:11.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.540+0000 7fa61e6f2640 1 -- 172.21.15.18:0/3647675423 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa618069950 con 0x7fa61813e990 2024-04-17T19:54:11.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.540+0000 7fa614ff9640 1 -- 172.21.15.18:0/3647675423 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa6100c0070 con 0x7fa61813e990 2024-04-17T19:54:11.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.540+0000 7fa614ff9640 1 --2- 172.21.15.18:0/3647675423 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fa604068380 0x7fa60406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:11.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.540+0000 7fa614ff9640 1 -- 172.21.15.18:0/3647675423 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7fa6101212d0 con 0x7fa61813e990 2024-04-17T19:54:11.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.540+0000 7fa617fff640 1 --2- 172.21.15.18:0/3647675423 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fa604068380 0x7fa60406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:11.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.540+0000 7fa617fff640 1 --2- 172.21.15.18:0/3647675423 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fa604068380 0x7fa60406a890 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa6180b5f30 tx=0x7fa608008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:11.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.544+0000 7fa614ff9640 1 -- 172.21.15.18:0/3647675423 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa6100c7070 con 0x7fa61813e990 2024-04-17T19:54:11.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.712+0000 7fa61e6f2640 1 -- 172.21.15.18:0/3647675423 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fa618073460 con 0x7fa61813e990 2024-04-17T19:54:11.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.712+0000 7fa614ff9640 1 -- 172.21.15.18:0/3647675423 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7fa6100169d0 con 0x7fa61813e990 2024-04-17T19:54:11.710 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-17T19:54:11.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.716+0000 7fa61e6f2640 1 -- 172.21.15.18:0/3647675423 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fa604068380 msgr2=0x7fa60406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:11.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.716+0000 7fa61e6f2640 1 --2- 172.21.15.18:0/3647675423 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fa604068380 0x7fa60406a890 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa6180b5f30 tx=0x7fa608008040 comp rx=0 tx=0).stop 2024-04-17T19:54:11.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.716+0000 7fa61e6f2640 1 -- 172.21.15.18:0/3647675423 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa61813e990 msgr2=0x7fa6181e65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:11.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.716+0000 7fa61e6f2640 1 --2- 172.21.15.18:0/3647675423 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa61813e990 0x7fa6181e65a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa610002240 tx=0x7fa610009750 comp rx=0 tx=0).stop 2024-04-17T19:54:11.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.716+0000 7fa61e6f2640 1 -- 172.21.15.18:0/3647675423 shutdown_connections 2024-04-17T19:54:11.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.716+0000 7fa61e6f2640 1 --2- 172.21.15.18:0/3647675423 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fa604068380 0x7fa60406a890 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:11.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.716+0000 7fa61e6f2640 1 --2- 172.21.15.18:0/3647675423 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa61813e990 0x7fa6181e65a0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:11.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.716+0000 7fa61e6f2640 1 --2- 172.21.15.18:0/3647675423 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa61813d1c0 0x7fa61814ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:11.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.716+0000 7fa61e6f2640 1 --2- 172.21.15.18:0/3647675423 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa600004d50 0x7fa6181e7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:11.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.716+0000 7fa61e6f2640 1 -- 172.21.15.18:0/3647675423 >> 172.21.15.18:0/3647675423 conn(0x7fa618072bb0 msgr2=0x7fa6180aa750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:11.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.716+0000 7fa61e6f2640 1 -- 172.21.15.18:0/3647675423 shutdown_connections 2024-04-17T19:54:11.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.716+0000 7fa61e6f2640 1 -- 172.21.15.18:0/3647675423 wait complete. 2024-04-17T19:54:11.733 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-17T19:54:11.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.888+0000 7f1907eca640 1 Processor -- start 2024-04-17T19:54:11.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.888+0000 7f1907eca640 1 -- start start 2024-04-17T19:54:11.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.892+0000 7f1907eca640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f190015e910 0x7f190015ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:11.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.892+0000 7f1907eca640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19000d0020 con 0x7f190015e1a0 2024-04-17T19:54:11.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.892+0000 7f1907eca640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19000cd930 con 0x7f190006cd60 2024-04-17T19:54:11.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.892+0000 7f1907eca640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f19000cdc10 con 0x7f190015e910 2024-04-17T19:54:11.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.892+0000 7f1905c66640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f190015e1a0 0x7f19000ce9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:33612/0 (socket says 172.21.15.18:33612) 2024-04-17T19:54:11.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.892+0000 7f1905c66640 1 -- 172.21.15.18:0/4123617135 learned_addr learned my addr 172.21.15.18:0/4123617135 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:54:11.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.892+0000 7f1905465640 1 --2- 172.21.15.18:0/4123617135 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f190015e910 0x7f190015ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:11.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.892+0000 7f1904c64640 1 -- 172.21.15.18:0/4123617135 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3747165653 0 0) 0x7f19000d0020 con 0x7f190015e1a0 2024-04-17T19:54:11.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.892+0000 7f1904c64640 1 -- 172.21.15.18:0/4123617135 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f18ec003530 con 0x7f190015e1a0 2024-04-17T19:54:11.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.892+0000 7f1904c64640 1 -- 172.21.15.18:0/4123617135 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3506515907 0 0) 0x7f19000cd930 con 0x7f190006cd60 2024-04-17T19:54:11.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.892+0000 7f1904c64640 1 -- 172.21.15.18:0/4123617135 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f19000d0020 con 0x7f190006cd60 2024-04-17T19:54:11.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.892+0000 7f1904c64640 1 -- 172.21.15.18:0/4123617135 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2967602435 0 0) 0x7f18ec003530 con 0x7f190015e1a0 2024-04-17T19:54:11.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.892+0000 7f1904c64640 1 -- 172.21.15.18:0/4123617135 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f190015e910 msgr2=0x7f190015ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:11.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.892+0000 7f1904c64640 1 --2- 172.21.15.18:0/4123617135 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f190015e910 0x7f190015ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:11.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.892+0000 7f1904c64640 1 -- 172.21.15.18:0/4123617135 >> v1:172.21.15.173:6789/0 conn(0x7f190006cd60 legacy=0x7f190006d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:11.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.892+0000 7f1904c64640 1 -- 172.21.15.18:0/4123617135 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19000cdef0 con 0x7f190015e1a0 2024-04-17T19:54:11.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.892+0000 7f1904c64640 1 -- 172.21.15.18:0/4123617135 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3208559991 0 0) 0x7f18f00016a0 con 0x7f190015e1a0 2024-04-17T19:54:11.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.892+0000 7f1904c64640 1 -- 172.21.15.18:0/4123617135 >> v1:172.21.15.18:6789/0 conn(0x7f190015e1a0 legacy=0x7f19000ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:11.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.892+0000 7f1904c64640 1 --2- 172.21.15.18:0/4123617135 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18ec003b80 0x7f18ec003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:11.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.892+0000 7f1904c64640 1 --2- 172.21.15.18:0/4123617135 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f190015e910 0x7f18ec004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:11.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.892+0000 7f1904c64640 1 --2- 172.21.15.18:0/4123617135 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18ec004d50 0x7f18ec005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:11.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.892+0000 7f1904c64640 1 -- 172.21.15.18:0/4123617135 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f19000cdc10 con 0x7f18ec004d50 2024-04-17T19:54:11.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.892+0000 7f1904c64640 1 -- 172.21.15.18:0/4123617135 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f18ec00bb90 con 0x7f18ec003b80 2024-04-17T19:54:11.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.892+0000 7f1904c64640 1 -- 172.21.15.18:0/4123617135 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f18ec00bd90 con 0x7f190015e910 2024-04-17T19:54:11.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.892+0000 7f1906467640 1 --2- 172.21.15.18:0/4123617135 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18ec004d50 0x7f18ec005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:11.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.892+0000 7f1905c66640 1 --2- 172.21.15.18:0/4123617135 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18ec003b80 0x7f18ec003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:11.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.892+0000 7f1905465640 1 --2- 172.21.15.18:0/4123617135 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f190015e910 0x7f18ec004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:11.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.892+0000 7f1906467640 1 -- 172.21.15.18:0/4123617135 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f190015e910 msgr2=0x7f18ec004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:11.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.892+0000 7f1906467640 1 --2- 172.21.15.18:0/4123617135 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f190015e910 0x7f18ec004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:11.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.892+0000 7f1906467640 1 -- 172.21.15.18:0/4123617135 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18ec003b80 msgr2=0x7f18ec003fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:11.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.892+0000 7f1906467640 1 --2- 172.21.15.18:0/4123617135 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18ec003b80 0x7f18ec003fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:11.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.892+0000 7f1906467640 1 -- 172.21.15.18:0/4123617135 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18ec003530 con 0x7f18ec004d50 2024-04-17T19:54:11.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.896+0000 7f1906467640 1 --2- 172.21.15.18:0/4123617135 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18ec004d50 0x7f18ec005160 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f18f8001fd0 tx=0x7f18f801f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed7f2d4bbaf48012 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:11.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.896+0000 7f1904c64640 1 -- 172.21.15.18:0/4123617135 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f8001c20 con 0x7f18ec004d50 2024-04-17T19:54:11.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.896+0000 7f1904c64640 1 -- 172.21.15.18:0/4123617135 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18f80a8cb0 con 0x7f18ec004d50 2024-04-17T19:54:11.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.896+0000 7f1904c64640 1 -- 172.21.15.18:0/4123617135 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f80a8e60 con 0x7f18ec004d50 2024-04-17T19:54:11.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.896+0000 7f1907eca640 1 -- 172.21.15.18:0/4123617135 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18ec004d50 msgr2=0x7f18ec005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:11.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.896+0000 7f1907eca640 1 --2- 172.21.15.18:0/4123617135 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18ec004d50 0x7f18ec005160 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f18f8001fd0 tx=0x7f18f801f070 comp rx=0 tx=0).stop 2024-04-17T19:54:11.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.896+0000 7f1906467640 1 -- 172.21.15.18:0/4123617135 reap_dead start 2024-04-17T19:54:11.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.896+0000 7f1907eca640 1 -- 172.21.15.18:0/4123617135 shutdown_connections 2024-04-17T19:54:11.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.896+0000 7f1907eca640 1 -- 172.21.15.18:0/4123617135 >> 172.21.15.18:0/4123617135 conn(0x7f1900072bb0 msgr2=0x7f1900072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:11.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.896+0000 7f1907eca640 1 -- 172.21.15.18:0/4123617135 shutdown_connections 2024-04-17T19:54:11.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.896+0000 7f1907eca640 1 -- 172.21.15.18:0/4123617135 wait complete. 2024-04-17T19:54:11.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.896+0000 7f1907eca640 1 Processor -- start 2024-04-17T19:54:11.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.900+0000 7f1907eca640 1 -- start start 2024-04-17T19:54:11.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.900+0000 7f1907eca640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18ec004d50 0x7f190014c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:11.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.900+0000 7f1907eca640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f19001594f0 0x7f1900154aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:11.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.900+0000 7f1907eca640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1900154fe0 0x7f1900150de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:11.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.900+0000 7f1907eca640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f190015e5b0 con 0x7f18ec004d50 2024-04-17T19:54:11.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.900+0000 7f1907eca640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f19000ce4b0 con 0x7f1900154fe0 2024-04-17T19:54:11.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.900+0000 7f1907eca640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f190015e730 con 0x7f19001594f0 2024-04-17T19:54:11.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.900+0000 7f1905c66640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18ec004d50 0x7f190014c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:11.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.900+0000 7f1905c66640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18ec004d50 0x7f190014c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53280/0 (socket says 172.21.15.18:53280) 2024-04-17T19:54:11.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.900+0000 7f1905c66640 1 -- 172.21.15.18:0/3888984815 learned_addr learned my addr 172.21.15.18:0/3888984815 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:11.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.900+0000 7f1906467640 1 --2- 172.21.15.18:0/3888984815 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1900154fe0 0x7f1900150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:11.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.900+0000 7f1905465640 1 --2- 172.21.15.18:0/3888984815 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f19001594f0 0x7f1900154aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:11.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.900+0000 7f1905c66640 1 -- 172.21.15.18:0/3888984815 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f19001594f0 msgr2=0x7f1900154aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:11.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.900+0000 7f1905c66640 1 --2- 172.21.15.18:0/3888984815 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f19001594f0 0x7f1900154aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:11.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.900+0000 7f1905c66640 1 -- 172.21.15.18:0/3888984815 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1900154fe0 msgr2=0x7f1900150de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:11.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.900+0000 7f1905c66640 1 --2- 172.21.15.18:0/3888984815 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1900154fe0 0x7f1900150de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:11.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.900+0000 7f1905c66640 1 -- 172.21.15.18:0/3888984815 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19001553f0 con 0x7f18ec004d50 2024-04-17T19:54:11.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.900+0000 7f1905c66640 1 --2- 172.21.15.18:0/3888984815 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18ec004d50 0x7f190014c1a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f18f000e780 tx=0x7f18f000ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:11.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.900+0000 7f18f67fc640 1 -- 172.21.15.18:0/3888984815 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f000c6c0 con 0x7f18ec004d50 2024-04-17T19:54:11.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.900+0000 7f18f67fc640 1 -- 172.21.15.18:0/3888984815 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18f0018070 con 0x7f18ec004d50 2024-04-17T19:54:11.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.900+0000 7f18f67fc640 1 -- 172.21.15.18:0/3888984815 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f000caa0 con 0x7f18ec004d50 2024-04-17T19:54:11.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.900+0000 7f1907eca640 1 -- 172.21.15.18:0/3888984815 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f190015cf30 con 0x7f18ec004d50 2024-04-17T19:54:11.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.900+0000 7f1907eca640 1 -- 172.21.15.18:0/3888984815 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f190015bd10 con 0x7f18ec004d50 2024-04-17T19:54:11.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.900+0000 7f1907eca640 1 -- 172.21.15.18:0/3888984815 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1900069950 con 0x7f18ec004d50 2024-04-17T19:54:11.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.904+0000 7f18f67fc640 1 -- 172.21.15.18:0/3888984815 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f18f000cc40 con 0x7f18ec004d50 2024-04-17T19:54:11.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.904+0000 7f18f67fc640 1 --2- 172.21.15.18:0/3888984815 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f18e4068380 0x7f18e406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:11.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.904+0000 7f18f67fc640 1 -- 172.21.15.18:0/3888984815 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7f18f0086c90 con 0x7f18ec004d50 2024-04-17T19:54:11.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.904+0000 7f1905465640 1 --2- 172.21.15.18:0/3888984815 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f18e4068380 0x7f18e406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:11.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.904+0000 7f1905465640 1 --2- 172.21.15.18:0/3888984815 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f18e4068380 0x7f18e406a890 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f190015ae50 tx=0x7f18fc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:11.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:11.908+0000 7f18f67fc640 1 -- 172.21.15.18:0/3888984815 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f19001553f0 con 0x7f18ec004d50 2024-04-17T19:54:12.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.080+0000 7f1907eca640 1 -- 172.21.15.18:0/3888984815 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f19000ccfc0 con 0x7f18ec004d50 2024-04-17T19:54:12.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.080+0000 7f18f67fc640 1 -- 172.21.15.18:0/3888984815 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7f18f0056de0 con 0x7f18ec004d50 2024-04-17T19:54:12.077 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-04-17T19:54:12.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.080+0000 7f1907eca640 1 -- 172.21.15.18:0/3888984815 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f18e4068380 msgr2=0x7f18e406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:12.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.080+0000 7f1907eca640 1 --2- 172.21.15.18:0/3888984815 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f18e4068380 0x7f18e406a890 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f190015ae50 tx=0x7f18fc008040 comp rx=0 tx=0).stop 2024-04-17T19:54:12.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.080+0000 7f1907eca640 1 -- 172.21.15.18:0/3888984815 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18ec004d50 msgr2=0x7f190014c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:12.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.080+0000 7f1907eca640 1 --2- 172.21.15.18:0/3888984815 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18ec004d50 0x7f190014c1a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f18f000e780 tx=0x7f18f000ec40 comp rx=0 tx=0).stop 2024-04-17T19:54:12.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.080+0000 7f1907eca640 1 -- 172.21.15.18:0/3888984815 shutdown_connections 2024-04-17T19:54:12.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.080+0000 7f1907eca640 1 --2- 172.21.15.18:0/3888984815 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f18e4068380 0x7f18e406a890 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:12.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.080+0000 7f1907eca640 1 --2- 172.21.15.18:0/3888984815 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1900154fe0 0x7f1900150de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:12.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.080+0000 7f1907eca640 1 --2- 172.21.15.18:0/3888984815 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f19001594f0 0x7f1900154aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:12.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.080+0000 7f1907eca640 1 --2- 172.21.15.18:0/3888984815 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18ec004d50 0x7f190014c1a0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:12.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.080+0000 7f1907eca640 1 -- 172.21.15.18:0/3888984815 >> 172.21.15.18:0/3888984815 conn(0x7f1900072bb0 msgr2=0x7f1900067ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:12.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.080+0000 7f1907eca640 1 -- 172.21.15.18:0/3888984815 shutdown_connections 2024-04-17T19:54:12.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.080+0000 7f1907eca640 1 -- 172.21.15.18:0/3888984815 wait complete. 2024-04-17T19:54:12.099 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-17T19:54:12.099 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-17T19:54:12.107 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T19:54:12.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.256+0000 7f0c3de24640 1 Processor -- start 2024-04-17T19:54:12.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.256+0000 7f0c3de24640 1 -- start start 2024-04-17T19:54:12.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.256+0000 7f0c3de24640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0c3815e910 0x7f0c3815ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:12.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.256+0000 7f0c3de24640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c380d0020 con 0x7f0c3815e1a0 2024-04-17T19:54:12.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.256+0000 7f0c3de24640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c380cd930 con 0x7f0c3806cd60 2024-04-17T19:54:12.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.256+0000 7f0c3de24640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f0c380cdc10 con 0x7f0c3815e910 2024-04-17T19:54:12.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.256+0000 7f0c2ffff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0c3815e910 0x7f0c3815ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:12.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.256+0000 7f0c377fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f0c3815e1a0 0x7f0c380ce9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:33616/0 (socket says 172.21.15.18:33616) 2024-04-17T19:54:12.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.256+0000 7f0c377fe640 1 -- 172.21.15.18:0/1405893290 learned_addr learned my addr 172.21.15.18:0/1405893290 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:54:12.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.256+0000 7f0c2ffff640 1 -- 172.21.15.18:0/1405893290 >> v1:172.21.15.173:6789/0 conn(0x7f0c3806cd60 legacy=0x7f0c3806d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:12.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.256+0000 7f0c2ffff640 1 -- 172.21.15.18:0/1405893290 >> v1:172.21.15.18:6789/0 conn(0x7f0c3815e1a0 legacy=0x7f0c380ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:12.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.256+0000 7f0c2ffff640 1 -- 172.21.15.18:0/1405893290 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c380cdef0 con 0x7f0c3815e910 2024-04-17T19:54:12.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.260+0000 7f0c2ffff640 1 --2- 172.21.15.18:0/1405893290 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c3815e910 0x7f0c3815ed20 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0c200097c0 tx=0x7f0c2001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d73fccb5de39530 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:12.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.260+0000 7f0c36ffd640 1 -- 172.21.15.18:0/1405893290 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c200b0070 con 0x7f0c3815e910 2024-04-17T19:54:12.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.260+0000 7f0c36ffd640 1 -- 172.21.15.18:0/1405893290 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c200ab600 con 0x7f0c3815e910 2024-04-17T19:54:12.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.260+0000 7f0c36ffd640 1 -- 172.21.15.18:0/1405893290 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c200ab9d0 con 0x7f0c3815e910 2024-04-17T19:54:12.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.260+0000 7f0c3de24640 1 -- 172.21.15.18:0/1405893290 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c3815e910 msgr2=0x7f0c3815ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:12.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.260+0000 7f0c3de24640 1 --2- 172.21.15.18:0/1405893290 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c3815e910 0x7f0c3815ed20 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0c200097c0 tx=0x7f0c2001c3d0 comp rx=0 tx=0).stop 2024-04-17T19:54:12.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.260+0000 7f0c3de24640 1 -- 172.21.15.18:0/1405893290 shutdown_connections 2024-04-17T19:54:12.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.260+0000 7f0c3de24640 1 --2- 172.21.15.18:0/1405893290 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c3815e910 0x7f0c3815ed20 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:12.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.260+0000 7f0c3de24640 1 -- 172.21.15.18:0/1405893290 >> 172.21.15.18:0/1405893290 conn(0x7f0c38072bb0 msgr2=0x7f0c38072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:12.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.260+0000 7f0c3de24640 1 -- 172.21.15.18:0/1405893290 shutdown_connections 2024-04-17T19:54:12.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.260+0000 7f0c3de24640 1 -- 172.21.15.18:0/1405893290 wait complete. 2024-04-17T19:54:12.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.260+0000 7f0c3de24640 1 Processor -- start 2024-04-17T19:54:12.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.260+0000 7f0c3de24640 1 -- start start 2024-04-17T19:54:12.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.264+0000 7f0c3de24640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0c3806cd60 0x7f0c3814c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:12.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.264+0000 7f0c3de24640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c3815e1a0 0x7f0c38156110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:12.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.264+0000 7f0c3de24640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c3815e910 0x7f0c38156650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:12.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.264+0000 7f0c3de24640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0c380cf260 con 0x7f0c3815e1a0 2024-04-17T19:54:12.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.264+0000 7f0c3de24640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0c380cf0e0 con 0x7f0c3815e910 2024-04-17T19:54:12.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.264+0000 7f0c3de24640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f0c38157a10 con 0x7f0c3806cd60 2024-04-17T19:54:12.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.264+0000 7f0c2ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c3815e1a0 0x7f0c38156110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:12.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.264+0000 7f0c2ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c3815e1a0 0x7f0c38156110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53296/0 (socket says 172.21.15.18:53296) 2024-04-17T19:54:12.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.264+0000 7f0c2ffff640 1 -- 172.21.15.18:0/1254685958 learned_addr learned my addr 172.21.15.18:0/1254685958 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:12.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.264+0000 7f0c37fff640 1 --2- 172.21.15.18:0/1254685958 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c3815e910 0x7f0c38156650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:12.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.264+0000 7f0c377fe640 1 --2- 172.21.15.18:0/1254685958 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0c3806cd60 0x7f0c3814c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:12.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.264+0000 7f0c2ffff640 1 -- 172.21.15.18:0/1254685958 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0c3806cd60 msgr2=0x7f0c3814c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:12.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.264+0000 7f0c2ffff640 1 --2- 172.21.15.18:0/1254685958 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0c3806cd60 0x7f0c3814c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:12.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.264+0000 7f0c2ffff640 1 -- 172.21.15.18:0/1254685958 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c3815e910 msgr2=0x7f0c38156650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:12.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.264+0000 7f0c2ffff640 1 --2- 172.21.15.18:0/1254685958 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c3815e910 0x7f0c38156650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:12.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.264+0000 7f0c2ffff640 1 -- 172.21.15.18:0/1254685958 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c381f8930 con 0x7f0c3815e1a0 2024-04-17T19:54:12.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.264+0000 7f0c2ffff640 1 --2- 172.21.15.18:0/1254685958 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c3815e1a0 0x7f0c38156110 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f0c200097c0 tx=0x7f0c2001ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:12.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.264+0000 7f0c34ff9640 1 -- 172.21.15.18:0/1254685958 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c200b0050 con 0x7f0c3815e1a0 2024-04-17T19:54:12.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.264+0000 7f0c34ff9640 1 -- 172.21.15.18:0/1254685958 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c200bc070 con 0x7f0c3815e1a0 2024-04-17T19:54:12.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.264+0000 7f0c34ff9640 1 -- 172.21.15.18:0/1254685958 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c200b5830 con 0x7f0c3815e1a0 2024-04-17T19:54:12.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.264+0000 7f0c3de24640 1 -- 172.21.15.18:0/1254685958 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c380b5580 con 0x7f0c3815e1a0 2024-04-17T19:54:12.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.264+0000 7f0c3de24640 1 -- 172.21.15.18:0/1254685958 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c380b5b40 con 0x7f0c3815e1a0 2024-04-17T19:54:12.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.264+0000 7f0c3de24640 1 -- 172.21.15.18:0/1254685958 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c380b52d0 con 0x7f0c3815e1a0 2024-04-17T19:54:12.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.264+0000 7f0c34ff9640 1 -- 172.21.15.18:0/1254685958 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0c200b59d0 con 0x7f0c3815e1a0 2024-04-17T19:54:12.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.264+0000 7f0c34ff9640 1 --2- 172.21.15.18:0/1254685958 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0c18068380 0x7f0c1806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:12.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.268+0000 7f0c34ff9640 1 -- 172.21.15.18:0/1254685958 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7f0c20122220 con 0x7f0c3815e1a0 2024-04-17T19:54:12.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.268+0000 7f0c377fe640 1 --2- 172.21.15.18:0/1254685958 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0c18068380 0x7f0c1806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:12.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.268+0000 7f0c377fe640 1 --2- 172.21.15.18:0/1254685958 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0c18068380 0x7f0c1806a890 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0c28000f70 tx=0x7f0c28009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:12.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.268+0000 7f0c34ff9640 1 -- 172.21.15.18:0/1254685958 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0c381f8930 con 0x7f0c3815e1a0 2024-04-17T19:54:12.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.436+0000 7f0c3de24640 1 -- 172.21.15.18:0/1254685958 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0c38069950 con 0x7f0c3815e1a0 2024-04-17T19:54:12.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.436+0000 7f0c34ff9640 1 -- 172.21.15.18:0/1254685958 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18759 (secure 0 0 0) 0x7f0c20016050 con 0x7f0c3815e1a0 2024-04-17T19:54:12.436 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:54:12.437 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":29,"fsid":"dd480169-5a81-4623-be5f-0499aa244b28","created":"2024-04-17T19:52:39.533760+0000","modified":"2024-04-17T19:53:45.435889+0000","last_up_change":"2024-04-17T19:52:51.229698+0000","last_in_change":"2024-04-17T19:52:42.144259+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T19:52:52.391648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T19:53:02.734240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T19:53:03.813028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T19:53:07.478812+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e232d577-2508-4ea4-b355-29fbae1ff025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6801","nonce":2323038417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6803","nonce":2323038417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6807","nonce":2323038417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6805","nonce":2323038417}]},"public_addr":"172.21.15.18:6801/2323038417","cluster_addr":"172.21.15.18:6803/2323038417","heartbeat_back_addr":"172.21.15.18:6807/2323038417","heartbeat_front_addr":"172.21.15.18:6805/2323038417","state":["exists","up"]},{"osd":1,"uuid":"31810ef3-2c71-48d6-8748-b74a2968d23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6817","nonce":1283678238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6819","nonce":1283678238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6823","nonce":1283678238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6821","nonce":1283678238}]},"public_addr":"172.21.15.18:6817/1283678238","cluster_addr":"172.21.15.18:6819/1283678238","heartbeat_back_addr":"172.21.15.18:6823/1283678238","heartbeat_front_addr":"172.21.15.18:6821/1283678238","state":["exists","up"]},{"osd":2,"uuid":"5a783cc5-a41c-4967-9e11-6b8330f97d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6809","nonce":1212875862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6811","nonce":1212875862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6815","nonce":1212875862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6813","nonce":1212875862}]},"public_addr":"172.21.15.18:6809/1212875862","cluster_addr":"172.21.15.18:6811/1212875862","heartbeat_back_addr":"172.21.15.18:6815/1212875862","heartbeat_front_addr":"172.21.15.18:6813/1212875862","state":["exists","up"]},{"osd":3,"uuid":"b7e056d9-9da5-46e1-810d-0c3e242fe5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6825","nonce":2428878428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6827","nonce":2428878428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6831","nonce":2428878428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6829","nonce":2428878428}]},"public_addr":"172.21.15.18:6825/2428878428","cluster_addr":"172.21.15.18:6827/2428878428","heartbeat_back_addr":"172.21.15.18:6831/2428878428","heartbeat_front_addr":"172.21.15.18:6829/2428878428","state":["exists","up"]},{"osd":4,"uuid":"21df023f-bc8b-4abb-93e5-0ecc91acda0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6825","nonce":1421511819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6827","nonce":1421511819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6831","nonce":1421511819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6829","nonce":1421511819}]},"public_addr":"172.21.15.173:6825/1421511819","cluster_addr":"172.21.15.173:6827/1421511819","heartbeat_back_addr":"172.21.15.173:6831/1421511819","heartbeat_front_addr":"172.21.15.173:6829/1421511819","state":["exists","up"]},{"osd":5,"uuid":"e270098a-6d33-49f8-84ed-94e09a880cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6801","nonce":4221907702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6803","nonce":4221907702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6807","nonce":4221907702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6805","nonce":4221907702}]},"public_addr":"172.21.15.173:6801/4221907702","cluster_addr":"172.21.15.173:6803/4221907702","heartbeat_back_addr":"172.21.15.173:6807/4221907702","heartbeat_front_addr":"172.21.15.173:6805/4221907702","state":["exists","up"]},{"osd":6,"uuid":"93c67c8c-268d-4e32-877c-043cd3acd87c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6809","nonce":761678552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6811","nonce":761678552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6815","nonce":761678552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6813","nonce":761678552}]},"public_addr":"172.21.15.173:6809/761678552","cluster_addr":"172.21.15.173:6811/761678552","heartbeat_back_addr":"172.21.15.173:6815/761678552","heartbeat_front_addr":"172.21.15.173:6813/761678552","state":["exists","up"]},{"osd":7,"uuid":"faf10eea-80de-40f6-abbb-34d07d3f59ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6817","nonce":383724537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6819","nonce":383724537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6823","nonce":383724537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6821","nonce":383724537}]},"public_addr":"172.21.15.173:6817/383724537","cluster_addr":"172.21.15.173:6819/383724537","heartbeat_back_addr":"172.21.15.173:6823/383724537","heartbeat_front_addr":"172.21.15.173:6821/383724537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.668924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.761747+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.768128+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.632252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.742608+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.734327+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.477107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.818292+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.31","mappings":[{"from":0,"to":7}]},{"pgid":"4.5","mappings":[{"from":3,"to":4},{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":0}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]},{"pgid":"4.1c","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T19:54:12.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.440+0000 7f0c3de24640 1 -- 172.21.15.18:0/1254685958 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0c18068380 msgr2=0x7f0c1806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:12.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.440+0000 7f0c3de24640 1 --2- 172.21.15.18:0/1254685958 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0c18068380 0x7f0c1806a890 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0c28000f70 tx=0x7f0c28009040 comp rx=0 tx=0).stop 2024-04-17T19:54:12.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.440+0000 7f0c3de24640 1 -- 172.21.15.18:0/1254685958 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c3815e1a0 msgr2=0x7f0c38156110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:12.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.440+0000 7f0c3de24640 1 --2- 172.21.15.18:0/1254685958 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c3815e1a0 0x7f0c38156110 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f0c200097c0 tx=0x7f0c2001ac10 comp rx=0 tx=0).stop 2024-04-17T19:54:12.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.440+0000 7f0c3de24640 1 -- 172.21.15.18:0/1254685958 shutdown_connections 2024-04-17T19:54:12.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.440+0000 7f0c3de24640 1 --2- 172.21.15.18:0/1254685958 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0c18068380 0x7f0c1806a890 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:12.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.440+0000 7f0c3de24640 1 --2- 172.21.15.18:0/1254685958 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0c3815e910 0x7f0c38156650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:12.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.440+0000 7f0c3de24640 1 --2- 172.21.15.18:0/1254685958 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c3815e1a0 0x7f0c38156110 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:12.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.440+0000 7f0c3de24640 1 --2- 172.21.15.18:0/1254685958 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0c3806cd60 0x7f0c3814c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:12.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.440+0000 7f0c3de24640 1 -- 172.21.15.18:0/1254685958 >> 172.21.15.18:0/1254685958 conn(0x7f0c38072bb0 msgr2=0x7f0c380b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:12.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.440+0000 7f0c3de24640 1 -- 172.21.15.18:0/1254685958 shutdown_connections 2024-04-17T19:54:12.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.440+0000 7f0c3de24640 1 -- 172.21.15.18:0/1254685958 wait complete. 2024-04-17T19:54:12.457 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T19:52:52.391648+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-17T19:53:02.734240+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-17T19:53:03.813028+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-17T19:53:07.478812+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-17T19:54:12.458 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T19:54:12.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.616+0000 7f1eed9f0640 1 Processor -- start 2024-04-17T19:54:12.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.616+0000 7f1eed9f0640 1 -- start start 2024-04-17T19:54:12.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.616+0000 7f1eed9f0640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1ee815c7c0 0x7f1ee815cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:12.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.616+0000 7f1eed9f0640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f1ee815d7c0 0x7f1ee815dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:12.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.616+0000 7f1eed9f0640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ee815fc90 con 0x7f1ee806cd60 2024-04-17T19:54:12.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.616+0000 7f1eed9f0640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f1ee8142870 con 0x7f1ee815d7c0 2024-04-17T19:54:12.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.616+0000 7f1eed9f0640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f1ee815ff00 con 0x7f1ee815c7c0 2024-04-17T19:54:12.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.616+0000 7f1ee6ffd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f1ee806cd60 0x7f1ee806d170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:33620/0 (socket says 172.21.15.18:33620) 2024-04-17T19:54:12.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.616+0000 7f1ee6ffd640 1 -- 172.21.15.18:0/1773535860 learned_addr learned my addr 172.21.15.18:0/1773535860 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:54:12.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.616+0000 7f1ee77fe640 1 --2- 172.21.15.18:0/1773535860 >> v2:172.21.15.173:3300/0 conn(0x7f1ee815d7c0 0x7f1ee815dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:12.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.616+0000 7f1ee5ffb640 1 -- 172.21.15.18:0/1773535860 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1810820808 0 0) 0x7f1ee815fc90 con 0x7f1ee806cd60 2024-04-17T19:54:12.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.616+0000 7f1ee67fc640 1 --2- 172.21.15.18:0/1773535860 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1ee815c7c0 0x7f1ee815cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:12.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.616+0000 7f1ee5ffb640 1 -- 172.21.15.18:0/1773535860 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ed0003530 con 0x7f1ee806cd60 2024-04-17T19:54:12.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.616+0000 7f1ee5ffb640 1 -- 172.21.15.18:0/1773535860 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1129553841 0 0) 0x7f1ed0003530 con 0x7f1ee806cd60 2024-04-17T19:54:12.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.616+0000 7f1ee5ffb640 1 -- 172.21.15.18:0/1773535860 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1ee815c7c0 msgr2=0x7f1ee815cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:12.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.616+0000 7f1ee5ffb640 1 --2- 172.21.15.18:0/1773535860 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1ee815c7c0 0x7f1ee815cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:12.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.616+0000 7f1ee5ffb640 1 -- 172.21.15.18:0/1773535860 >> v2:172.21.15.173:3300/0 conn(0x7f1ee815d7c0 msgr2=0x7f1ee815dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:12.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.616+0000 7f1ee5ffb640 1 --2- 172.21.15.18:0/1773535860 >> v2:172.21.15.173:3300/0 conn(0x7f1ee815d7c0 0x7f1ee815dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:12.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.616+0000 7f1ee5ffb640 1 -- 172.21.15.18:0/1773535860 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ee81601e0 con 0x7f1ee806cd60 2024-04-17T19:54:12.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.616+0000 7f1ee5ffb640 1 -- 172.21.15.18:0/1773535860 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3208559991 0 0) 0x7f1ed8001680 con 0x7f1ee806cd60 2024-04-17T19:54:12.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.616+0000 7f1ee5ffb640 1 -- 172.21.15.18:0/1773535860 >> v1:172.21.15.18:6789/0 conn(0x7f1ee806cd60 legacy=0x7f1ee806d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:12.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.616+0000 7f1ee5ffb640 1 --2- 172.21.15.18:0/1773535860 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ed00039c0 0x7f1ed0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:12.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.616+0000 7f1ee5ffb640 1 --2- 172.21.15.18:0/1773535860 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ed0004810 0x7f1ed0004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:12.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.616+0000 7f1ee5ffb640 1 --2- 172.21.15.18:0/1773535860 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1ee815c7c0 0x7f1ed0005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:12.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.616+0000 7f1ee5ffb640 1 -- 172.21.15.18:0/1773535860 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee8142870 con 0x7f1ed00039c0 2024-04-17T19:54:12.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.616+0000 7f1ee5ffb640 1 -- 172.21.15.18:0/1773535860 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee815ff00 con 0x7f1ed0004810 2024-04-17T19:54:12.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.616+0000 7f1ee5ffb640 1 -- 172.21.15.18:0/1773535860 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f1ed000b9d0 con 0x7f1ee815c7c0 2024-04-17T19:54:12.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.616+0000 7f1ee6ffd640 1 --2- 172.21.15.18:0/1773535860 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ed00039c0 0x7f1ed0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:12.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.616+0000 7f1ee67fc640 1 --2- 172.21.15.18:0/1773535860 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ed0004810 0x7f1ed0004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:12.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.616+0000 7f1ee77fe640 1 --2- 172.21.15.18:0/1773535860 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1ee815c7c0 0x7f1ed0005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:12.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.620+0000 7f1ee6ffd640 1 -- 172.21.15.18:0/1773535860 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1ee815c7c0 msgr2=0x7f1ed0005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:12.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.620+0000 7f1ee6ffd640 1 --2- 172.21.15.18:0/1773535860 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1ee815c7c0 0x7f1ed0005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:12.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.620+0000 7f1ee6ffd640 1 -- 172.21.15.18:0/1773535860 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ed0004810 msgr2=0x7f1ed0004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:12.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.620+0000 7f1ee6ffd640 1 --2- 172.21.15.18:0/1773535860 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ed0004810 0x7f1ed0004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:12.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.620+0000 7f1ee6ffd640 1 -- 172.21.15.18:0/1773535860 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ed0003530 con 0x7f1ed00039c0 2024-04-17T19:54:12.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.620+0000 7f1ee6ffd640 1 --2- 172.21.15.18:0/1773535860 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ed00039c0 0x7f1ed0003e30 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f1ed8001060 tx=0x7f1ed801cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfb71ac4dda401e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:12.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.620+0000 7f1ee5ffb640 1 -- 172.21.15.18:0/1773535860 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed8007d80 con 0x7f1ed00039c0 2024-04-17T19:54:12.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.620+0000 7f1ee5ffb640 1 -- 172.21.15.18:0/1773535860 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ed80a9020 con 0x7f1ed00039c0 2024-04-17T19:54:12.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.620+0000 7f1ee5ffb640 1 -- 172.21.15.18:0/1773535860 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed8005b00 con 0x7f1ed00039c0 2024-04-17T19:54:12.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.620+0000 7f1eed9f0640 1 -- 172.21.15.18:0/1773535860 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ed00039c0 msgr2=0x7f1ed0003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:12.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.620+0000 7f1eed9f0640 1 --2- 172.21.15.18:0/1773535860 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ed00039c0 0x7f1ed0003e30 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f1ed8001060 tx=0x7f1ed801cbb0 comp rx=0 tx=0).stop 2024-04-17T19:54:12.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.620+0000 7f1ee77fe640 1 -- 172.21.15.18:0/1773535860 reap_dead start 2024-04-17T19:54:12.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.620+0000 7f1eed9f0640 1 -- 172.21.15.18:0/1773535860 shutdown_connections 2024-04-17T19:54:12.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.620+0000 7f1eed9f0640 1 -- 172.21.15.18:0/1773535860 >> 172.21.15.18:0/1773535860 conn(0x7f1ee8072bb0 msgr2=0x7f1ee8072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:12.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.620+0000 7f1eed9f0640 1 -- 172.21.15.18:0/1773535860 shutdown_connections 2024-04-17T19:54:12.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.620+0000 7f1eed9f0640 1 -- 172.21.15.18:0/1773535860 wait complete. 2024-04-17T19:54:12.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.624+0000 7f1eed9f0640 1 Processor -- start 2024-04-17T19:54:12.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.624+0000 7f1eed9f0640 1 -- start start 2024-04-17T19:54:12.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.624+0000 7f1eed9f0640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ed00039c0 0x7f1ee8162610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:12.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.624+0000 7f1eed9f0640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1ee80afd80 0x7f1ee81f78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:12.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.624+0000 7f1eed9f0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ee81f7e10 0x7f1ee8160bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:12.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.624+0000 7f1eed9f0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee815cd50 con 0x7f1ee81f7e10 2024-04-17T19:54:12.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.624+0000 7f1eed9f0640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee815cbd0 con 0x7f1ed00039c0 2024-04-17T19:54:12.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.624+0000 7f1eed9f0640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f1ee815ced0 con 0x7f1ee80afd80 2024-04-17T19:54:12.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.624+0000 7f1ee77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ee81f7e10 0x7f1ee8160bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:12.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.624+0000 7f1ee77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ee81f7e10 0x7f1ee8160bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53314/0 (socket says 172.21.15.18:53314) 2024-04-17T19:54:12.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.624+0000 7f1ee77fe640 1 -- 172.21.15.18:0/2403672956 learned_addr learned my addr 172.21.15.18:0/2403672956 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:12.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.624+0000 7f1ee67fc640 1 --2- 172.21.15.18:0/2403672956 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1ee80afd80 0x7f1ee81f78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:12.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.624+0000 7f1ee6ffd640 1 --2- 172.21.15.18:0/2403672956 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ed00039c0 0x7f1ee8162610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:12.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.624+0000 7f1ee77fe640 1 -- 172.21.15.18:0/2403672956 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1ee80afd80 msgr2=0x7f1ee81f78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:12.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.624+0000 7f1ee77fe640 1 --2- 172.21.15.18:0/2403672956 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1ee80afd80 0x7f1ee81f78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:12.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.624+0000 7f1ee77fe640 1 -- 172.21.15.18:0/2403672956 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ed00039c0 msgr2=0x7f1ee8162610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:12.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.624+0000 7f1ee77fe640 1 --2- 172.21.15.18:0/2403672956 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ed00039c0 0x7f1ee8162610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:12.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.624+0000 7f1ee77fe640 1 -- 172.21.15.18:0/2403672956 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ee81f8220 con 0x7f1ee81f7e10 2024-04-17T19:54:12.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.624+0000 7f1ee77fe640 1 --2- 172.21.15.18:0/2403672956 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ee81f7e10 0x7f1ee8160bf0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1ee8156c90 tx=0x7f1ee0011730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:12.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.624+0000 7f1ecffff640 1 -- 172.21.15.18:0/2403672956 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee0003db0 con 0x7f1ee81f7e10 2024-04-17T19:54:12.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.624+0000 7f1ecffff640 1 -- 172.21.15.18:0/2403672956 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ee0011e80 con 0x7f1ee81f7e10 2024-04-17T19:54:12.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.624+0000 7f1eed9f0640 1 -- 172.21.15.18:0/2403672956 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ee8157a20 con 0x7f1ee81f7e10 2024-04-17T19:54:12.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.624+0000 7f1ecffff640 1 -- 172.21.15.18:0/2403672956 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee0004270 con 0x7f1ee81f7e10 2024-04-17T19:54:12.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.624+0000 7f1eed9f0640 1 -- 172.21.15.18:0/2403672956 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ee8157fe0 con 0x7f1ee81f7e10 2024-04-17T19:54:12.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.628+0000 7f1eed9f0640 1 -- 172.21.15.18:0/2403672956 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ee8157790 con 0x7f1ee81f7e10 2024-04-17T19:54:12.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.628+0000 7f1ecffff640 1 -- 172.21.15.18:0/2403672956 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1ee0004410 con 0x7f1ee81f7e10 2024-04-17T19:54:12.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.628+0000 7f1ecffff640 1 --2- 172.21.15.18:0/2403672956 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f1ed4068380 0x7f1ed406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:12.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.628+0000 7f1ecffff640 1 -- 172.21.15.18:0/2403672956 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7f1ee0089ed0 con 0x7f1ee81f7e10 2024-04-17T19:54:12.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.628+0000 7f1ee6ffd640 1 --2- 172.21.15.18:0/2403672956 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f1ed4068380 0x7f1ed406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:12.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.628+0000 7f1ee6ffd640 1 --2- 172.21.15.18:0/2403672956 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f1ed4068380 0x7f1ed406a890 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1ed80aa000 tx=0x7f1ed8001a50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:12.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.632+0000 7f1ecffff640 1 -- 172.21.15.18:0/2403672956 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1ee81f8220 con 0x7f1ee81f7e10 2024-04-17T19:54:12.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.788+0000 7f1eed9f0640 1 -- 172.21.15.18:0/2403672956 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1ee8069950 con 0x7f1ee81f7e10 2024-04-17T19:54:12.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.788+0000 7f1ecffff640 1 -- 172.21.15.18:0/2403672956 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7f1ee005a0b0 con 0x7f1ee81f7e10 2024-04-17T19:54:12.787 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-17T19:54:12.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.792+0000 7f1eed9f0640 1 -- 172.21.15.18:0/2403672956 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f1ed4068380 msgr2=0x7f1ed406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:12.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.792+0000 7f1eed9f0640 1 --2- 172.21.15.18:0/2403672956 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f1ed4068380 0x7f1ed406a890 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1ed80aa000 tx=0x7f1ed8001a50 comp rx=0 tx=0).stop 2024-04-17T19:54:12.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.792+0000 7f1eed9f0640 1 -- 172.21.15.18:0/2403672956 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ee81f7e10 msgr2=0x7f1ee8160bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:12.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.792+0000 7f1eed9f0640 1 --2- 172.21.15.18:0/2403672956 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ee81f7e10 0x7f1ee8160bf0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f1ee8156c90 tx=0x7f1ee0011730 comp rx=0 tx=0).stop 2024-04-17T19:54:12.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.792+0000 7f1eed9f0640 1 -- 172.21.15.18:0/2403672956 shutdown_connections 2024-04-17T19:54:12.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.792+0000 7f1eed9f0640 1 --2- 172.21.15.18:0/2403672956 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f1ed4068380 0x7f1ed406a890 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:12.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.792+0000 7f1eed9f0640 1 --2- 172.21.15.18:0/2403672956 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ee81f7e10 0x7f1ee8160bf0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:12.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.792+0000 7f1eed9f0640 1 --2- 172.21.15.18:0/2403672956 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1ee80afd80 0x7f1ee81f78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:12.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.792+0000 7f1eed9f0640 1 --2- 172.21.15.18:0/2403672956 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ed00039c0 0x7f1ee8162610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:12.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.792+0000 7f1eed9f0640 1 -- 172.21.15.18:0/2403672956 >> 172.21.15.18:0/2403672956 conn(0x7f1ee8072bb0 msgr2=0x7f1ee80b5180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:12.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.792+0000 7f1eed9f0640 1 -- 172.21.15.18:0/2403672956 shutdown_connections 2024-04-17T19:54:12.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.792+0000 7f1eed9f0640 1 -- 172.21.15.18:0/2403672956 wait complete. 2024-04-17T19:54:12.807 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-17T19:54:12.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.964+0000 7f7de5347640 1 Processor -- start 2024-04-17T19:54:12.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.964+0000 7f7de5347640 1 -- start start 2024-04-17T19:54:12.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.964+0000 7f7de5347640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f7de00cece0 0x7f7de0161500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:12.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.964+0000 7f7de5347640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7de00cf0f0 0x7f7de00b1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:12.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.964+0000 7f7de5347640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7de00cdc10 con 0x7f7de0161a40 2024-04-17T19:54:12.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.964+0000 7f7de5347640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f7de00ce4b0 con 0x7f7de00cece0 2024-04-17T19:54:12.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.964+0000 7f7de5347640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f7de0161070 con 0x7f7de00cf0f0 2024-04-17T19:54:12.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.968+0000 7f7ddeffd640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f7de00cece0 0x7f7de0161500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:12.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.968+0000 7f7dde7fc640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7de00cf0f0 0x7f7de00b1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:12.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.968+0000 7f7ddf7fe640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f7de0161a40 0x7f7de00b6850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.18:59162/0 (socket says 172.21.15.18:59162) 2024-04-17T19:54:12.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.968+0000 7f7ddeffd640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f7de00cece0 0x7f7de0161500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.18:37576/0 (socket says 172.21.15.18:37576) 2024-04-17T19:54:12.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.968+0000 7f7ddf7fe640 1 -- 172.21.15.18:0/2366516522 learned_addr learned my addr 172.21.15.18:0/2366516522 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:54:12.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.968+0000 7f7ddeffd640 1 -- 172.21.15.18:0/2366516522 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7de00cf0f0 msgr2=0x7f7de00b1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:12.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.968+0000 7f7ddeffd640 1 --2- 172.21.15.18:0/2366516522 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7de00cf0f0 0x7f7de00b1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:12.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.968+0000 7f7ddeffd640 1 -- 172.21.15.18:0/2366516522 >> v1:172.21.15.173:6789/0 conn(0x7f7de0161a40 legacy=0x7f7de00b6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:12.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.968+0000 7f7ddeffd640 1 -- 172.21.15.18:0/2366516522 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7de00cdef0 con 0x7f7de00cece0 2024-04-17T19:54:12.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.968+0000 7f7ddeffd640 1 --2- 172.21.15.18:0/2366516522 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7de00cece0 0x7f7de0161500 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7dd40097c0 tx=0x7f7dd401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=122f7219091a1a88 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:12.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.968+0000 7f7dddffb640 1 -- 172.21.15.18:0/2366516522 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd40b1070 con 0x7f7de00cece0 2024-04-17T19:54:12.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.968+0000 7f7dddffb640 1 -- 172.21.15.18:0/2366516522 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dd40ac410 con 0x7f7de00cece0 2024-04-17T19:54:12.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.968+0000 7f7dddffb640 1 -- 172.21.15.18:0/2366516522 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd40ac7e0 con 0x7f7de00cece0 2024-04-17T19:54:12.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.972+0000 7f7de5347640 1 -- 172.21.15.18:0/2366516522 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7de00cece0 msgr2=0x7f7de0161500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:12.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.972+0000 7f7de5347640 1 --2- 172.21.15.18:0/2366516522 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7de00cece0 0x7f7de0161500 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7dd40097c0 tx=0x7f7dd401c4a0 comp rx=0 tx=0).stop 2024-04-17T19:54:12.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.972+0000 7f7de5347640 1 -- 172.21.15.18:0/2366516522 shutdown_connections 2024-04-17T19:54:12.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.972+0000 7f7de5347640 1 --2- 172.21.15.18:0/2366516522 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7de00cf0f0 0x7f7de00b1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:12.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.972+0000 7f7de5347640 1 --2- 172.21.15.18:0/2366516522 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7de00cece0 0x7f7de0161500 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:12.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.972+0000 7f7de5347640 1 -- 172.21.15.18:0/2366516522 >> 172.21.15.18:0/2366516522 conn(0x7f7de009aa70 msgr2=0x7f7de009ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:12.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.972+0000 7f7de5347640 1 -- 172.21.15.18:0/2366516522 shutdown_connections 2024-04-17T19:54:12.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.972+0000 7f7de5347640 1 -- 172.21.15.18:0/2366516522 wait complete. 2024-04-17T19:54:12.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.972+0000 7f7de5347640 1 Processor -- start 2024-04-17T19:54:12.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.972+0000 7f7de5347640 1 -- start start 2024-04-17T19:54:12.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.972+0000 7f7de5347640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7de00cf0f0 0x7f7de0149180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:12.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.972+0000 7f7de5347640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7de0161a40 0x7f7de0167270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:12.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.972+0000 7f7de5347640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7de0166d50 0x7f7de006f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:12.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.972+0000 7f7de5347640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7de00b1880 con 0x7f7de0166d50 2024-04-17T19:54:12.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.972+0000 7f7de5347640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7de00b7170 con 0x7f7de00cf0f0 2024-04-17T19:54:12.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.972+0000 7f7de5347640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f7de00b1a00 con 0x7f7de0161a40 2024-04-17T19:54:12.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.976+0000 7f7ddf7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7de0166d50 0x7f7de006f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:12.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.976+0000 7f7ddf7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7de0166d50 0x7f7de006f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53316/0 (socket says 172.21.15.18:53316) 2024-04-17T19:54:12.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.976+0000 7f7ddf7fe640 1 -- 172.21.15.18:0/3332996652 learned_addr learned my addr 172.21.15.18:0/3332996652 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:12.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.976+0000 7f7ddeffd640 1 --2- 172.21.15.18:0/3332996652 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7de00cf0f0 0x7f7de0149180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:12.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.976+0000 7f7dde7fc640 1 --2- 172.21.15.18:0/3332996652 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7de0161a40 0x7f7de0167270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:12.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.976+0000 7f7ddf7fe640 1 -- 172.21.15.18:0/3332996652 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7de0161a40 msgr2=0x7f7de0167270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:12.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.976+0000 7f7ddf7fe640 1 --2- 172.21.15.18:0/3332996652 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7de0161a40 0x7f7de0167270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:12.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.976+0000 7f7ddf7fe640 1 -- 172.21.15.18:0/3332996652 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7de00cf0f0 msgr2=0x7f7de0149180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:12.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.976+0000 7f7ddf7fe640 1 --2- 172.21.15.18:0/3332996652 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7de00cf0f0 0x7f7de0149180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:12.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.976+0000 7f7ddf7fe640 1 -- 172.21.15.18:0/3332996652 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7de015c960 con 0x7f7de0166d50 2024-04-17T19:54:12.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.976+0000 7f7dde7fc640 1 --2- 172.21.15.18:0/3332996652 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7de0161a40 0x7f7de0167270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:54:12.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.976+0000 7f7ddf7fe640 1 --2- 172.21.15.18:0/3332996652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7de0166d50 0x7f7de006f9e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7dd800caa0 tx=0x7f7dd800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:12.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.976+0000 7f7dc77fe640 1 -- 172.21.15.18:0/3332996652 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd8017070 con 0x7f7de0166d50 2024-04-17T19:54:12.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.976+0000 7f7dc77fe640 1 -- 172.21.15.18:0/3332996652 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dd800aae0 con 0x7f7de0166d50 2024-04-17T19:54:12.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.976+0000 7f7de5347640 1 -- 172.21.15.18:0/3332996652 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7de015cc40 con 0x7f7de0166d50 2024-04-17T19:54:12.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.976+0000 7f7dc77fe640 1 -- 172.21.15.18:0/3332996652 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd8012400 con 0x7f7de0166d50 2024-04-17T19:54:12.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.976+0000 7f7de5347640 1 -- 172.21.15.18:0/3332996652 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7de015d200 con 0x7f7de0166d50 2024-04-17T19:54:12.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.976+0000 7f7de5347640 1 -- 172.21.15.18:0/3332996652 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7de0069950 con 0x7f7de0166d50 2024-04-17T19:54:12.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.976+0000 7f7dc77fe640 1 -- 172.21.15.18:0/3332996652 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7dd801a070 con 0x7f7de0166d50 2024-04-17T19:54:12.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.976+0000 7f7dc77fe640 1 --2- 172.21.15.18:0/3332996652 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f7dcc0683b0 0x7f7dcc06a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:12.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.976+0000 7f7dc77fe640 1 -- 172.21.15.18:0/3332996652 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7f7dd8086a60 con 0x7f7de0166d50 2024-04-17T19:54:12.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.976+0000 7f7ddeffd640 1 --2- 172.21.15.18:0/3332996652 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f7dcc0683b0 0x7f7dcc06a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:12.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.976+0000 7f7ddeffd640 1 --2- 172.21.15.18:0/3332996652 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f7dcc0683b0 0x7f7dcc06a8c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7dd40ae000 tx=0x7f7dd4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:12.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:12.980+0000 7f7dc77fe640 1 -- 172.21.15.18:0/3332996652 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7dd8056b20 con 0x7f7de0166d50 2024-04-17T19:54:13.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.144+0000 7f7de5347640 1 -- 172.21.15.18:0/3332996652 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f7de00c53c0 con 0x7f7de0166d50 2024-04-17T19:54:13.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.148+0000 7f7dc77fe640 1 -- 172.21.15.18:0/3332996652 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7f7dd8056420 con 0x7f7de0166d50 2024-04-17T19:54:13.144 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-17T19:54:13.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.148+0000 7f7de5347640 1 -- 172.21.15.18:0/3332996652 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f7dcc0683b0 msgr2=0x7f7dcc06a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:13.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.148+0000 7f7de5347640 1 --2- 172.21.15.18:0/3332996652 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f7dcc0683b0 0x7f7dcc06a8c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7dd40ae000 tx=0x7f7dd4008040 comp rx=0 tx=0).stop 2024-04-17T19:54:13.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.148+0000 7f7de5347640 1 -- 172.21.15.18:0/3332996652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7de0166d50 msgr2=0x7f7de006f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:13.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.148+0000 7f7de5347640 1 --2- 172.21.15.18:0/3332996652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7de0166d50 0x7f7de006f9e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7dd800caa0 tx=0x7f7dd800cf60 comp rx=0 tx=0).stop 2024-04-17T19:54:13.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.148+0000 7f7de5347640 1 -- 172.21.15.18:0/3332996652 shutdown_connections 2024-04-17T19:54:13.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.148+0000 7f7de5347640 1 --2- 172.21.15.18:0/3332996652 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f7dcc0683b0 0x7f7dcc06a8c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:13.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.148+0000 7f7de5347640 1 --2- 172.21.15.18:0/3332996652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7de0166d50 0x7f7de006f9e0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:13.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.148+0000 7f7de5347640 1 --2- 172.21.15.18:0/3332996652 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7de0161a40 0x7f7de0167270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:13.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.148+0000 7f7de5347640 1 --2- 172.21.15.18:0/3332996652 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7de00cf0f0 0x7f7de0149180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:13.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.148+0000 7f7de5347640 1 -- 172.21.15.18:0/3332996652 >> 172.21.15.18:0/3332996652 conn(0x7f7de009aa70 msgr2=0x7f7de009ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:13.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.148+0000 7f7de5347640 1 -- 172.21.15.18:0/3332996652 shutdown_connections 2024-04-17T19:54:13.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.148+0000 7f7de5347640 1 -- 172.21.15.18:0/3332996652 wait complete. 2024-04-17T19:54:13.167 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-17T19:54:13.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.328+0000 7f363ca9b640 1 Processor -- start 2024-04-17T19:54:13.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.328+0000 7f363ca9b640 1 -- start start 2024-04-17T19:54:13.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.328+0000 7f363ca9b640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f363806ed50 0x7f363809aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:13.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.328+0000 7f363ca9b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f36380b31a0 0x7f363809afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:13.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.328+0000 7f363ca9b640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36380b13d0 con 0x7f36380aea10 2024-04-17T19:54:13.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.328+0000 7f363ca9b640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f36380d1850 con 0x7f36380b31a0 2024-04-17T19:54:13.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.328+0000 7f363ca9b640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f36380d1aa0 con 0x7f363806ed50 2024-04-17T19:54:13.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.328+0000 7f3636d9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f36380b31a0 0x7f363809afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:13.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.328+0000 7f3636d9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f36380b31a0 0x7f363809afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53324/0 (socket says 172.21.15.18:53324) 2024-04-17T19:54:13.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.328+0000 7f3636d9d640 1 -- 172.21.15.18:0/3396760786 learned_addr learned my addr 172.21.15.18:0/3396760786 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:13.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.328+0000 7f363659c640 1 --2- 172.21.15.18:0/3396760786 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f363806ed50 0x7f363809aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:13.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.328+0000 7f3636d9d640 1 -- 172.21.15.18:0/3396760786 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f363806ed50 msgr2=0x7f363809aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:13.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.328+0000 7f3636d9d640 1 --2- 172.21.15.18:0/3396760786 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f363806ed50 0x7f363809aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:13.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.328+0000 7f3636d9d640 1 -- 172.21.15.18:0/3396760786 >> v1:172.21.15.173:6789/0 conn(0x7f36380aea10 legacy=0x7f3638163080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:13.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.328+0000 7f3636d9d640 1 -- 172.21.15.18:0/3396760786 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36380d1d80 con 0x7f36380b31a0 2024-04-17T19:54:13.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.332+0000 7f3636d9d640 1 --2- 172.21.15.18:0/3396760786 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36380b31a0 0x7f363809afb0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f3630009e50 tx=0x7f363001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64c9be56deb8f821 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:13.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.332+0000 7f363559a640 1 -- 172.21.15.18:0/3396760786 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36300a5700 con 0x7f36380b31a0 2024-04-17T19:54:13.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.332+0000 7f363559a640 1 -- 172.21.15.18:0/3396760786 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36300a58a0 con 0x7f36380b31a0 2024-04-17T19:54:13.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.332+0000 7f363559a640 1 -- 172.21.15.18:0/3396760786 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36300a5c70 con 0x7f36380b31a0 2024-04-17T19:54:13.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.332+0000 7f363ca9b640 1 -- 172.21.15.18:0/3396760786 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36380b31a0 msgr2=0x7f363809afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:13.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.332+0000 7f363ca9b640 1 --2- 172.21.15.18:0/3396760786 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36380b31a0 0x7f363809afb0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f3630009e50 tx=0x7f363001ca30 comp rx=0 tx=0).stop 2024-04-17T19:54:13.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.332+0000 7f363ca9b640 1 -- 172.21.15.18:0/3396760786 shutdown_connections 2024-04-17T19:54:13.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.332+0000 7f363ca9b640 1 --2- 172.21.15.18:0/3396760786 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36380b31a0 0x7f363809afb0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:13.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.332+0000 7f363ca9b640 1 --2- 172.21.15.18:0/3396760786 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f363806ed50 0x7f363809aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:13.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.332+0000 7f363ca9b640 1 -- 172.21.15.18:0/3396760786 >> 172.21.15.18:0/3396760786 conn(0x7f36380b6990 msgr2=0x7f36380b6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:13.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.332+0000 7f363ca9b640 1 -- 172.21.15.18:0/3396760786 shutdown_connections 2024-04-17T19:54:13.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.332+0000 7f363ca9b640 1 -- 172.21.15.18:0/3396760786 wait complete. 2024-04-17T19:54:13.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.336+0000 7f363ca9b640 1 Processor -- start 2024-04-17T19:54:13.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.336+0000 7f363ca9b640 1 -- start start 2024-04-17T19:54:13.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.336+0000 7f363ca9b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f363806ed50 0x7f36381528f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:13.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.336+0000 7f363ca9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36380aea10 0x7f3638161e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:13.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.336+0000 7f363ca9b640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f36380b31a0 0x7f3638162370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:13.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.336+0000 7f363ca9b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f363816c5a0 con 0x7f36380aea10 2024-04-17T19:54:13.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.336+0000 7f363ca9b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f363816c420 con 0x7f363806ed50 2024-04-17T19:54:13.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.336+0000 7f363ca9b640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f363816c720 con 0x7f36380b31a0 2024-04-17T19:54:13.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.336+0000 7f3635d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36380aea10 0x7f3638161e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:13.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.336+0000 7f3635d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36380aea10 0x7f3638161e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53338/0 (socket says 172.21.15.18:53338) 2024-04-17T19:54:13.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.336+0000 7f3635d9b640 1 -- 172.21.15.18:0/811400648 learned_addr learned my addr 172.21.15.18:0/811400648 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:13.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.336+0000 7f363659c640 1 --2- 172.21.15.18:0/811400648 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f363806ed50 0x7f36381528f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:13.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.336+0000 7f3636d9d640 1 --2- 172.21.15.18:0/811400648 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f36380b31a0 0x7f3638162370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:13.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.336+0000 7f3635d9b640 1 -- 172.21.15.18:0/811400648 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f36380b31a0 msgr2=0x7f3638162370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:13.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.336+0000 7f3635d9b640 1 --2- 172.21.15.18:0/811400648 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f36380b31a0 0x7f3638162370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:13.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.336+0000 7f3635d9b640 1 -- 172.21.15.18:0/811400648 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f363806ed50 msgr2=0x7f36381528f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:13.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.336+0000 7f3635d9b640 1 --2- 172.21.15.18:0/811400648 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f363806ed50 0x7f36381528f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:13.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.336+0000 7f3635d9b640 1 -- 172.21.15.18:0/811400648 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3638160520 con 0x7f36380aea10 2024-04-17T19:54:13.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.336+0000 7f3635d9b640 1 --2- 172.21.15.18:0/811400648 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36380aea10 0x7f3638161e30 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f362c00c3c0 tx=0x7f362c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:13.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.336+0000 7f3626ffd640 1 -- 172.21.15.18:0/811400648 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f362c0052d0 con 0x7f36380aea10 2024-04-17T19:54:13.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.336+0000 7f3626ffd640 1 -- 172.21.15.18:0/811400648 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f362c005470 con 0x7f36380aea10 2024-04-17T19:54:13.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.336+0000 7f3626ffd640 1 -- 172.21.15.18:0/811400648 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f362c007260 con 0x7f36380aea10 2024-04-17T19:54:13.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.336+0000 7f363ca9b640 1 -- 172.21.15.18:0/811400648 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f363815fc30 con 0x7f36380aea10 2024-04-17T19:54:13.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.336+0000 7f363ca9b640 1 -- 172.21.15.18:0/811400648 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3638158600 con 0x7f36380aea10 2024-04-17T19:54:13.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.340+0000 7f363ca9b640 1 -- 172.21.15.18:0/811400648 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3638069950 con 0x7f36380aea10 2024-04-17T19:54:13.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.340+0000 7f3626ffd640 1 -- 172.21.15.18:0/811400648 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f362c007400 con 0x7f36380aea10 2024-04-17T19:54:13.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.340+0000 7f3626ffd640 1 --2- 172.21.15.18:0/811400648 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f3618068380 0x7f361806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:13.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.340+0000 7f3626ffd640 1 -- 172.21.15.18:0/811400648 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7f362c0860e0 con 0x7f36380aea10 2024-04-17T19:54:13.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.340+0000 7f363659c640 1 --2- 172.21.15.18:0/811400648 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f3618068380 0x7f361806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:13.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.340+0000 7f363659c640 1 --2- 172.21.15.18:0/811400648 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f3618068380 0x7f361806a890 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3628009a50 tx=0x7f3628008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:13.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.344+0000 7f3626ffd640 1 -- 172.21.15.18:0/811400648 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f36380b13d0 con 0x7f36380aea10 2024-04-17T19:54:13.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.508+0000 7f363ca9b640 1 -- 172.21.15.18:0/811400648 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f363806e920 con 0x7f36380aea10 2024-04-17T19:54:13.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.508+0000 7f3626ffd640 1 -- 172.21.15.18:0/811400648 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7f362c0562d0 con 0x7f36380aea10 2024-04-17T19:54:13.508 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-17T19:54:13.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.512+0000 7f363ca9b640 1 -- 172.21.15.18:0/811400648 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f3618068380 msgr2=0x7f361806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:13.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.512+0000 7f363ca9b640 1 --2- 172.21.15.18:0/811400648 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f3618068380 0x7f361806a890 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3628009a50 tx=0x7f3628008040 comp rx=0 tx=0).stop 2024-04-17T19:54:13.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.512+0000 7f363ca9b640 1 -- 172.21.15.18:0/811400648 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36380aea10 msgr2=0x7f3638161e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:13.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.512+0000 7f363ca9b640 1 --2- 172.21.15.18:0/811400648 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36380aea10 0x7f3638161e30 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f362c00c3c0 tx=0x7f362c00c880 comp rx=0 tx=0).stop 2024-04-17T19:54:13.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.512+0000 7f363ca9b640 1 -- 172.21.15.18:0/811400648 shutdown_connections 2024-04-17T19:54:13.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.512+0000 7f363ca9b640 1 --2- 172.21.15.18:0/811400648 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f3618068380 0x7f361806a890 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:13.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.512+0000 7f363ca9b640 1 --2- 172.21.15.18:0/811400648 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f36380b31a0 0x7f3638162370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:13.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.512+0000 7f363ca9b640 1 --2- 172.21.15.18:0/811400648 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36380aea10 0x7f3638161e30 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:13.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.512+0000 7f363ca9b640 1 --2- 172.21.15.18:0/811400648 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f363806ed50 0x7f36381528f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:13.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.512+0000 7f363ca9b640 1 -- 172.21.15.18:0/811400648 >> 172.21.15.18:0/811400648 conn(0x7f36380b6990 msgr2=0x7f363815bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:13.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.512+0000 7f363ca9b640 1 -- 172.21.15.18:0/811400648 shutdown_connections 2024-04-17T19:54:13.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.512+0000 7f363ca9b640 1 -- 172.21.15.18:0/811400648 wait complete. 2024-04-17T19:54:13.532 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-17T19:54:13.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.696+0000 7fce0fd5f640 1 Processor -- start 2024-04-17T19:54:13.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.696+0000 7fce0fd5f640 1 -- start start 2024-04-17T19:54:13.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.696+0000 7fce0fd5f640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fce0806ec50 0x7fce0809aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:13.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.696+0000 7fce0fd5f640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fce0809afb0 0x7fce080b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:13.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.696+0000 7fce0fd5f640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fce080b1ef0 0x7fce080d19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:13.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.696+0000 7fce0fd5f640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fce080d29f0 con 0x7fce0806ec50 2024-04-17T19:54:13.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.696+0000 7fce0fd5f640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7fce0809b3c0 con 0x7fce0809afb0 2024-04-17T19:54:13.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.696+0000 7fce0fd5f640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fce080b2300 con 0x7fce080b1ef0 2024-04-17T19:54:13.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.696+0000 7fce0dafb640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fce0806ec50 0x7fce0809aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:13.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.696+0000 7fce0dafb640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fce0806ec50 0x7fce0809aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53348/0 (socket says 172.21.15.18:53348) 2024-04-17T19:54:13.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.696+0000 7fce0dafb640 1 -- 172.21.15.18:0/142477428 learned_addr learned my addr 172.21.15.18:0/142477428 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:13.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.696+0000 7fce0d2fa640 1 --2- 172.21.15.18:0/142477428 >> v2:172.21.15.173:3300/0 conn(0x7fce0809afb0 0x7fce080b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:13.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.696+0000 7fce0e2fc640 1 --2- 172.21.15.18:0/142477428 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fce080b1ef0 0x7fce080d19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:13.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.696+0000 7fce0dafb640 1 -- 172.21.15.18:0/142477428 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fce080b1ef0 msgr2=0x7fce080d19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:13.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.696+0000 7fce0dafb640 1 --2- 172.21.15.18:0/142477428 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fce080b1ef0 0x7fce080d19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:13.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.696+0000 7fce0dafb640 1 -- 172.21.15.18:0/142477428 >> v2:172.21.15.173:3300/0 conn(0x7fce0809afb0 msgr2=0x7fce080b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:13.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.696+0000 7fce0dafb640 1 --2- 172.21.15.18:0/142477428 >> v2:172.21.15.173:3300/0 conn(0x7fce0809afb0 0x7fce080b19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:13.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.696+0000 7fce0dafb640 1 -- 172.21.15.18:0/142477428 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce080d2710 con 0x7fce0806ec50 2024-04-17T19:54:13.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.700+0000 7fce0dafb640 1 --2- 172.21.15.18:0/142477428 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce0806ec50 0x7fce0809aa70 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fce08073960 tx=0x7fce0001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7648efc503c8df85 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:13.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.700+0000 7fce0caf9640 1 -- 172.21.15.18:0/142477428 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce000a57e0 con 0x7fce0806ec50 2024-04-17T19:54:13.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.700+0000 7fce0caf9640 1 -- 172.21.15.18:0/142477428 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce000a5980 con 0x7fce0806ec50 2024-04-17T19:54:13.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.700+0000 7fce0caf9640 1 -- 172.21.15.18:0/142477428 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce000a5d50 con 0x7fce0806ec50 2024-04-17T19:54:13.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.700+0000 7fce0fd5f640 1 -- 172.21.15.18:0/142477428 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce0806ec50 msgr2=0x7fce0809aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:13.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.700+0000 7fce0fd5f640 1 --2- 172.21.15.18:0/142477428 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce0806ec50 0x7fce0809aa70 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fce08073960 tx=0x7fce0001c960 comp rx=0 tx=0).stop 2024-04-17T19:54:13.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.700+0000 7fce0fd5f640 1 -- 172.21.15.18:0/142477428 shutdown_connections 2024-04-17T19:54:13.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.700+0000 7fce0fd5f640 1 --2- 172.21.15.18:0/142477428 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fce080b1ef0 0x7fce080d19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:13.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.700+0000 7fce0fd5f640 1 --2- 172.21.15.18:0/142477428 >> v2:172.21.15.173:3300/0 conn(0x7fce0809afb0 0x7fce080b19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:13.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.700+0000 7fce0fd5f640 1 --2- 172.21.15.18:0/142477428 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce0806ec50 0x7fce0809aa70 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:13.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.700+0000 7fce0fd5f640 1 -- 172.21.15.18:0/142477428 >> 172.21.15.18:0/142477428 conn(0x7fce080b6990 msgr2=0x7fce080b6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:13.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.700+0000 7fce0fd5f640 1 -- 172.21.15.18:0/142477428 shutdown_connections 2024-04-17T19:54:13.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.700+0000 7fce0fd5f640 1 -- 172.21.15.18:0/142477428 wait complete. 2024-04-17T19:54:13.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.704+0000 7fce0fd5f640 1 Processor -- start 2024-04-17T19:54:13.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.704+0000 7fce0fd5f640 1 -- start start 2024-04-17T19:54:13.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.704+0000 7fce0fd5f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce0806ec50 0x7fce081f73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:13.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.704+0000 7fce0fd5f640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fce0809afb0 0x7fce081493e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:13.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.704+0000 7fce0fd5f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce080b1ef0 0x7fce0815e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:13.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.704+0000 7fce0fd5f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fce080d2490 con 0x7fce080b1ef0 2024-04-17T19:54:13.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.704+0000 7fce0fd5f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fce080d2310 con 0x7fce0806ec50 2024-04-17T19:54:13.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.704+0000 7fce0fd5f640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fce081569e0 con 0x7fce0809afb0 2024-04-17T19:54:13.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.704+0000 7fce0e2fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce080b1ef0 0x7fce0815e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:13.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.704+0000 7fce0e2fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce080b1ef0 0x7fce0815e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53360/0 (socket says 172.21.15.18:53360) 2024-04-17T19:54:13.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.704+0000 7fce0e2fc640 1 -- 172.21.15.18:0/2959767214 learned_addr learned my addr 172.21.15.18:0/2959767214 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:13.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.704+0000 7fce0dafb640 1 --2- 172.21.15.18:0/2959767214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce0806ec50 0x7fce081f73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:13.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.704+0000 7fce0d2fa640 1 --2- 172.21.15.18:0/2959767214 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fce0809afb0 0x7fce081493e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:13.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.708+0000 7fce0e2fc640 1 -- 172.21.15.18:0/2959767214 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fce0809afb0 msgr2=0x7fce081493e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:13.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.708+0000 7fce0e2fc640 1 --2- 172.21.15.18:0/2959767214 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fce0809afb0 0x7fce081493e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:13.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.708+0000 7fce0e2fc640 1 -- 172.21.15.18:0/2959767214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce0806ec50 msgr2=0x7fce081f73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:13.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.708+0000 7fce0e2fc640 1 --2- 172.21.15.18:0/2959767214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce0806ec50 0x7fce081f73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:13.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.708+0000 7fce0e2fc640 1 -- 172.21.15.18:0/2959767214 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce080d0f10 con 0x7fce080b1ef0 2024-04-17T19:54:13.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.708+0000 7fce0e2fc640 1 --2- 172.21.15.18:0/2959767214 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce080b1ef0 0x7fce0815e2e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fce0400d590 tx=0x7fce0400da50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:13.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.708+0000 7fcdfe7fc640 1 -- 172.21.15.18:0/2959767214 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce040125f0 con 0x7fce080b1ef0 2024-04-17T19:54:13.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.708+0000 7fcdfe7fc640 1 -- 172.21.15.18:0/2959767214 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce04019070 con 0x7fce080b1ef0 2024-04-17T19:54:13.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.708+0000 7fcdfe7fc640 1 -- 172.21.15.18:0/2959767214 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce040129f0 con 0x7fce080b1ef0 2024-04-17T19:54:13.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.708+0000 7fce0fd5f640 1 -- 172.21.15.18:0/2959767214 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce081f7900 con 0x7fce080b1ef0 2024-04-17T19:54:13.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.708+0000 7fce0fd5f640 1 -- 172.21.15.18:0/2959767214 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce080d1490 con 0x7fce080b1ef0 2024-04-17T19:54:13.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.708+0000 7fce0fd5f640 1 -- 172.21.15.18:0/2959767214 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce08069950 con 0x7fce080b1ef0 2024-04-17T19:54:13.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.708+0000 7fcdfe7fc640 1 -- 172.21.15.18:0/2959767214 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fce04012b90 con 0x7fce080b1ef0 2024-04-17T19:54:13.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.708+0000 7fcdfe7fc640 1 --2- 172.21.15.18:0/2959767214 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fcdec0683b0 0x7fcdec06a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:13.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.708+0000 7fcdfe7fc640 1 -- 172.21.15.18:0/2959767214 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7fce04086f80 con 0x7fce080b1ef0 2024-04-17T19:54:13.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.708+0000 7fce0dafb640 1 --2- 172.21.15.18:0/2959767214 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fcdec0683b0 0x7fcdec06a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:13.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.708+0000 7fce0dafb640 1 --2- 172.21.15.18:0/2959767214 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fcdec0683b0 0x7fcdec06a8c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fce000ae000 tx=0x7fce000a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:13.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.712+0000 7fcdfe7fc640 1 -- 172.21.15.18:0/2959767214 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fce04056b20 con 0x7fce080b1ef0 2024-04-17T19:54:13.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.876+0000 7fce0fd5f640 1 -- 172.21.15.18:0/2959767214 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fce0806d9c0 con 0x7fce080b1ef0 2024-04-17T19:54:13.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.876+0000 7fcdfe7fc640 1 -- 172.21.15.18:0/2959767214 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7fce0405ae20 con 0x7fce080b1ef0 2024-04-17T19:54:13.873 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-17T19:54:13.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.876+0000 7fce0fd5f640 1 -- 172.21.15.18:0/2959767214 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fcdec0683b0 msgr2=0x7fcdec06a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:13.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.876+0000 7fce0fd5f640 1 --2- 172.21.15.18:0/2959767214 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fcdec0683b0 0x7fcdec06a8c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fce000ae000 tx=0x7fce000a7070 comp rx=0 tx=0).stop 2024-04-17T19:54:13.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.876+0000 7fce0fd5f640 1 -- 172.21.15.18:0/2959767214 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce080b1ef0 msgr2=0x7fce0815e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:13.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.876+0000 7fce0fd5f640 1 --2- 172.21.15.18:0/2959767214 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce080b1ef0 0x7fce0815e2e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fce0400d590 tx=0x7fce0400da50 comp rx=0 tx=0).stop 2024-04-17T19:54:13.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.876+0000 7fce0fd5f640 1 -- 172.21.15.18:0/2959767214 shutdown_connections 2024-04-17T19:54:13.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.876+0000 7fce0fd5f640 1 --2- 172.21.15.18:0/2959767214 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fcdec0683b0 0x7fcdec06a8c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:13.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.876+0000 7fce0fd5f640 1 --2- 172.21.15.18:0/2959767214 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce080b1ef0 0x7fce0815e2e0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:13.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.876+0000 7fce0fd5f640 1 --2- 172.21.15.18:0/2959767214 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fce0809afb0 0x7fce081493e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:13.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.876+0000 7fce0fd5f640 1 --2- 172.21.15.18:0/2959767214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce0806ec50 0x7fce081f73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:13.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.876+0000 7fce0fd5f640 1 -- 172.21.15.18:0/2959767214 >> 172.21.15.18:0/2959767214 conn(0x7fce080b6990 msgr2=0x7fce080b2480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:13.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.876+0000 7fce0fd5f640 1 -- 172.21.15.18:0/2959767214 shutdown_connections 2024-04-17T19:54:13.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:13.876+0000 7fce0fd5f640 1 -- 172.21.15.18:0/2959767214 wait complete. 2024-04-17T19:54:13.894 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-17T19:54:14.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.040+0000 7f6ba405b640 1 Processor -- start 2024-04-17T19:54:14.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.040+0000 7f6ba405b640 1 -- start start 2024-04-17T19:54:14.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.040+0000 7f6ba405b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6b9c0ce470 0x7f6b9c16a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:14.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.040+0000 7f6ba405b640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b9c06de40 con 0x7f6b9c06eee0 2024-04-17T19:54:14.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.040+0000 7f6ba405b640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b9c06e120 con 0x7f6b9c0713e0 2024-04-17T19:54:14.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.040+0000 7f6ba405b640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f6b9c06e400 con 0x7f6b9c0ce470 2024-04-17T19:54:14.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.040+0000 7f6ba25f8640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6b9c0ce470 0x7f6b9c16a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:14.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.040+0000 7f6ba1df7640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f6b9c06eee0 0x7f6b9c070cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:33624/0 (socket says 172.21.15.18:33624) 2024-04-17T19:54:14.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.040+0000 7f6ba1df7640 1 -- 172.21.15.18:0/1160071640 learned_addr learned my addr 172.21.15.18:0/1160071640 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:54:14.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.040+0000 7f6ba25f8640 1 -- 172.21.15.18:0/1160071640 >> v1:172.21.15.173:6789/0 conn(0x7f6b9c0713e0 legacy=0x7f6b9c0cdd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:14.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.040+0000 7f6ba25f8640 1 -- 172.21.15.18:0/1160071640 >> v1:172.21.15.18:6789/0 conn(0x7f6b9c06eee0 legacy=0x7f6b9c070cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:14.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.040+0000 7f6ba0df5640 1 -- 172.21.15.18:0/1160071640 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3180677000 0 0) 0x7f6b9c06de40 con 0x7f6b9c06eee0 2024-04-17T19:54:14.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.040+0000 7f6ba25f8640 1 -- 172.21.15.18:0/1160071640 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b9c06e6e0 con 0x7f6b9c0ce470 2024-04-17T19:54:14.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.044+0000 7f6ba25f8640 1 --2- 172.21.15.18:0/1160071640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b9c0ce470 0x7f6b9c16a360 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f6b940097c0 tx=0x7f6b9401ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a52bfa2f3fc2ac5 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:14.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.044+0000 7f6ba0df5640 1 -- 172.21.15.18:0/1160071640 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b940b5070 con 0x7f6b9c0ce470 2024-04-17T19:54:14.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.044+0000 7f6ba0df5640 1 -- 172.21.15.18:0/1160071640 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b940a8990 con 0x7f6b9c0ce470 2024-04-17T19:54:14.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.044+0000 7f6ba0df5640 1 -- 172.21.15.18:0/1160071640 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b940a8d60 con 0x7f6b9c0ce470 2024-04-17T19:54:14.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.044+0000 7f6ba405b640 1 -- 172.21.15.18:0/1160071640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b9c0ce470 msgr2=0x7f6b9c16a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:14.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.044+0000 7f6ba405b640 1 --2- 172.21.15.18:0/1160071640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b9c0ce470 0x7f6b9c16a360 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f6b940097c0 tx=0x7f6b9401ec90 comp rx=0 tx=0).stop 2024-04-17T19:54:14.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.044+0000 7f6ba405b640 1 -- 172.21.15.18:0/1160071640 shutdown_connections 2024-04-17T19:54:14.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.044+0000 7f6ba405b640 1 --2- 172.21.15.18:0/1160071640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b9c0ce470 0x7f6b9c16a360 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:14.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.044+0000 7f6ba405b640 1 -- 172.21.15.18:0/1160071640 >> 172.21.15.18:0/1160071640 conn(0x7f6b9c0d2bf0 msgr2=0x7f6b9c0d3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:14.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.044+0000 7f6ba405b640 1 -- 172.21.15.18:0/1160071640 shutdown_connections 2024-04-17T19:54:14.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.044+0000 7f6ba405b640 1 -- 172.21.15.18:0/1160071640 wait complete. 2024-04-17T19:54:14.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.048+0000 7f6ba405b640 1 Processor -- start 2024-04-17T19:54:14.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.048+0000 7f6ba405b640 1 -- start start 2024-04-17T19:54:14.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.048+0000 7f6ba405b640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6b9c06eee0 0x7f6b9c152a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:14.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.048+0000 7f6ba405b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b9c0ce470 0x7f6b9c0b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:14.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.048+0000 7f6ba405b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b9c15b420 0x7f6b9c15b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:14.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.048+0000 7f6ba405b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6b9c06daf0 con 0x7f6b9c15b420 2024-04-17T19:54:14.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.048+0000 7f6ba405b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6b9c15f8f0 con 0x7f6b9c0ce470 2024-04-17T19:54:14.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.048+0000 7f6ba405b640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f6b9c16a8a0 con 0x7f6b9c06eee0 2024-04-17T19:54:14.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.048+0000 7f6ba25f8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b9c15b420 0x7f6b9c15b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:14.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.048+0000 7f6ba25f8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b9c15b420 0x7f6b9c15b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53374/0 (socket says 172.21.15.18:53374) 2024-04-17T19:54:14.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.048+0000 7f6ba25f8640 1 -- 172.21.15.18:0/3245003910 learned_addr learned my addr 172.21.15.18:0/3245003910 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:14.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.048+0000 7f6ba15f6640 1 --2- 172.21.15.18:0/3245003910 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b9c0ce470 0x7f6b9c0b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:14.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.048+0000 7f6ba1df7640 1 --2- 172.21.15.18:0/3245003910 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6b9c06eee0 0x7f6b9c152a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:14.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.048+0000 7f6ba25f8640 1 -- 172.21.15.18:0/3245003910 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6b9c06eee0 msgr2=0x7f6b9c152a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:14.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.048+0000 7f6ba25f8640 1 --2- 172.21.15.18:0/3245003910 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6b9c06eee0 0x7f6b9c152a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:14.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.048+0000 7f6ba25f8640 1 -- 172.21.15.18:0/3245003910 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b9c0ce470 msgr2=0x7f6b9c0b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:14.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.048+0000 7f6ba25f8640 1 --2- 172.21.15.18:0/3245003910 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b9c0ce470 0x7f6b9c0b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:14.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.048+0000 7f6ba25f8640 1 -- 172.21.15.18:0/3245003910 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b9c153340 con 0x7f6b9c15b420 2024-04-17T19:54:14.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.048+0000 7f6ba25f8640 1 --2- 172.21.15.18:0/3245003910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b9c15b420 0x7f6b9c15b830 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f6b940b3040 tx=0x7f6b9401ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:14.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.048+0000 7f6b9a7fc640 1 -- 172.21.15.18:0/3245003910 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b940b5040 con 0x7f6b9c15b420 2024-04-17T19:54:14.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.048+0000 7f6b9a7fc640 1 -- 172.21.15.18:0/3245003910 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b940c0070 con 0x7f6b9c15b420 2024-04-17T19:54:14.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.048+0000 7f6ba405b640 1 -- 172.21.15.18:0/3245003910 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b9c15bd70 con 0x7f6b9c15b420 2024-04-17T19:54:14.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.048+0000 7f6b9a7fc640 1 -- 172.21.15.18:0/3245003910 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b940b09c0 con 0x7f6b9c15b420 2024-04-17T19:54:14.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.048+0000 7f6ba405b640 1 -- 172.21.15.18:0/3245003910 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b9c0c6fe0 con 0x7f6b9c15b420 2024-04-17T19:54:14.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.052+0000 7f6ba405b640 1 -- 172.21.15.18:0/3245003910 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b9c069950 con 0x7f6b9c15b420 2024-04-17T19:54:14.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.052+0000 7f6b9a7fc640 1 -- 172.21.15.18:0/3245003910 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6b940b0b60 con 0x7f6b9c15b420 2024-04-17T19:54:14.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.052+0000 7f6b9a7fc640 1 --2- 172.21.15.18:0/3245003910 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f6b88068380 0x7f6b8806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:14.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.052+0000 7f6b9a7fc640 1 -- 172.21.15.18:0/3245003910 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7f6b94124200 con 0x7f6b9c15b420 2024-04-17T19:54:14.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.052+0000 7f6ba1df7640 1 --2- 172.21.15.18:0/3245003910 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f6b88068380 0x7f6b8806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:14.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.052+0000 7f6ba1df7640 1 --2- 172.21.15.18:0/3245003910 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f6b88068380 0x7f6b8806a890 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c005fd0 tx=0x7f6b8c005c20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:14.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.056+0000 7f6b9a7fc640 1 -- 172.21.15.18:0/3245003910 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6b9c15bd70 con 0x7f6b9c15b420 2024-04-17T19:54:14.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.224+0000 7f6ba405b640 1 -- 172.21.15.18:0/3245003910 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6b9c071800 con 0x7f6b9c15b420 2024-04-17T19:54:14.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.224+0000 7f6b9a7fc640 1 -- 172.21.15.18:0/3245003910 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7f6b9c153340 con 0x7f6b9c15b420 2024-04-17T19:54:14.223 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-04-17T19:54:14.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.228+0000 7f6ba405b640 1 -- 172.21.15.18:0/3245003910 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f6b88068380 msgr2=0x7f6b8806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:14.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.228+0000 7f6ba405b640 1 --2- 172.21.15.18:0/3245003910 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f6b88068380 0x7f6b8806a890 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c005fd0 tx=0x7f6b8c005c20 comp rx=0 tx=0).stop 2024-04-17T19:54:14.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.228+0000 7f6ba405b640 1 -- 172.21.15.18:0/3245003910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b9c15b420 msgr2=0x7f6b9c15b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:14.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.228+0000 7f6ba405b640 1 --2- 172.21.15.18:0/3245003910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b9c15b420 0x7f6b9c15b830 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f6b940b3040 tx=0x7f6b9401ba30 comp rx=0 tx=0).stop 2024-04-17T19:54:14.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.228+0000 7f6ba405b640 1 -- 172.21.15.18:0/3245003910 shutdown_connections 2024-04-17T19:54:14.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.228+0000 7f6ba405b640 1 --2- 172.21.15.18:0/3245003910 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f6b88068380 0x7f6b8806a890 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:14.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.228+0000 7f6ba405b640 1 --2- 172.21.15.18:0/3245003910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b9c15b420 0x7f6b9c15b830 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:14.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.228+0000 7f6ba405b640 1 --2- 172.21.15.18:0/3245003910 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b9c0ce470 0x7f6b9c0b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:14.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.228+0000 7f6ba405b640 1 --2- 172.21.15.18:0/3245003910 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6b9c06eee0 0x7f6b9c152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:14.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.228+0000 7f6ba405b640 1 -- 172.21.15.18:0/3245003910 >> 172.21.15.18:0/3245003910 conn(0x7f6b9c0d2bf0 msgr2=0x7f6b9c0b3280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:14.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.228+0000 7f6ba405b640 1 -- 172.21.15.18:0/3245003910 shutdown_connections 2024-04-17T19:54:14.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:14.228+0000 7f6ba405b640 1 -- 172.21.15.18:0/3245003910 wait complete. 2024-04-17T19:54:14.244 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi173.front.sepia.ceph.com... 2024-04-17T19:54:14.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:54:14.244 DEBUG:teuthology.orchestra.run.smithi173:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-04-17T19:54:14.268 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi173.stderr:ceph-fuse[33073]: fuse finished with error 0 and tester_r 0 2024-04-17T19:54:14.270 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T19:54:20.371 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi173.front.sepia.ceph.com 2024-04-17T19:54:20.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:54:20.372 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-17T19:54:20.389 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-17T19:54:20.389 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-17T19:54:20.437 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-17T19:54:20.438 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-17T19:54:20.490 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T19:54:20.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.656+0000 7f185b621640 1 Processor -- start 2024-04-17T19:54:20.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.656+0000 7f185b621640 1 -- start start 2024-04-17T19:54:20.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.660+0000 7f185b621640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f185406cd60 0x7f185406d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:20.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.660+0000 7f185b621640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f185415fc90 con 0x7f185415d7c0 2024-04-17T19:54:20.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.660+0000 7f185b621640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f185406d6b0 con 0x7f185415c7c0 2024-04-17T19:54:20.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.660+0000 7f185b621640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f1854142870 con 0x7f185406cd60 2024-04-17T19:54:20.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.660+0000 7f1859bbe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f185415d7c0 0x7f185415dbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:38904/0 (socket says 172.21.15.18:38904) 2024-04-17T19:54:20.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.660+0000 7f1859bbe640 1 -- 172.21.15.18:0/315274072 learned_addr learned my addr 172.21.15.18:0/315274072 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:54:20.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.660+0000 7f18593bd640 1 --2- 172.21.15.18:0/315274072 >> v2:172.21.15.173:3300/0 conn(0x7f185406cd60 0x7f185406d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:20.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.660+0000 7f184bfff640 1 -- 172.21.15.18:0/315274072 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 254596690 0 0) 0x7f185415fc90 con 0x7f185415d7c0 2024-04-17T19:54:20.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.660+0000 7f184bfff640 1 -- 172.21.15.18:0/315274072 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1840003530 con 0x7f185415d7c0 2024-04-17T19:54:20.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.660+0000 7f184bfff640 1 -- 172.21.15.18:0/315274072 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1639228923 0 0) 0x7f1840003530 con 0x7f185415d7c0 2024-04-17T19:54:20.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.660+0000 7f184bfff640 1 -- 172.21.15.18:0/315274072 >> v2:172.21.15.173:3300/0 conn(0x7f185406cd60 msgr2=0x7f185406d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:20.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.660+0000 7f184bfff640 1 --2- 172.21.15.18:0/315274072 >> v2:172.21.15.173:3300/0 conn(0x7f185406cd60 0x7f185406d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:20.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.660+0000 7f184bfff640 1 -- 172.21.15.18:0/315274072 >> v1:172.21.15.173:6789/0 conn(0x7f185415c7c0 legacy=0x7f185415cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:20.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.660+0000 7f184bfff640 1 -- 172.21.15.18:0/315274072 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f185415ff00 con 0x7f185415d7c0 2024-04-17T19:54:20.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.660+0000 7f184bfff640 1 -- 172.21.15.18:0/315274072 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3208559991 0 0) 0x7f184c001a20 con 0x7f185415d7c0 2024-04-17T19:54:20.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.660+0000 7f184bfff640 1 -- 172.21.15.18:0/315274072 >> v1:172.21.15.18:6789/0 conn(0x7f185415d7c0 legacy=0x7f185415dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:20.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.660+0000 7f184bfff640 1 --2- 172.21.15.18:0/315274072 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18400039c0 0x7f1840003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:20.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.660+0000 7f184bfff640 1 --2- 172.21.15.18:0/315274072 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1840004810 0x7f1840004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:20.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.660+0000 7f184bfff640 1 --2- 172.21.15.18:0/315274072 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1840005260 0x7f184000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:20.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.660+0000 7f184bfff640 1 -- 172.21.15.18:0/315274072 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1854142870 con 0x7f18400039c0 2024-04-17T19:54:20.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.660+0000 7f184bfff640 1 -- 172.21.15.18:0/315274072 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f184000c1f0 con 0x7f1840004810 2024-04-17T19:54:20.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.660+0000 7f184bfff640 1 -- 172.21.15.18:0/315274072 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f184000c3f0 con 0x7f1840005260 2024-04-17T19:54:20.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.660+0000 7f18593bd640 1 --2- 172.21.15.18:0/315274072 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18400039c0 0x7f1840003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:20.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.660+0000 7f1858bbc640 1 --2- 172.21.15.18:0/315274072 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1840004810 0x7f1840004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:20.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.660+0000 7f18593bd640 1 -- 172.21.15.18:0/315274072 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1840005260 msgr2=0x7f184000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:20.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.660+0000 7f18593bd640 1 --2- 172.21.15.18:0/315274072 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1840005260 0x7f184000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:20.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.660+0000 7f18593bd640 1 -- 172.21.15.18:0/315274072 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1840004810 msgr2=0x7f1840004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:20.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.660+0000 7f18593bd640 1 --2- 172.21.15.18:0/315274072 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1840004810 0x7f1840004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:20.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.660+0000 7f18593bd640 1 -- 172.21.15.18:0/315274072 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1840003530 con 0x7f18400039c0 2024-04-17T19:54:20.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.660+0000 7f1859bbe640 1 -- 172.21.15.18:0/315274072 reap_dead start 2024-04-17T19:54:20.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.664+0000 7f18593bd640 1 --2- 172.21.15.18:0/315274072 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18400039c0 0x7f1840003e30 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f18540719c0 tx=0x7f185415d3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c9f16b2ee9bf0d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:20.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.664+0000 7f184bfff640 1 -- 172.21.15.18:0/315274072 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18500096b0 con 0x7f18400039c0 2024-04-17T19:54:20.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.664+0000 7f184bfff640 1 -- 172.21.15.18:0/315274072 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18500a64d0 con 0x7f18400039c0 2024-04-17T19:54:20.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.664+0000 7f184bfff640 1 -- 172.21.15.18:0/315274072 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18500a68c0 con 0x7f18400039c0 2024-04-17T19:54:20.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.664+0000 7f185b621640 1 -- 172.21.15.18:0/315274072 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18400039c0 msgr2=0x7f1840003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:20.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.664+0000 7f185b621640 1 --2- 172.21.15.18:0/315274072 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18400039c0 0x7f1840003e30 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f18540719c0 tx=0x7f185415d3e0 comp rx=0 tx=0).stop 2024-04-17T19:54:20.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.664+0000 7f185b621640 1 -- 172.21.15.18:0/315274072 shutdown_connections 2024-04-17T19:54:20.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.664+0000 7f185b621640 1 --2- 172.21.15.18:0/315274072 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18400039c0 0x7f1840003e30 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:20.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.664+0000 7f185b621640 1 -- 172.21.15.18:0/315274072 >> 172.21.15.18:0/315274072 conn(0x7f1854072bb0 msgr2=0x7f1854072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:20.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.664+0000 7f185b621640 1 -- 172.21.15.18:0/315274072 shutdown_connections 2024-04-17T19:54:20.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.664+0000 7f185b621640 1 -- 172.21.15.18:0/315274072 wait complete. 2024-04-17T19:54:20.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.668+0000 7f185b621640 1 Processor -- start 2024-04-17T19:54:20.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.668+0000 7f185b621640 1 -- start start 2024-04-17T19:54:20.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.668+0000 7f185b621640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f18400039c0 0x7f185413ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:20.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.668+0000 7f185b621640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18541593d0 0x7f18541597e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:20.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.668+0000 7f185b621640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f185406e8e0 0x7f185406ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:20.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.668+0000 7f185b621640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f18541609e0 con 0x7f18541593d0 2024-04-17T19:54:20.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.668+0000 7f185b621640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f185415dbd0 con 0x7f185406e8e0 2024-04-17T19:54:20.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.668+0000 7f185b621640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f18541f9b80 con 0x7f18400039c0 2024-04-17T19:54:20.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.668+0000 7f1858bbc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18541593d0 0x7f18541597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:20.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.668+0000 7f1858bbc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18541593d0 0x7f18541597e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44946/0 (socket says 172.21.15.18:44946) 2024-04-17T19:54:20.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.668+0000 7f1858bbc640 1 -- 172.21.15.18:0/2046234528 learned_addr learned my addr 172.21.15.18:0/2046234528 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:20.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.668+0000 7f18593bd640 1 --2- 172.21.15.18:0/2046234528 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f18400039c0 0x7f185413ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:20.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.668+0000 7f1859bbe640 1 --2- 172.21.15.18:0/2046234528 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f185406e8e0 0x7f185406ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:20.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.668+0000 7f1858bbc640 1 -- 172.21.15.18:0/2046234528 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f18400039c0 msgr2=0x7f185413ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:20.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.668+0000 7f1858bbc640 1 --2- 172.21.15.18:0/2046234528 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f18400039c0 0x7f185413ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:20.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.668+0000 7f1858bbc640 1 -- 172.21.15.18:0/2046234528 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f185406e8e0 msgr2=0x7f185406ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:20.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.668+0000 7f1858bbc640 1 --2- 172.21.15.18:0/2046234528 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f185406e8e0 0x7f185406ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:20.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.668+0000 7f1858bbc640 1 -- 172.21.15.18:0/2046234528 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f185406f230 con 0x7f18541593d0 2024-04-17T19:54:20.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.668+0000 7f18593bd640 1 --2- 172.21.15.18:0/2046234528 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f18400039c0 0x7f185413ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:54:20.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.668+0000 7f1859bbe640 1 --2- 172.21.15.18:0/2046234528 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f185406e8e0 0x7f185406ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:54:20.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.668+0000 7f1858bbc640 1 --2- 172.21.15.18:0/2046234528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18541593d0 0x7f18541597e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f184400e490 tx=0x7f184400e950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:20.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.668+0000 7f1849ffb640 1 -- 172.21.15.18:0/2046234528 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18440052e0 con 0x7f18541593d0 2024-04-17T19:54:20.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.668+0000 7f1849ffb640 1 -- 172.21.15.18:0/2046234528 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1844018070 con 0x7f18541593d0 2024-04-17T19:54:20.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.668+0000 7f185b621640 1 -- 172.21.15.18:0/2046234528 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f185415b260 con 0x7f18541593d0 2024-04-17T19:54:20.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.668+0000 7f1849ffb640 1 -- 172.21.15.18:0/2046234528 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1844005480 con 0x7f18541593d0 2024-04-17T19:54:20.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.668+0000 7f185b621640 1 -- 172.21.15.18:0/2046234528 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f185415a4a0 con 0x7f18541593d0 2024-04-17T19:54:20.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.668+0000 7f185b621640 1 -- 172.21.15.18:0/2046234528 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1854069950 con 0x7f18541593d0 2024-04-17T19:54:20.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.672+0000 7f1849ffb640 1 -- 172.21.15.18:0/2046234528 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1844003820 con 0x7f18541593d0 2024-04-17T19:54:20.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.672+0000 7f1849ffb640 1 --2- 172.21.15.18:0/2046234528 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f18380683b0 0x7f183806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:20.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.672+0000 7f18593bd640 1 --2- 172.21.15.18:0/2046234528 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f18380683b0 0x7f183806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:20.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.672+0000 7f1849ffb640 1 -- 172.21.15.18:0/2046234528 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7f1844086b10 con 0x7f18541593d0 2024-04-17T19:54:20.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.672+0000 7f18593bd640 1 --2- 172.21.15.18:0/2046234528 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f18380683b0 0x7f183806a8c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f18500af000 tx=0x7f1850008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:20.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.676+0000 7f1849ffb640 1 -- 172.21.15.18:0/2046234528 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f185406f230 con 0x7f18541593d0 2024-04-17T19:54:20.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.840+0000 7f185b621640 1 -- 172.21.15.18:0/2046234528 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f18540b4b80 con 0x7f18541593d0 2024-04-17T19:54:20.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.844+0000 7f1849ffb640 1 -- 172.21.15.18:0/2046234528 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18759 (secure 0 0 0) 0x7f185406d6b0 con 0x7f18541593d0 2024-04-17T19:54:20.841 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:54:20.841 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":29,"fsid":"dd480169-5a81-4623-be5f-0499aa244b28","created":"2024-04-17T19:52:39.533760+0000","modified":"2024-04-17T19:53:45.435889+0000","last_up_change":"2024-04-17T19:52:51.229698+0000","last_in_change":"2024-04-17T19:52:42.144259+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T19:52:52.391648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T19:53:02.734240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T19:53:03.813028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T19:53:07.478812+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e232d577-2508-4ea4-b355-29fbae1ff025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6801","nonce":2323038417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6803","nonce":2323038417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6807","nonce":2323038417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6805","nonce":2323038417}]},"public_addr":"172.21.15.18:6801/2323038417","cluster_addr":"172.21.15.18:6803/2323038417","heartbeat_back_addr":"172.21.15.18:6807/2323038417","heartbeat_front_addr":"172.21.15.18:6805/2323038417","state":["exists","up"]},{"osd":1,"uuid":"31810ef3-2c71-48d6-8748-b74a2968d23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6817","nonce":1283678238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6819","nonce":1283678238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6823","nonce":1283678238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6821","nonce":1283678238}]},"public_addr":"172.21.15.18:6817/1283678238","cluster_addr":"172.21.15.18:6819/1283678238","heartbeat_back_addr":"172.21.15.18:6823/1283678238","heartbeat_front_addr":"172.21.15.18:6821/1283678238","state":["exists","up"]},{"osd":2,"uuid":"5a783cc5-a41c-4967-9e11-6b8330f97d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6809","nonce":1212875862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6811","nonce":1212875862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6815","nonce":1212875862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6813","nonce":1212875862}]},"public_addr":"172.21.15.18:6809/1212875862","cluster_addr":"172.21.15.18:6811/1212875862","heartbeat_back_addr":"172.21.15.18:6815/1212875862","heartbeat_front_addr":"172.21.15.18:6813/1212875862","state":["exists","up"]},{"osd":3,"uuid":"b7e056d9-9da5-46e1-810d-0c3e242fe5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6825","nonce":2428878428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6827","nonce":2428878428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6831","nonce":2428878428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6829","nonce":2428878428}]},"public_addr":"172.21.15.18:6825/2428878428","cluster_addr":"172.21.15.18:6827/2428878428","heartbeat_back_addr":"172.21.15.18:6831/2428878428","heartbeat_front_addr":"172.21.15.18:6829/2428878428","state":["exists","up"]},{"osd":4,"uuid":"21df023f-bc8b-4abb-93e5-0ecc91acda0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6825","nonce":1421511819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6827","nonce":1421511819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6831","nonce":1421511819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6829","nonce":1421511819}]},"public_addr":"172.21.15.173:6825/1421511819","cluster_addr":"172.21.15.173:6827/1421511819","heartbeat_back_addr":"172.21.15.173:6831/1421511819","heartbeat_front_addr":"172.21.15.173:6829/1421511819","state":["exists","up"]},{"osd":5,"uuid":"e270098a-6d33-49f8-84ed-94e09a880cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6801","nonce":4221907702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6803","nonce":4221907702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6807","nonce":4221907702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6805","nonce":4221907702}]},"public_addr":"172.21.15.173:6801/4221907702","cluster_addr":"172.21.15.173:6803/4221907702","heartbeat_back_addr":"172.21.15.173:6807/4221907702","heartbeat_front_addr":"172.21.15.173:6805/4221907702","state":["exists","up"]},{"osd":6,"uuid":"93c67c8c-268d-4e32-877c-043cd3acd87c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6809","nonce":761678552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6811","nonce":761678552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6815","nonce":761678552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6813","nonce":761678552}]},"public_addr":"172.21.15.173:6809/761678552","cluster_addr":"172.21.15.173:6811/761678552","heartbeat_back_addr":"172.21.15.173:6815/761678552","heartbeat_front_addr":"172.21.15.173:6813/761678552","state":["exists","up"]},{"osd":7,"uuid":"faf10eea-80de-40f6-abbb-34d07d3f59ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6817","nonce":383724537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6819","nonce":383724537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6823","nonce":383724537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6821","nonce":383724537}]},"public_addr":"172.21.15.173:6817/383724537","cluster_addr":"172.21.15.173:6819/383724537","heartbeat_back_addr":"172.21.15.173:6823/383724537","heartbeat_front_addr":"172.21.15.173:6821/383724537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.668924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.761747+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.768128+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.632252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.742608+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.734327+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.477107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.818292+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.31","mappings":[{"from":0,"to":7}]},{"pgid":"4.5","mappings":[{"from":3,"to":4},{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":0}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]},{"pgid":"4.1c","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T19:54:20.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.844+0000 7f185b621640 1 -- 172.21.15.18:0/2046234528 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f18380683b0 msgr2=0x7f183806a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:20.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.844+0000 7f185b621640 1 --2- 172.21.15.18:0/2046234528 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f18380683b0 0x7f183806a8c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f18500af000 tx=0x7f1850008040 comp rx=0 tx=0).stop 2024-04-17T19:54:20.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.844+0000 7f185b621640 1 -- 172.21.15.18:0/2046234528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18541593d0 msgr2=0x7f18541597e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:20.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.844+0000 7f185b621640 1 --2- 172.21.15.18:0/2046234528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18541593d0 0x7f18541597e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f184400e490 tx=0x7f184400e950 comp rx=0 tx=0).stop 2024-04-17T19:54:20.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.844+0000 7f185b621640 1 -- 172.21.15.18:0/2046234528 shutdown_connections 2024-04-17T19:54:20.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.844+0000 7f185b621640 1 --2- 172.21.15.18:0/2046234528 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f18380683b0 0x7f183806a8c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:20.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.844+0000 7f185b621640 1 --2- 172.21.15.18:0/2046234528 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f185406e8e0 0x7f185406ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:20.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.844+0000 7f185b621640 1 --2- 172.21.15.18:0/2046234528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18541593d0 0x7f18541597e0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:20.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.844+0000 7f185b621640 1 --2- 172.21.15.18:0/2046234528 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f18400039c0 0x7f185413ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:20.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.844+0000 7f185b621640 1 -- 172.21.15.18:0/2046234528 >> 172.21.15.18:0/2046234528 conn(0x7f1854072bb0 msgr2=0x7f18540700d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:20.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.844+0000 7f185b621640 1 -- 172.21.15.18:0/2046234528 shutdown_connections 2024-04-17T19:54:20.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:20.844+0000 7f185b621640 1 -- 172.21.15.18:0/2046234528 wait complete. 2024-04-17T19:54:20.862 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T19:52:52.391648+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-17T19:53:02.734240+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-17T19:53:03.813028+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-17T19:53:07.478812+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-17T19:54:20.862 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T19:54:21.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.024+0000 7fdcac74e640 1 Processor -- start 2024-04-17T19:54:21.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.024+0000 7fdcac74e640 1 -- start start 2024-04-17T19:54:21.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.028+0000 7fdcac74e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fdca40713e0 0x7fdca40cdd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:21.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.028+0000 7fdcac74e640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdca40ce2a0 0x7fdca40d07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:21.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.028+0000 7fdcac74e640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdca40ce6b0 con 0x7fdca406eee0 2024-04-17T19:54:21.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.028+0000 7fdcac74e640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fdca406de40 con 0x7fdca40713e0 2024-04-17T19:54:21.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.028+0000 7fdcac74e640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fdca406e120 con 0x7fdca40ce2a0 2024-04-17T19:54:21.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.028+0000 7fdca9ce9640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fdca40713e0 0x7fdca40cdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:21.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.028+0000 7fdcaa4ea640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fdca406eee0 0x7fdca4070cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:38908/0 (socket says 172.21.15.18:38908) 2024-04-17T19:54:21.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.028+0000 7fdcaa4ea640 1 -- 172.21.15.18:0/2049658514 learned_addr learned my addr 172.21.15.18:0/2049658514 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:54:21.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.028+0000 7fdcaaceb640 1 --2- 172.21.15.18:0/2049658514 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdca40ce2a0 0x7fdca40d07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:21.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.028+0000 7fdca9ce9640 1 -- 172.21.15.18:0/2049658514 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdca40ce2a0 msgr2=0x7fdca40d07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:21.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.028+0000 7fdca9ce9640 1 --2- 172.21.15.18:0/2049658514 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdca40ce2a0 0x7fdca40d07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:21.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.028+0000 7fdca9ce9640 1 -- 172.21.15.18:0/2049658514 >> v1:172.21.15.18:6789/0 conn(0x7fdca406eee0 legacy=0x7fdca4070cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:21.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.028+0000 7fdca94e8640 1 -- 172.21.15.18:0/2049658514 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2843609566 0 0) 0x7fdca40ce6b0 con 0x7fdca406eee0 2024-04-17T19:54:21.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.028+0000 7fdca9ce9640 1 -- 172.21.15.18:0/2049658514 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdca406e400 con 0x7fdca40713e0 2024-04-17T19:54:21.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.028+0000 7fdcaaceb640 1 --2- 172.21.15.18:0/2049658514 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdca40ce2a0 0x7fdca40d07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:54:21.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.032+0000 7fdca9ce9640 1 --2- 172.21.15.18:0/2049658514 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdca40713e0 0x7fdca40cdd60 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fdc940097c0 tx=0x7fdc9401ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fed5f903284f3ac server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:21.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.032+0000 7fdca94e8640 1 -- 172.21.15.18:0/2049658514 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc940b5070 con 0x7fdca40713e0 2024-04-17T19:54:21.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.032+0000 7fdca94e8640 1 -- 172.21.15.18:0/2049658514 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc940a8990 con 0x7fdca40713e0 2024-04-17T19:54:21.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.032+0000 7fdca94e8640 1 -- 172.21.15.18:0/2049658514 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc940a8d60 con 0x7fdca40713e0 2024-04-17T19:54:21.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.032+0000 7fdcac74e640 1 -- 172.21.15.18:0/2049658514 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdca40713e0 msgr2=0x7fdca40cdd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:21.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.032+0000 7fdcac74e640 1 --2- 172.21.15.18:0/2049658514 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdca40713e0 0x7fdca40cdd60 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fdc940097c0 tx=0x7fdc9401ec90 comp rx=0 tx=0).stop 2024-04-17T19:54:21.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.032+0000 7fdcac74e640 1 -- 172.21.15.18:0/2049658514 shutdown_connections 2024-04-17T19:54:21.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.032+0000 7fdcac74e640 1 --2- 172.21.15.18:0/2049658514 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdca40ce2a0 0x7fdca40d07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:21.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.032+0000 7fdcac74e640 1 --2- 172.21.15.18:0/2049658514 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdca40713e0 0x7fdca40cdd60 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:21.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.032+0000 7fdcac74e640 1 -- 172.21.15.18:0/2049658514 >> 172.21.15.18:0/2049658514 conn(0x7fdca40d2bf0 msgr2=0x7fdca40d3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:21.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.032+0000 7fdcac74e640 1 -- 172.21.15.18:0/2049658514 shutdown_connections 2024-04-17T19:54:21.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.032+0000 7fdcac74e640 1 -- 172.21.15.18:0/2049658514 wait complete. 2024-04-17T19:54:21.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.036+0000 7fdcac74e640 1 Processor -- start 2024-04-17T19:54:21.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.036+0000 7fdcac74e640 1 -- start start 2024-04-17T19:54:21.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.036+0000 7fdcac74e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdca406eee0 0x7fdca40c8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:21.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.036+0000 7fdcac74e640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdca40ce2a0 0x7fdca4153280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:21.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.036+0000 7fdcac74e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdca40b2be0 0x7fdca41432f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:21.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.036+0000 7fdcac74e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fdca415f8f0 con 0x7fdca40b2be0 2024-04-17T19:54:21.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.036+0000 7fdcac74e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fdca406e9c0 con 0x7fdca406eee0 2024-04-17T19:54:21.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.036+0000 7fdcac74e640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fdca406daf0 con 0x7fdca40ce2a0 2024-04-17T19:54:21.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.036+0000 7fdcaaceb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdca40b2be0 0x7fdca41432f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:21.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.036+0000 7fdcaaceb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdca40b2be0 0x7fdca41432f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44972/0 (socket says 172.21.15.18:44972) 2024-04-17T19:54:21.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.036+0000 7fdcaaceb640 1 -- 172.21.15.18:0/3278527195 learned_addr learned my addr 172.21.15.18:0/3278527195 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:21.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.036+0000 7fdcaa4ea640 1 --2- 172.21.15.18:0/3278527195 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdca406eee0 0x7fdca40c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:21.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.036+0000 7fdca9ce9640 1 --2- 172.21.15.18:0/3278527195 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdca40ce2a0 0x7fdca4153280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:21.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.036+0000 7fdcaaceb640 1 -- 172.21.15.18:0/3278527195 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdca40ce2a0 msgr2=0x7fdca4153280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:21.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.036+0000 7fdcaaceb640 1 --2- 172.21.15.18:0/3278527195 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdca40ce2a0 0x7fdca4153280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:21.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.036+0000 7fdcaaceb640 1 -- 172.21.15.18:0/3278527195 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdca406eee0 msgr2=0x7fdca40c8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:21.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.036+0000 7fdcaaceb640 1 --2- 172.21.15.18:0/3278527195 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdca406eee0 0x7fdca40c8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:21.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.036+0000 7fdcaaceb640 1 -- 172.21.15.18:0/3278527195 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdca41461e0 con 0x7fdca40b2be0 2024-04-17T19:54:21.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.036+0000 7fdcaaceb640 1 --2- 172.21.15.18:0/3278527195 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdca40b2be0 0x7fdca41432f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c007ea0 tx=0x7fdc9c007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:21.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.036+0000 7fdc9affd640 1 -- 172.21.15.18:0/3278527195 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c01a070 con 0x7fdca40b2be0 2024-04-17T19:54:21.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.036+0000 7fdc9affd640 1 -- 172.21.15.18:0/3278527195 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc9c0039a0 con 0x7fdca40b2be0 2024-04-17T19:54:21.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.036+0000 7fdcac74e640 1 -- 172.21.15.18:0/3278527195 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdca40b5bf0 con 0x7fdca40b2be0 2024-04-17T19:54:21.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.036+0000 7fdc9affd640 1 -- 172.21.15.18:0/3278527195 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c003d90 con 0x7fdca40b2be0 2024-04-17T19:54:21.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.036+0000 7fdcac74e640 1 -- 172.21.15.18:0/3278527195 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdca40c8030 con 0x7fdca40b2be0 2024-04-17T19:54:21.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.040+0000 7fdcac74e640 1 -- 172.21.15.18:0/3278527195 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdca4069950 con 0x7fdca40b2be0 2024-04-17T19:54:21.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.040+0000 7fdc9affd640 1 -- 172.21.15.18:0/3278527195 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdc9c01d070 con 0x7fdca40b2be0 2024-04-17T19:54:21.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.040+0000 7fdc9affd640 1 --2- 172.21.15.18:0/3278527195 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fdc880683b0 0x7fdc8806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:21.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.040+0000 7fdc9affd640 1 -- 172.21.15.18:0/3278527195 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7fdc9c086fd0 con 0x7fdca40b2be0 2024-04-17T19:54:21.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.040+0000 7fdcaa4ea640 1 --2- 172.21.15.18:0/3278527195 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fdc880683b0 0x7fdc8806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:21.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.040+0000 7fdcaa4ea640 1 --2- 172.21.15.18:0/3278527195 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fdc880683b0 0x7fdc8806a8c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fdca0000f70 tx=0x7fdca0007c10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:21.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.044+0000 7fdc9affd640 1 -- 172.21.15.18:0/3278527195 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdca41461e0 con 0x7fdca40b2be0 2024-04-17T19:54:21.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.204+0000 7fdcac74e640 1 -- 172.21.15.18:0/3278527195 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdca4071800 con 0x7fdca40b2be0 2024-04-17T19:54:21.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.204+0000 7fdc9affd640 1 -- 172.21.15.18:0/3278527195 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7fdc9c010070 con 0x7fdca40b2be0 2024-04-17T19:54:21.204 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-17T19:54:21.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.208+0000 7fdcac74e640 1 -- 172.21.15.18:0/3278527195 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fdc880683b0 msgr2=0x7fdc8806a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:21.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.208+0000 7fdcac74e640 1 --2- 172.21.15.18:0/3278527195 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fdc880683b0 0x7fdc8806a8c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fdca0000f70 tx=0x7fdca0007c10 comp rx=0 tx=0).stop 2024-04-17T19:54:21.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.208+0000 7fdcac74e640 1 -- 172.21.15.18:0/3278527195 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdca40b2be0 msgr2=0x7fdca41432f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:21.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.208+0000 7fdcac74e640 1 --2- 172.21.15.18:0/3278527195 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdca40b2be0 0x7fdca41432f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c007ea0 tx=0x7fdc9c007f90 comp rx=0 tx=0).stop 2024-04-17T19:54:21.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.208+0000 7fdcac74e640 1 -- 172.21.15.18:0/3278527195 shutdown_connections 2024-04-17T19:54:21.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.208+0000 7fdcac74e640 1 --2- 172.21.15.18:0/3278527195 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fdc880683b0 0x7fdc8806a8c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:21.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.208+0000 7fdcac74e640 1 --2- 172.21.15.18:0/3278527195 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdca40b2be0 0x7fdca41432f0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:21.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.208+0000 7fdcac74e640 1 --2- 172.21.15.18:0/3278527195 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdca40ce2a0 0x7fdca4153280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:21.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.208+0000 7fdcac74e640 1 --2- 172.21.15.18:0/3278527195 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdca406eee0 0x7fdca40c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:21.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.208+0000 7fdcac74e640 1 -- 172.21.15.18:0/3278527195 >> 172.21.15.18:0/3278527195 conn(0x7fdca40d2bf0 msgr2=0x7fdca415b250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:21.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.208+0000 7fdcac74e640 1 -- 172.21.15.18:0/3278527195 shutdown_connections 2024-04-17T19:54:21.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.208+0000 7fdcac74e640 1 -- 172.21.15.18:0/3278527195 wait complete. 2024-04-17T19:54:21.225 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-17T19:54:21.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.380+0000 7f30ed1cf640 1 Processor -- start 2024-04-17T19:54:21.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.380+0000 7f30ed1cf640 1 -- start start 2024-04-17T19:54:21.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.380+0000 7f30ed1cf640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f30e815e1a0 0x7f30e80ce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:21.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.380+0000 7f30ed1cf640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f30e80cef10 0x7f30e815e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:21.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.380+0000 7f30ed1cf640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30e80d0020 con 0x7f30e815ee50 2024-04-17T19:54:21.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.380+0000 7f30ed1cf640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f30e80cd930 con 0x7f30e80cef10 2024-04-17T19:54:21.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.380+0000 7f30ed1cf640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f30e80cdc10 con 0x7f30e815e1a0 2024-04-17T19:54:21.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.380+0000 7f30e659c640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f30e80cef10 0x7f30e815e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:21.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.380+0000 7f30e6d9d640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f30e815e1a0 0x7f30e80ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:21.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.380+0000 7f30e759e640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f30e815ee50 0x7f30e806cd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.18:55388/0 (socket says 172.21.15.18:55388) 2024-04-17T19:54:21.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.380+0000 7f30e659c640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f30e80cef10 0x7f30e815e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.18:51436/0 (socket says 172.21.15.18:51436) 2024-04-17T19:54:21.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.380+0000 7f30e6d9d640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f30e815e1a0 0x7f30e80ce9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.18:53514/0 (socket says 172.21.15.18:53514) 2024-04-17T19:54:21.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.380+0000 7f30e759e640 1 -- 172.21.15.18:0/3920902054 learned_addr learned my addr 172.21.15.18:0/3920902054 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:54:21.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.384+0000 7f30e659c640 1 -- 172.21.15.18:0/3920902054 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f30e815e1a0 msgr2=0x7f30e80ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:21.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.384+0000 7f30e659c640 1 --2- 172.21.15.18:0/3920902054 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f30e815e1a0 0x7f30e80ce9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:21.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.384+0000 7f30e659c640 1 -- 172.21.15.18:0/3920902054 >> v1:172.21.15.173:6789/0 conn(0x7f30e815ee50 legacy=0x7f30e806cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:21.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.384+0000 7f30e659c640 1 -- 172.21.15.18:0/3920902054 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30e80cdef0 con 0x7f30e80cef10 2024-04-17T19:54:21.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.384+0000 7f30e5d9b640 1 -- 172.21.15.18:0/3920902054 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2208386427 0 0) 0x7f30e80d0020 con 0x7f30e815ee50 2024-04-17T19:54:21.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.384+0000 7f30e6d9d640 1 --2- 172.21.15.18:0/3920902054 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f30e815e1a0 0x7f30e80ce9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-17T19:54:21.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.384+0000 7f30e659c640 1 --2- 172.21.15.18:0/3920902054 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f30e80cef10 0x7f30e815e910 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f30dc0097c0 tx=0x7f30dc01c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f59d346e715bf84 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:21.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.384+0000 7f30e5d9b640 1 -- 172.21.15.18:0/3920902054 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30dc0b0070 con 0x7f30e80cef10 2024-04-17T19:54:21.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.384+0000 7f30e5d9b640 1 -- 172.21.15.18:0/3920902054 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30dc0ab600 con 0x7f30e80cef10 2024-04-17T19:54:21.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.384+0000 7f30e5d9b640 1 -- 172.21.15.18:0/3920902054 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30dc0ab9d0 con 0x7f30e80cef10 2024-04-17T19:54:21.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.384+0000 7f30ed1cf640 1 -- 172.21.15.18:0/3920902054 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f30e80cef10 msgr2=0x7f30e815e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:21.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.384+0000 7f30ed1cf640 1 --2- 172.21.15.18:0/3920902054 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f30e80cef10 0x7f30e815e910 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f30dc0097c0 tx=0x7f30dc01c410 comp rx=0 tx=0).stop 2024-04-17T19:54:21.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.388+0000 7f30ed1cf640 1 -- 172.21.15.18:0/3920902054 shutdown_connections 2024-04-17T19:54:21.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.388+0000 7f30ed1cf640 1 --2- 172.21.15.18:0/3920902054 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f30e80cef10 0x7f30e815e910 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:21.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.388+0000 7f30ed1cf640 1 --2- 172.21.15.18:0/3920902054 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f30e815e1a0 0x7f30e80ce9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:21.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.388+0000 7f30ed1cf640 1 -- 172.21.15.18:0/3920902054 >> 172.21.15.18:0/3920902054 conn(0x7f30e8072bb0 msgr2=0x7f30e8072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:21.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.388+0000 7f30ed1cf640 1 -- 172.21.15.18:0/3920902054 shutdown_connections 2024-04-17T19:54:21.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.388+0000 7f30ed1cf640 1 -- 172.21.15.18:0/3920902054 wait complete. 2024-04-17T19:54:21.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.388+0000 7f30ed1cf640 1 Processor -- start 2024-04-17T19:54:21.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.388+0000 7f30ed1cf640 1 -- start start 2024-04-17T19:54:21.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.388+0000 7f30ed1cf640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f30e80cef10 0x7f30e814c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:21.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.388+0000 7f30ed1cf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30e815e1a0 0x7f30e815c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:21.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.388+0000 7f30ed1cf640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f30e815ee50 0x7f30e8159130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:21.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.388+0000 7f30ed1cf640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f30e8157b90 con 0x7f30e815e1a0 2024-04-17T19:54:21.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.388+0000 7f30ed1cf640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f30e8157a10 con 0x7f30e80cef10 2024-04-17T19:54:21.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.388+0000 7f30ed1cf640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f30e806d470 con 0x7f30e815ee50 2024-04-17T19:54:21.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.388+0000 7f30e659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30e815e1a0 0x7f30e815c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:21.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.388+0000 7f30e659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30e815e1a0 0x7f30e815c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44974/0 (socket says 172.21.15.18:44974) 2024-04-17T19:54:21.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.388+0000 7f30e659c640 1 -- 172.21.15.18:0/637001477 learned_addr learned my addr 172.21.15.18:0/637001477 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:21.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.392+0000 7f30e6d9d640 1 --2- 172.21.15.18:0/637001477 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f30e80cef10 0x7f30e814c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:21.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.392+0000 7f30e759e640 1 --2- 172.21.15.18:0/637001477 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f30e815ee50 0x7f30e8159130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:21.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.392+0000 7f30e659c640 1 -- 172.21.15.18:0/637001477 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f30e815ee50 msgr2=0x7f30e8159130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:21.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.392+0000 7f30e659c640 1 --2- 172.21.15.18:0/637001477 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f30e815ee50 0x7f30e8159130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:21.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.392+0000 7f30e659c640 1 -- 172.21.15.18:0/637001477 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f30e80cef10 msgr2=0x7f30e814c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:21.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.392+0000 7f30e659c640 1 --2- 172.21.15.18:0/637001477 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f30e80cef10 0x7f30e814c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:21.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.392+0000 7f30e659c640 1 -- 172.21.15.18:0/637001477 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30e8152ab0 con 0x7f30e815e1a0 2024-04-17T19:54:21.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.392+0000 7f30e659c640 1 --2- 172.21.15.18:0/637001477 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30e815e1a0 0x7f30e815c530 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f30dc0ae040 tx=0x7f30dc0191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:21.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.392+0000 7f30cf7fe640 1 -- 172.21.15.18:0/637001477 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30dc0b0040 con 0x7f30e815e1a0 2024-04-17T19:54:21.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.392+0000 7f30cf7fe640 1 -- 172.21.15.18:0/637001477 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30dc0b43f0 con 0x7f30e815e1a0 2024-04-17T19:54:21.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.392+0000 7f30ed1cf640 1 -- 172.21.15.18:0/637001477 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30e8153570 con 0x7f30e815e1a0 2024-04-17T19:54:21.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.392+0000 7f30cf7fe640 1 -- 172.21.15.18:0/637001477 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30dc0b4800 con 0x7f30e815e1a0 2024-04-17T19:54:21.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.392+0000 7f30ed1cf640 1 -- 172.21.15.18:0/637001477 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30e8153290 con 0x7f30e815e1a0 2024-04-17T19:54:21.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.392+0000 7f30ed1cf640 1 -- 172.21.15.18:0/637001477 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30e8069950 con 0x7f30e815e1a0 2024-04-17T19:54:21.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.392+0000 7f30cf7fe640 1 -- 172.21.15.18:0/637001477 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f30dc0b49a0 con 0x7f30e815e1a0 2024-04-17T19:54:21.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.392+0000 7f30cf7fe640 1 --2- 172.21.15.18:0/637001477 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f30d4068380 0x7f30d406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:21.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.392+0000 7f30cf7fe640 1 -- 172.21.15.18:0/637001477 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7f30dc1206e0 con 0x7f30e815e1a0 2024-04-17T19:54:21.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.392+0000 7f30e6d9d640 1 --2- 172.21.15.18:0/637001477 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f30d4068380 0x7f30d406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:21.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.392+0000 7f30e6d9d640 1 --2- 172.21.15.18:0/637001477 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f30d4068380 0x7f30d406a890 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f30d8009580 tx=0x7f30d8009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:21.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.396+0000 7f30cf7fe640 1 -- 172.21.15.18:0/637001477 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f30dc016090 con 0x7f30e815e1a0 2024-04-17T19:54:21.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.564+0000 7f30ed1cf640 1 -- 172.21.15.18:0/637001477 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f30e8152d40 con 0x7f30e815e1a0 2024-04-17T19:54:21.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.564+0000 7f30cf7fe640 1 -- 172.21.15.18:0/637001477 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7f30dc0f0290 con 0x7f30e815e1a0 2024-04-17T19:54:21.564 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-17T19:54:21.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.568+0000 7f30ed1cf640 1 -- 172.21.15.18:0/637001477 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f30d4068380 msgr2=0x7f30d406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:21.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.568+0000 7f30ed1cf640 1 --2- 172.21.15.18:0/637001477 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f30d4068380 0x7f30d406a890 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f30d8009580 tx=0x7f30d8009190 comp rx=0 tx=0).stop 2024-04-17T19:54:21.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.568+0000 7f30ed1cf640 1 -- 172.21.15.18:0/637001477 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30e815e1a0 msgr2=0x7f30e815c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:21.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.568+0000 7f30ed1cf640 1 --2- 172.21.15.18:0/637001477 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30e815e1a0 0x7f30e815c530 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f30dc0ae040 tx=0x7f30dc0191b0 comp rx=0 tx=0).stop 2024-04-17T19:54:21.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.568+0000 7f30ed1cf640 1 -- 172.21.15.18:0/637001477 shutdown_connections 2024-04-17T19:54:21.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.568+0000 7f30ed1cf640 1 --2- 172.21.15.18:0/637001477 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f30d4068380 0x7f30d406a890 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:21.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.568+0000 7f30ed1cf640 1 --2- 172.21.15.18:0/637001477 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f30e815ee50 0x7f30e8159130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:21.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.568+0000 7f30ed1cf640 1 --2- 172.21.15.18:0/637001477 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30e815e1a0 0x7f30e815c530 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:21.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.568+0000 7f30ed1cf640 1 --2- 172.21.15.18:0/637001477 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f30e80cef10 0x7f30e814c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:21.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.568+0000 7f30ed1cf640 1 -- 172.21.15.18:0/637001477 >> 172.21.15.18:0/637001477 conn(0x7f30e8072bb0 msgr2=0x7f30e8072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:21.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.568+0000 7f30ed1cf640 1 -- 172.21.15.18:0/637001477 shutdown_connections 2024-04-17T19:54:21.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.568+0000 7f30ed1cf640 1 -- 172.21.15.18:0/637001477 wait complete. 2024-04-17T19:54:21.585 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-17T19:54:21.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.744+0000 7f1d211b5640 1 Processor -- start 2024-04-17T19:54:21.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.744+0000 7f1d211b5640 1 -- start start 2024-04-17T19:54:21.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.744+0000 7f1d211b5640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1d1c15b810 0x7f1d1c0cde90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:21.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.744+0000 7f1d211b5640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f1d1c0cfb20 0x7f1d1c0cff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:21.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.744+0000 7f1d211b5640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d1c0b53d0 con 0x7f1d1c15f2c0 2024-04-17T19:54:21.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.744+0000 7f1d211b5640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f1d1c0b5990 con 0x7f1d1c15b810 2024-04-17T19:54:21.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.744+0000 7f1d211b5640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f1d1c0b56b0 con 0x7f1d1c0cfb20 2024-04-17T19:54:21.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.744+0000 7f1d1ad9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1d1c15b810 0x7f1d1c0cde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:21.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.744+0000 7f1d1ad9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1d1c15b810 0x7f1d1c0cde90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:44990/0 (socket says 172.21.15.18:44990) 2024-04-17T19:54:21.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.744+0000 7f1d1ad9d640 1 -- 172.21.15.18:0/1512433225 learned_addr learned my addr 172.21.15.18:0/1512433225 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:21.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.744+0000 7f1d1ad9d640 1 -- 172.21.15.18:0/1512433225 >> v2:172.21.15.173:3300/0 conn(0x7f1d1c0cfb20 msgr2=0x7f1d1c0cff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:21.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.744+0000 7f1d1ad9d640 1 --2- 172.21.15.18:0/1512433225 >> v2:172.21.15.173:3300/0 conn(0x7f1d1c0cfb20 0x7f1d1c0cff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:21.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.744+0000 7f1d1ad9d640 1 -- 172.21.15.18:0/1512433225 >> v1:172.21.15.173:6789/0 conn(0x7f1d1c15f2c0 legacy=0x7f1d1c15f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:21.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.744+0000 7f1d1ad9d640 1 -- 172.21.15.18:0/1512433225 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d1c06ea10 con 0x7f1d1c15b810 2024-04-17T19:54:21.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.748+0000 7f1d1ad9d640 1 --2- 172.21.15.18:0/1512433225 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d1c15b810 0x7f1d1c0cde90 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c0707f0 tx=0x7f1d0c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d4cfaae5c8821a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:21.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.748+0000 7f1d19d9b640 1 -- 172.21.15.18:0/1512433225 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d0c0b2070 con 0x7f1d1c15b810 2024-04-17T19:54:21.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.748+0000 7f1d19d9b640 1 -- 172.21.15.18:0/1512433225 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d0c0a9070 con 0x7f1d1c15b810 2024-04-17T19:54:21.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.748+0000 7f1d19d9b640 1 -- 172.21.15.18:0/1512433225 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d0c0ad880 con 0x7f1d1c15b810 2024-04-17T19:54:21.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.748+0000 7f1d211b5640 1 -- 172.21.15.18:0/1512433225 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d1c15b810 msgr2=0x7f1d1c0cde90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:21.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.748+0000 7f1d211b5640 1 --2- 172.21.15.18:0/1512433225 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d1c15b810 0x7f1d1c0cde90 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c0707f0 tx=0x7f1d0c01c450 comp rx=0 tx=0).stop 2024-04-17T19:54:21.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.748+0000 7f1d211b5640 1 -- 172.21.15.18:0/1512433225 shutdown_connections 2024-04-17T19:54:21.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.748+0000 7f1d211b5640 1 --2- 172.21.15.18:0/1512433225 >> v2:172.21.15.173:3300/0 conn(0x7f1d1c0cfb20 0x7f1d1c0cff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:21.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.748+0000 7f1d211b5640 1 --2- 172.21.15.18:0/1512433225 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d1c15b810 0x7f1d1c0cde90 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:21.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.748+0000 7f1d211b5640 1 -- 172.21.15.18:0/1512433225 >> 172.21.15.18:0/1512433225 conn(0x7f1d1c072bb0 msgr2=0x7f1d1c072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:21.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.748+0000 7f1d211b5640 1 -- 172.21.15.18:0/1512433225 shutdown_connections 2024-04-17T19:54:21.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.748+0000 7f1d211b5640 1 -- 172.21.15.18:0/1512433225 wait complete. 2024-04-17T19:54:21.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.752+0000 7f1d211b5640 1 Processor -- start 2024-04-17T19:54:21.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.752+0000 7f1d211b5640 1 -- start start 2024-04-17T19:54:21.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.752+0000 7f1d211b5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d1c0cfb20 0x7f1d1c15a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:21.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.752+0000 7f1d211b5640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d1c15b810 0x7f1d1c1400e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:21.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.752+0000 7f1d211b5640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1d1c15f2c0 0x7f1d1c149020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:21.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.752+0000 7f1d211b5640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1d1c1669e0 con 0x7f1d1c0cfb20 2024-04-17T19:54:21.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.752+0000 7f1d211b5640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1d1c166860 con 0x7f1d1c15b810 2024-04-17T19:54:21.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.752+0000 7f1d211b5640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f1d1c166b60 con 0x7f1d1c15f2c0 2024-04-17T19:54:21.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.752+0000 7f1d1ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d1c0cfb20 0x7f1d1c15a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:21.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.752+0000 7f1d1ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d1c0cfb20 0x7f1d1c15a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45000/0 (socket says 172.21.15.18:45000) 2024-04-17T19:54:21.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.752+0000 7f1d1ad9d640 1 -- 172.21.15.18:0/2367969589 learned_addr learned my addr 172.21.15.18:0/2367969589 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:21.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.752+0000 7f1d1a59c640 1 --2- 172.21.15.18:0/2367969589 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d1c15b810 0x7f1d1c1400e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:21.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.752+0000 7f1d1b59e640 1 --2- 172.21.15.18:0/2367969589 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1d1c15f2c0 0x7f1d1c149020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:21.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.752+0000 7f1d1ad9d640 1 -- 172.21.15.18:0/2367969589 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1d1c15f2c0 msgr2=0x7f1d1c149020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:21.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.752+0000 7f1d1ad9d640 1 --2- 172.21.15.18:0/2367969589 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1d1c15f2c0 0x7f1d1c149020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:21.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.752+0000 7f1d1ad9d640 1 -- 172.21.15.18:0/2367969589 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d1c15b810 msgr2=0x7f1d1c1400e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:21.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.752+0000 7f1d1ad9d640 1 --2- 172.21.15.18:0/2367969589 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d1c15b810 0x7f1d1c1400e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:21.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.752+0000 7f1d1ad9d640 1 -- 172.21.15.18:0/2367969589 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d1c15cf10 con 0x7f1d1c0cfb20 2024-04-17T19:54:21.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.752+0000 7f1d1b59e640 1 --2- 172.21.15.18:0/2367969589 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1d1c15f2c0 0x7f1d1c149020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:54:21.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.752+0000 7f1d1ad9d640 1 --2- 172.21.15.18:0/2367969589 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d1c0cfb20 0x7f1d1c15a660 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c01a080 tx=0x7f1d0c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:21.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.752+0000 7f1d037fe640 1 -- 172.21.15.18:0/2367969589 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d0c0bc020 con 0x7f1d1c0cfb20 2024-04-17T19:54:21.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.752+0000 7f1d037fe640 1 -- 172.21.15.18:0/2367969589 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d0c0b8420 con 0x7f1d1c0cfb20 2024-04-17T19:54:21.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.752+0000 7f1d037fe640 1 -- 172.21.15.18:0/2367969589 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d0c0b2040 con 0x7f1d1c0cfb20 2024-04-17T19:54:21.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.752+0000 7f1d211b5640 1 -- 172.21.15.18:0/2367969589 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d1c15d1f0 con 0x7f1d1c0cfb20 2024-04-17T19:54:21.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.752+0000 7f1d211b5640 1 -- 172.21.15.18:0/2367969589 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d1c15d7b0 con 0x7f1d1c0cfb20 2024-04-17T19:54:21.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.756+0000 7f1d211b5640 1 -- 172.21.15.18:0/2367969589 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d1c069950 con 0x7f1d1c0cfb20 2024-04-17T19:54:21.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.756+0000 7f1d037fe640 1 -- 172.21.15.18:0/2367969589 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1d0c0bf020 con 0x7f1d1c0cfb20 2024-04-17T19:54:21.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.756+0000 7f1d037fe640 1 --2- 172.21.15.18:0/2367969589 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f1d08068380 0x7f1d0806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:21.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.756+0000 7f1d037fe640 1 -- 172.21.15.18:0/2367969589 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7f1d0c120dc0 con 0x7f1d1c0cfb20 2024-04-17T19:54:21.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.756+0000 7f1d1a59c640 1 --2- 172.21.15.18:0/2367969589 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f1d08068380 0x7f1d0806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:21.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.756+0000 7f1d1a59c640 1 --2- 172.21.15.18:0/2367969589 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f1d08068380 0x7f1d0806a890 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1d10006fd0 tx=0x7f1d10008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:21.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.760+0000 7f1d037fe640 1 -- 172.21.15.18:0/2367969589 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1d0c0c6070 con 0x7f1d1c0cfb20 2024-04-17T19:54:21.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.920+0000 7f1d211b5640 1 -- 172.21.15.18:0/2367969589 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f1d1c0b4360 con 0x7f1d1c0cfb20 2024-04-17T19:54:21.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.924+0000 7f1d037fe640 1 -- 172.21.15.18:0/2367969589 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7f1d0c0160d0 con 0x7f1d1c0cfb20 2024-04-17T19:54:21.921 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-17T19:54:21.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.924+0000 7f1d211b5640 1 -- 172.21.15.18:0/2367969589 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f1d08068380 msgr2=0x7f1d0806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:21.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.924+0000 7f1d211b5640 1 --2- 172.21.15.18:0/2367969589 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f1d08068380 0x7f1d0806a890 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1d10006fd0 tx=0x7f1d10008040 comp rx=0 tx=0).stop 2024-04-17T19:54:21.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.924+0000 7f1d211b5640 1 -- 172.21.15.18:0/2367969589 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d1c0cfb20 msgr2=0x7f1d1c15a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:21.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.924+0000 7f1d211b5640 1 --2- 172.21.15.18:0/2367969589 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d1c0cfb20 0x7f1d1c15a660 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c01a080 tx=0x7f1d0c01ac90 comp rx=0 tx=0).stop 2024-04-17T19:54:21.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.924+0000 7f1d211b5640 1 -- 172.21.15.18:0/2367969589 shutdown_connections 2024-04-17T19:54:21.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.924+0000 7f1d211b5640 1 --2- 172.21.15.18:0/2367969589 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f1d08068380 0x7f1d0806a890 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:21.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.924+0000 7f1d211b5640 1 --2- 172.21.15.18:0/2367969589 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1d1c15f2c0 0x7f1d1c149020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:21.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.924+0000 7f1d211b5640 1 --2- 172.21.15.18:0/2367969589 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d1c15b810 0x7f1d1c1400e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:21.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.924+0000 7f1d211b5640 1 --2- 172.21.15.18:0/2367969589 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d1c0cfb20 0x7f1d1c15a660 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:21.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.924+0000 7f1d211b5640 1 -- 172.21.15.18:0/2367969589 >> 172.21.15.18:0/2367969589 conn(0x7f1d1c072bb0 msgr2=0x7f1d1c15f6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:21.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.924+0000 7f1d211b5640 1 -- 172.21.15.18:0/2367969589 shutdown_connections 2024-04-17T19:54:21.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:21.924+0000 7f1d211b5640 1 -- 172.21.15.18:0/2367969589 wait complete. 2024-04-17T19:54:21.944 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-17T19:54:22.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.108+0000 7f0352644640 1 Processor -- start 2024-04-17T19:54:22.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.108+0000 7f0352644640 1 -- start start 2024-04-17T19:54:22.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.108+0000 7f0352644640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f034c073080 0x7f034c073490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:22.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.108+0000 7f0352644640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f034c0b5440 con 0x7f034c15d2d0 2024-04-17T19:54:22.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.108+0000 7f0352644640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f034c0739d0 con 0x7f034c0ce690 2024-04-17T19:54:22.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.108+0000 7f0352644640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f034c0cd5f0 con 0x7f034c073080 2024-04-17T19:54:22.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.108+0000 7f034bfff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f034c15d2d0 0x7f034c0b4d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:38912/0 (socket says 172.21.15.18:38912) 2024-04-17T19:54:22.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.108+0000 7f034bfff640 1 -- 172.21.15.18:0/1561948942 learned_addr learned my addr 172.21.15.18:0/1561948942 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:54:22.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.108+0000 7f034b7fe640 1 --2- 172.21.15.18:0/1561948942 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f034c073080 0x7f034c073490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:22.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.112+0000 7f034affd640 1 -- 172.21.15.18:0/1561948942 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 305136866 0 0) 0x7f0334001120 con 0x7f034c15d2d0 2024-04-17T19:54:22.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.112+0000 7f034affd640 1 -- 172.21.15.18:0/1561948942 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0338003530 con 0x7f034c15d2d0 2024-04-17T19:54:22.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.112+0000 7f034affd640 1 -- 172.21.15.18:0/1561948942 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 389337992 0 0) 0x7f03440014a0 con 0x7f034c0ce690 2024-04-17T19:54:22.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.112+0000 7f034affd640 1 -- 172.21.15.18:0/1561948942 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0334001120 con 0x7f034c0ce690 2024-04-17T19:54:22.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.112+0000 7f034affd640 1 -- 172.21.15.18:0/1561948942 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3720923054 0 0) 0x7f0338003530 con 0x7f034c15d2d0 2024-04-17T19:54:22.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.112+0000 7f034affd640 1 -- 172.21.15.18:0/1561948942 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f034c073080 msgr2=0x7f034c073490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:22.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.112+0000 7f034affd640 1 --2- 172.21.15.18:0/1561948942 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f034c073080 0x7f034c073490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:22.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.112+0000 7f034affd640 1 -- 172.21.15.18:0/1561948942 >> v1:172.21.15.173:6789/0 conn(0x7f034c0ce690 legacy=0x7f034c0ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:22.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.112+0000 7f034affd640 1 -- 172.21.15.18:0/1561948942 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f034c0cd8d0 con 0x7f034c15d2d0 2024-04-17T19:54:22.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.112+0000 7f034affd640 1 -- 172.21.15.18:0/1561948942 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3208559991 0 0) 0x7f0334001850 con 0x7f034c15d2d0 2024-04-17T19:54:22.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.112+0000 7f034affd640 1 -- 172.21.15.18:0/1561948942 >> v1:172.21.15.18:6789/0 conn(0x7f034c15d2d0 legacy=0x7f034c0b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:22.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.112+0000 7f034affd640 1 --2- 172.21.15.18:0/1561948942 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0338003b80 0x7f0338003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:22.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.112+0000 7f034affd640 1 --2- 172.21.15.18:0/1561948942 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0338004810 0x7f0338004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:22.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.112+0000 7f034affd640 1 --2- 172.21.15.18:0/1561948942 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f034c073080 0x7f0338005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:22.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.112+0000 7f034affd640 1 -- 172.21.15.18:0/1561948942 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f034c0cd5f0 con 0x7f0338004810 2024-04-17T19:54:22.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.112+0000 7f034affd640 1 -- 172.21.15.18:0/1561948942 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f033800bb60 con 0x7f0338003b80 2024-04-17T19:54:22.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.112+0000 7f034affd640 1 -- 172.21.15.18:0/1561948942 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f033800bd30 con 0x7f034c073080 2024-04-17T19:54:22.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.112+0000 7f034b7fe640 1 --2- 172.21.15.18:0/1561948942 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0338004810 0x7f0338004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:22.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.112+0000 7f0350be1640 1 --2- 172.21.15.18:0/1561948942 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f034c073080 0x7f0338005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:22.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.112+0000 7f034bfff640 1 --2- 172.21.15.18:0/1561948942 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0338003b80 0x7f0338003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:22.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.112+0000 7f034b7fe640 1 -- 172.21.15.18:0/1561948942 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f034c073080 msgr2=0x7f0338005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:22.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.112+0000 7f034b7fe640 1 --2- 172.21.15.18:0/1561948942 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f034c073080 0x7f0338005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:22.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.112+0000 7f034b7fe640 1 -- 172.21.15.18:0/1561948942 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0338003b80 msgr2=0x7f0338003fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:22.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.112+0000 7f034b7fe640 1 --2- 172.21.15.18:0/1561948942 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0338003b80 0x7f0338003fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:22.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.112+0000 7f034b7fe640 1 -- 172.21.15.18:0/1561948942 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0338003530 con 0x7f0338004810 2024-04-17T19:54:22.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.112+0000 7f034b7fe640 1 --2- 172.21.15.18:0/1561948942 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0338004810 0x7f0338004c20 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f033c009b10 tx=0x7f033c01ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=936b85e1229938cc server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:22.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.112+0000 7f034affd640 1 -- 172.21.15.18:0/1561948942 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f033c0b2070 con 0x7f0338004810 2024-04-17T19:54:22.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.112+0000 7f034affd640 1 -- 172.21.15.18:0/1561948942 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f033c0a5680 con 0x7f0338004810 2024-04-17T19:54:22.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.112+0000 7f034affd640 1 -- 172.21.15.18:0/1561948942 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f033c0096b0 con 0x7f0338004810 2024-04-17T19:54:22.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.116+0000 7f0352644640 1 -- 172.21.15.18:0/1561948942 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0338004810 msgr2=0x7f0338004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:22.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.116+0000 7f0352644640 1 --2- 172.21.15.18:0/1561948942 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0338004810 0x7f0338004c20 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f033c009b10 tx=0x7f033c01ca90 comp rx=0 tx=0).stop 2024-04-17T19:54:22.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.116+0000 7f0350be1640 1 -- 172.21.15.18:0/1561948942 reap_dead start 2024-04-17T19:54:22.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.116+0000 7f0352644640 1 -- 172.21.15.18:0/1561948942 shutdown_connections 2024-04-17T19:54:22.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.116+0000 7f0352644640 1 -- 172.21.15.18:0/1561948942 >> 172.21.15.18:0/1561948942 conn(0x7f034c0b3910 msgr2=0x7f034c0d12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:22.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.116+0000 7f0352644640 1 -- 172.21.15.18:0/1561948942 shutdown_connections 2024-04-17T19:54:22.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.116+0000 7f0352644640 1 -- 172.21.15.18:0/1561948942 wait complete. 2024-04-17T19:54:22.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.116+0000 7f0352644640 1 Processor -- start 2024-04-17T19:54:22.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.116+0000 7f0352644640 1 -- start start 2024-04-17T19:54:22.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.116+0000 7f0352644640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0338004810 0x7f034c1585f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:22.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.116+0000 7f0352644640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f034c1f38d0 0x7f034c153e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:22.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.116+0000 7f0352644640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f034c1f6ea0 0x7f034c1f72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:22.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.116+0000 7f0352644640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f034c15d6e0 con 0x7f034c1f38d0 2024-04-17T19:54:22.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.116+0000 7f0352644640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f034c0cde90 con 0x7f0338004810 2024-04-17T19:54:22.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.116+0000 7f0352644640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f034c15d860 con 0x7f034c1f6ea0 2024-04-17T19:54:22.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.116+0000 7f034b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f034c1f38d0 0x7f034c153e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:22.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.116+0000 7f034b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f034c1f38d0 0x7f034c153e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45018/0 (socket says 172.21.15.18:45018) 2024-04-17T19:54:22.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.116+0000 7f034b7fe640 1 -- 172.21.15.18:0/2133797213 learned_addr learned my addr 172.21.15.18:0/2133797213 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:22.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.116+0000 7f034bfff640 1 --2- 172.21.15.18:0/2133797213 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0338004810 0x7f034c1585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:22.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.116+0000 7f0350be1640 1 --2- 172.21.15.18:0/2133797213 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f034c1f6ea0 0x7f034c1f72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:22.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.120+0000 7f034b7fe640 1 -- 172.21.15.18:0/2133797213 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f034c1f6ea0 msgr2=0x7f034c1f72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:22.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.120+0000 7f034b7fe640 1 --2- 172.21.15.18:0/2133797213 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f034c1f6ea0 0x7f034c1f72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:22.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.120+0000 7f034b7fe640 1 -- 172.21.15.18:0/2133797213 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0338004810 msgr2=0x7f034c1585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:22.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.120+0000 7f034b7fe640 1 --2- 172.21.15.18:0/2133797213 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0338004810 0x7f034c1585f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:22.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.120+0000 7f034b7fe640 1 -- 172.21.15.18:0/2133797213 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f034c1f77f0 con 0x7f034c1f38d0 2024-04-17T19:54:22.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.120+0000 7f034b7fe640 1 --2- 172.21.15.18:0/2133797213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f034c1f38d0 0x7f034c153e60 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f033c009b10 tx=0x7f0338005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:22.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.120+0000 7f0348ff9640 1 -- 172.21.15.18:0/2133797213 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f033c0bd020 con 0x7f034c1f38d0 2024-04-17T19:54:22.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.120+0000 7f0348ff9640 1 -- 172.21.15.18:0/2133797213 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f033c004020 con 0x7f034c1f38d0 2024-04-17T19:54:22.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.120+0000 7f0352644640 1 -- 172.21.15.18:0/2133797213 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f034c1f3ce0 con 0x7f034c1f38d0 2024-04-17T19:54:22.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.120+0000 7f0348ff9640 1 -- 172.21.15.18:0/2133797213 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f033c0b2040 con 0x7f034c1f38d0 2024-04-17T19:54:22.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.120+0000 7f0352644640 1 -- 172.21.15.18:0/2133797213 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f034c156360 con 0x7f034c1f38d0 2024-04-17T19:54:22.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.120+0000 7f0352644640 1 -- 172.21.15.18:0/2133797213 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f034c069950 con 0x7f034c1f38d0 2024-04-17T19:54:22.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.120+0000 7f0348ff9640 1 -- 172.21.15.18:0/2133797213 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f033c0c0070 con 0x7f034c1f38d0 2024-04-17T19:54:22.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.120+0000 7f0348ff9640 1 --2- 172.21.15.18:0/2133797213 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f032c068380 0x7f032c06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:22.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.120+0000 7f0348ff9640 1 -- 172.21.15.18:0/2133797213 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7f033c120b90 con 0x7f034c1f38d0 2024-04-17T19:54:22.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.120+0000 7f034bfff640 1 --2- 172.21.15.18:0/2133797213 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f032c068380 0x7f032c06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:22.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.120+0000 7f034bfff640 1 --2- 172.21.15.18:0/2133797213 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f032c068380 0x7f032c06a890 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0334001ec0 tx=0x7f0334009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:22.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.124+0000 7f0348ff9640 1 -- 172.21.15.18:0/2133797213 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f034c1f77f0 con 0x7f034c1f38d0 2024-04-17T19:54:22.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.292+0000 7f0352644640 1 -- 172.21.15.18:0/2133797213 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f034c160ee0 con 0x7f034c1f38d0 2024-04-17T19:54:22.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.296+0000 7f0348ff9640 1 -- 172.21.15.18:0/2133797213 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7f033c0167e0 con 0x7f034c1f38d0 2024-04-17T19:54:22.293 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-17T19:54:22.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.296+0000 7f0352644640 1 -- 172.21.15.18:0/2133797213 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f032c068380 msgr2=0x7f032c06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:22.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.296+0000 7f0352644640 1 --2- 172.21.15.18:0/2133797213 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f032c068380 0x7f032c06a890 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0334001ec0 tx=0x7f0334009040 comp rx=0 tx=0).stop 2024-04-17T19:54:22.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.296+0000 7f0352644640 1 -- 172.21.15.18:0/2133797213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f034c1f38d0 msgr2=0x7f034c153e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:22.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.296+0000 7f0352644640 1 --2- 172.21.15.18:0/2133797213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f034c1f38d0 0x7f034c153e60 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f033c009b10 tx=0x7f0338005840 comp rx=0 tx=0).stop 2024-04-17T19:54:22.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.296+0000 7f0352644640 1 -- 172.21.15.18:0/2133797213 shutdown_connections 2024-04-17T19:54:22.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.296+0000 7f0352644640 1 --2- 172.21.15.18:0/2133797213 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f032c068380 0x7f032c06a890 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:22.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.296+0000 7f0352644640 1 --2- 172.21.15.18:0/2133797213 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f034c1f6ea0 0x7f034c1f72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:22.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.296+0000 7f0352644640 1 --2- 172.21.15.18:0/2133797213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f034c1f38d0 0x7f034c153e60 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:22.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.296+0000 7f0352644640 1 --2- 172.21.15.18:0/2133797213 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0338004810 0x7f034c1585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:22.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.296+0000 7f0352644640 1 -- 172.21.15.18:0/2133797213 >> 172.21.15.18:0/2133797213 conn(0x7f034c0b3910 msgr2=0x7f034c151e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:22.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.296+0000 7f0352644640 1 -- 172.21.15.18:0/2133797213 shutdown_connections 2024-04-17T19:54:22.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.296+0000 7f0352644640 1 -- 172.21.15.18:0/2133797213 wait complete. 2024-04-17T19:54:22.316 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-17T19:54:22.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.476+0000 7f771f3c7640 1 Processor -- start 2024-04-17T19:54:22.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.476+0000 7f771f3c7640 1 -- start start 2024-04-17T19:54:22.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.476+0000 7f771f3c7640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f771815d2d0 0x7f77180b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:22.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.476+0000 7f771f3c7640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77180cd5f0 con 0x7f7718073080 2024-04-17T19:54:22.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.476+0000 7f771f3c7640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77180cd8d0 con 0x7f77180ce690 2024-04-17T19:54:22.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.476+0000 7f771f3c7640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f77180cdbb0 con 0x7f771815d2d0 2024-04-17T19:54:22.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.476+0000 7f771d163640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f771815d2d0 0x7f77180b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:22.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.476+0000 7f771c962640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f7718073080 0x7f7718073490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:38914/0 (socket says 172.21.15.18:38914) 2024-04-17T19:54:22.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.476+0000 7f771c962640 1 -- 172.21.15.18:0/734368692 learned_addr learned my addr 172.21.15.18:0/734368692 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:54:22.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.480+0000 7f771d163640 1 -- 172.21.15.18:0/734368692 >> v1:172.21.15.173:6789/0 conn(0x7f77180ce690 legacy=0x7f77180ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:22.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.480+0000 7f771d163640 1 -- 172.21.15.18:0/734368692 >> v1:172.21.15.18:6789/0 conn(0x7f7718073080 legacy=0x7f7718073490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:22.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.480+0000 7f770bfff640 1 -- 172.21.15.18:0/734368692 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 837243976 0 0) 0x7f77180cd5f0 con 0x7f7718073080 2024-04-17T19:54:22.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.480+0000 7f771d163640 1 -- 172.21.15.18:0/734368692 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77180cde90 con 0x7f771815d2d0 2024-04-17T19:54:22.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.480+0000 7f771d163640 1 --2- 172.21.15.18:0/734368692 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f771815d2d0 0x7f77180b4d30 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f77140097c0 tx=0x7f771401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8af4a21959e6368 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:22.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.480+0000 7f770bfff640 1 -- 172.21.15.18:0/734368692 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77140b0070 con 0x7f771815d2d0 2024-04-17T19:54:22.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.480+0000 7f770bfff640 1 -- 172.21.15.18:0/734368692 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77140ab600 con 0x7f771815d2d0 2024-04-17T19:54:22.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.480+0000 7f770bfff640 1 -- 172.21.15.18:0/734368692 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77140ab9d0 con 0x7f771815d2d0 2024-04-17T19:54:22.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.480+0000 7f771f3c7640 1 -- 172.21.15.18:0/734368692 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f771815d2d0 msgr2=0x7f77180b4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:22.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.480+0000 7f771f3c7640 1 --2- 172.21.15.18:0/734368692 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f771815d2d0 0x7f77180b4d30 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f77140097c0 tx=0x7f771401c4a0 comp rx=0 tx=0).stop 2024-04-17T19:54:22.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.480+0000 7f771f3c7640 1 -- 172.21.15.18:0/734368692 shutdown_connections 2024-04-17T19:54:22.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.480+0000 7f771f3c7640 1 --2- 172.21.15.18:0/734368692 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f771815d2d0 0x7f77180b4d30 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:22.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.480+0000 7f771f3c7640 1 -- 172.21.15.18:0/734368692 >> 172.21.15.18:0/734368692 conn(0x7f77180b3910 msgr2=0x7f77180d12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:22.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.480+0000 7f771f3c7640 1 -- 172.21.15.18:0/734368692 shutdown_connections 2024-04-17T19:54:22.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.480+0000 7f771f3c7640 1 -- 172.21.15.18:0/734368692 wait complete. 2024-04-17T19:54:22.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.484+0000 7f771f3c7640 1 Processor -- start 2024-04-17T19:54:22.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.484+0000 7f771f3c7640 1 -- start start 2024-04-17T19:54:22.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.484+0000 7f771f3c7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7718073080 0x7f771813fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:22.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.484+0000 7f771f3c7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77180ce690 0x7f7718153580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:22.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.484+0000 7f771f3c7640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f771815d2d0 0x7f77181560c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:22.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.484+0000 7f771f3c7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f771816b690 con 0x7f77180ce690 2024-04-17T19:54:22.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.484+0000 7f771f3c7640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f77180cf7d0 con 0x7f7718073080 2024-04-17T19:54:22.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.484+0000 7f771f3c7640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f771816b810 con 0x7f771815d2d0 2024-04-17T19:54:22.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.484+0000 7f771c962640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77180ce690 0x7f7718153580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:22.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.484+0000 7f771c962640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77180ce690 0x7f7718153580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45046/0 (socket says 172.21.15.18:45046) 2024-04-17T19:54:22.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.484+0000 7f771c962640 1 -- 172.21.15.18:0/1754379426 learned_addr learned my addr 172.21.15.18:0/1754379426 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:22.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.484+0000 7f771d163640 1 --2- 172.21.15.18:0/1754379426 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7718073080 0x7f771813fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:22.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.484+0000 7f771d964640 1 --2- 172.21.15.18:0/1754379426 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f771815d2d0 0x7f77181560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:22.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.484+0000 7f771c962640 1 -- 172.21.15.18:0/1754379426 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f771815d2d0 msgr2=0x7f77181560c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:22.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.484+0000 7f771c962640 1 --2- 172.21.15.18:0/1754379426 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f771815d2d0 0x7f77181560c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:22.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.484+0000 7f771c962640 1 -- 172.21.15.18:0/1754379426 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7718073080 msgr2=0x7f771813fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:22.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.484+0000 7f771c962640 1 --2- 172.21.15.18:0/1754379426 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7718073080 0x7f771813fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:22.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.484+0000 7f771c962640 1 -- 172.21.15.18:0/1754379426 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f771815a980 con 0x7f77180ce690 2024-04-17T19:54:22.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.484+0000 7f771d163640 1 --2- 172.21.15.18:0/1754379426 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7718073080 0x7f771813fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:54:22.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.484+0000 7f771c962640 1 --2- 172.21.15.18:0/1754379426 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77180ce690 0x7f7718153580 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f770c00c440 tx=0x7f770c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:22.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.484+0000 7f7709ffb640 1 -- 172.21.15.18:0/1754379426 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f770c0074e0 con 0x7f77180ce690 2024-04-17T19:54:22.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.484+0000 7f7709ffb640 1 -- 172.21.15.18:0/1754379426 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f770c0047f0 con 0x7f77180ce690 2024-04-17T19:54:22.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.484+0000 7f771f3c7640 1 -- 172.21.15.18:0/1754379426 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f771815ac60 con 0x7f77180ce690 2024-04-17T19:54:22.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.484+0000 7f7709ffb640 1 -- 172.21.15.18:0/1754379426 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f770c007680 con 0x7f77180ce690 2024-04-17T19:54:22.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.484+0000 7f771f3c7640 1 -- 172.21.15.18:0/1754379426 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7718153ac0 con 0x7f77180ce690 2024-04-17T19:54:22.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.488+0000 7f771f3c7640 1 -- 172.21.15.18:0/1754379426 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7718069950 con 0x7f77180ce690 2024-04-17T19:54:22.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.488+0000 7f7709ffb640 1 -- 172.21.15.18:0/1754379426 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f770c011070 con 0x7f77180ce690 2024-04-17T19:54:22.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.488+0000 7f7709ffb640 1 --2- 172.21.15.18:0/1754379426 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f76fc0683b0 0x7f76fc06a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:22.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.488+0000 7f7709ffb640 1 -- 172.21.15.18:0/1754379426 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7f770c0869e0 con 0x7f77180ce690 2024-04-17T19:54:22.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.488+0000 7f771d163640 1 --2- 172.21.15.18:0/1754379426 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f76fc0683b0 0x7f76fc06a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:22.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.488+0000 7f771d163640 1 --2- 172.21.15.18:0/1754379426 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f76fc0683b0 0x7f76fc06a8c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f77140ad000 tx=0x7f7714008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:22.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.492+0000 7f7709ffb640 1 -- 172.21.15.18:0/1754379426 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f770c056b30 con 0x7f77180ce690 2024-04-17T19:54:22.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.672+0000 7f771f3c7640 1 -- 172.21.15.18:0/1754379426 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f771815f9e0 con 0x7f77180ce690 2024-04-17T19:54:22.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.672+0000 7f7709ffb640 1 -- 172.21.15.18:0/1754379426 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7f770c056430 con 0x7f77180ce690 2024-04-17T19:54:22.671 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-04-17T19:54:22.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.676+0000 7f771f3c7640 1 -- 172.21.15.18:0/1754379426 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f76fc0683b0 msgr2=0x7f76fc06a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:22.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.676+0000 7f771f3c7640 1 --2- 172.21.15.18:0/1754379426 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f76fc0683b0 0x7f76fc06a8c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f77140ad000 tx=0x7f7714008040 comp rx=0 tx=0).stop 2024-04-17T19:54:22.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.676+0000 7f771f3c7640 1 -- 172.21.15.18:0/1754379426 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77180ce690 msgr2=0x7f7718153580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:22.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.676+0000 7f771f3c7640 1 --2- 172.21.15.18:0/1754379426 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77180ce690 0x7f7718153580 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f770c00c440 tx=0x7f770c00c900 comp rx=0 tx=0).stop 2024-04-17T19:54:22.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.676+0000 7f771f3c7640 1 -- 172.21.15.18:0/1754379426 shutdown_connections 2024-04-17T19:54:22.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.676+0000 7f771f3c7640 1 --2- 172.21.15.18:0/1754379426 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f76fc0683b0 0x7f76fc06a8c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:22.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.676+0000 7f771f3c7640 1 --2- 172.21.15.18:0/1754379426 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f771815d2d0 0x7f77181560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:22.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.676+0000 7f771f3c7640 1 --2- 172.21.15.18:0/1754379426 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77180ce690 0x7f7718153580 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:22.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.676+0000 7f771f3c7640 1 --2- 172.21.15.18:0/1754379426 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7718073080 0x7f771813fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:22.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.676+0000 7f771f3c7640 1 -- 172.21.15.18:0/1754379426 >> 172.21.15.18:0/1754379426 conn(0x7f77180b3910 msgr2=0x7f771815df00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:22.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.676+0000 7f771f3c7640 1 -- 172.21.15.18:0/1754379426 shutdown_connections 2024-04-17T19:54:22.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.676+0000 7f771f3c7640 1 -- 172.21.15.18:0/1754379426 wait complete. 2024-04-17T19:54:22.694 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-04-17T19:54:22.694 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-17T19:54:22.701 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T19:54:22.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.852+0000 7fbad3e51640 1 Processor -- start 2024-04-17T19:54:22.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.852+0000 7fbad3e51640 1 -- start start 2024-04-17T19:54:22.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.852+0000 7fbad3e51640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbacc0ced70 0x7fbacc0b6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:22.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.852+0000 7fbad3e51640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbacc0b6d90 0x7fbacc0ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:22.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.852+0000 7fbad3e51640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbacc0cf180 con 0x7fbacc0cd090 2024-04-17T19:54:22.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.852+0000 7fbad3e51640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fbacc0b2c70 con 0x7fbacc0ced70 2024-04-17T19:54:22.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.852+0000 7fbad3e51640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fbacc0ce4d0 con 0x7fbacc0b6d90 2024-04-17T19:54:22.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.852+0000 7fbad1bed640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbacc0ced70 0x7fbacc0b6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:22.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.852+0000 7fbad23ee640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fbacc0cd090 0x7fbacc0b1470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:38916/0 (socket says 172.21.15.18:38916) 2024-04-17T19:54:22.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.852+0000 7fbad1bed640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbacc0ced70 0x7fbacc0b6850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45048/0 (socket says 172.21.15.18:45048) 2024-04-17T19:54:22.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.852+0000 7fbad23ee640 1 -- 172.21.15.18:0/3727934912 learned_addr learned my addr 172.21.15.18:0/3727934912 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:54:22.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.852+0000 7fbad13ec640 1 --2- 172.21.15.18:0/3727934912 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbacc0b6d90 0x7fbacc0ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:22.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.856+0000 7fbad0beb640 1 -- 172.21.15.18:0/3727934912 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 708847803 0 0) 0x7fbabc001120 con 0x7fbacc0cd090 2024-04-17T19:54:22.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.856+0000 7fbad0beb640 1 -- 172.21.15.18:0/3727934912 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbab4003530 con 0x7fbacc0cd090 2024-04-17T19:54:22.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.856+0000 7fbad1bed640 1 -- 172.21.15.18:0/3727934912 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbacc0b6d90 msgr2=0x7fbacc0ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:22.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.856+0000 7fbad1bed640 1 --2- 172.21.15.18:0/3727934912 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbacc0b6d90 0x7fbacc0ccb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:22.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.856+0000 7fbad1bed640 1 -- 172.21.15.18:0/3727934912 >> v1:172.21.15.18:6789/0 conn(0x7fbacc0cd090 legacy=0x7fbacc0b1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:22.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.856+0000 7fbad1bed640 1 -- 172.21.15.18:0/3727934912 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbacc0b71a0 con 0x7fbacc0ced70 2024-04-17T19:54:22.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.856+0000 7fbad1bed640 1 --2- 172.21.15.18:0/3727934912 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbacc0ced70 0x7fbacc0b6850 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fbac4009d90 tx=0x7fbac401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ea31f7bb444a375 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:22.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.856+0000 7fbad0beb640 1 -- 172.21.15.18:0/3727934912 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac40b2070 con 0x7fbacc0ced70 2024-04-17T19:54:22.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.856+0000 7fbad0beb640 1 -- 172.21.15.18:0/3727934912 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbac40a5830 con 0x7fbacc0ced70 2024-04-17T19:54:22.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.856+0000 7fbad0beb640 1 -- 172.21.15.18:0/3727934912 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac40a5be0 con 0x7fbacc0ced70 2024-04-17T19:54:22.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.860+0000 7fbad3e51640 1 -- 172.21.15.18:0/3727934912 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbacc0ced70 msgr2=0x7fbacc0b6850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:22.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.860+0000 7fbad3e51640 1 --2- 172.21.15.18:0/3727934912 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbacc0ced70 0x7fbacc0b6850 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fbac4009d90 tx=0x7fbac401c970 comp rx=0 tx=0).stop 2024-04-17T19:54:22.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.860+0000 7fbad3e51640 1 -- 172.21.15.18:0/3727934912 shutdown_connections 2024-04-17T19:54:22.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.860+0000 7fbad3e51640 1 --2- 172.21.15.18:0/3727934912 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbacc0b6d90 0x7fbacc0ccb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:22.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.860+0000 7fbad3e51640 1 --2- 172.21.15.18:0/3727934912 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbacc0ced70 0x7fbacc0b6850 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:22.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.860+0000 7fbad3e51640 1 -- 172.21.15.18:0/3727934912 >> 172.21.15.18:0/3727934912 conn(0x7fbacc09aa70 msgr2=0x7fbacc09ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:22.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.860+0000 7fbad3e51640 1 -- 172.21.15.18:0/3727934912 shutdown_connections 2024-04-17T19:54:22.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.860+0000 7fbad3e51640 1 -- 172.21.15.18:0/3727934912 wait complete. 2024-04-17T19:54:22.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.860+0000 7fbad3e51640 1 Processor -- start 2024-04-17T19:54:22.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.860+0000 7fbad3e51640 1 -- start start 2024-04-17T19:54:22.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.864+0000 7fbad3e51640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbacc0b6d90 0x7fbacc1533c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:22.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.864+0000 7fbad3e51640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbacc0cd090 0x7fbacc06de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:22.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.864+0000 7fbad3e51640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbacc0ced70 0x7fbacc15b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:22.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.864+0000 7fbad3e51640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbacc0cd8b0 con 0x7fbacc0ced70 2024-04-17T19:54:22.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.864+0000 7fbad3e51640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fbacc0b33e0 con 0x7fbacc0b6d90 2024-04-17T19:54:22.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.864+0000 7fbad3e51640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fbacc0d0c30 con 0x7fbacc0cd090 2024-04-17T19:54:22.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.864+0000 7fbad23ee640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbacc0ced70 0x7fbacc15b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:22.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.864+0000 7fbad23ee640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbacc0ced70 0x7fbacc15b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45062/0 (socket says 172.21.15.18:45062) 2024-04-17T19:54:22.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.864+0000 7fbad23ee640 1 -- 172.21.15.18:0/31429682 learned_addr learned my addr 172.21.15.18:0/31429682 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:22.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.864+0000 7fbad1bed640 1 --2- 172.21.15.18:0/31429682 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbacc0b6d90 0x7fbacc1533c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:22.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.864+0000 7fbad13ec640 1 --2- 172.21.15.18:0/31429682 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbacc0cd090 0x7fbacc06de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:22.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.864+0000 7fbad23ee640 1 -- 172.21.15.18:0/31429682 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbacc0cd090 msgr2=0x7fbacc06de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:22.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.864+0000 7fbad23ee640 1 --2- 172.21.15.18:0/31429682 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbacc0cd090 0x7fbacc06de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:22.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.864+0000 7fbad23ee640 1 -- 172.21.15.18:0/31429682 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbacc0b6d90 msgr2=0x7fbacc1533c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:22.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.864+0000 7fbad23ee640 1 --2- 172.21.15.18:0/31429682 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbacc0b6d90 0x7fbacc1533c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:22.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.864+0000 7fbad23ee640 1 -- 172.21.15.18:0/31429682 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbacc06eb20 con 0x7fbacc0ced70 2024-04-17T19:54:22.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.864+0000 7fbad23ee640 1 --2- 172.21.15.18:0/31429682 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbacc0ced70 0x7fbacc15b160 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fbabc00c3f0 tx=0x7fbabc00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:22.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.864+0000 7fbaca7fc640 1 -- 172.21.15.18:0/31429682 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbabc017070 con 0x7fbacc0ced70 2024-04-17T19:54:22.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.864+0000 7fbaca7fc640 1 -- 172.21.15.18:0/31429682 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbabc005cf0 con 0x7fbacc0ced70 2024-04-17T19:54:22.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.864+0000 7fbad3e51640 1 -- 172.21.15.18:0/31429682 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbacc0c55e0 con 0x7fbacc0ced70 2024-04-17T19:54:22.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.864+0000 7fbaca7fc640 1 -- 172.21.15.18:0/31429682 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbabc0072d0 con 0x7fbacc0ced70 2024-04-17T19:54:22.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.864+0000 7fbad3e51640 1 -- 172.21.15.18:0/31429682 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbacc0c5ba0 con 0x7fbacc0ced70 2024-04-17T19:54:22.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.864+0000 7fbad3e51640 1 -- 172.21.15.18:0/31429682 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbacc069950 con 0x7fbacc0ced70 2024-04-17T19:54:22.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.864+0000 7fbaca7fc640 1 -- 172.21.15.18:0/31429682 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbabc01a070 con 0x7fbacc0ced70 2024-04-17T19:54:22.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.864+0000 7fbaca7fc640 1 --2- 172.21.15.18:0/31429682 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fbab8068380 0x7fbab806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:22.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.868+0000 7fbaca7fc640 1 -- 172.21.15.18:0/31429682 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7fbabc085f80 con 0x7fbacc0ced70 2024-04-17T19:54:22.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.868+0000 7fbad1bed640 1 --2- 172.21.15.18:0/31429682 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fbab8068380 0x7fbab806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:22.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.868+0000 7fbad1bed640 1 --2- 172.21.15.18:0/31429682 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fbab8068380 0x7fbab806a890 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbac40af000 tx=0x7fbac40a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:22.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:22.872+0000 7fbaca7fc640 1 -- 172.21.15.18:0/31429682 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbacc0cf180 con 0x7fbacc0ced70 2024-04-17T19:54:23.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.036+0000 7fbad3e51640 1 -- 172.21.15.18:0/31429682 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbacc0c8910 con 0x7fbacc0ced70 2024-04-17T19:54:23.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.036+0000 7fbaca7fc640 1 -- 172.21.15.18:0/31429682 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18759 (secure 0 0 0) 0x7fbabc055bb0 con 0x7fbacc0ced70 2024-04-17T19:54:23.035 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:54:23.036 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":29,"fsid":"dd480169-5a81-4623-be5f-0499aa244b28","created":"2024-04-17T19:52:39.533760+0000","modified":"2024-04-17T19:53:45.435889+0000","last_up_change":"2024-04-17T19:52:51.229698+0000","last_in_change":"2024-04-17T19:52:42.144259+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T19:52:52.391648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T19:53:02.734240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T19:53:03.813028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T19:53:07.478812+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e232d577-2508-4ea4-b355-29fbae1ff025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6801","nonce":2323038417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6803","nonce":2323038417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6807","nonce":2323038417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6805","nonce":2323038417}]},"public_addr":"172.21.15.18:6801/2323038417","cluster_addr":"172.21.15.18:6803/2323038417","heartbeat_back_addr":"172.21.15.18:6807/2323038417","heartbeat_front_addr":"172.21.15.18:6805/2323038417","state":["exists","up"]},{"osd":1,"uuid":"31810ef3-2c71-48d6-8748-b74a2968d23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6817","nonce":1283678238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6819","nonce":1283678238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6823","nonce":1283678238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6821","nonce":1283678238}]},"public_addr":"172.21.15.18:6817/1283678238","cluster_addr":"172.21.15.18:6819/1283678238","heartbeat_back_addr":"172.21.15.18:6823/1283678238","heartbeat_front_addr":"172.21.15.18:6821/1283678238","state":["exists","up"]},{"osd":2,"uuid":"5a783cc5-a41c-4967-9e11-6b8330f97d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6809","nonce":1212875862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6811","nonce":1212875862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6815","nonce":1212875862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6813","nonce":1212875862}]},"public_addr":"172.21.15.18:6809/1212875862","cluster_addr":"172.21.15.18:6811/1212875862","heartbeat_back_addr":"172.21.15.18:6815/1212875862","heartbeat_front_addr":"172.21.15.18:6813/1212875862","state":["exists","up"]},{"osd":3,"uuid":"b7e056d9-9da5-46e1-810d-0c3e242fe5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6825","nonce":2428878428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6827","nonce":2428878428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6831","nonce":2428878428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6829","nonce":2428878428}]},"public_addr":"172.21.15.18:6825/2428878428","cluster_addr":"172.21.15.18:6827/2428878428","heartbeat_back_addr":"172.21.15.18:6831/2428878428","heartbeat_front_addr":"172.21.15.18:6829/2428878428","state":["exists","up"]},{"osd":4,"uuid":"21df023f-bc8b-4abb-93e5-0ecc91acda0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6825","nonce":1421511819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6827","nonce":1421511819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6831","nonce":1421511819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6829","nonce":1421511819}]},"public_addr":"172.21.15.173:6825/1421511819","cluster_addr":"172.21.15.173:6827/1421511819","heartbeat_back_addr":"172.21.15.173:6831/1421511819","heartbeat_front_addr":"172.21.15.173:6829/1421511819","state":["exists","up"]},{"osd":5,"uuid":"e270098a-6d33-49f8-84ed-94e09a880cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6801","nonce":4221907702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6803","nonce":4221907702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6807","nonce":4221907702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6805","nonce":4221907702}]},"public_addr":"172.21.15.173:6801/4221907702","cluster_addr":"172.21.15.173:6803/4221907702","heartbeat_back_addr":"172.21.15.173:6807/4221907702","heartbeat_front_addr":"172.21.15.173:6805/4221907702","state":["exists","up"]},{"osd":6,"uuid":"93c67c8c-268d-4e32-877c-043cd3acd87c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6809","nonce":761678552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6811","nonce":761678552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6815","nonce":761678552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6813","nonce":761678552}]},"public_addr":"172.21.15.173:6809/761678552","cluster_addr":"172.21.15.173:6811/761678552","heartbeat_back_addr":"172.21.15.173:6815/761678552","heartbeat_front_addr":"172.21.15.173:6813/761678552","state":["exists","up"]},{"osd":7,"uuid":"faf10eea-80de-40f6-abbb-34d07d3f59ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6817","nonce":383724537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6819","nonce":383724537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6823","nonce":383724537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6821","nonce":383724537}]},"public_addr":"172.21.15.173:6817/383724537","cluster_addr":"172.21.15.173:6819/383724537","heartbeat_back_addr":"172.21.15.173:6823/383724537","heartbeat_front_addr":"172.21.15.173:6821/383724537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.668924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.761747+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.768128+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.632252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.742608+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.734327+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.477107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.818292+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.31","mappings":[{"from":0,"to":7}]},{"pgid":"4.5","mappings":[{"from":3,"to":4},{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":0}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]},{"pgid":"4.1c","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T19:54:23.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.040+0000 7fbad3e51640 1 -- 172.21.15.18:0/31429682 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fbab8068380 msgr2=0x7fbab806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:23.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.040+0000 7fbad3e51640 1 --2- 172.21.15.18:0/31429682 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fbab8068380 0x7fbab806a890 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbac40af000 tx=0x7fbac40a7070 comp rx=0 tx=0).stop 2024-04-17T19:54:23.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.040+0000 7fbad3e51640 1 -- 172.21.15.18:0/31429682 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbacc0ced70 msgr2=0x7fbacc15b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:23.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.040+0000 7fbad3e51640 1 --2- 172.21.15.18:0/31429682 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbacc0ced70 0x7fbacc15b160 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fbabc00c3f0 tx=0x7fbabc00c8b0 comp rx=0 tx=0).stop 2024-04-17T19:54:23.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.040+0000 7fbad3e51640 1 -- 172.21.15.18:0/31429682 shutdown_connections 2024-04-17T19:54:23.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.040+0000 7fbad3e51640 1 --2- 172.21.15.18:0/31429682 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fbab8068380 0x7fbab806a890 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:23.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.040+0000 7fbad3e51640 1 --2- 172.21.15.18:0/31429682 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbacc0ced70 0x7fbacc15b160 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:23.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.040+0000 7fbad3e51640 1 --2- 172.21.15.18:0/31429682 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbacc0cd090 0x7fbacc06de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:23.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.040+0000 7fbad3e51640 1 --2- 172.21.15.18:0/31429682 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbacc0b6d90 0x7fbacc1533c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:23.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.040+0000 7fbad3e51640 1 -- 172.21.15.18:0/31429682 >> 172.21.15.18:0/31429682 conn(0x7fbacc09aa70 msgr2=0x7fbacc0b1470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:23.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.040+0000 7fbad3e51640 1 -- 172.21.15.18:0/31429682 shutdown_connections 2024-04-17T19:54:23.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.040+0000 7fbad3e51640 1 -- 172.21.15.18:0/31429682 wait complete. 2024-04-17T19:54:23.059 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-17T19:52:52.391648+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-17T19:53:02.734240+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-17T19:53:03.813028+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-17T19:53:07.478812+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-17T19:54:23.059 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-17T19:54:23.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.220+0000 7f64231b1640 1 Processor -- start 2024-04-17T19:54:23.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.220+0000 7f64231b1640 1 -- start start 2024-04-17T19:54:23.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.220+0000 7f64231b1640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f641c06c8b0 0x7f641c06ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:23.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.220+0000 7f64231b1640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f641c0d41b0 con 0x7f641c0d3b80 2024-04-17T19:54:23.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.220+0000 7f64231b1640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f641c0d4490 con 0x7f641c0d0620 2024-04-17T19:54:23.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.220+0000 7f64231b1640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f641c0d3f90 con 0x7f641c06c8b0 2024-04-17T19:54:23.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.220+0000 7f642174e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f641c06c8b0 0x7f641c06ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:23.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.220+0000 7f6420f4d640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f641c0d3b80 0x7f641c0cff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:38918/0 (socket says 172.21.15.18:38918) 2024-04-17T19:54:23.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.220+0000 7f6420f4d640 1 -- 172.21.15.18:0/396204685 learned_addr learned my addr 172.21.15.18:0/396204685 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:54:23.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.220+0000 7f641b7fe640 1 -- 172.21.15.18:0/396204685 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 582497907 0 0) 0x7f641c0d41b0 con 0x7f641c0d3b80 2024-04-17T19:54:23.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.220+0000 7f642174e640 1 -- 172.21.15.18:0/396204685 >> v1:172.21.15.173:6789/0 conn(0x7f641c0d0620 legacy=0x7f641c06c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:23.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.220+0000 7f642174e640 1 -- 172.21.15.18:0/396204685 >> v1:172.21.15.18:6789/0 conn(0x7f641c0d3b80 legacy=0x7f641c0cff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:23.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.220+0000 7f642174e640 1 -- 172.21.15.18:0/396204685 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f641c0d4770 con 0x7f641c06c8b0 2024-04-17T19:54:23.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.224+0000 7f642174e640 1 --2- 172.21.15.18:0/396204685 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f641c06c8b0 0x7f641c06ccc0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f64140097c0 tx=0x7f641401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b56dd39125052234 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:23.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.224+0000 7f641b7fe640 1 -- 172.21.15.18:0/396204685 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64140b0070 con 0x7f641c06c8b0 2024-04-17T19:54:23.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.224+0000 7f641b7fe640 1 -- 172.21.15.18:0/396204685 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64140ab600 con 0x7f641c06c8b0 2024-04-17T19:54:23.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.224+0000 7f641b7fe640 1 -- 172.21.15.18:0/396204685 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64140ab9d0 con 0x7f641c06c8b0 2024-04-17T19:54:23.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.224+0000 7f64231b1640 1 -- 172.21.15.18:0/396204685 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f641c06c8b0 msgr2=0x7f641c06ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:23.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.224+0000 7f64231b1640 1 --2- 172.21.15.18:0/396204685 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f641c06c8b0 0x7f641c06ccc0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f64140097c0 tx=0x7f641401c4a0 comp rx=0 tx=0).stop 2024-04-17T19:54:23.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.224+0000 7f64231b1640 1 -- 172.21.15.18:0/396204685 shutdown_connections 2024-04-17T19:54:23.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.224+0000 7f64231b1640 1 --2- 172.21.15.18:0/396204685 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f641c06c8b0 0x7f641c06ccc0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:23.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.224+0000 7f64231b1640 1 -- 172.21.15.18:0/396204685 >> 172.21.15.18:0/396204685 conn(0x7f641c0d4ed0 msgr2=0x7f641c0d52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:23.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.224+0000 7f64231b1640 1 -- 172.21.15.18:0/396204685 shutdown_connections 2024-04-17T19:54:23.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.224+0000 7f64231b1640 1 -- 172.21.15.18:0/396204685 wait complete. 2024-04-17T19:54:23.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.228+0000 7f64231b1640 1 Processor -- start 2024-04-17T19:54:23.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.228+0000 7f64231b1640 1 -- start start 2024-04-17T19:54:23.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.228+0000 7f64231b1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f641c06c8b0 0x7f641c151c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:23.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.228+0000 7f64231b1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f641c0d3b80 0x7f641c154470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:23.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.228+0000 7f64231b1640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f641c15aa40 0x7f641c15ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:23.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.228+0000 7f64231b1640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f641c16df00 con 0x7f641c0d3b80 2024-04-17T19:54:23.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.228+0000 7f64231b1640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f641c16dd80 con 0x7f641c06c8b0 2024-04-17T19:54:23.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.228+0000 7f64231b1640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f641c16e080 con 0x7f641c15aa40 2024-04-17T19:54:23.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.228+0000 7f641bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f641c0d3b80 0x7f641c154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:23.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.228+0000 7f641bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f641c0d3b80 0x7f641c154470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45088/0 (socket says 172.21.15.18:45088) 2024-04-17T19:54:23.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.228+0000 7f641bfff640 1 -- 172.21.15.18:0/1855766795 learned_addr learned my addr 172.21.15.18:0/1855766795 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:23.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.228+0000 7f6420f4d640 1 --2- 172.21.15.18:0/1855766795 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f641c06c8b0 0x7f641c151c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:23.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.228+0000 7f642174e640 1 --2- 172.21.15.18:0/1855766795 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f641c15aa40 0x7f641c15ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:23.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.228+0000 7f641bfff640 1 -- 172.21.15.18:0/1855766795 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f641c15aa40 msgr2=0x7f641c15ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:23.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.228+0000 7f641bfff640 1 --2- 172.21.15.18:0/1855766795 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f641c15aa40 0x7f641c15ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:23.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.228+0000 7f641bfff640 1 -- 172.21.15.18:0/1855766795 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f641c06c8b0 msgr2=0x7f641c151c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:23.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.228+0000 7f641bfff640 1 --2- 172.21.15.18:0/1855766795 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f641c06c8b0 0x7f641c151c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:23.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.228+0000 7f641bfff640 1 -- 172.21.15.18:0/1855766795 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f641c1527e0 con 0x7f641c0d3b80 2024-04-17T19:54:23.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.228+0000 7f642174e640 1 --2- 172.21.15.18:0/1855766795 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f641c15aa40 0x7f641c15ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:54:23.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.228+0000 7f641bfff640 1 --2- 172.21.15.18:0/1855766795 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f641c0d3b80 0x7f641c154470 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f641000c3c0 tx=0x7f641000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:23.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.228+0000 7f64197fa640 1 -- 172.21.15.18:0/1855766795 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6410017070 con 0x7f641c0d3b80 2024-04-17T19:54:23.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.228+0000 7f64197fa640 1 -- 172.21.15.18:0/1855766795 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64100052d0 con 0x7f641c0d3b80 2024-04-17T19:54:23.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.228+0000 7f64231b1640 1 -- 172.21.15.18:0/1855766795 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f641c15b390 con 0x7f641c0d3b80 2024-04-17T19:54:23.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.228+0000 7f64197fa640 1 -- 172.21.15.18:0/1855766795 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6410003840 con 0x7f641c0d3b80 2024-04-17T19:54:23.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.228+0000 7f64231b1640 1 -- 172.21.15.18:0/1855766795 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f641c155330 con 0x7f641c0d3b80 2024-04-17T19:54:23.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.232+0000 7f64231b1640 1 -- 172.21.15.18:0/1855766795 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f641c154dc0 con 0x7f641c0d3b80 2024-04-17T19:54:23.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.232+0000 7f64197fa640 1 -- 172.21.15.18:0/1855766795 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f641001a070 con 0x7f641c0d3b80 2024-04-17T19:54:23.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.232+0000 7f64197fa640 1 --2- 172.21.15.18:0/1855766795 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f6408068380 0x7f640806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:23.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.232+0000 7f64197fa640 1 -- 172.21.15.18:0/1855766795 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7f6410086440 con 0x7f641c0d3b80 2024-04-17T19:54:23.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.232+0000 7f6420f4d640 1 --2- 172.21.15.18:0/1855766795 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f6408068380 0x7f640806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:23.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.232+0000 7f6420f4d640 1 --2- 172.21.15.18:0/1855766795 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f6408068380 0x7f640806a890 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f640c001750 tx=0x7f640c0016a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:23.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.236+0000 7f64197fa640 1 -- 172.21.15.18:0/1855766795 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6410021020 con 0x7f641c0d3b80 2024-04-17T19:54:23.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.400+0000 7f64231b1640 1 -- 172.21.15.18:0/1855766795 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f641c069950 con 0x7f641c0d3b80 2024-04-17T19:54:23.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.400+0000 7f64197fa640 1 -- 172.21.15.18:0/1855766795 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) ==== 93+0+10 (secure 0 0 0) 0x7f641c15b390 con 0x7f641c0d3b80 2024-04-17T19:54:23.400 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-17T19:54:23.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.404+0000 7f64231b1640 1 -- 172.21.15.18:0/1855766795 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f6408068380 msgr2=0x7f640806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:23.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.404+0000 7f64231b1640 1 --2- 172.21.15.18:0/1855766795 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f6408068380 0x7f640806a890 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f640c001750 tx=0x7f640c0016a0 comp rx=0 tx=0).stop 2024-04-17T19:54:23.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.404+0000 7f64231b1640 1 -- 172.21.15.18:0/1855766795 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f641c0d3b80 msgr2=0x7f641c154470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:23.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.404+0000 7f64231b1640 1 --2- 172.21.15.18:0/1855766795 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f641c0d3b80 0x7f641c154470 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f641000c3c0 tx=0x7f641000c880 comp rx=0 tx=0).stop 2024-04-17T19:54:23.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.404+0000 7f64231b1640 1 -- 172.21.15.18:0/1855766795 shutdown_connections 2024-04-17T19:54:23.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.404+0000 7f64231b1640 1 --2- 172.21.15.18:0/1855766795 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f6408068380 0x7f640806a890 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:23.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.404+0000 7f64231b1640 1 --2- 172.21.15.18:0/1855766795 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f641c15aa40 0x7f641c15ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:23.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.404+0000 7f64231b1640 1 --2- 172.21.15.18:0/1855766795 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f641c0d3b80 0x7f641c154470 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:23.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.404+0000 7f64231b1640 1 --2- 172.21.15.18:0/1855766795 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f641c06c8b0 0x7f641c151c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:23.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.404+0000 7f64231b1640 1 -- 172.21.15.18:0/1855766795 >> 172.21.15.18:0/1855766795 conn(0x7f641c0d4ed0 msgr2=0x7f641c0ba5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:23.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.404+0000 7f64231b1640 1 -- 172.21.15.18:0/1855766795 shutdown_connections 2024-04-17T19:54:23.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.404+0000 7f64231b1640 1 -- 172.21.15.18:0/1855766795 wait complete. 2024-04-17T19:54:23.423 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-17T19:54:23.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.584+0000 7f830f8fc640 1 Processor -- start 2024-04-17T19:54:23.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.584+0000 7f830f8fc640 1 -- start start 2024-04-17T19:54:23.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.588+0000 7f830f8fc640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f83080cfb20 0x7f83080cff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:23.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.588+0000 7f830f8fc640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f830806ef30 0x7f830806f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:23.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.588+0000 7f830f8fc640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83080b53d0 con 0x7f830815b810 2024-04-17T19:54:23.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.588+0000 7f830f8fc640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f83080b5990 con 0x7f83080cfb20 2024-04-17T19:54:23.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.588+0000 7f830f8fc640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f83080b56b0 con 0x7f830806ef30 2024-04-17T19:54:23.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.588+0000 7f830d698640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f830815b810 0x7f83080cde90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:38926/0 (socket says 172.21.15.18:38926) 2024-04-17T19:54:23.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.588+0000 7f830d698640 1 -- 172.21.15.18:0/3772312962 learned_addr learned my addr 172.21.15.18:0/3772312962 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:54:23.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.588+0000 7f830de99640 1 --2- 172.21.15.18:0/3772312962 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f830806ef30 0x7f830806f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:23.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.588+0000 7f830ce97640 1 --2- 172.21.15.18:0/3772312962 >> v2:172.21.15.173:3300/0 conn(0x7f83080cfb20 0x7f83080cff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:23.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.588+0000 7f82fbfff640 1 -- 172.21.15.18:0/3772312962 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 26832408 0 0) 0x7f83080b53d0 con 0x7f830815b810 2024-04-17T19:54:23.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.588+0000 7f82fbfff640 1 -- 172.21.15.18:0/3772312962 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82f4004640 con 0x7f830815b810 2024-04-17T19:54:23.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.588+0000 7f82fbfff640 1 -- 172.21.15.18:0/3772312962 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4174896138 0 0) 0x7f82f4004640 con 0x7f830815b810 2024-04-17T19:54:23.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.588+0000 7f82fbfff640 1 -- 172.21.15.18:0/3772312962 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f830806ef30 msgr2=0x7f830806f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:23.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.588+0000 7f82fbfff640 1 --2- 172.21.15.18:0/3772312962 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f830806ef30 0x7f830806f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:23.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.588+0000 7f82fbfff640 1 -- 172.21.15.18:0/3772312962 >> v2:172.21.15.173:3300/0 conn(0x7f83080cfb20 msgr2=0x7f83080cff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:23.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.588+0000 7f82fbfff640 1 --2- 172.21.15.18:0/3772312962 >> v2:172.21.15.173:3300/0 conn(0x7f83080cfb20 0x7f83080cff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:23.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.588+0000 7f82fbfff640 1 -- 172.21.15.18:0/3772312962 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f830806ea10 con 0x7f830815b810 2024-04-17T19:54:23.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.588+0000 7f82fbfff640 1 -- 172.21.15.18:0/3772312962 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3208559991 0 0) 0x7f8304001680 con 0x7f830815b810 2024-04-17T19:54:23.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.588+0000 7f82fbfff640 1 -- 172.21.15.18:0/3772312962 >> v1:172.21.15.18:6789/0 conn(0x7f830815b810 legacy=0x7f83080cde90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:23.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.588+0000 7f82fbfff640 1 --2- 172.21.15.18:0/3772312962 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82f4004ad0 0x7f82f4004f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:23.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.588+0000 7f82fbfff640 1 --2- 172.21.15.18:0/3772312962 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82f4005920 0x7f82f4005d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:23.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.588+0000 7f82fbfff640 1 --2- 172.21.15.18:0/3772312962 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f830806ef30 0x7f82f4006270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:23.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.588+0000 7f82fbfff640 1 -- 172.21.15.18:0/3772312962 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f83080b5990 con 0x7f82f4004ad0 2024-04-17T19:54:23.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.588+0000 7f82fbfff640 1 -- 172.21.15.18:0/3772312962 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f83080b56b0 con 0x7f82f4005920 2024-04-17T19:54:23.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.588+0000 7f82fbfff640 1 -- 172.21.15.18:0/3772312962 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f82f400cb90 con 0x7f830806ef30 2024-04-17T19:54:23.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.588+0000 7f830d698640 1 --2- 172.21.15.18:0/3772312962 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82f4004ad0 0x7f82f4004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:23.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.588+0000 7f830ce97640 1 --2- 172.21.15.18:0/3772312962 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82f4005920 0x7f82f4005d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:23.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.588+0000 7f830de99640 1 --2- 172.21.15.18:0/3772312962 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f830806ef30 0x7f82f4006270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:23.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.588+0000 7f830d698640 1 -- 172.21.15.18:0/3772312962 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f830806ef30 msgr2=0x7f82f4006270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:23.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.588+0000 7f830d698640 1 --2- 172.21.15.18:0/3772312962 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f830806ef30 0x7f82f4006270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:23.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.588+0000 7f830d698640 1 -- 172.21.15.18:0/3772312962 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82f4005920 msgr2=0x7f82f4005d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:23.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.588+0000 7f830d698640 1 --2- 172.21.15.18:0/3772312962 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82f4005920 0x7f82f4005d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:23.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.588+0000 7f830d698640 1 -- 172.21.15.18:0/3772312962 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82f4004640 con 0x7f82f4004ad0 2024-04-17T19:54:23.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.588+0000 7f830ce97640 1 --2- 172.21.15.18:0/3772312962 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82f4005920 0x7f82f4005d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:54:23.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.588+0000 7f830de99640 1 --2- 172.21.15.18:0/3772312962 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f830806ef30 0x7f82f4006270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:54:23.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.592+0000 7f830d698640 1 --2- 172.21.15.18:0/3772312962 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82f4004ad0 0x7f82f4004f40 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f830400c210 tx=0x7f830401cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca96511e7af96e9c server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:23.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.592+0000 7f82fbfff640 1 -- 172.21.15.18:0/3772312962 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8304007d60 con 0x7f82f4004ad0 2024-04-17T19:54:23.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.592+0000 7f82fbfff640 1 -- 172.21.15.18:0/3772312962 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83040a9020 con 0x7f82f4004ad0 2024-04-17T19:54:23.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.592+0000 7f82fbfff640 1 -- 172.21.15.18:0/3772312962 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8304005ae0 con 0x7f82f4004ad0 2024-04-17T19:54:23.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.592+0000 7f830f8fc640 1 -- 172.21.15.18:0/3772312962 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82f4004ad0 msgr2=0x7f82f4004f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:23.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.592+0000 7f830f8fc640 1 --2- 172.21.15.18:0/3772312962 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82f4004ad0 0x7f82f4004f40 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f830400c210 tx=0x7f830401cca0 comp rx=0 tx=0).stop 2024-04-17T19:54:23.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.592+0000 7f830de99640 1 -- 172.21.15.18:0/3772312962 reap_dead start 2024-04-17T19:54:23.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.592+0000 7f830f8fc640 1 -- 172.21.15.18:0/3772312962 shutdown_connections 2024-04-17T19:54:23.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.592+0000 7f830f8fc640 1 -- 172.21.15.18:0/3772312962 >> 172.21.15.18:0/3772312962 conn(0x7f8308072bb0 msgr2=0x7f8308072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:23.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.592+0000 7f830f8fc640 1 -- 172.21.15.18:0/3772312962 shutdown_connections 2024-04-17T19:54:23.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.592+0000 7f830f8fc640 1 -- 172.21.15.18:0/3772312962 wait complete. 2024-04-17T19:54:23.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.592+0000 7f830f8fc640 1 Processor -- start 2024-04-17T19:54:23.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.592+0000 7f830f8fc640 1 -- start start 2024-04-17T19:54:23.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.596+0000 7f830f8fc640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82f4004ad0 0x7f8308148ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:23.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.596+0000 7f830f8fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f830814e710 0x7f8308156780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:23.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.596+0000 7f830f8fc640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8308156cc0 0x7f8308150680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:23.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.596+0000 7f830f8fc640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f830806ff20 con 0x7f830814e710 2024-04-17T19:54:23.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.596+0000 7f830f8fc640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f830806fda0 con 0x7f82f4004ad0 2024-04-17T19:54:23.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.596+0000 7f830f8fc640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f83080700a0 con 0x7f8308156cc0 2024-04-17T19:54:23.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.596+0000 7f830ce97640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f830814e710 0x7f8308156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:23.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.596+0000 7f830ce97640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f830814e710 0x7f8308156780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45104/0 (socket says 172.21.15.18:45104) 2024-04-17T19:54:23.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.596+0000 7f830ce97640 1 -- 172.21.15.18:0/1060933431 learned_addr learned my addr 172.21.15.18:0/1060933431 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:23.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.596+0000 7f830d698640 1 --2- 172.21.15.18:0/1060933431 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82f4004ad0 0x7f8308148ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:23.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.596+0000 7f830de99640 1 --2- 172.21.15.18:0/1060933431 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8308156cc0 0x7f8308150680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:23.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.596+0000 7f830ce97640 1 -- 172.21.15.18:0/1060933431 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8308156cc0 msgr2=0x7f8308150680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:23.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.596+0000 7f830ce97640 1 --2- 172.21.15.18:0/1060933431 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8308156cc0 0x7f8308150680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:23.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.596+0000 7f830ce97640 1 -- 172.21.15.18:0/1060933431 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82f4004ad0 msgr2=0x7f8308148ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:23.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.596+0000 7f830ce97640 1 --2- 172.21.15.18:0/1060933431 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82f4004ad0 0x7f8308148ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:23.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.596+0000 7f830ce97640 1 -- 172.21.15.18:0/1060933431 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8308149420 con 0x7f830814e710 2024-04-17T19:54:23.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.596+0000 7f830ce97640 1 --2- 172.21.15.18:0/1060933431 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f830814e710 0x7f8308156780 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f82fc00f430 tx=0x7f82fc00f8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:23.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.596+0000 7f82f9ffb640 1 -- 172.21.15.18:0/1060933431 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82fc0039a0 con 0x7f830814e710 2024-04-17T19:54:23.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.596+0000 7f82f9ffb640 1 -- 172.21.15.18:0/1060933431 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82fc003b40 con 0x7f830814e710 2024-04-17T19:54:23.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.596+0000 7f830f8fc640 1 -- 172.21.15.18:0/1060933431 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83081570d0 con 0x7f830814e710 2024-04-17T19:54:23.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.596+0000 7f82f9ffb640 1 -- 172.21.15.18:0/1060933431 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82fc004020 con 0x7f830814e710 2024-04-17T19:54:23.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.596+0000 7f830f8fc640 1 -- 172.21.15.18:0/1060933431 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f830814d950 con 0x7f830814e710 2024-04-17T19:54:23.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.596+0000 7f830f8fc640 1 -- 172.21.15.18:0/1060933431 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8308069950 con 0x7f830814e710 2024-04-17T19:54:23.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.596+0000 7f82f9ffb640 1 -- 172.21.15.18:0/1060933431 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f82fc01d020 con 0x7f830814e710 2024-04-17T19:54:23.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.596+0000 7f82f9ffb640 1 --2- 172.21.15.18:0/1060933431 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f82ec068380 0x7f82ec06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:23.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.600+0000 7f82f9ffb640 1 -- 172.21.15.18:0/1060933431 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7f82fc0877f0 con 0x7f830814e710 2024-04-17T19:54:23.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.600+0000 7f830d698640 1 --2- 172.21.15.18:0/1060933431 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f82ec068380 0x7f82ec06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:23.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.600+0000 7f830d698640 1 --2- 172.21.15.18:0/1060933431 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f82ec068380 0x7f82ec06a890 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f830400c210 tx=0x7f83040b1040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:23.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.604+0000 7f82f9ffb640 1 -- 172.21.15.18:0/1060933431 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f82fc024020 con 0x7f830814e710 2024-04-17T19:54:23.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.764+0000 7f830f8fc640 1 -- 172.21.15.18:0/1060933431 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f83080cdc20 con 0x7f830814e710 2024-04-17T19:54:23.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.764+0000 7f82f9ffb640 1 -- 172.21.15.18:0/1060933431 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) ==== 104+0+11 (secure 0 0 0) 0x7f83081570d0 con 0x7f830814e710 2024-04-17T19:54:23.762 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-17T19:54:23.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.764+0000 7f830f8fc640 1 -- 172.21.15.18:0/1060933431 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f82ec068380 msgr2=0x7f82ec06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:23.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.764+0000 7f830f8fc640 1 --2- 172.21.15.18:0/1060933431 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f82ec068380 0x7f82ec06a890 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f830400c210 tx=0x7f83040b1040 comp rx=0 tx=0).stop 2024-04-17T19:54:23.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.764+0000 7f830f8fc640 1 -- 172.21.15.18:0/1060933431 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f830814e710 msgr2=0x7f8308156780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:23.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.764+0000 7f830f8fc640 1 --2- 172.21.15.18:0/1060933431 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f830814e710 0x7f8308156780 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f82fc00f430 tx=0x7f82fc00f8f0 comp rx=0 tx=0).stop 2024-04-17T19:54:23.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.764+0000 7f830f8fc640 1 -- 172.21.15.18:0/1060933431 shutdown_connections 2024-04-17T19:54:23.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.764+0000 7f830f8fc640 1 --2- 172.21.15.18:0/1060933431 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f82ec068380 0x7f82ec06a890 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:23.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.764+0000 7f830f8fc640 1 --2- 172.21.15.18:0/1060933431 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8308156cc0 0x7f8308150680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:23.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.764+0000 7f830f8fc640 1 --2- 172.21.15.18:0/1060933431 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f830814e710 0x7f8308156780 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:23.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.764+0000 7f830f8fc640 1 --2- 172.21.15.18:0/1060933431 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f82f4004ad0 0x7f8308148ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:23.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.764+0000 7f830f8fc640 1 -- 172.21.15.18:0/1060933431 >> 172.21.15.18:0/1060933431 conn(0x7f8308072bb0 msgr2=0x7f8308072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:23.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.764+0000 7f830f8fc640 1 -- 172.21.15.18:0/1060933431 shutdown_connections 2024-04-17T19:54:23.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.768+0000 7f830f8fc640 1 -- 172.21.15.18:0/1060933431 wait complete. 2024-04-17T19:54:23.784 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-17T19:54:23.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.932+0000 7f757b46f640 1 Processor -- start 2024-04-17T19:54:23.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.932+0000 7f757b46f640 1 -- start start 2024-04-17T19:54:23.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.936+0000 7f757b46f640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f75740b1550 0x7f75740b1960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:23.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.936+0000 7f757b46f640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f75740d20a0 0x7f75740d24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:23.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.936+0000 7f757b46f640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f757415de30 con 0x7f757415d7e0 2024-04-17T19:54:23.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.936+0000 7f757b46f640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f757415dbf0 con 0x7f75740b1550 2024-04-17T19:54:23.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.936+0000 7f757b46f640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f75740d1c10 con 0x7f75740d20a0 2024-04-17T19:54:23.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.936+0000 7f757920b640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f757415d7e0 0x7f757406c910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:38930/0 (socket says 172.21.15.18:38930) 2024-04-17T19:54:23.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.936+0000 7f757920b640 1 -- 172.21.15.18:0/2013281419 learned_addr learned my addr 172.21.15.18:0/2013281419 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:54:23.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.936+0000 7f7578a0a640 1 --2- 172.21.15.18:0/2013281419 >> v2:172.21.15.173:3300/0 conn(0x7f75740b1550 0x7f75740b1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:23.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.936+0000 7f7579a0c640 1 --2- 172.21.15.18:0/2013281419 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f75740d20a0 0x7f75740d24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:23.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.936+0000 7f756bfff640 1 -- 172.21.15.18:0/2013281419 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2393732696 0 0) 0x7f757415de30 con 0x7f757415d7e0 2024-04-17T19:54:23.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.936+0000 7f756bfff640 1 -- 172.21.15.18:0/2013281419 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7560003530 con 0x7f757415d7e0 2024-04-17T19:54:23.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.936+0000 7f756bfff640 1 -- 172.21.15.18:0/2013281419 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3075135806 0 0) 0x7f7560003530 con 0x7f757415d7e0 2024-04-17T19:54:23.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.936+0000 7f756bfff640 1 -- 172.21.15.18:0/2013281419 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f75740d20a0 msgr2=0x7f75740d24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:23.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.936+0000 7f756bfff640 1 --2- 172.21.15.18:0/2013281419 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f75740d20a0 0x7f75740d24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:23.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.936+0000 7f756bfff640 1 -- 172.21.15.18:0/2013281419 >> v2:172.21.15.173:3300/0 conn(0x7f75740b1550 msgr2=0x7f75740b1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:23.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.936+0000 7f756bfff640 1 --2- 172.21.15.18:0/2013281419 >> v2:172.21.15.173:3300/0 conn(0x7f75740b1550 0x7f75740b1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:23.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.936+0000 7f756bfff640 1 -- 172.21.15.18:0/2013281419 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f757415e110 con 0x7f757415d7e0 2024-04-17T19:54:23.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.936+0000 7f756bfff640 1 -- 172.21.15.18:0/2013281419 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3208559991 0 0) 0x7f7570001a00 con 0x7f757415d7e0 2024-04-17T19:54:23.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.936+0000 7f756bfff640 1 -- 172.21.15.18:0/2013281419 >> v1:172.21.15.18:6789/0 conn(0x7f757415d7e0 legacy=0x7f757406c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:23.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.936+0000 7f756bfff640 1 --2- 172.21.15.18:0/2013281419 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75600039c0 0x7f7560003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:23.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.936+0000 7f756bfff640 1 --2- 172.21.15.18:0/2013281419 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7560004810 0x7f7560004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:23.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.936+0000 7f756bfff640 1 --2- 172.21.15.18:0/2013281419 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f75740d20a0 0x7f7560005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:23.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.936+0000 7f756bfff640 1 -- 172.21.15.18:0/2013281419 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f757415dbf0 con 0x7f75600039c0 2024-04-17T19:54:23.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.936+0000 7f756bfff640 1 -- 172.21.15.18:0/2013281419 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f75740d1c10 con 0x7f7560004810 2024-04-17T19:54:23.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.936+0000 7f756bfff640 1 -- 172.21.15.18:0/2013281419 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f756000ba00 con 0x7f75740d20a0 2024-04-17T19:54:23.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.936+0000 7f757920b640 1 --2- 172.21.15.18:0/2013281419 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75600039c0 0x7f7560003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:23.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.936+0000 7f7578a0a640 1 --2- 172.21.15.18:0/2013281419 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7560004810 0x7f7560004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:23.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.936+0000 7f7579a0c640 1 --2- 172.21.15.18:0/2013281419 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f75740d20a0 0x7f7560005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:23.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.936+0000 7f757920b640 1 -- 172.21.15.18:0/2013281419 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f75740d20a0 msgr2=0x7f7560005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:23.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.936+0000 7f757920b640 1 --2- 172.21.15.18:0/2013281419 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f75740d20a0 0x7f7560005160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:23.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.936+0000 7f757920b640 1 -- 172.21.15.18:0/2013281419 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7560004810 msgr2=0x7f7560004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:23.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.936+0000 7f757920b640 1 --2- 172.21.15.18:0/2013281419 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7560004810 0x7f7560004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:23.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.936+0000 7f757920b640 1 -- 172.21.15.18:0/2013281419 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7560003530 con 0x7f75600039c0 2024-04-17T19:54:23.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.940+0000 7f757920b640 1 --2- 172.21.15.18:0/2013281419 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75600039c0 0x7f7560003e30 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f757000a850 tx=0x7f757001d380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc6a14843f2d90da server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:23.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.940+0000 7f756bfff640 1 -- 172.21.15.18:0/2013281419 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f757000a4a0 con 0x7f75600039c0 2024-04-17T19:54:23.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.940+0000 7f756bfff640 1 -- 172.21.15.18:0/2013281419 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75700ad650 con 0x7f75600039c0 2024-04-17T19:54:23.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.940+0000 7f756bfff640 1 -- 172.21.15.18:0/2013281419 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75700ada40 con 0x7f75600039c0 2024-04-17T19:54:23.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.940+0000 7f757b46f640 1 -- 172.21.15.18:0/2013281419 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75600039c0 msgr2=0x7f7560003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:23.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.940+0000 7f757b46f640 1 --2- 172.21.15.18:0/2013281419 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75600039c0 0x7f7560003e30 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f757000a850 tx=0x7f757001d380 comp rx=0 tx=0).stop 2024-04-17T19:54:23.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.940+0000 7f7579a0c640 1 -- 172.21.15.18:0/2013281419 reap_dead start 2024-04-17T19:54:23.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.940+0000 7f757b46f640 1 -- 172.21.15.18:0/2013281419 shutdown_connections 2024-04-17T19:54:23.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.940+0000 7f757b46f640 1 -- 172.21.15.18:0/2013281419 >> 172.21.15.18:0/2013281419 conn(0x7f75740b6990 msgr2=0x7f75740b6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:23.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.940+0000 7f757b46f640 1 -- 172.21.15.18:0/2013281419 shutdown_connections 2024-04-17T19:54:23.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.940+0000 7f757b46f640 1 -- 172.21.15.18:0/2013281419 wait complete. 2024-04-17T19:54:23.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.944+0000 7f757b46f640 1 Processor -- start 2024-04-17T19:54:23.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.944+0000 7f757b46f640 1 -- start start 2024-04-17T19:54:23.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.944+0000 7f757b46f640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f75600039c0 0x7f75741f8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:23.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.944+0000 7f757b46f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75740b03e0 0x7f75741fc720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:23.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.944+0000 7f757b46f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75741fcc60 0x7f75741fd070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:23.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.944+0000 7f757b46f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f75741682e0 con 0x7f75741fcc60 2024-04-17T19:54:23.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.944+0000 7f757b46f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7574168160 con 0x7f75740b03e0 2024-04-17T19:54:23.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.944+0000 7f757b46f640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f7574168460 con 0x7f75600039c0 2024-04-17T19:54:23.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.944+0000 7f7579a0c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75741fcc60 0x7f75741fd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:23.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.944+0000 7f7579a0c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75741fcc60 0x7f75741fd070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45108/0 (socket says 172.21.15.18:45108) 2024-04-17T19:54:23.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.944+0000 7f7579a0c640 1 -- 172.21.15.18:0/2157171545 learned_addr learned my addr 172.21.15.18:0/2157171545 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:23.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.944+0000 7f7578a0a640 1 --2- 172.21.15.18:0/2157171545 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75740b03e0 0x7f75741fc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:23.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.944+0000 7f757920b640 1 --2- 172.21.15.18:0/2157171545 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f75600039c0 0x7f75741f8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:23.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.944+0000 7f7579a0c640 1 -- 172.21.15.18:0/2157171545 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f75600039c0 msgr2=0x7f75741f8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:23.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.944+0000 7f7579a0c640 1 --2- 172.21.15.18:0/2157171545 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f75600039c0 0x7f75741f8930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:23.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.944+0000 7f7579a0c640 1 -- 172.21.15.18:0/2157171545 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75740b03e0 msgr2=0x7f75741fc720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:23.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.944+0000 7f7579a0c640 1 --2- 172.21.15.18:0/2157171545 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75740b03e0 0x7f75741fc720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:23.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.944+0000 7f7579a0c640 1 -- 172.21.15.18:0/2157171545 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7574075ba0 con 0x7f75741fcc60 2024-04-17T19:54:23.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.944+0000 7f7579a0c640 1 --2- 172.21.15.18:0/2157171545 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75741fcc60 0x7f75741fd070 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f75740744c0 tx=0x7f756c010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:23.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.944+0000 7f7569ffb640 1 -- 172.21.15.18:0/2157171545 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f756c00f040 con 0x7f75741fcc60 2024-04-17T19:54:23.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.944+0000 7f7569ffb640 1 -- 172.21.15.18:0/2157171545 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f756c01c070 con 0x7f75741fcc60 2024-04-17T19:54:23.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.944+0000 7f757b46f640 1 -- 172.21.15.18:0/2157171545 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75740af610 con 0x7f75741fcc60 2024-04-17T19:54:23.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.944+0000 7f7569ffb640 1 -- 172.21.15.18:0/2157171545 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f756c00eae0 con 0x7f75741fcc60 2024-04-17T19:54:23.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.944+0000 7f757b46f640 1 -- 172.21.15.18:0/2157171545 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75740afbd0 con 0x7f75741fcc60 2024-04-17T19:54:23.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.944+0000 7f757b46f640 1 -- 172.21.15.18:0/2157171545 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7574069950 con 0x7f75741fcc60 2024-04-17T19:54:23.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.948+0000 7f7569ffb640 1 -- 172.21.15.18:0/2157171545 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f756c00ec80 con 0x7f75741fcc60 2024-04-17T19:54:23.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.948+0000 7f7569ffb640 1 --2- 172.21.15.18:0/2157171545 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f7558068380 0x7f755806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:23.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.948+0000 7f7569ffb640 1 -- 172.21.15.18:0/2157171545 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7f756c0866c0 con 0x7f75741fcc60 2024-04-17T19:54:23.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.948+0000 7f757920b640 1 --2- 172.21.15.18:0/2157171545 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f7558068380 0x7f755806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:23.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.948+0000 7f757920b640 1 --2- 172.21.15.18:0/2157171545 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f7558068380 0x7f755806a890 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f75700ad000 tx=0x7f757415e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:23.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:23.952+0000 7f7569ffb640 1 -- 172.21.15.18:0/2157171545 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f756c025020 con 0x7f75741fcc60 2024-04-17T19:54:24.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.108+0000 7f757b46f640 1 -- 172.21.15.18:0/2157171545 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f75740b0f30 con 0x7f75741fcc60 2024-04-17T19:54:24.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.108+0000 7f7569ffb640 1 -- 172.21.15.18:0/2157171545 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) ==== 100+0+11 (secure 0 0 0) 0x7f756c0561c0 con 0x7f75741fcc60 2024-04-17T19:54:24.108 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-17T19:54:24.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.112+0000 7f757b46f640 1 -- 172.21.15.18:0/2157171545 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f7558068380 msgr2=0x7f755806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:24.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.112+0000 7f757b46f640 1 --2- 172.21.15.18:0/2157171545 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f7558068380 0x7f755806a890 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f75700ad000 tx=0x7f757415e000 comp rx=0 tx=0).stop 2024-04-17T19:54:24.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.112+0000 7f757b46f640 1 -- 172.21.15.18:0/2157171545 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75741fcc60 msgr2=0x7f75741fd070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:24.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.112+0000 7f757b46f640 1 --2- 172.21.15.18:0/2157171545 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75741fcc60 0x7f75741fd070 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f75740744c0 tx=0x7f756c010c20 comp rx=0 tx=0).stop 2024-04-17T19:54:24.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.112+0000 7f757b46f640 1 -- 172.21.15.18:0/2157171545 shutdown_connections 2024-04-17T19:54:24.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.112+0000 7f757b46f640 1 --2- 172.21.15.18:0/2157171545 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f7558068380 0x7f755806a890 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:24.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.112+0000 7f757b46f640 1 --2- 172.21.15.18:0/2157171545 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75741fcc60 0x7f75741fd070 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:24.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.112+0000 7f757b46f640 1 --2- 172.21.15.18:0/2157171545 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75740b03e0 0x7f75741fc720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:24.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.112+0000 7f757b46f640 1 --2- 172.21.15.18:0/2157171545 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f75600039c0 0x7f75741f8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:24.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.112+0000 7f757b46f640 1 -- 172.21.15.18:0/2157171545 >> 172.21.15.18:0/2157171545 conn(0x7f75740b6990 msgr2=0x7f7574158f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:24.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.112+0000 7f757b46f640 1 -- 172.21.15.18:0/2157171545 shutdown_connections 2024-04-17T19:54:24.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.112+0000 7f757b46f640 1 -- 172.21.15.18:0/2157171545 wait complete. 2024-04-17T19:54:24.130 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-17T19:54:24.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.280+0000 7f0b05760640 1 Processor -- start 2024-04-17T19:54:24.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.280+0000 7f0b05760640 1 -- start start 2024-04-17T19:54:24.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.280+0000 7f0b05760640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0b0015e910 0x7f0b0015ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:24.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.280+0000 7f0b05760640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b000d0020 con 0x7f0b0015e1a0 2024-04-17T19:54:24.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.280+0000 7f0b05760640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b000cd930 con 0x7f0b0006cd60 2024-04-17T19:54:24.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.280+0000 7f0b05760640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f0b000cdc10 con 0x7f0b0015e910 2024-04-17T19:54:24.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.280+0000 7f0afeffd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f0b0015e1a0 0x7f0b000ce9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:38936/0 (socket says 172.21.15.18:38936) 2024-04-17T19:54:24.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.280+0000 7f0afeffd640 1 -- 172.21.15.18:0/606550945 learned_addr learned my addr 172.21.15.18:0/606550945 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:54:24.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.280+0000 7f0af7fff640 1 --2- 172.21.15.18:0/606550945 >> v2:172.21.15.173:3300/0 conn(0x7f0b0015e910 0x7f0b0015ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:24.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.280+0000 7f0afe7fc640 1 -- 172.21.15.18:0/606550945 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3144868630 0 0) 0x7f0b000d0020 con 0x7f0b0015e1a0 2024-04-17T19:54:24.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.280+0000 7f0afe7fc640 1 -- 172.21.15.18:0/606550945 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0aec003530 con 0x7f0b0015e1a0 2024-04-17T19:54:24.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.280+0000 7f0afe7fc640 1 -- 172.21.15.18:0/606550945 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3213304180 0 0) 0x7f0aec003530 con 0x7f0b0015e1a0 2024-04-17T19:54:24.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.280+0000 7f0afe7fc640 1 -- 172.21.15.18:0/606550945 >> v2:172.21.15.173:3300/0 conn(0x7f0b0015e910 msgr2=0x7f0b0015ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:24.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.280+0000 7f0afe7fc640 1 --2- 172.21.15.18:0/606550945 >> v2:172.21.15.173:3300/0 conn(0x7f0b0015e910 0x7f0b0015ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:24.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.280+0000 7f0afe7fc640 1 -- 172.21.15.18:0/606550945 >> v1:172.21.15.173:6789/0 conn(0x7f0b0006cd60 legacy=0x7f0b0006d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:24.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.280+0000 7f0afe7fc640 1 -- 172.21.15.18:0/606550945 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b000cdef0 con 0x7f0b0015e1a0 2024-04-17T19:54:24.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.280+0000 7f0afe7fc640 1 -- 172.21.15.18:0/606550945 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3208559991 0 0) 0x7f0af00016a0 con 0x7f0b0015e1a0 2024-04-17T19:54:24.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.280+0000 7f0afe7fc640 1 -- 172.21.15.18:0/606550945 >> v1:172.21.15.18:6789/0 conn(0x7f0b0015e1a0 legacy=0x7f0b000ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:24.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.280+0000 7f0afe7fc640 1 --2- 172.21.15.18:0/606550945 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0aec0039c0 0x7f0aec003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:24.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.280+0000 7f0afe7fc640 1 --2- 172.21.15.18:0/606550945 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0aec004810 0x7f0aec004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:24.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.280+0000 7f0afe7fc640 1 --2- 172.21.15.18:0/606550945 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0aec005260 0x7f0aec00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:24.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.280+0000 7f0afe7fc640 1 -- 172.21.15.18:0/606550945 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0b000cdc10 con 0x7f0aec0039c0 2024-04-17T19:54:24.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.280+0000 7f0afe7fc640 1 -- 172.21.15.18:0/606550945 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0aec00c1f0 con 0x7f0aec004810 2024-04-17T19:54:24.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.280+0000 7f0afe7fc640 1 -- 172.21.15.18:0/606550945 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f0aec00c3f0 con 0x7f0aec005260 2024-04-17T19:54:24.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.280+0000 7f0afeffd640 1 --2- 172.21.15.18:0/606550945 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0aec0039c0 0x7f0aec003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:24.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.280+0000 7f0afeffd640 1 -- 172.21.15.18:0/606550945 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0aec005260 msgr2=0x7f0aec00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:24.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.280+0000 7f0aff7fe640 1 --2- 172.21.15.18:0/606550945 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0aec005260 0x7f0aec00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:24.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.280+0000 7f0afeffd640 1 --2- 172.21.15.18:0/606550945 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0aec005260 0x7f0aec00b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:24.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.280+0000 7f0af7fff640 1 --2- 172.21.15.18:0/606550945 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0aec004810 0x7f0aec004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:24.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.280+0000 7f0afeffd640 1 -- 172.21.15.18:0/606550945 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0aec004810 msgr2=0x7f0aec004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:24.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.280+0000 7f0afeffd640 1 --2- 172.21.15.18:0/606550945 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0aec004810 0x7f0aec004c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:24.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.280+0000 7f0aff7fe640 1 -- 172.21.15.18:0/606550945 reap_dead start 2024-04-17T19:54:24.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.280+0000 7f0afeffd640 1 -- 172.21.15.18:0/606550945 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aec003530 con 0x7f0aec0039c0 2024-04-17T19:54:24.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.284+0000 7f0afeffd640 1 --2- 172.21.15.18:0/606550945 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0aec0039c0 0x7f0aec003e30 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f0b000d01f0 tx=0x7f0af001cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2921d2cc32deee7 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:24.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.284+0000 7f0afe7fc640 1 -- 172.21.15.18:0/606550945 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af0007d60 con 0x7f0aec0039c0 2024-04-17T19:54:24.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.284+0000 7f0afe7fc640 1 -- 172.21.15.18:0/606550945 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0af00a9070 con 0x7f0aec0039c0 2024-04-17T19:54:24.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.284+0000 7f0afe7fc640 1 -- 172.21.15.18:0/606550945 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af0005d40 con 0x7f0aec0039c0 2024-04-17T19:54:24.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.284+0000 7f0b05760640 1 -- 172.21.15.18:0/606550945 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0aec0039c0 msgr2=0x7f0aec003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:24.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.284+0000 7f0b05760640 1 --2- 172.21.15.18:0/606550945 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0aec0039c0 0x7f0aec003e30 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f0b000d01f0 tx=0x7f0af001cc90 comp rx=0 tx=0).stop 2024-04-17T19:54:24.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.284+0000 7f0b05760640 1 -- 172.21.15.18:0/606550945 shutdown_connections 2024-04-17T19:54:24.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.284+0000 7f0b05760640 1 --2- 172.21.15.18:0/606550945 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0aec0039c0 0x7f0aec003e30 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:24.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.284+0000 7f0b05760640 1 -- 172.21.15.18:0/606550945 >> 172.21.15.18:0/606550945 conn(0x7f0b00072bb0 msgr2=0x7f0b00072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:24.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.284+0000 7f0b05760640 1 -- 172.21.15.18:0/606550945 shutdown_connections 2024-04-17T19:54:24.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.284+0000 7f0b05760640 1 -- 172.21.15.18:0/606550945 wait complete. 2024-04-17T19:54:24.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.288+0000 7f0b05760640 1 Processor -- start 2024-04-17T19:54:24.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.288+0000 7f0b05760640 1 -- start start 2024-04-17T19:54:24.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.288+0000 7f0b05760640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0aec0039c0 0x7f0b00144470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:24.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.288+0000 7f0b05760640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b00152be0 0x7f0b00152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:24.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.288+0000 7f0b05760640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0b001500c0 0x7f0b001504d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:24.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.288+0000 7f0b05760640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0b0006d580 con 0x7f0b00152be0 2024-04-17T19:54:24.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.288+0000 7f0b05760640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0b0015f130 con 0x7f0aec0039c0 2024-04-17T19:54:24.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.288+0000 7f0b05760640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f0b0015b720 con 0x7f0b001500c0 2024-04-17T19:54:24.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.288+0000 7f0af7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b00152be0 0x7f0b00152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:24.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.288+0000 7f0af7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b00152be0 0x7f0b00152ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45126/0 (socket says 172.21.15.18:45126) 2024-04-17T19:54:24.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.288+0000 7f0af7fff640 1 -- 172.21.15.18:0/3679103857 learned_addr learned my addr 172.21.15.18:0/3679103857 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:24.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.288+0000 7f0aff7fe640 1 --2- 172.21.15.18:0/3679103857 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0b001500c0 0x7f0b001504d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:24.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.288+0000 7f0afeffd640 1 --2- 172.21.15.18:0/3679103857 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0aec0039c0 0x7f0b00144470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:24.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.288+0000 7f0af7fff640 1 -- 172.21.15.18:0/3679103857 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0b001500c0 msgr2=0x7f0b001504d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:24.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.288+0000 7f0af7fff640 1 --2- 172.21.15.18:0/3679103857 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0b001500c0 0x7f0b001504d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:24.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.288+0000 7f0af7fff640 1 -- 172.21.15.18:0/3679103857 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0aec0039c0 msgr2=0x7f0b00144470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:24.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.288+0000 7f0af7fff640 1 --2- 172.21.15.18:0/3679103857 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0aec0039c0 0x7f0b00144470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:24.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.288+0000 7f0af7fff640 1 -- 172.21.15.18:0/3679103857 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b00150a10 con 0x7f0b00152be0 2024-04-17T19:54:24.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.288+0000 7f0af7fff640 1 --2- 172.21.15.18:0/3679103857 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b00152be0 0x7f0b00152ff0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0ae80107c0 tx=0x7f0ae8010c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:24.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.288+0000 7f0af77fe640 1 -- 172.21.15.18:0/3679103857 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae800f040 con 0x7f0b00152be0 2024-04-17T19:54:24.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.288+0000 7f0af77fe640 1 -- 172.21.15.18:0/3679103857 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ae800eb00 con 0x7f0b00152be0 2024-04-17T19:54:24.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.288+0000 7f0af77fe640 1 -- 172.21.15.18:0/3679103857 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae8010e70 con 0x7f0b00152be0 2024-04-17T19:54:24.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.288+0000 7f0b05760640 1 -- 172.21.15.18:0/3679103857 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b00153950 con 0x7f0b00152be0 2024-04-17T19:54:24.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.288+0000 7f0b05760640 1 -- 172.21.15.18:0/3679103857 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b00153f10 con 0x7f0b00152be0 2024-04-17T19:54:24.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.288+0000 7f0b05760640 1 -- 172.21.15.18:0/3679103857 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b00069950 con 0x7f0b00152be0 2024-04-17T19:54:24.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.292+0000 7f0af77fe640 1 -- 172.21.15.18:0/3679103857 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0ae801c400 con 0x7f0b00152be0 2024-04-17T19:54:24.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.292+0000 7f0af77fe640 1 --2- 172.21.15.18:0/3679103857 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0ae00683b0 0x7f0ae006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:24.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.292+0000 7f0afeffd640 1 --2- 172.21.15.18:0/3679103857 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0ae00683b0 0x7f0ae006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:24.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.292+0000 7f0af77fe640 1 -- 172.21.15.18:0/3679103857 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7f0ae8087200 con 0x7f0b00152be0 2024-04-17T19:54:24.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.292+0000 7f0afeffd640 1 --2- 172.21.15.18:0/3679103857 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0ae00683b0 0x7f0ae006a8c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0af00ab000 tx=0x7f0af00a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:24.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.296+0000 7f0af77fe640 1 -- 172.21.15.18:0/3679103857 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0b00150a10 con 0x7f0b00152be0 2024-04-17T19:54:24.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.460+0000 7f0b05760640 1 -- 172.21.15.18:0/3679103857 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f0b000ccaf0 con 0x7f0b00152be0 2024-04-17T19:54:24.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.460+0000 7f0af77fe640 1 -- 172.21.15.18:0/3679103857 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) ==== 103+0+11 (secure 0 0 0) 0x7f0ae8018030 con 0x7f0b00152be0 2024-04-17T19:54:24.459 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-17T19:54:24.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.464+0000 7f0b05760640 1 -- 172.21.15.18:0/3679103857 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0ae00683b0 msgr2=0x7f0ae006a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:24.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.464+0000 7f0b05760640 1 --2- 172.21.15.18:0/3679103857 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0ae00683b0 0x7f0ae006a8c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0af00ab000 tx=0x7f0af00a7070 comp rx=0 tx=0).stop 2024-04-17T19:54:24.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.464+0000 7f0b05760640 1 -- 172.21.15.18:0/3679103857 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b00152be0 msgr2=0x7f0b00152ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:24.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.464+0000 7f0b05760640 1 --2- 172.21.15.18:0/3679103857 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b00152be0 0x7f0b00152ff0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0ae80107c0 tx=0x7f0ae8010c80 comp rx=0 tx=0).stop 2024-04-17T19:54:24.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.464+0000 7f0b05760640 1 -- 172.21.15.18:0/3679103857 shutdown_connections 2024-04-17T19:54:24.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.464+0000 7f0b05760640 1 --2- 172.21.15.18:0/3679103857 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0ae00683b0 0x7f0ae006a8c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:24.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.464+0000 7f0b05760640 1 --2- 172.21.15.18:0/3679103857 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0b001500c0 0x7f0b001504d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:24.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.464+0000 7f0b05760640 1 --2- 172.21.15.18:0/3679103857 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b00152be0 0x7f0b00152ff0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:24.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.464+0000 7f0b05760640 1 --2- 172.21.15.18:0/3679103857 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0aec0039c0 0x7f0b00144470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:24.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.464+0000 7f0b05760640 1 -- 172.21.15.18:0/3679103857 >> 172.21.15.18:0/3679103857 conn(0x7f0b00072bb0 msgr2=0x7f0b000b15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:24.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.464+0000 7f0b05760640 1 -- 172.21.15.18:0/3679103857 shutdown_connections 2024-04-17T19:54:24.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.464+0000 7f0b05760640 1 -- 172.21.15.18:0/3679103857 wait complete. 2024-04-17T19:54:24.482 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-17T19:54:24.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.640+0000 7f96ee908640 1 Processor -- start 2024-04-17T19:54:24.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.640+0000 7f96ee908640 1 -- start start 2024-04-17T19:54:24.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.640+0000 7f96ee908640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f96e80d3b80 0x7f96e80cff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:24.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.640+0000 7f96ee908640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f96e80d0450 0x7f96e81631c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:24.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.640+0000 7f96ee908640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96e80d0860 con 0x7f96e8163700 2024-04-17T19:54:24.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.640+0000 7f96ee908640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f96e80d3f90 con 0x7f96e80d3b80 2024-04-17T19:54:24.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.640+0000 7f96ee908640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f96e8160be0 con 0x7f96e80d0450 2024-04-17T19:54:24.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.640+0000 7f96e7fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f96e80d3b80 0x7f96e80cff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:24.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.644+0000 7f96e7fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f96e80d3b80 0x7f96e80cff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34106/0 (socket says 172.21.15.18:34106) 2024-04-17T19:54:24.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.644+0000 7f96e7fff640 1 -- 172.21.15.18:0/22962704 learned_addr learned my addr 172.21.15.18:0/22962704 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:24.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.644+0000 7f96ecea5640 1 --1- 172.21.15.18:0/22962704 >> v1:172.21.15.173:6789/0 conn(0x7f96e8163700 0x7f96e806c1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.18:38294/0 (socket says 172.21.15.18:38294) 2024-04-17T19:54:24.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.644+0000 7f96e77fe640 1 --2- 172.21.15.18:0/22962704 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f96e80d0450 0x7f96e81631c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:24.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.644+0000 7f96e7fff640 1 -- 172.21.15.18:0/22962704 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f96e80d0450 msgr2=0x7f96e81631c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:24.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.644+0000 7f96e7fff640 1 --2- 172.21.15.18:0/22962704 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f96e80d0450 0x7f96e81631c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:24.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.644+0000 7f96e7fff640 1 -- 172.21.15.18:0/22962704 >> v1:172.21.15.173:6789/0 conn(0x7f96e8163700 legacy=0x7f96e806c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:24.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.644+0000 7f96e7fff640 1 -- 172.21.15.18:0/22962704 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96e80d41b0 con 0x7f96e80d3b80 2024-04-17T19:54:24.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.644+0000 7f96e7fff640 1 --2- 172.21.15.18:0/22962704 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96e80d3b80 0x7f96e80cff10 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f96d8009870 tx=0x7f96d801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ae3f47c2c012132 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:24.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.644+0000 7f96e6ffd640 1 -- 172.21.15.18:0/22962704 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d80ab650 con 0x7f96e80d3b80 2024-04-17T19:54:24.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.644+0000 7f96e6ffd640 1 -- 172.21.15.18:0/22962704 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96d80b0070 con 0x7f96e80d3b80 2024-04-17T19:54:24.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.644+0000 7f96e6ffd640 1 -- 172.21.15.18:0/22962704 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d80aba10 con 0x7f96e80d3b80 2024-04-17T19:54:24.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.644+0000 7f96ee908640 1 -- 172.21.15.18:0/22962704 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96e80d3b80 msgr2=0x7f96e80cff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:24.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.644+0000 7f96ee908640 1 --2- 172.21.15.18:0/22962704 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96e80d3b80 0x7f96e80cff10 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f96d8009870 tx=0x7f96d801c560 comp rx=0 tx=0).stop 2024-04-17T19:54:24.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.644+0000 7f96ee908640 1 -- 172.21.15.18:0/22962704 shutdown_connections 2024-04-17T19:54:24.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.644+0000 7f96ee908640 1 --2- 172.21.15.18:0/22962704 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f96e80d0450 0x7f96e81631c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:24.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.644+0000 7f96ee908640 1 --2- 172.21.15.18:0/22962704 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96e80d3b80 0x7f96e80cff10 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:24.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.644+0000 7f96ee908640 1 -- 172.21.15.18:0/22962704 >> 172.21.15.18:0/22962704 conn(0x7f96e80d4ed0 msgr2=0x7f96e80d52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:24.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.644+0000 7f96ee908640 1 -- 172.21.15.18:0/22962704 shutdown_connections 2024-04-17T19:54:24.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.644+0000 7f96ee908640 1 -- 172.21.15.18:0/22962704 wait complete. 2024-04-17T19:54:24.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.648+0000 7f96ee908640 1 Processor -- start 2024-04-17T19:54:24.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.648+0000 7f96ee908640 1 -- start start 2024-04-17T19:54:24.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.648+0000 7f96ee908640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f96e80d0450 0x7f96e8159490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:24.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.648+0000 7f96ee908640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96e80d3b80 0x7f96e815def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:24.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.648+0000 7f96ee908640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96e8163700 0x7f96e815e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:24.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.648+0000 7f96ee908640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f96e815fdd0 con 0x7f96e80d3b80 2024-04-17T19:54:24.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.648+0000 7f96ee908640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f96e8163f20 con 0x7f96e8163700 2024-04-17T19:54:24.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.648+0000 7f96ee908640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f96e815ff50 con 0x7f96e80d0450 2024-04-17T19:54:24.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.648+0000 7f96e77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96e80d3b80 0x7f96e815def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:24.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.648+0000 7f96e77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96e80d3b80 0x7f96e815def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34118/0 (socket says 172.21.15.18:34118) 2024-04-17T19:54:24.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.648+0000 7f96e77fe640 1 -- 172.21.15.18:0/3861897066 learned_addr learned my addr 172.21.15.18:0/3861897066 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:24.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.648+0000 7f96ecea5640 1 --2- 172.21.15.18:0/3861897066 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96e8163700 0x7f96e815e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:24.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.648+0000 7f96e7fff640 1 --2- 172.21.15.18:0/3861897066 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f96e80d0450 0x7f96e8159490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:24.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.648+0000 7f96e77fe640 1 -- 172.21.15.18:0/3861897066 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f96e80d0450 msgr2=0x7f96e8159490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:24.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.648+0000 7f96e77fe640 1 --2- 172.21.15.18:0/3861897066 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f96e80d0450 0x7f96e8159490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:24.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.648+0000 7f96e77fe640 1 -- 172.21.15.18:0/3861897066 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96e8163700 msgr2=0x7f96e815e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:24.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.648+0000 7f96e77fe640 1 --2- 172.21.15.18:0/3861897066 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96e8163700 0x7f96e815e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:24.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.648+0000 7f96e77fe640 1 -- 172.21.15.18:0/3861897066 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96e8162690 con 0x7f96e80d3b80 2024-04-17T19:54:24.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.648+0000 7f96ecea5640 1 --2- 172.21.15.18:0/3861897066 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96e8163700 0x7f96e815e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:54:24.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.648+0000 7f96e77fe640 1 --2- 172.21.15.18:0/3861897066 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96e80d3b80 0x7f96e815def0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f96dc00e870 tx=0x7f96dc00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:24.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.652+0000 7f96e4ff9640 1 -- 172.21.15.18:0/3861897066 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96dc017070 con 0x7f96e80d3b80 2024-04-17T19:54:24.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.652+0000 7f96e4ff9640 1 -- 172.21.15.18:0/3861897066 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96dc00c940 con 0x7f96e80d3b80 2024-04-17T19:54:24.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.652+0000 7f96ee908640 1 -- 172.21.15.18:0/3861897066 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96e81620d0 con 0x7f96e80d3b80 2024-04-17T19:54:24.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.652+0000 7f96e4ff9640 1 -- 172.21.15.18:0/3861897066 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96dc00ccf0 con 0x7f96e80d3b80 2024-04-17T19:54:24.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.652+0000 7f96ee908640 1 -- 172.21.15.18:0/3861897066 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96e8159f70 con 0x7f96e80d3b80 2024-04-17T19:54:24.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.652+0000 7f96ee908640 1 -- 172.21.15.18:0/3861897066 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96e8069950 con 0x7f96e80d3b80 2024-04-17T19:54:24.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.652+0000 7f96e4ff9640 1 -- 172.21.15.18:0/3861897066 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f96dc01a070 con 0x7f96e80d3b80 2024-04-17T19:54:24.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.652+0000 7f96e4ff9640 1 --2- 172.21.15.18:0/3861897066 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f96d4068380 0x7f96d406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:24.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.652+0000 7f96e4ff9640 1 -- 172.21.15.18:0/3861897066 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7f96dc086d90 con 0x7f96e80d3b80 2024-04-17T19:54:24.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.652+0000 7f96e7fff640 1 --2- 172.21.15.18:0/3861897066 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f96d4068380 0x7f96d406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:24.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.652+0000 7f96e7fff640 1 --2- 172.21.15.18:0/3861897066 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f96d4068380 0x7f96d406a890 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f96d80af000 tx=0x7f96d80a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:24.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.656+0000 7f96e4ff9640 1 -- 172.21.15.18:0/3861897066 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f96dc056e50 con 0x7f96e80d3b80 2024-04-17T19:54:24.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.824+0000 7f96ee908640 1 -- 172.21.15.18:0/3861897066 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f96e80d3540 con 0x7f96e80d3b80 2024-04-17T19:54:24.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.824+0000 7f96e4ff9640 1 -- 172.21.15.18:0/3861897066 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) ==== 80+0+0 (secure 0 0 0) 0x7f96dc056750 con 0x7f96e80d3b80 2024-04-17T19:54:24.823 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-04-17T19:54:24.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.828+0000 7f96ee908640 1 -- 172.21.15.18:0/3861897066 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f96d4068380 msgr2=0x7f96d406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:24.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.828+0000 7f96ee908640 1 --2- 172.21.15.18:0/3861897066 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f96d4068380 0x7f96d406a890 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f96d80af000 tx=0x7f96d80a7000 comp rx=0 tx=0).stop 2024-04-17T19:54:24.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.828+0000 7f96ee908640 1 -- 172.21.15.18:0/3861897066 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96e80d3b80 msgr2=0x7f96e815def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:24.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.828+0000 7f96ee908640 1 --2- 172.21.15.18:0/3861897066 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96e80d3b80 0x7f96e815def0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f96dc00e870 tx=0x7f96dc00ec70 comp rx=0 tx=0).stop 2024-04-17T19:54:24.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.828+0000 7f96ee908640 1 -- 172.21.15.18:0/3861897066 shutdown_connections 2024-04-17T19:54:24.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.828+0000 7f96ee908640 1 --2- 172.21.15.18:0/3861897066 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f96d4068380 0x7f96d406a890 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:24.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.828+0000 7f96ee908640 1 --2- 172.21.15.18:0/3861897066 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96e8163700 0x7f96e815e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:24.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.828+0000 7f96ee908640 1 --2- 172.21.15.18:0/3861897066 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96e80d3b80 0x7f96e815def0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:24.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.828+0000 7f96ee908640 1 --2- 172.21.15.18:0/3861897066 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f96e80d0450 0x7f96e8159490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:24.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.828+0000 7f96ee908640 1 -- 172.21.15.18:0/3861897066 >> 172.21.15.18:0/3861897066 conn(0x7f96e80d4ed0 msgr2=0x7f96e80b5550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:24.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.828+0000 7f96ee908640 1 -- 172.21.15.18:0/3861897066 shutdown_connections 2024-04-17T19:54:24.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:24.828+0000 7f96ee908640 1 -- 172.21.15.18:0/3861897066 wait complete. 2024-04-17T19:54:24.843 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi173.front.sepia.ceph.com... 2024-04-17T19:54:24.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:54:24.844 DEBUG:teuthology.orchestra.run.smithi173:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2024-04-17T19:54:24.857 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi173.stderr:ceph-fuse[33192]: fuse finished with error 0 and tester_r 0 2024-04-17T19:54:24.859 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T19:54:24.918 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi173.front.sepia.ceph.com 2024-04-17T19:54:24.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:54:24.919 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-04-17T19:54:24.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:54:24.926 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-04-17T19:54:24.932 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-17T19:54:24.932 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-17T19:54:24.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:54:24.932 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-17T19:54:24.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:54:24.990 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-17T19:54:25.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:54:25.085 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link delete ceph-brx 2024-04-17T19:54:25.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:54:25.234 DEBUG:teuthology.orchestra.run.smithi173:> ip netns list 2024-04-17T19:54:25.241 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-17T19:54:25.241 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-17T19:54:25.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:54:25.241 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-17T19:54:25.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:54:25.298 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-17T19:54:25.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-17T19:54:25.382 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link delete ceph-brx 2024-04-17T19:54:25.578 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-17T19:54:25.588 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-17T19:54:25.588 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T19:54:25.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.752+0000 7f401f7a6640 1 Processor -- start 2024-04-17T19:54:25.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.752+0000 7f401f7a6640 1 -- start start 2024-04-17T19:54:25.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.752+0000 7f401f7a6640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f40180d24a0 0x7f401815d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:25.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.752+0000 7f401f7a6640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f40180cf6c0 0x7f40180cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:25.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.752+0000 7f401f7a6640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f401806e9a0 con 0x7f40180b6850 2024-04-17T19:54:25.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.752+0000 7f401f7a6640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f401806ec80 con 0x7f40180cf6c0 2024-04-17T19:54:25.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.752+0000 7f401f7a6640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f40180d19c0 con 0x7f40180d24a0 2024-04-17T19:54:25.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.752+0000 7f401dd43640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f40180cf6c0 0x7f40180cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:25.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.752+0000 7f401dd43640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f40180cf6c0 0x7f40180cfad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34122/0 (socket says 172.21.15.18:34122) 2024-04-17T19:54:25.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.752+0000 7f401dd43640 1 -- 172.21.15.18:0/2473243008 learned_addr learned my addr 172.21.15.18:0/2473243008 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:25.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.752+0000 7f401d542640 1 --2- 172.21.15.18:0/2473243008 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f40180d24a0 0x7f401815d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:25.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.752+0000 7f401dd43640 1 -- 172.21.15.18:0/2473243008 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f40180d24a0 msgr2=0x7f401815d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:25.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.752+0000 7f401dd43640 1 --2- 172.21.15.18:0/2473243008 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f40180d24a0 0x7f401815d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:25.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.752+0000 7f401dd43640 1 -- 172.21.15.18:0/2473243008 >> v1:172.21.15.173:6789/0 conn(0x7f40180b6850 legacy=0x7f40180b6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:25.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.752+0000 7f401dd43640 1 -- 172.21.15.18:0/2473243008 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40180d1ca0 con 0x7f40180cf6c0 2024-04-17T19:54:25.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.756+0000 7f401dd43640 1 --2- 172.21.15.18:0/2473243008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40180cf6c0 0x7f40180cfad0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f4010009870 tx=0x7f401001e770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7743a6f297fe1c2d server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:25.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.756+0000 7f4017fff640 1 -- 172.21.15.18:0/2473243008 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40100ad680 con 0x7f40180cf6c0 2024-04-17T19:54:25.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.756+0000 7f4017fff640 1 -- 172.21.15.18:0/2473243008 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40100b2070 con 0x7f40180cf6c0 2024-04-17T19:54:25.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.756+0000 7f4017fff640 1 -- 172.21.15.18:0/2473243008 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40100ada40 con 0x7f40180cf6c0 2024-04-17T19:54:25.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.756+0000 7f401f7a6640 1 -- 172.21.15.18:0/2473243008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40180cf6c0 msgr2=0x7f40180cfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:25.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.756+0000 7f401f7a6640 1 --2- 172.21.15.18:0/2473243008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40180cf6c0 0x7f40180cfad0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f4010009870 tx=0x7f401001e770 comp rx=0 tx=0).stop 2024-04-17T19:54:25.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.756+0000 7f401f7a6640 1 -- 172.21.15.18:0/2473243008 shutdown_connections 2024-04-17T19:54:25.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.756+0000 7f401f7a6640 1 --2- 172.21.15.18:0/2473243008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40180cf6c0 0x7f40180cfad0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:25.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.756+0000 7f401f7a6640 1 --2- 172.21.15.18:0/2473243008 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f40180d24a0 0x7f401815d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:25.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.756+0000 7f401f7a6640 1 -- 172.21.15.18:0/2473243008 >> 172.21.15.18:0/2473243008 conn(0x7f401809aa70 msgr2=0x7f401809ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:25.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.756+0000 7f401f7a6640 1 -- 172.21.15.18:0/2473243008 shutdown_connections 2024-04-17T19:54:25.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.756+0000 7f401f7a6640 1 -- 172.21.15.18:0/2473243008 wait complete. 2024-04-17T19:54:25.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.760+0000 7f401f7a6640 1 Processor -- start 2024-04-17T19:54:25.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.760+0000 7f401f7a6640 1 -- start start 2024-04-17T19:54:25.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.760+0000 7f401f7a6640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40180b6850 0x7f401814f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:25.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.760+0000 7f401f7a6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40180cf6c0 0x7f40180703f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:25.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.760+0000 7f401f7a6640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f40180d24a0 0x7f4018070930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:25.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.760+0000 7f401f7a6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f401806cdf0 con 0x7f40180cf6c0 2024-04-17T19:54:25.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.760+0000 7f401f7a6640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f401806ef60 con 0x7f40180b6850 2024-04-17T19:54:25.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.760+0000 7f401f7a6640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f401806cf70 con 0x7f40180d24a0 2024-04-17T19:54:25.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.760+0000 7f401cd41640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40180cf6c0 0x7f40180703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:25.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.760+0000 7f401cd41640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40180cf6c0 0x7f40180703f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34130/0 (socket says 172.21.15.18:34130) 2024-04-17T19:54:25.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.760+0000 7f401cd41640 1 -- 172.21.15.18:0/1320261349 learned_addr learned my addr 172.21.15.18:0/1320261349 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:25.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.760+0000 7f401dd43640 1 --2- 172.21.15.18:0/1320261349 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f40180d24a0 0x7f4018070930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:25.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.760+0000 7f401d542640 1 --2- 172.21.15.18:0/1320261349 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40180b6850 0x7f401814f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:25.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.760+0000 7f401cd41640 1 -- 172.21.15.18:0/1320261349 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f40180d24a0 msgr2=0x7f4018070930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:25.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.760+0000 7f401cd41640 1 --2- 172.21.15.18:0/1320261349 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f40180d24a0 0x7f4018070930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:25.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.760+0000 7f401cd41640 1 -- 172.21.15.18:0/1320261349 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40180b6850 msgr2=0x7f401814f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:25.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.760+0000 7f401cd41640 1 --2- 172.21.15.18:0/1320261349 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40180b6850 0x7f401814f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:25.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.760+0000 7f401cd41640 1 -- 172.21.15.18:0/1320261349 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4018150ed0 con 0x7f40180cf6c0 2024-04-17T19:54:25.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.760+0000 7f401cd41640 1 --2- 172.21.15.18:0/1320261349 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40180cf6c0 0x7f40180703f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f400c00c730 tx=0x7f400c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:25.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.760+0000 7f4015ffb640 1 -- 172.21.15.18:0/1320261349 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400c003ba0 con 0x7f40180cf6c0 2024-04-17T19:54:25.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.760+0000 7f4015ffb640 1 -- 172.21.15.18:0/1320261349 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f400c003d60 con 0x7f40180cf6c0 2024-04-17T19:54:25.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.760+0000 7f4015ffb640 1 -- 172.21.15.18:0/1320261349 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f400c00aa30 con 0x7f40180cf6c0 2024-04-17T19:54:25.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.760+0000 7f401f7a6640 1 -- 172.21.15.18:0/1320261349 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4018150910 con 0x7f40180cf6c0 2024-04-17T19:54:25.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.760+0000 7f401f7a6640 1 -- 172.21.15.18:0/1320261349 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40180cc250 con 0x7f40180cf6c0 2024-04-17T19:54:25.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.764+0000 7f401f7a6640 1 -- 172.21.15.18:0/1320261349 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4018069950 con 0x7f40180cf6c0 2024-04-17T19:54:25.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.764+0000 7f4015ffb640 1 -- 172.21.15.18:0/1320261349 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f400c00abd0 con 0x7f40180cf6c0 2024-04-17T19:54:25.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.764+0000 7f4015ffb640 1 --2- 172.21.15.18:0/1320261349 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f4004068380 0x7f400406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:25.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.764+0000 7f4015ffb640 1 -- 172.21.15.18:0/1320261349 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7f400c086af0 con 0x7f40180cf6c0 2024-04-17T19:54:25.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.764+0000 7f401d542640 1 --2- 172.21.15.18:0/1320261349 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f4004068380 0x7f400406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:25.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.764+0000 7f401d542640 1 --2- 172.21.15.18:0/1320261349 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f4004068380 0x7f400406a890 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4018072b50 tx=0x7f4008008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:25.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.768+0000 7f4015ffb640 1 -- 172.21.15.18:0/1320261349 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f400c056680 con 0x7f40180cf6c0 2024-04-17T19:54:25.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.928+0000 7f401f7a6640 1 -- 172.21.15.18:0/1320261349 --> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f40180b3160 con 0x7f4004068380 2024-04-17T19:54:25.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.948+0000 7f4015ffb640 1 -- 172.21.15.18:0/1320261349 <== mgr.4104 v2:172.21.15.18:6832/751466605 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332535 (secure 0 0 0) 0x7f40180b3160 con 0x7f4004068380 2024-04-17T19:54:25.949 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:54:25.955 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-17T19:54:25.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.956+0000 7f401f7a6640 1 -- 172.21.15.18:0/1320261349 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f4004068380 msgr2=0x7f400406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:25.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.956+0000 7f401f7a6640 1 --2- 172.21.15.18:0/1320261349 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f4004068380 0x7f400406a890 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4018072b50 tx=0x7f4008008040 comp rx=0 tx=0).stop 2024-04-17T19:54:25.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.956+0000 7f401f7a6640 1 -- 172.21.15.18:0/1320261349 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40180cf6c0 msgr2=0x7f40180703f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:25.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.956+0000 7f401f7a6640 1 --2- 172.21.15.18:0/1320261349 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40180cf6c0 0x7f40180703f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f400c00c730 tx=0x7f400c00cbf0 comp rx=0 tx=0).stop 2024-04-17T19:54:25.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.956+0000 7f401f7a6640 1 -- 172.21.15.18:0/1320261349 shutdown_connections 2024-04-17T19:54:25.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.956+0000 7f401f7a6640 1 --2- 172.21.15.18:0/1320261349 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f4004068380 0x7f400406a890 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:25.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.956+0000 7f401f7a6640 1 --2- 172.21.15.18:0/1320261349 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f40180d24a0 0x7f4018070930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:25.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.956+0000 7f401f7a6640 1 --2- 172.21.15.18:0/1320261349 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40180cf6c0 0x7f40180703f0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:25.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.956+0000 7f401f7a6640 1 --2- 172.21.15.18:0/1320261349 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40180b6850 0x7f401814f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:25.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.956+0000 7f401f7a6640 1 -- 172.21.15.18:0/1320261349 >> 172.21.15.18:0/1320261349 conn(0x7f401809aa70 msgr2=0x7f40180b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:25.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.956+0000 7f401f7a6640 1 -- 172.21.15.18:0/1320261349 shutdown_connections 2024-04-17T19:54:25.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:25.956+0000 7f401f7a6640 1 -- 172.21.15.18:0/1320261349 wait complete. 2024-04-17T19:54:25.974 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2024-04-17T19:54:24.373504+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597195,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":218,"num_write_kb":2445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":170,"ondisk_log_size":170,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236448,"kb_used_data":3632,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738272,"statfs":{"total":773094113280,"available":772851990528,"internally_reserved":0,"allocated":3719168,"data_stored":2188246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":238276148},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005374"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.454644+0000","last_change":"2024-04-17T19:53:04.461184+0000","last_active":"2024-04-17T19:53:45.454644+0000","last_peered":"2024-04-17T19:53:45.454644+0000","last_clean":"2024-04-17T19:53:45.454644+0000","last_became_active":"2024-04-17T19:53:04.460006+0000","last_became_peered":"2024-04-17T19:53:04.460006+0000","last_unstale":"2024-04-17T19:53:45.454644+0000","last_undegraded":"2024-04-17T19:53:45.454644+0000","last_fullsized":"2024-04-17T19:53:45.454644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:23:02.868468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.461480+0000","last_change":"2024-04-17T19:53:05.474006+0000","last_active":"2024-04-17T19:53:45.461480+0000","last_peered":"2024-04-17T19:53:45.461480+0000","last_clean":"2024-04-17T19:53:45.461480+0000","last_became_active":"2024-04-17T19:53:05.467848+0000","last_became_peered":"2024-04-17T19:53:05.467848+0000","last_unstale":"2024-04-17T19:53:45.461480+0000","last_undegraded":"2024-04-17T19:53:45.461480+0000","last_fullsized":"2024-04-17T19:53:45.461480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:05:21.173050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.584776+0000","last_change":"2024-04-17T19:53:09.559397+0000","last_active":"2024-04-17T19:53:45.584776+0000","last_peered":"2024-04-17T19:53:45.584776+0000","last_clean":"2024-04-17T19:53:45.584776+0000","last_became_active":"2024-04-17T19:53:09.558504+0000","last_became_peered":"2024-04-17T19:53:09.558504+0000","last_unstale":"2024-04-17T19:53:45.584776+0000","last_undegraded":"2024-04-17T19:53:45.584776+0000","last_fullsized":"2024-04-17T19:53:45.584776+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:06:18.745394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.461903+0000","last_change":"2024-04-17T19:53:04.484961+0000","last_active":"2024-04-17T19:53:45.461903+0000","last_peered":"2024-04-17T19:53:45.461903+0000","last_clean":"2024-04-17T19:53:45.461903+0000","last_became_active":"2024-04-17T19:53:04.468291+0000","last_became_peered":"2024-04-17T19:53:04.468291+0000","last_unstale":"2024-04-17T19:53:45.461903+0000","last_undegraded":"2024-04-17T19:53:45.461903+0000","last_fullsized":"2024-04-17T19:53:45.461903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:06:00.469757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.459913+0000","last_change":"2024-04-17T19:53:05.475578+0000","last_active":"2024-04-17T19:53:45.459913+0000","last_peered":"2024-04-17T19:53:45.459913+0000","last_clean":"2024-04-17T19:53:45.459913+0000","last_became_active":"2024-04-17T19:53:05.473678+0000","last_became_peered":"2024-04-17T19:53:05.473678+0000","last_unstale":"2024-04-17T19:53:45.459913+0000","last_undegraded":"2024-04-17T19:53:45.459913+0000","last_fullsized":"2024-04-17T19:53:45.459913+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:47:05.354826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.449924+0000","last_change":"2024-04-17T19:53:09.545180+0000","last_active":"2024-04-17T19:53:45.449924+0000","last_peered":"2024-04-17T19:53:45.449924+0000","last_clean":"2024-04-17T19:53:45.449924+0000","last_became_active":"2024-04-17T19:53:09.544580+0000","last_became_peered":"2024-04-17T19:53:09.544580+0000","last_unstale":"2024-04-17T19:53:45.449924+0000","last_undegraded":"2024-04-17T19:53:45.449924+0000","last_fullsized":"2024-04-17T19:53:45.449924+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:02:44.844970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.448758+0000","last_change":"2024-04-17T19:53:04.468009+0000","last_active":"2024-04-17T19:53:45.448758+0000","last_peered":"2024-04-17T19:53:45.448758+0000","last_clean":"2024-04-17T19:53:45.448758+0000","last_became_active":"2024-04-17T19:53:04.467568+0000","last_became_peered":"2024-04-17T19:53:04.467568+0000","last_unstale":"2024-04-17T19:53:45.448758+0000","last_undegraded":"2024-04-17T19:53:45.448758+0000","last_fullsized":"2024-04-17T19:53:45.448758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:18:11.256327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.579947+0000","last_change":"2024-04-17T19:53:05.464961+0000","last_active":"2024-04-17T19:53:45.579947+0000","last_peered":"2024-04-17T19:53:45.579947+0000","last_clean":"2024-04-17T19:53:45.579947+0000","last_became_active":"2024-04-17T19:53:05.464601+0000","last_became_peered":"2024-04-17T19:53:05.464601+0000","last_unstale":"2024-04-17T19:53:45.579947+0000","last_undegraded":"2024-04-17T19:53:45.579947+0000","last_fullsized":"2024-04-17T19:53:45.579947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:12:03.449509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.450440+0000","last_change":"2024-04-17T19:53:09.529447+0000","last_active":"2024-04-17T19:53:45.450440+0000","last_peered":"2024-04-17T19:53:45.450440+0000","last_clean":"2024-04-17T19:53:45.450440+0000","last_became_active":"2024-04-17T19:53:09.528285+0000","last_became_peered":"2024-04-17T19:53:09.528285+0000","last_unstale":"2024-04-17T19:53:45.450440+0000","last_undegraded":"2024-04-17T19:53:45.450440+0000","last_fullsized":"2024-04-17T19:53:45.450440+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:47:09.400433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.448308+0000","last_change":"2024-04-17T19:53:04.467639+0000","last_active":"2024-04-17T19:53:45.448308+0000","last_peered":"2024-04-17T19:53:45.448308+0000","last_clean":"2024-04-17T19:53:45.448308+0000","last_became_active":"2024-04-17T19:53:04.467004+0000","last_became_peered":"2024-04-17T19:53:04.467004+0000","last_unstale":"2024-04-17T19:53:45.448308+0000","last_undegraded":"2024-04-17T19:53:45.448308+0000","last_fullsized":"2024-04-17T19:53:45.448308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:38:40.499868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.565298+0000","last_change":"2024-04-17T19:53:05.468179+0000","last_active":"2024-04-17T19:53:45.565298+0000","last_peered":"2024-04-17T19:53:45.565298+0000","last_clean":"2024-04-17T19:53:45.565298+0000","last_became_active":"2024-04-17T19:53:05.467217+0000","last_became_peered":"2024-04-17T19:53:05.467217+0000","last_unstale":"2024-04-17T19:53:45.565298+0000","last_undegraded":"2024-04-17T19:53:45.565298+0000","last_fullsized":"2024-04-17T19:53:45.565298+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:29:50.290114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.450089+0000","last_change":"2024-04-17T19:53:09.549722+0000","last_active":"2024-04-17T19:53:45.450089+0000","last_peered":"2024-04-17T19:53:45.450089+0000","last_clean":"2024-04-17T19:53:45.450089+0000","last_became_active":"2024-04-17T19:53:09.548876+0000","last_became_peered":"2024-04-17T19:53:09.548876+0000","last_unstale":"2024-04-17T19:53:45.450089+0000","last_undegraded":"2024-04-17T19:53:45.450089+0000","last_fullsized":"2024-04-17T19:53:45.450089+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:15:49.773156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.567108+0000","last_change":"2024-04-17T19:53:05.475996+0000","last_active":"2024-04-17T19:53:45.567108+0000","last_peered":"2024-04-17T19:53:45.567108+0000","last_clean":"2024-04-17T19:53:45.567108+0000","last_became_active":"2024-04-17T19:53:05.475517+0000","last_became_peered":"2024-04-17T19:53:05.475517+0000","last_unstale":"2024-04-17T19:53:45.567108+0000","last_undegraded":"2024-04-17T19:53:45.567108+0000","last_fullsized":"2024-04-17T19:53:45.567108+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:39:47.272961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.566537+0000","last_change":"2024-04-17T19:53:04.465884+0000","last_active":"2024-04-17T19:53:45.566537+0000","last_peered":"2024-04-17T19:53:45.566537+0000","last_clean":"2024-04-17T19:53:45.566537+0000","last_became_active":"2024-04-17T19:53:04.465108+0000","last_became_peered":"2024-04-17T19:53:04.465108+0000","last_unstale":"2024-04-17T19:53:45.566537+0000","last_undegraded":"2024-04-17T19:53:45.566537+0000","last_fullsized":"2024-04-17T19:53:45.566537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:23:02.868468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.566637+0000","last_change":"2024-04-17T19:53:09.545287+0000","last_active":"2024-04-17T19:53:45.566637+0000","last_peered":"2024-04-17T19:53:45.566637+0000","last_clean":"2024-04-17T19:53:45.566637+0000","last_became_active":"2024-04-17T19:53:09.544328+0000","last_became_peered":"2024-04-17T19:53:09.544328+0000","last_unstale":"2024-04-17T19:53:45.566637+0000","last_undegraded":"2024-04-17T19:53:45.566637+0000","last_fullsized":"2024-04-17T19:53:45.566637+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:47:26.887721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.582177+0000","last_change":"2024-04-17T19:53:05.496585+0000","last_active":"2024-04-17T19:53:45.582177+0000","last_peered":"2024-04-17T19:53:45.582177+0000","last_clean":"2024-04-17T19:53:45.582177+0000","last_became_active":"2024-04-17T19:53:05.495800+0000","last_became_peered":"2024-04-17T19:53:05.495800+0000","last_unstale":"2024-04-17T19:53:45.582177+0000","last_undegraded":"2024-04-17T19:53:45.582177+0000","last_fullsized":"2024-04-17T19:53:45.582177+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:18:12.267644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452508+0000","last_change":"2024-04-17T19:53:04.479274+0000","last_active":"2024-04-17T19:53:45.452508+0000","last_peered":"2024-04-17T19:53:45.452508+0000","last_clean":"2024-04-17T19:53:45.452508+0000","last_became_active":"2024-04-17T19:53:04.478425+0000","last_became_peered":"2024-04-17T19:53:04.478425+0000","last_unstale":"2024-04-17T19:53:45.452508+0000","last_undegraded":"2024-04-17T19:53:45.452508+0000","last_fullsized":"2024-04-17T19:53:45.452508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:16:15.623557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.447838+0000","last_change":"2024-04-17T19:53:09.526995+0000","last_active":"2024-04-17T19:53:45.447838+0000","last_peered":"2024-04-17T19:53:45.447838+0000","last_clean":"2024-04-17T19:53:45.447838+0000","last_became_active":"2024-04-17T19:53:09.525577+0000","last_became_peered":"2024-04-17T19:53:09.525577+0000","last_unstale":"2024-04-17T19:53:45.447838+0000","last_undegraded":"2024-04-17T19:53:45.447838+0000","last_fullsized":"2024-04-17T19:53:45.447838+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:52:59.924361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.451938+0000","last_change":"2024-04-17T19:53:05.463312+0000","last_active":"2024-04-17T19:53:45.451938+0000","last_peered":"2024-04-17T19:53:45.451938+0000","last_clean":"2024-04-17T19:53:45.451938+0000","last_became_active":"2024-04-17T19:53:05.462415+0000","last_became_peered":"2024-04-17T19:53:05.462415+0000","last_unstale":"2024-04-17T19:53:45.451938+0000","last_undegraded":"2024-04-17T19:53:45.451938+0000","last_fullsized":"2024-04-17T19:53:45.451938+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:27:51.520335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.460026+0000","last_change":"2024-04-17T19:53:04.471150+0000","last_active":"2024-04-17T19:53:45.460026+0000","last_peered":"2024-04-17T19:53:45.460026+0000","last_clean":"2024-04-17T19:53:45.460026+0000","last_became_active":"2024-04-17T19:53:04.470258+0000","last_became_peered":"2024-04-17T19:53:04.470258+0000","last_unstale":"2024-04-17T19:53:45.460026+0000","last_undegraded":"2024-04-17T19:53:45.460026+0000","last_fullsized":"2024-04-17T19:53:45.460026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:06:00.469757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.587281+0000","last_change":"2024-04-17T19:53:09.565387+0000","last_active":"2024-04-17T19:53:45.587281+0000","last_peered":"2024-04-17T19:53:45.587281+0000","last_clean":"2024-04-17T19:53:45.587281+0000","last_became_active":"2024-04-17T19:53:09.564134+0000","last_became_peered":"2024-04-17T19:53:09.564134+0000","last_unstale":"2024-04-17T19:53:45.587281+0000","last_undegraded":"2024-04-17T19:53:45.587281+0000","last_fullsized":"2024-04-17T19:53:45.587281+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:21:01.809464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.564723+0000","last_change":"2024-04-17T19:53:05.468962+0000","last_active":"2024-04-17T19:53:45.564723+0000","last_peered":"2024-04-17T19:53:45.564723+0000","last_clean":"2024-04-17T19:53:45.564723+0000","last_became_active":"2024-04-17T19:53:05.466996+0000","last_became_peered":"2024-04-17T19:53:05.466996+0000","last_unstale":"2024-04-17T19:53:45.564723+0000","last_undegraded":"2024-04-17T19:53:45.564723+0000","last_fullsized":"2024-04-17T19:53:45.564723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:04:55.125411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.446787+0000","last_change":"2024-04-17T19:53:04.472916+0000","last_active":"2024-04-17T19:53:45.446787+0000","last_peered":"2024-04-17T19:53:45.446787+0000","last_clean":"2024-04-17T19:53:45.446787+0000","last_became_active":"2024-04-17T19:53:04.468136+0000","last_became_peered":"2024-04-17T19:53:04.468136+0000","last_unstale":"2024-04-17T19:53:45.446787+0000","last_undegraded":"2024-04-17T19:53:45.446787+0000","last_fullsized":"2024-04-17T19:53:45.446787+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:23:02.868468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.587217+0000","last_change":"2024-04-17T19:53:45.587217+0000","last_active":"2024-04-17T19:53:45.587217+0000","last_peered":"2024-04-17T19:53:45.587217+0000","last_clean":"2024-04-17T19:53:45.587217+0000","last_became_active":"2024-04-17T19:53:45.586731+0000","last_became_peered":"2024-04-17T19:53:45.586731+0000","last_unstale":"2024-04-17T19:53:45.587217+0000","last_undegraded":"2024-04-17T19:53:45.587217+0000","last_fullsized":"2024-04-17T19:53:45.587217+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:41:58.423269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,7],"acting":[2,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452775+0000","last_change":"2024-04-17T19:53:05.467799+0000","last_active":"2024-04-17T19:53:45.452775+0000","last_peered":"2024-04-17T19:53:45.452775+0000","last_clean":"2024-04-17T19:53:45.452775+0000","last_became_active":"2024-04-17T19:53:05.465048+0000","last_became_peered":"2024-04-17T19:53:05.465048+0000","last_unstale":"2024-04-17T19:53:45.452775+0000","last_undegraded":"2024-04-17T19:53:45.452775+0000","last_fullsized":"2024-04-17T19:53:45.452775+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:19:09.456602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.567142+0000","last_change":"2024-04-17T19:53:04.469594+0000","last_active":"2024-04-17T19:53:45.567142+0000","last_peered":"2024-04-17T19:53:45.567142+0000","last_clean":"2024-04-17T19:53:45.567142+0000","last_became_active":"2024-04-17T19:53:04.469119+0000","last_became_peered":"2024-04-17T19:53:04.469119+0000","last_unstale":"2024-04-17T19:53:45.567142+0000","last_undegraded":"2024-04-17T19:53:45.567142+0000","last_fullsized":"2024-04-17T19:53:45.567142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:40:30.547343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.450404+0000","last_change":"2024-04-17T19:53:09.527277+0000","last_active":"2024-04-17T19:53:45.450404+0000","last_peered":"2024-04-17T19:53:45.450404+0000","last_clean":"2024-04-17T19:53:45.450404+0000","last_became_active":"2024-04-17T19:53:09.526436+0000","last_became_peered":"2024-04-17T19:53:09.526436+0000","last_unstale":"2024-04-17T19:53:45.450404+0000","last_undegraded":"2024-04-17T19:53:45.450404+0000","last_fullsized":"2024-04-17T19:53:45.450404+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:54:31.569576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.454142+0000","last_change":"2024-04-17T19:53:05.443712+0000","last_active":"2024-04-17T19:53:45.454142+0000","last_peered":"2024-04-17T19:53:45.454142+0000","last_clean":"2024-04-17T19:53:45.454142+0000","last_became_active":"2024-04-17T19:53:05.442881+0000","last_became_peered":"2024-04-17T19:53:05.442881+0000","last_unstale":"2024-04-17T19:53:45.454142+0000","last_undegraded":"2024-04-17T19:53:45.454142+0000","last_fullsized":"2024-04-17T19:53:45.454142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:20:57.763858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.453372+0000","last_change":"2024-04-17T19:53:04.465717+0000","last_active":"2024-04-17T19:53:45.453372+0000","last_peered":"2024-04-17T19:53:45.453372+0000","last_clean":"2024-04-17T19:53:45.453372+0000","last_became_active":"2024-04-17T19:53:04.464701+0000","last_became_peered":"2024-04-17T19:53:04.464701+0000","last_unstale":"2024-04-17T19:53:45.453372+0000","last_undegraded":"2024-04-17T19:53:45.453372+0000","last_fullsized":"2024-04-17T19:53:45.453372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:18:11.256327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.456232+0000","last_change":"2024-04-17T19:53:09.530585+0000","last_active":"2024-04-17T19:53:45.456232+0000","last_peered":"2024-04-17T19:53:45.456232+0000","last_clean":"2024-04-17T19:53:45.456232+0000","last_became_active":"2024-04-17T19:53:09.529345+0000","last_became_peered":"2024-04-17T19:53:09.529345+0000","last_unstale":"2024-04-17T19:53:45.456232+0000","last_undegraded":"2024-04-17T19:53:45.456232+0000","last_fullsized":"2024-04-17T19:53:45.456232+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:01:38.507428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452698+0000","last_change":"2024-04-17T19:53:05.452177+0000","last_active":"2024-04-17T19:53:45.452698+0000","last_peered":"2024-04-17T19:53:45.452698+0000","last_clean":"2024-04-17T19:53:45.452698+0000","last_became_active":"2024-04-17T19:53:05.451272+0000","last_became_peered":"2024-04-17T19:53:05.451272+0000","last_unstale":"2024-04-17T19:53:45.452698+0000","last_undegraded":"2024-04-17T19:53:45.452698+0000","last_fullsized":"2024-04-17T19:53:45.452698+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:51:17.675125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.567067+0000","last_change":"2024-04-17T19:53:04.471944+0000","last_active":"2024-04-17T19:53:45.567067+0000","last_peered":"2024-04-17T19:53:45.567067+0000","last_clean":"2024-04-17T19:53:45.567067+0000","last_became_active":"2024-04-17T19:53:04.471458+0000","last_became_peered":"2024-04-17T19:53:04.471458+0000","last_unstale":"2024-04-17T19:53:45.567067+0000","last_undegraded":"2024-04-17T19:53:45.567067+0000","last_fullsized":"2024-04-17T19:53:45.567067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:12:02.438192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452001+0000","last_change":"2024-04-17T19:53:09.549998+0000","last_active":"2024-04-17T19:53:45.452001+0000","last_peered":"2024-04-17T19:53:45.452001+0000","last_clean":"2024-04-17T19:53:45.452001+0000","last_became_active":"2024-04-17T19:53:09.548136+0000","last_became_peered":"2024-04-17T19:53:09.548136+0000","last_unstale":"2024-04-17T19:53:45.452001+0000","last_undegraded":"2024-04-17T19:53:45.452001+0000","last_fullsized":"2024-04-17T19:53:45.452001+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:02:14.459968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.451671+0000","last_change":"2024-04-17T19:53:05.472884+0000","last_active":"2024-04-17T19:53:45.451671+0000","last_peered":"2024-04-17T19:53:45.451671+0000","last_clean":"2024-04-17T19:53:45.451671+0000","last_became_active":"2024-04-17T19:53:05.472513+0000","last_became_peered":"2024-04-17T19:53:05.472513+0000","last_unstale":"2024-04-17T19:53:45.451671+0000","last_undegraded":"2024-04-17T19:53:45.451671+0000","last_fullsized":"2024-04-17T19:53:45.451671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:21:37.163564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.457647+0000","last_change":"2024-04-17T19:53:04.487713+0000","last_active":"2024-04-17T19:53:45.457647+0000","last_peered":"2024-04-17T19:53:45.457647+0000","last_clean":"2024-04-17T19:53:45.457647+0000","last_became_active":"2024-04-17T19:53:04.487005+0000","last_became_peered":"2024-04-17T19:53:04.487005+0000","last_unstale":"2024-04-17T19:53:45.457647+0000","last_undegraded":"2024-04-17T19:53:45.457647+0000","last_fullsized":"2024-04-17T19:53:45.457647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:53:36.130201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.451279+0000","last_change":"2024-04-17T19:53:09.547824+0000","last_active":"2024-04-17T19:53:45.451279+0000","last_peered":"2024-04-17T19:53:45.451279+0000","last_clean":"2024-04-17T19:53:45.451279+0000","last_became_active":"2024-04-17T19:53:09.545636+0000","last_became_peered":"2024-04-17T19:53:09.545636+0000","last_unstale":"2024-04-17T19:53:45.451279+0000","last_undegraded":"2024-04-17T19:53:45.451279+0000","last_fullsized":"2024-04-17T19:53:45.451279+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:06:17.885652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.447639+0000","last_change":"2024-04-17T19:53:05.465820+0000","last_active":"2024-04-17T19:53:45.447639+0000","last_peered":"2024-04-17T19:53:45.447639+0000","last_clean":"2024-04-17T19:53:45.447639+0000","last_became_active":"2024-04-17T19:53:05.464376+0000","last_became_peered":"2024-04-17T19:53:05.464376+0000","last_unstale":"2024-04-17T19:53:45.447639+0000","last_undegraded":"2024-04-17T19:53:45.447639+0000","last_fullsized":"2024-04-17T19:53:45.447639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:53:13.956259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.567378+0000","last_change":"2024-04-17T19:53:04.464706+0000","last_active":"2024-04-17T19:53:45.567378+0000","last_peered":"2024-04-17T19:53:45.567378+0000","last_clean":"2024-04-17T19:53:45.567378+0000","last_became_active":"2024-04-17T19:53:04.464109+0000","last_became_peered":"2024-04-17T19:53:04.464109+0000","last_unstale":"2024-04-17T19:53:45.567378+0000","last_undegraded":"2024-04-17T19:53:45.567378+0000","last_fullsized":"2024-04-17T19:53:45.567378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:38:40.499868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452114+0000","last_change":"2024-04-17T19:53:09.553078+0000","last_active":"2024-04-17T19:53:45.452114+0000","last_peered":"2024-04-17T19:53:45.452114+0000","last_clean":"2024-04-17T19:53:45.452114+0000","last_became_active":"2024-04-17T19:53:09.548806+0000","last_became_peered":"2024-04-17T19:53:09.548806+0000","last_unstale":"2024-04-17T19:53:45.452114+0000","last_undegraded":"2024-04-17T19:53:45.452114+0000","last_fullsized":"2024-04-17T19:53:45.452114+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:33:37.250066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452511+0000","last_change":"2024-04-17T19:53:05.476631+0000","last_active":"2024-04-17T19:53:45.452511+0000","last_peered":"2024-04-17T19:53:45.452511+0000","last_clean":"2024-04-17T19:53:45.452511+0000","last_became_active":"2024-04-17T19:53:05.474164+0000","last_became_peered":"2024-04-17T19:53:05.474164+0000","last_unstale":"2024-04-17T19:53:45.452511+0000","last_undegraded":"2024-04-17T19:53:45.452511+0000","last_fullsized":"2024-04-17T19:53:45.452511+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:53:13.956259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.585125+0000","last_change":"2024-04-17T19:53:04.486117+0000","last_active":"2024-04-17T19:53:45.585125+0000","last_peered":"2024-04-17T19:53:45.585125+0000","last_clean":"2024-04-17T19:53:45.585125+0000","last_became_active":"2024-04-17T19:53:04.485424+0000","last_became_peered":"2024-04-17T19:53:04.485424+0000","last_unstale":"2024-04-17T19:53:45.585125+0000","last_undegraded":"2024-04-17T19:53:45.585125+0000","last_fullsized":"2024-04-17T19:53:45.585125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:21:45.875274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.457318+0000","last_change":"2024-04-17T19:53:09.549846+0000","last_active":"2024-04-17T19:53:45.457318+0000","last_peered":"2024-04-17T19:53:45.457318+0000","last_clean":"2024-04-17T19:53:45.457318+0000","last_became_active":"2024-04-17T19:53:09.548070+0000","last_became_peered":"2024-04-17T19:53:09.548070+0000","last_unstale":"2024-04-17T19:53:45.457318+0000","last_undegraded":"2024-04-17T19:53:45.457318+0000","last_fullsized":"2024-04-17T19:53:45.457318+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:05.469665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452883+0000","last_change":"2024-04-17T19:53:05.469993+0000","last_active":"2024-04-17T19:53:45.452883+0000","last_peered":"2024-04-17T19:53:45.452883+0000","last_clean":"2024-04-17T19:53:45.452883+0000","last_became_active":"2024-04-17T19:53:05.468241+0000","last_became_peered":"2024-04-17T19:53:05.468241+0000","last_unstale":"2024-04-17T19:53:45.452883+0000","last_undegraded":"2024-04-17T19:53:45.452883+0000","last_fullsized":"2024-04-17T19:53:45.452883+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:39:15.005822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.565089+0000","last_change":"2024-04-17T19:53:04.484259+0000","last_active":"2024-04-17T19:53:45.565089+0000","last_peered":"2024-04-17T19:53:45.565089+0000","last_clean":"2024-04-17T19:53:45.565089+0000","last_became_active":"2024-04-17T19:53:04.483882+0000","last_became_peered":"2024-04-17T19:53:04.483882+0000","last_unstale":"2024-04-17T19:53:45.565089+0000","last_undegraded":"2024-04-17T19:53:45.565089+0000","last_fullsized":"2024-04-17T19:53:45.565089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:18:11.256327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.460808+0000","last_change":"2024-04-17T19:53:09.559932+0000","last_active":"2024-04-17T19:53:45.460808+0000","last_peered":"2024-04-17T19:53:45.460808+0000","last_clean":"2024-04-17T19:53:45.460808+0000","last_became_active":"2024-04-17T19:53:09.558888+0000","last_became_peered":"2024-04-17T19:53:09.558888+0000","last_unstale":"2024-04-17T19:53:45.460808+0000","last_undegraded":"2024-04-17T19:53:45.460808+0000","last_fullsized":"2024-04-17T19:53:45.460808+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:22:59.388953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452018+0000","last_change":"2024-04-17T19:53:05.463658+0000","last_active":"2024-04-17T19:53:45.452018+0000","last_peered":"2024-04-17T19:53:45.452018+0000","last_clean":"2024-04-17T19:53:45.452018+0000","last_became_active":"2024-04-17T19:53:05.462437+0000","last_became_peered":"2024-04-17T19:53:05.462437+0000","last_unstale":"2024-04-17T19:53:45.452018+0000","last_undegraded":"2024-04-17T19:53:45.452018+0000","last_fullsized":"2024-04-17T19:53:45.452018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:06:14.699788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.566591+0000","last_change":"2024-04-17T19:53:04.459172+0000","last_active":"2024-04-17T19:53:45.566591+0000","last_peered":"2024-04-17T19:53:45.566591+0000","last_clean":"2024-04-17T19:53:45.566591+0000","last_became_active":"2024-04-17T19:53:04.458798+0000","last_became_peered":"2024-04-17T19:53:04.458798+0000","last_unstale":"2024-04-17T19:53:45.566591+0000","last_undegraded":"2024-04-17T19:53:45.566591+0000","last_fullsized":"2024-04-17T19:53:45.566591+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:21:36.152247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":181,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.580414+0000","last_change":"2024-04-17T19:52:54.651873+0000","last_active":"2024-04-17T19:53:45.580414+0000","last_peered":"2024-04-17T19:53:45.580414+0000","last_clean":"2024-04-17T19:53:45.580414+0000","last_became_active":"2024-04-17T19:52:54.649700+0000","last_became_peered":"2024-04-17T19:52:54.649700+0000","last_unstale":"2024-04-17T19:53:45.580414+0000","last_undegraded":"2024-04-17T19:53:45.580414+0000","last_fullsized":"2024-04-17T19:53:45.580414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:52:53.245174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:52:53.245174+0000","last_clean_scrub_stamp":"2024-04-17T19:52:53.245174+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:26:16.094093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.468715+0000","last_change":"2024-04-17T19:53:45.466468+0000","last_active":"2024-04-17T19:53:45.468715+0000","last_peered":"2024-04-17T19:53:45.468715+0000","last_clean":"2024-04-17T19:53:45.468715+0000","last_became_active":"2024-04-17T19:53:45.464724+0000","last_became_peered":"2024-04-17T19:53:45.464724+0000","last_unstale":"2024-04-17T19:53:45.468715+0000","last_undegraded":"2024-04-17T19:53:45.468715+0000","last_fullsized":"2024-04-17T19:53:45.468715+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:07:11.268705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,2,0],"acting":[4,5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.566911+0000","last_change":"2024-04-17T19:53:05.475968+0000","last_active":"2024-04-17T19:53:45.566911+0000","last_peered":"2024-04-17T19:53:45.566911+0000","last_clean":"2024-04-17T19:53:45.566911+0000","last_became_active":"2024-04-17T19:53:05.475600+0000","last_became_peered":"2024-04-17T19:53:05.475600+0000","last_unstale":"2024-04-17T19:53:45.566911+0000","last_undegraded":"2024-04-17T19:53:45.566911+0000","last_fullsized":"2024-04-17T19:53:45.566911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:34:03.644428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452962+0000","last_change":"2024-04-17T19:53:04.457214+0000","last_active":"2024-04-17T19:53:45.452962+0000","last_peered":"2024-04-17T19:53:45.452962+0000","last_clean":"2024-04-17T19:53:45.452962+0000","last_became_active":"2024-04-17T19:53:04.453473+0000","last_became_peered":"2024-04-17T19:53:04.453473+0000","last_unstale":"2024-04-17T19:53:45.452962+0000","last_undegraded":"2024-04-17T19:53:45.452962+0000","last_fullsized":"2024-04-17T19:53:45.452962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:14:03.008171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.450160+0000","last_change":"2024-04-17T19:53:09.548981+0000","last_active":"2024-04-17T19:53:45.450160+0000","last_peered":"2024-04-17T19:53:45.450160+0000","last_clean":"2024-04-17T19:53:45.450160+0000","last_became_active":"2024-04-17T19:53:09.548575+0000","last_became_peered":"2024-04-17T19:53:09.548575+0000","last_unstale":"2024-04-17T19:53:45.450160+0000","last_undegraded":"2024-04-17T19:53:45.450160+0000","last_fullsized":"2024-04-17T19:53:45.450160+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:05:25.218656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.448148+0000","last_change":"2024-04-17T19:53:05.464697+0000","last_active":"2024-04-17T19:53:45.448148+0000","last_peered":"2024-04-17T19:53:45.448148+0000","last_clean":"2024-04-17T19:53:45.448148+0000","last_became_active":"2024-04-17T19:53:05.463935+0000","last_became_peered":"2024-04-17T19:53:05.463935+0000","last_unstale":"2024-04-17T19:53:45.448148+0000","last_undegraded":"2024-04-17T19:53:45.448148+0000","last_fullsized":"2024-04-17T19:53:45.448148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:15:45.727550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.461105+0000","last_change":"2024-04-17T19:53:04.475555+0000","last_active":"2024-04-17T19:53:45.461105+0000","last_peered":"2024-04-17T19:53:45.461105+0000","last_clean":"2024-04-17T19:53:45.461105+0000","last_became_active":"2024-04-17T19:53:04.467881+0000","last_became_peered":"2024-04-17T19:53:04.467881+0000","last_unstale":"2024-04-17T19:53:45.461105+0000","last_undegraded":"2024-04-17T19:53:45.461105+0000","last_fullsized":"2024-04-17T19:53:45.461105+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:22:17.837334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.457150+0000","last_change":"2024-04-17T19:53:09.535560+0000","last_active":"2024-04-17T19:53:45.457150+0000","last_peered":"2024-04-17T19:53:45.457150+0000","last_clean":"2024-04-17T19:53:45.457150+0000","last_became_active":"2024-04-17T19:53:09.534631+0000","last_became_peered":"2024-04-17T19:53:09.534631+0000","last_unstale":"2024-04-17T19:53:45.457150+0000","last_undegraded":"2024-04-17T19:53:45.457150+0000","last_fullsized":"2024-04-17T19:53:45.457150+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:30:27.062045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.449100+0000","last_change":"2024-04-17T19:53:05.460324+0000","last_active":"2024-04-17T19:53:45.449100+0000","last_peered":"2024-04-17T19:53:45.449100+0000","last_clean":"2024-04-17T19:53:45.449100+0000","last_became_active":"2024-04-17T19:53:05.459941+0000","last_became_peered":"2024-04-17T19:53:05.459941+0000","last_unstale":"2024-04-17T19:53:45.449100+0000","last_undegraded":"2024-04-17T19:53:45.449100+0000","last_fullsized":"2024-04-17T19:53:45.449100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:34:03.644428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.453037+0000","last_change":"2024-04-17T19:53:04.467765+0000","last_active":"2024-04-17T19:53:45.453037+0000","last_peered":"2024-04-17T19:53:45.453037+0000","last_clean":"2024-04-17T19:53:45.453037+0000","last_became_active":"2024-04-17T19:53:04.466753+0000","last_became_peered":"2024-04-17T19:53:04.466753+0000","last_unstale":"2024-04-17T19:53:45.453037+0000","last_undegraded":"2024-04-17T19:53:45.453037+0000","last_fullsized":"2024-04-17T19:53:45.453037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:53:36.130201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.564913+0000","last_change":"2024-04-17T19:53:09.519632+0000","last_active":"2024-04-17T19:53:45.564913+0000","last_peered":"2024-04-17T19:53:45.564913+0000","last_clean":"2024-04-17T19:53:45.564913+0000","last_became_active":"2024-04-17T19:53:09.518979+0000","last_became_peered":"2024-04-17T19:53:09.518979+0000","last_unstale":"2024-04-17T19:53:45.564913+0000","last_undegraded":"2024-04-17T19:53:45.564913+0000","last_fullsized":"2024-04-17T19:53:45.564913+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:07:11.268705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.451403+0000","last_change":"2024-04-17T19:53:05.464583+0000","last_active":"2024-04-17T19:53:45.451403+0000","last_peered":"2024-04-17T19:53:45.451403+0000","last_clean":"2024-04-17T19:53:45.451403+0000","last_became_active":"2024-04-17T19:53:05.464158+0000","last_became_peered":"2024-04-17T19:53:05.464158+0000","last_unstale":"2024-04-17T19:53:45.451403+0000","last_undegraded":"2024-04-17T19:53:45.451403+0000","last_fullsized":"2024-04-17T19:53:45.451403+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:38:41.511185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.449354+0000","last_change":"2024-04-17T19:53:04.477502+0000","last_active":"2024-04-17T19:53:45.449354+0000","last_peered":"2024-04-17T19:53:45.449354+0000","last_clean":"2024-04-17T19:53:45.449354+0000","last_became_active":"2024-04-17T19:53:04.477162+0000","last_became_peered":"2024-04-17T19:53:04.477162+0000","last_unstale":"2024-04-17T19:53:45.449354+0000","last_undegraded":"2024-04-17T19:53:45.449354+0000","last_fullsized":"2024-04-17T19:53:45.449354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:21:36.152247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.580275+0000","last_change":"2024-04-17T19:53:09.533476+0000","last_active":"2024-04-17T19:53:45.580275+0000","last_peered":"2024-04-17T19:53:45.580275+0000","last_clean":"2024-04-17T19:53:45.580275+0000","last_became_active":"2024-04-17T19:53:09.532715+0000","last_became_peered":"2024-04-17T19:53:09.532715+0000","last_unstale":"2024-04-17T19:53:45.580275+0000","last_undegraded":"2024-04-17T19:53:45.580275+0000","last_fullsized":"2024-04-17T19:53:45.580275+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:38:45.556791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.564867+0000","last_change":"2024-04-17T19:53:05.473330+0000","last_active":"2024-04-17T19:53:45.564867+0000","last_peered":"2024-04-17T19:53:45.564867+0000","last_clean":"2024-04-17T19:53:45.564867+0000","last_became_active":"2024-04-17T19:53:05.468223+0000","last_became_peered":"2024-04-17T19:53:05.468223+0000","last_unstale":"2024-04-17T19:53:45.564867+0000","last_undegraded":"2024-04-17T19:53:45.564867+0000","last_fullsized":"2024-04-17T19:53:45.564867+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:01:34.461822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452279+0000","last_change":"2024-04-17T19:53:04.461896+0000","last_active":"2024-04-17T19:53:45.452279+0000","last_peered":"2024-04-17T19:53:45.452279+0000","last_clean":"2024-04-17T19:53:45.452279+0000","last_became_active":"2024-04-17T19:53:04.460919+0000","last_became_peered":"2024-04-17T19:53:04.460919+0000","last_unstale":"2024-04-17T19:53:45.452279+0000","last_undegraded":"2024-04-17T19:53:45.452279+0000","last_fullsized":"2024-04-17T19:53:45.452279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:22:17.837334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.461171+0000","last_change":"2024-04-17T19:53:09.547397+0000","last_active":"2024-04-17T19:53:45.461171+0000","last_peered":"2024-04-17T19:53:45.461171+0000","last_clean":"2024-04-17T19:53:45.461171+0000","last_became_active":"2024-04-17T19:53:09.546048+0000","last_became_peered":"2024-04-17T19:53:09.546048+0000","last_unstale":"2024-04-17T19:53:45.461171+0000","last_undegraded":"2024-04-17T19:53:45.461171+0000","last_fullsized":"2024-04-17T19:53:45.461171+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:58:59.810415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.579920+0000","last_change":"2024-04-17T19:53:05.474322+0000","last_active":"2024-04-17T19:53:45.579920+0000","last_peered":"2024-04-17T19:53:45.579920+0000","last_clean":"2024-04-17T19:53:45.579920+0000","last_became_active":"2024-04-17T19:53:05.473892+0000","last_became_peered":"2024-04-17T19:53:05.473892+0000","last_unstale":"2024-04-17T19:53:45.579920+0000","last_undegraded":"2024-04-17T19:53:45.579920+0000","last_fullsized":"2024-04-17T19:53:45.579920+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:18:12.267644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.447293+0000","last_change":"2024-04-17T19:53:04.460138+0000","last_active":"2024-04-17T19:53:45.447293+0000","last_peered":"2024-04-17T19:53:45.447293+0000","last_clean":"2024-04-17T19:53:45.447293+0000","last_became_active":"2024-04-17T19:53:04.459663+0000","last_became_peered":"2024-04-17T19:53:04.459663+0000","last_unstale":"2024-04-17T19:53:45.447293+0000","last_undegraded":"2024-04-17T19:53:45.447293+0000","last_fullsized":"2024-04-17T19:53:45.447293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:06:00.469757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.459601+0000","last_change":"2024-04-17T19:53:09.533802+0000","last_active":"2024-04-17T19:53:45.459601+0000","last_peered":"2024-04-17T19:53:45.459601+0000","last_clean":"2024-04-17T19:53:45.459601+0000","last_became_active":"2024-04-17T19:53:09.532504+0000","last_became_peered":"2024-04-17T19:53:09.532504+0000","last_unstale":"2024-04-17T19:53:45.459601+0000","last_undegraded":"2024-04-17T19:53:45.459601+0000","last_fullsized":"2024-04-17T19:53:45.459601+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:04:59.171017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.566317+0000","last_change":"2024-04-17T19:53:05.467855+0000","last_active":"2024-04-17T19:53:45.566317+0000","last_peered":"2024-04-17T19:53:45.566317+0000","last_clean":"2024-04-17T19:53:45.566317+0000","last_became_active":"2024-04-17T19:53:05.467349+0000","last_became_peered":"2024-04-17T19:53:05.467349+0000","last_unstale":"2024-04-17T19:53:45.566317+0000","last_undegraded":"2024-04-17T19:53:45.566317+0000","last_fullsized":"2024-04-17T19:53:45.566317+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:52:55.878755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.567245+0000","last_change":"2024-04-17T19:53:04.465826+0000","last_active":"2024-04-17T19:53:45.567245+0000","last_peered":"2024-04-17T19:53:45.567245+0000","last_clean":"2024-04-17T19:53:45.567245+0000","last_became_active":"2024-04-17T19:53:04.465333+0000","last_became_peered":"2024-04-17T19:53:04.465333+0000","last_unstale":"2024-04-17T19:53:45.567245+0000","last_undegraded":"2024-04-17T19:53:45.567245+0000","last_fullsized":"2024-04-17T19:53:45.567245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:25:21.542158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.451925+0000","last_change":"2024-04-17T19:53:09.550127+0000","last_active":"2024-04-17T19:53:45.451925+0000","last_peered":"2024-04-17T19:53:45.451925+0000","last_clean":"2024-04-17T19:53:45.451925+0000","last_became_active":"2024-04-17T19:53:09.548109+0000","last_became_peered":"2024-04-17T19:53:09.548109+0000","last_unstale":"2024-04-17T19:53:45.451925+0000","last_undegraded":"2024-04-17T19:53:45.451925+0000","last_fullsized":"2024-04-17T19:53:45.451925+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:03:47.252621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452197+0000","last_change":"2024-04-17T19:53:05.455185+0000","last_active":"2024-04-17T19:53:45.452197+0000","last_peered":"2024-04-17T19:53:45.452197+0000","last_clean":"2024-04-17T19:53:45.452197+0000","last_became_active":"2024-04-17T19:53:05.454358+0000","last_became_peered":"2024-04-17T19:53:05.454358+0000","last_unstale":"2024-04-17T19:53:45.452197+0000","last_undegraded":"2024-04-17T19:53:45.452197+0000","last_fullsized":"2024-04-17T19:53:45.452197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:26:54.093651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.586332+0000","last_change":"2024-04-17T19:53:04.474288+0000","last_active":"2024-04-17T19:53:45.586332+0000","last_peered":"2024-04-17T19:53:45.586332+0000","last_clean":"2024-04-17T19:53:45.586332+0000","last_became_active":"2024-04-17T19:53:04.473389+0000","last_became_peered":"2024-04-17T19:53:04.473389+0000","last_unstale":"2024-04-17T19:53:45.586332+0000","last_undegraded":"2024-04-17T19:53:45.586332+0000","last_fullsized":"2024-04-17T19:53:45.586332+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:31:27.754909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.566775+0000","last_change":"2024-04-17T19:53:09.524630+0000","last_active":"2024-04-17T19:53:45.566775+0000","last_peered":"2024-04-17T19:53:45.566775+0000","last_clean":"2024-04-17T19:53:45.566775+0000","last_became_active":"2024-04-17T19:53:09.521522+0000","last_became_peered":"2024-04-17T19:53:09.521522+0000","last_unstale":"2024-04-17T19:53:45.566775+0000","last_undegraded":"2024-04-17T19:53:45.566775+0000","last_fullsized":"2024-04-17T19:53:45.566775+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:59:47.402073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.448592+0000","last_change":"2024-04-17T19:53:05.455865+0000","last_active":"2024-04-17T19:53:45.448592+0000","last_peered":"2024-04-17T19:53:45.448592+0000","last_clean":"2024-04-17T19:53:45.448592+0000","last_became_active":"2024-04-17T19:53:05.455429+0000","last_became_peered":"2024-04-17T19:53:05.455429+0000","last_unstale":"2024-04-17T19:53:45.448592+0000","last_undegraded":"2024-04-17T19:53:45.448592+0000","last_fullsized":"2024-04-17T19:53:45.448592+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:01:34.461822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"29'20","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:14.279048+0000","last_change":"2024-04-17T19:53:04.460295+0000","last_active":"2024-04-17T19:54:14.279048+0000","last_peered":"2024-04-17T19:54:14.279048+0000","last_clean":"2024-04-17T19:54:14.279048+0000","last_became_active":"2024-04-17T19:53:04.459855+0000","last_became_peered":"2024-04-17T19:53:04.459855+0000","last_unstale":"2024-04-17T19:54:14.279048+0000","last_undegraded":"2024-04-17T19:54:14.279048+0000","last_fullsized":"2024-04-17T19:54:14.279048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:21:45.875274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6029,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.451349+0000","last_change":"2024-04-17T19:53:09.530008+0000","last_active":"2024-04-17T19:53:45.451349+0000","last_peered":"2024-04-17T19:53:45.451349+0000","last_clean":"2024-04-17T19:53:45.451349+0000","last_became_active":"2024-04-17T19:53:09.528987+0000","last_became_peered":"2024-04-17T19:53:09.528987+0000","last_unstale":"2024-04-17T19:53:45.451349+0000","last_undegraded":"2024-04-17T19:53:45.451349+0000","last_fullsized":"2024-04-17T19:53:45.451349+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:34:07.690034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.564991+0000","last_change":"2024-04-17T19:53:05.472755+0000","last_active":"2024-04-17T19:53:45.564991+0000","last_peered":"2024-04-17T19:53:45.564991+0000","last_clean":"2024-04-17T19:53:45.564991+0000","last_became_active":"2024-04-17T19:53:05.468432+0000","last_became_peered":"2024-04-17T19:53:05.468432+0000","last_unstale":"2024-04-17T19:53:45.564991+0000","last_undegraded":"2024-04-17T19:53:45.564991+0000","last_fullsized":"2024-04-17T19:53:45.564991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:30:23.016439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.587107+0000","last_change":"2024-04-17T19:53:04.474378+0000","last_active":"2024-04-17T19:53:45.587107+0000","last_peered":"2024-04-17T19:53:45.587107+0000","last_clean":"2024-04-17T19:53:45.587107+0000","last_became_active":"2024-04-17T19:53:04.473458+0000","last_became_peered":"2024-04-17T19:53:04.473458+0000","last_unstale":"2024-04-17T19:53:45.587107+0000","last_undegraded":"2024-04-17T19:53:45.587107+0000","last_fullsized":"2024-04-17T19:53:45.587107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:16:30.888573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.450618+0000","last_change":"2024-04-17T19:53:09.558527+0000","last_active":"2024-04-17T19:53:45.450618+0000","last_peered":"2024-04-17T19:53:45.450618+0000","last_clean":"2024-04-17T19:53:45.450618+0000","last_became_active":"2024-04-17T19:53:09.557653+0000","last_became_peered":"2024-04-17T19:53:09.557653+0000","last_unstale":"2024-04-17T19:53:45.450618+0000","last_undegraded":"2024-04-17T19:53:45.450618+0000","last_fullsized":"2024-04-17T19:53:45.450618+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:01:38.507428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.460152+0000","last_change":"2024-04-17T19:53:05.467990+0000","last_active":"2024-04-17T19:53:45.460152+0000","last_peered":"2024-04-17T19:53:45.460152+0000","last_clean":"2024-04-17T19:53:45.460152+0000","last_became_active":"2024-04-17T19:53:05.461293+0000","last_became_peered":"2024-04-17T19:53:05.461293+0000","last_unstale":"2024-04-17T19:53:45.460152+0000","last_undegraded":"2024-04-17T19:53:45.460152+0000","last_fullsized":"2024-04-17T19:53:45.460152+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:01:34.461822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.449080+0000","last_change":"2024-04-17T19:53:04.472928+0000","last_active":"2024-04-17T19:53:45.449080+0000","last_peered":"2024-04-17T19:53:45.449080+0000","last_clean":"2024-04-17T19:53:45.449080+0000","last_became_active":"2024-04-17T19:53:04.467986+0000","last_became_peered":"2024-04-17T19:53:04.467986+0000","last_unstale":"2024-04-17T19:53:45.449080+0000","last_undegraded":"2024-04-17T19:53:45.449080+0000","last_fullsized":"2024-04-17T19:53:45.449080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:53:36.130201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.584286+0000","last_change":"2024-04-17T19:53:09.560792+0000","last_active":"2024-04-17T19:53:45.584286+0000","last_peered":"2024-04-17T19:53:45.584286+0000","last_clean":"2024-04-17T19:53:45.584286+0000","last_became_active":"2024-04-17T19:53:09.558779+0000","last_became_peered":"2024-04-17T19:53:09.558779+0000","last_unstale":"2024-04-17T19:53:45.584286+0000","last_undegraded":"2024-04-17T19:53:45.584286+0000","last_fullsized":"2024-04-17T19:53:45.584286+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:13:52.775623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.451247+0000","last_change":"2024-04-17T19:53:05.459934+0000","last_active":"2024-04-17T19:53:45.451247+0000","last_peered":"2024-04-17T19:53:45.451247+0000","last_clean":"2024-04-17T19:53:45.451247+0000","last_became_active":"2024-04-17T19:53:05.459538+0000","last_became_peered":"2024-04-17T19:53:05.459538+0000","last_unstale":"2024-04-17T19:53:45.451247+0000","last_undegraded":"2024-04-17T19:53:45.451247+0000","last_fullsized":"2024-04-17T19:53:45.451247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:25:22.553475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.581377+0000","last_change":"2024-04-17T19:53:04.460345+0000","last_active":"2024-04-17T19:53:45.581377+0000","last_peered":"2024-04-17T19:53:45.581377+0000","last_clean":"2024-04-17T19:53:45.581377+0000","last_became_active":"2024-04-17T19:53:04.459787+0000","last_became_peered":"2024-04-17T19:53:04.459787+0000","last_unstale":"2024-04-17T19:53:45.581377+0000","last_undegraded":"2024-04-17T19:53:45.581377+0000","last_fullsized":"2024-04-17T19:53:45.581377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:16:30.888573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.589100+0000","last_change":"2024-04-17T19:53:45.589100+0000","last_active":"2024-04-17T19:53:45.589100+0000","last_peered":"2024-04-17T19:53:45.589100+0000","last_clean":"2024-04-17T19:53:45.589100+0000","last_became_active":"2024-04-17T19:53:45.587729+0000","last_became_peered":"2024-04-17T19:53:45.587729+0000","last_unstale":"2024-04-17T19:53:45.589100+0000","last_undegraded":"2024-04-17T19:53:45.589100+0000","last_fullsized":"2024-04-17T19:53:45.589100+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:47:26.887721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,7],"acting":[4,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452474+0000","last_change":"2024-04-17T19:53:09.536930+0000","last_active":"2024-04-17T19:53:45.452474+0000","last_peered":"2024-04-17T19:53:45.452474+0000","last_clean":"2024-04-17T19:53:45.452474+0000","last_became_active":"2024-04-17T19:53:09.535559+0000","last_became_peered":"2024-04-17T19:53:09.535559+0000","last_unstale":"2024-04-17T19:53:45.452474+0000","last_undegraded":"2024-04-17T19:53:45.452474+0000","last_fullsized":"2024-04-17T19:53:45.452474+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:29:54.335720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.459931+0000","last_change":"2024-04-17T19:53:05.440653+0000","last_active":"2024-04-17T19:53:45.459931+0000","last_peered":"2024-04-17T19:53:45.459931+0000","last_clean":"2024-04-17T19:53:45.459931+0000","last_became_active":"2024-04-17T19:53:05.439793+0000","last_became_peered":"2024-04-17T19:53:05.439793+0000","last_unstale":"2024-04-17T19:53:45.459931+0000","last_undegraded":"2024-04-17T19:53:45.459931+0000","last_fullsized":"2024-04-17T19:53:45.459931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:10:21.772873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.565078+0000","last_change":"2024-04-17T19:53:04.461705+0000","last_active":"2024-04-17T19:53:45.565078+0000","last_peered":"2024-04-17T19:53:45.565078+0000","last_clean":"2024-04-17T19:53:45.565078+0000","last_became_active":"2024-04-17T19:53:04.461020+0000","last_became_peered":"2024-04-17T19:53:04.461020+0000","last_unstale":"2024-04-17T19:53:45.565078+0000","last_undegraded":"2024-04-17T19:53:45.565078+0000","last_fullsized":"2024-04-17T19:53:45.565078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:53:36.130201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.566746+0000","last_change":"2024-04-17T19:53:09.535147+0000","last_active":"2024-04-17T19:53:45.566746+0000","last_peered":"2024-04-17T19:53:45.566746+0000","last_clean":"2024-04-17T19:53:45.566746+0000","last_became_active":"2024-04-17T19:53:09.534655+0000","last_became_peered":"2024-04-17T19:53:09.534655+0000","last_unstale":"2024-04-17T19:53:45.566746+0000","last_undegraded":"2024-04-17T19:53:45.566746+0000","last_fullsized":"2024-04-17T19:53:45.566746+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:06:37.779654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452972+0000","last_change":"2024-04-17T19:53:05.455848+0000","last_active":"2024-04-17T19:53:45.452972+0000","last_peered":"2024-04-17T19:53:45.452972+0000","last_clean":"2024-04-17T19:53:45.452972+0000","last_became_active":"2024-04-17T19:53:05.452844+0000","last_became_peered":"2024-04-17T19:53:05.452844+0000","last_unstale":"2024-04-17T19:53:45.452972+0000","last_undegraded":"2024-04-17T19:53:45.452972+0000","last_fullsized":"2024-04-17T19:53:45.452972+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:54:27.523970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.453145+0000","last_change":"2024-04-17T19:53:04.470824+0000","last_active":"2024-04-17T19:53:45.453145+0000","last_peered":"2024-04-17T19:53:45.453145+0000","last_clean":"2024-04-17T19:53:45.453145+0000","last_became_active":"2024-04-17T19:53:04.469777+0000","last_became_peered":"2024-04-17T19:53:04.469777+0000","last_unstale":"2024-04-17T19:53:45.453145+0000","last_undegraded":"2024-04-17T19:53:45.453145+0000","last_fullsized":"2024-04-17T19:53:45.453145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:30:04.861958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.567218+0000","last_change":"2024-04-17T19:53:04.469785+0000","last_active":"2024-04-17T19:53:45.567218+0000","last_peered":"2024-04-17T19:53:45.567218+0000","last_clean":"2024-04-17T19:53:45.567218+0000","last_became_active":"2024-04-17T19:53:04.469297+0000","last_became_peered":"2024-04-17T19:53:04.469297+0000","last_unstale":"2024-04-17T19:53:45.567218+0000","last_undegraded":"2024-04-17T19:53:45.567218+0000","last_fullsized":"2024-04-17T19:53:45.567218+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:50:02.697725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452825+0000","last_change":"2024-04-17T19:53:05.460191+0000","last_active":"2024-04-17T19:53:45.452825+0000","last_peered":"2024-04-17T19:53:45.452825+0000","last_clean":"2024-04-17T19:53:45.452825+0000","last_became_active":"2024-04-17T19:53:05.459616+0000","last_became_peered":"2024-04-17T19:53:05.459616+0000","last_unstale":"2024-04-17T19:53:45.452825+0000","last_undegraded":"2024-04-17T19:53:45.452825+0000","last_fullsized":"2024-04-17T19:53:45.452825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:12:15.307126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.464499+0000","last_change":"2024-04-17T19:53:45.464499+0000","last_active":"2024-04-17T19:53:45.464499+0000","last_peered":"2024-04-17T19:53:45.464499+0000","last_clean":"2024-04-17T19:53:45.464499+0000","last_became_active":"2024-04-17T19:53:45.462598+0000","last_became_peered":"2024-04-17T19:53:45.462598+0000","last_unstale":"2024-04-17T19:53:45.464499+0000","last_undegraded":"2024-04-17T19:53:45.464499+0000","last_fullsized":"2024-04-17T19:53:45.464499+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:27:35.519260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,2],"acting":[4,6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.458228+0000","last_change":"2024-04-17T19:53:04.487292+0000","last_active":"2024-04-17T19:53:45.458228+0000","last_peered":"2024-04-17T19:53:45.458228+0000","last_clean":"2024-04-17T19:53:45.458228+0000","last_became_active":"2024-04-17T19:53:04.486707+0000","last_became_peered":"2024-04-17T19:53:04.486707+0000","last_unstale":"2024-04-17T19:53:45.458228+0000","last_undegraded":"2024-04-17T19:53:45.458228+0000","last_fullsized":"2024-04-17T19:53:45.458228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:48:50.049562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.580306+0000","last_change":"2024-04-17T19:53:05.449319+0000","last_active":"2024-04-17T19:53:45.580306+0000","last_peered":"2024-04-17T19:53:45.580306+0000","last_clean":"2024-04-17T19:53:45.580306+0000","last_became_active":"2024-04-17T19:53:05.448374+0000","last_became_peered":"2024-04-17T19:53:05.448374+0000","last_unstale":"2024-04-17T19:53:45.580306+0000","last_undegraded":"2024-04-17T19:53:45.580306+0000","last_fullsized":"2024-04-17T19:53:45.580306+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:21:37.163564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.586836+0000","last_change":"2024-04-17T19:53:09.561127+0000","last_active":"2024-04-17T19:53:45.586836+0000","last_peered":"2024-04-17T19:53:45.586836+0000","last_clean":"2024-04-17T19:53:45.586836+0000","last_became_active":"2024-04-17T19:53:09.560076+0000","last_became_peered":"2024-04-17T19:53:09.560076+0000","last_unstale":"2024-04-17T19:53:45.586836+0000","last_undegraded":"2024-04-17T19:53:45.586836+0000","last_fullsized":"2024-04-17T19:53:45.586836+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:25:20.343613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.450144+0000","last_change":"2024-04-17T19:53:05.472665+0000","last_active":"2024-04-17T19:53:45.450144+0000","last_peered":"2024-04-17T19:53:45.450144+0000","last_clean":"2024-04-17T19:53:45.450144+0000","last_became_active":"2024-04-17T19:53:05.472324+0000","last_became_peered":"2024-04-17T19:53:05.472324+0000","last_unstale":"2024-04-17T19:53:45.450144+0000","last_undegraded":"2024-04-17T19:53:45.450144+0000","last_fullsized":"2024-04-17T19:53:45.450144+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:50:03.709043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.584932+0000","last_change":"2024-04-17T19:53:05.477190+0000","last_active":"2024-04-17T19:53:45.584932+0000","last_peered":"2024-04-17T19:53:45.584932+0000","last_clean":"2024-04-17T19:53:45.584932+0000","last_became_active":"2024-04-17T19:53:05.475823+0000","last_became_peered":"2024-04-17T19:53:05.475823+0000","last_unstale":"2024-04-17T19:53:45.584932+0000","last_undegraded":"2024-04-17T19:53:45.584932+0000","last_fullsized":"2024-04-17T19:53:45.584932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:53:37.141518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.564743+0000","last_change":"2024-04-17T19:53:05.453565+0000","last_active":"2024-04-17T19:53:45.564743+0000","last_peered":"2024-04-17T19:53:45.564743+0000","last_clean":"2024-04-17T19:53:45.564743+0000","last_became_active":"2024-04-17T19:53:05.453142+0000","last_became_peered":"2024-04-17T19:53:05.453142+0000","last_unstale":"2024-04-17T19:53:45.564743+0000","last_undegraded":"2024-04-17T19:53:45.564743+0000","last_fullsized":"2024-04-17T19:53:45.564743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:39:58.812875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.457952+0000","last_change":"2024-04-17T19:53:05.476450+0000","last_active":"2024-04-17T19:53:45.457952+0000","last_peered":"2024-04-17T19:53:45.457952+0000","last_clean":"2024-04-17T19:53:45.457952+0000","last_became_active":"2024-04-17T19:53:05.473931+0000","last_became_peered":"2024-04-17T19:53:05.473931+0000","last_unstale":"2024-04-17T19:53:45.457952+0000","last_undegraded":"2024-04-17T19:53:45.457952+0000","last_fullsized":"2024-04-17T19:53:45.457952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:10:21.772873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452420+0000","last_change":"2024-04-17T19:53:05.469653+0000","last_active":"2024-04-17T19:53:45.452420+0000","last_peered":"2024-04-17T19:53:45.452420+0000","last_clean":"2024-04-17T19:53:45.452420+0000","last_became_active":"2024-04-17T19:53:05.467838+0000","last_became_peered":"2024-04-17T19:53:05.467838+0000","last_unstale":"2024-04-17T19:53:45.452420+0000","last_undegraded":"2024-04-17T19:53:45.452420+0000","last_fullsized":"2024-04-17T19:53:45.452420+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:38:51.699072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.454087+0000","last_change":"2024-04-17T19:53:05.462678+0000","last_active":"2024-04-17T19:53:45.454087+0000","last_peered":"2024-04-17T19:53:45.454087+0000","last_clean":"2024-04-17T19:53:45.454087+0000","last_became_active":"2024-04-17T19:53:05.461829+0000","last_became_peered":"2024-04-17T19:53:05.461829+0000","last_unstale":"2024-04-17T19:53:45.454087+0000","last_undegraded":"2024-04-17T19:53:45.454087+0000","last_fullsized":"2024-04-17T19:53:45.454087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:03:53.876774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.451061+0000","last_change":"2024-04-17T19:53:05.465993+0000","last_active":"2024-04-17T19:53:45.451061+0000","last_peered":"2024-04-17T19:53:45.451061+0000","last_clean":"2024-04-17T19:53:45.451061+0000","last_became_active":"2024-04-17T19:53:05.465547+0000","last_became_peered":"2024-04-17T19:53:05.465547+0000","last_unstale":"2024-04-17T19:53:45.451061+0000","last_undegraded":"2024-04-17T19:53:45.451061+0000","last_fullsized":"2024-04-17T19:53:45.451061+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:12:03.449509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.459282+0000","last_change":"2024-04-17T19:53:05.477188+0000","last_active":"2024-04-17T19:53:45.459282+0000","last_peered":"2024-04-17T19:53:45.459282+0000","last_clean":"2024-04-17T19:53:45.459282+0000","last_became_active":"2024-04-17T19:53:05.474798+0000","last_became_peered":"2024-04-17T19:53:05.474798+0000","last_unstale":"2024-04-17T19:53:45.459282+0000","last_undegraded":"2024-04-17T19:53:45.459282+0000","last_fullsized":"2024-04-17T19:53:45.459282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:15:45.727550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.564722+0000","last_change":"2024-04-17T19:53:05.484009+0000","last_active":"2024-04-17T19:53:45.564722+0000","last_peered":"2024-04-17T19:53:45.564722+0000","last_clean":"2024-04-17T19:53:45.564722+0000","last_became_active":"2024-04-17T19:53:05.483664+0000","last_became_peered":"2024-04-17T19:53:05.483664+0000","last_unstale":"2024-04-17T19:53:45.564722+0000","last_undegraded":"2024-04-17T19:53:45.564722+0000","last_fullsized":"2024-04-17T19:53:45.564722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:47:05.354826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.456386+0000","last_change":"2024-04-17T19:53:05.466532+0000","last_active":"2024-04-17T19:53:45.456386+0000","last_peered":"2024-04-17T19:53:45.456386+0000","last_clean":"2024-04-17T19:53:45.456386+0000","last_became_active":"2024-04-17T19:53:05.465302+0000","last_became_peered":"2024-04-17T19:53:05.465302+0000","last_unstale":"2024-04-17T19:53:45.456386+0000","last_undegraded":"2024-04-17T19:53:45.456386+0000","last_fullsized":"2024-04-17T19:53:45.456386+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:27:51.520335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.579924+0000","last_change":"2024-04-17T19:53:05.456313+0000","last_active":"2024-04-17T19:53:45.579924+0000","last_peered":"2024-04-17T19:53:45.579924+0000","last_clean":"2024-04-17T19:53:45.579924+0000","last_became_active":"2024-04-17T19:53:05.455862+0000","last_became_peered":"2024-04-17T19:53:05.455862+0000","last_unstale":"2024-04-17T19:53:45.579924+0000","last_undegraded":"2024-04-17T19:53:45.579924+0000","last_fullsized":"2024-04-17T19:53:45.579924+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:23:03.879786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452546+0000","last_change":"2024-04-17T19:53:05.465083+0000","last_active":"2024-04-17T19:53:45.452546+0000","last_peered":"2024-04-17T19:53:45.452546+0000","last_clean":"2024-04-17T19:53:45.452546+0000","last_became_active":"2024-04-17T19:53:05.463806+0000","last_became_peered":"2024-04-17T19:53:05.463806+0000","last_unstale":"2024-04-17T19:53:45.452546+0000","last_undegraded":"2024-04-17T19:53:45.452546+0000","last_fullsized":"2024-04-17T19:53:45.452546+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:25:16.298007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.448031+0000","last_change":"2024-04-17T19:53:05.464340+0000","last_active":"2024-04-17T19:53:45.448031+0000","last_peered":"2024-04-17T19:53:45.448031+0000","last_clean":"2024-04-17T19:53:45.448031+0000","last_became_active":"2024-04-17T19:53:05.463286+0000","last_became_peered":"2024-04-17T19:53:05.463286+0000","last_unstale":"2024-04-17T19:53:45.448031+0000","last_undegraded":"2024-04-17T19:53:45.448031+0000","last_fullsized":"2024-04-17T19:53:45.448031+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:54:27.523970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.565133+0000","last_change":"2024-04-17T19:53:05.475791+0000","last_active":"2024-04-17T19:53:45.565133+0000","last_peered":"2024-04-17T19:53:45.565133+0000","last_clean":"2024-04-17T19:53:45.565133+0000","last_became_active":"2024-04-17T19:53:05.475372+0000","last_became_peered":"2024-04-17T19:53:05.475372+0000","last_unstale":"2024-04-17T19:53:45.565133+0000","last_undegraded":"2024-04-17T19:53:45.565133+0000","last_fullsized":"2024-04-17T19:53:45.565133+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:10:32.839503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.582332+0000","last_change":"2024-04-17T19:53:05.496650+0000","last_active":"2024-04-17T19:53:45.582332+0000","last_peered":"2024-04-17T19:53:45.582332+0000","last_clean":"2024-04-17T19:53:45.582332+0000","last_became_active":"2024-04-17T19:53:05.495881+0000","last_became_peered":"2024-04-17T19:53:05.495881+0000","last_unstale":"2024-04-17T19:53:45.582332+0000","last_undegraded":"2024-04-17T19:53:45.582332+0000","last_fullsized":"2024-04-17T19:53:45.582332+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:23:03.879786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.565817+0000","last_change":"2024-04-17T19:53:05.461335+0000","last_active":"2024-04-17T19:53:45.565817+0000","last_peered":"2024-04-17T19:53:45.565817+0000","last_clean":"2024-04-17T19:53:45.565817+0000","last_became_active":"2024-04-17T19:53:05.460831+0000","last_became_peered":"2024-04-17T19:53:05.460831+0000","last_unstale":"2024-04-17T19:53:45.565817+0000","last_undegraded":"2024-04-17T19:53:45.565817+0000","last_fullsized":"2024-04-17T19:53:45.565817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:22:55.343347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.564726+0000","last_change":"2024-04-17T19:53:05.473875+0000","last_active":"2024-04-17T19:53:45.564726+0000","last_peered":"2024-04-17T19:53:45.564726+0000","last_clean":"2024-04-17T19:53:45.564726+0000","last_became_active":"2024-04-17T19:53:05.467366+0000","last_became_peered":"2024-04-17T19:53:05.467366+0000","last_unstale":"2024-04-17T19:53:45.564726+0000","last_undegraded":"2024-04-17T19:53:45.564726+0000","last_fullsized":"2024-04-17T19:53:45.564726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:05:21.173050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.588365+0000","last_change":"2024-04-17T19:53:45.588365+0000","last_active":"2024-04-17T19:53:45.588365+0000","last_peered":"2024-04-17T19:53:45.588365+0000","last_clean":"2024-04-17T19:53:45.588365+0000","last_became_active":"2024-04-17T19:53:45.587213+0000","last_became_peered":"2024-04-17T19:53:45.587213+0000","last_unstale":"2024-04-17T19:53:45.588365+0000","last_undegraded":"2024-04-17T19:53:45.588365+0000","last_fullsized":"2024-04-17T19:53:45.588365+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:25:48.397875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.451842+0000","last_change":"2024-04-17T19:53:05.465968+0000","last_active":"2024-04-17T19:53:45.451842+0000","last_peered":"2024-04-17T19:53:45.451842+0000","last_clean":"2024-04-17T19:53:45.451842+0000","last_became_active":"2024-04-17T19:53:05.465145+0000","last_became_peered":"2024-04-17T19:53:05.465145+0000","last_unstale":"2024-04-17T19:53:45.451842+0000","last_undegraded":"2024-04-17T19:53:45.451842+0000","last_fullsized":"2024-04-17T19:53:45.451842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:47:46.099722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.453510+0000","last_change":"2024-04-17T19:53:05.463993+0000","last_active":"2024-04-17T19:53:45.453510+0000","last_peered":"2024-04-17T19:53:45.453510+0000","last_clean":"2024-04-17T19:53:45.453510+0000","last_became_active":"2024-04-17T19:53:05.463172+0000","last_became_peered":"2024-04-17T19:53:05.463172+0000","last_unstale":"2024-04-17T19:53:45.453510+0000","last_undegraded":"2024-04-17T19:53:45.453510+0000","last_fullsized":"2024-04-17T19:53:45.453510+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:29:50.457953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.447976+0000","last_change":"2024-04-17T19:53:05.471782+0000","last_active":"2024-04-17T19:53:45.447976+0000","last_peered":"2024-04-17T19:53:45.447976+0000","last_clean":"2024-04-17T19:53:45.447976+0000","last_became_active":"2024-04-17T19:53:05.471347+0000","last_became_peered":"2024-04-17T19:53:05.471347+0000","last_unstale":"2024-04-17T19:53:45.447976+0000","last_undegraded":"2024-04-17T19:53:45.447976+0000","last_fullsized":"2024-04-17T19:53:45.447976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:42:22.878631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.448544+0000","last_change":"2024-04-17T19:53:05.460256+0000","last_active":"2024-04-17T19:53:45.448544+0000","last_peered":"2024-04-17T19:53:45.448544+0000","last_clean":"2024-04-17T19:53:45.448544+0000","last_became_active":"2024-04-17T19:53:05.459869+0000","last_became_peered":"2024-04-17T19:53:05.459869+0000","last_unstale":"2024-04-17T19:53:45.448544+0000","last_undegraded":"2024-04-17T19:53:45.448544+0000","last_fullsized":"2024-04-17T19:53:45.448544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:47:05.354826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.448801+0000","last_change":"2024-04-17T19:53:05.467331+0000","last_active":"2024-04-17T19:53:45.448801+0000","last_peered":"2024-04-17T19:53:45.448801+0000","last_clean":"2024-04-17T19:53:45.448801+0000","last_became_active":"2024-04-17T19:53:05.467015+0000","last_became_peered":"2024-04-17T19:53:05.467015+0000","last_unstale":"2024-04-17T19:53:45.448801+0000","last_undegraded":"2024-04-17T19:53:45.448801+0000","last_fullsized":"2024-04-17T19:53:45.448801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:10:32.839503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.581375+0000","last_change":"2024-04-17T19:53:05.462631+0000","last_active":"2024-04-17T19:53:45.581375+0000","last_peered":"2024-04-17T19:53:45.581375+0000","last_clean":"2024-04-17T19:53:45.581375+0000","last_became_active":"2024-04-17T19:53:05.462217+0000","last_became_peered":"2024-04-17T19:53:05.462217+0000","last_unstale":"2024-04-17T19:53:45.581375+0000","last_undegraded":"2024-04-17T19:53:45.581375+0000","last_fullsized":"2024-04-17T19:53:45.581375+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:50:03.709043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452168+0000","last_change":"2024-04-17T19:53:05.467941+0000","last_active":"2024-04-17T19:53:45.452168+0000","last_peered":"2024-04-17T19:53:45.452168+0000","last_clean":"2024-04-17T19:53:45.452168+0000","last_became_active":"2024-04-17T19:53:05.467093+0000","last_became_peered":"2024-04-17T19:53:05.467093+0000","last_unstale":"2024-04-17T19:53:45.452168+0000","last_undegraded":"2024-04-17T19:53:45.452168+0000","last_fullsized":"2024-04-17T19:53:45.452168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:12:15.307126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.447185+0000","last_change":"2024-04-17T19:53:05.465748+0000","last_active":"2024-04-17T19:53:45.447185+0000","last_peered":"2024-04-17T19:53:45.447185+0000","last_clean":"2024-04-17T19:53:45.447185+0000","last_became_active":"2024-04-17T19:53:05.465436+0000","last_became_peered":"2024-04-17T19:53:05.465436+0000","last_unstale":"2024-04-17T19:53:45.447185+0000","last_undegraded":"2024-04-17T19:53:45.447185+0000","last_fullsized":"2024-04-17T19:53:45.447185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:02:40.799364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.450402+0000","last_change":"2024-04-17T19:53:05.458098+0000","last_active":"2024-04-17T19:53:45.450402+0000","last_peered":"2024-04-17T19:53:45.450402+0000","last_clean":"2024-04-17T19:53:45.450402+0000","last_became_active":"2024-04-17T19:53:05.457656+0000","last_became_peered":"2024-04-17T19:53:05.457656+0000","last_unstale":"2024-04-17T19:53:45.450402+0000","last_undegraded":"2024-04-17T19:53:45.450402+0000","last_fullsized":"2024-04-17T19:53:45.450402+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:40:31.558660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.447486+0000","last_change":"2024-04-17T19:53:05.477086+0000","last_active":"2024-04-17T19:53:45.447486+0000","last_peered":"2024-04-17T19:53:45.447486+0000","last_clean":"2024-04-17T19:53:45.447486+0000","last_became_active":"2024-04-17T19:53:05.476734+0000","last_became_peered":"2024-04-17T19:53:05.476734+0000","last_unstale":"2024-04-17T19:53:45.447486+0000","last_undegraded":"2024-04-17T19:53:45.447486+0000","last_fullsized":"2024-04-17T19:53:45.447486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:10:21.772873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.450605+0000","last_change":"2024-04-17T19:53:05.458378+0000","last_active":"2024-04-17T19:53:45.450605+0000","last_peered":"2024-04-17T19:53:45.450605+0000","last_clean":"2024-04-17T19:53:45.450605+0000","last_became_active":"2024-04-17T19:53:05.457210+0000","last_became_peered":"2024-04-17T19:53:05.457210+0000","last_unstale":"2024-04-17T19:53:45.450605+0000","last_undegraded":"2024-04-17T19:53:45.450605+0000","last_fullsized":"2024-04-17T19:53:45.450605+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:23:03.879786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.455270+0000","last_change":"2024-04-17T19:53:05.455054+0000","last_active":"2024-04-17T19:53:45.455270+0000","last_peered":"2024-04-17T19:53:45.455270+0000","last_clean":"2024-04-17T19:53:45.455270+0000","last_became_active":"2024-04-17T19:53:05.454065+0000","last_became_peered":"2024-04-17T19:53:05.454065+0000","last_unstale":"2024-04-17T19:53:45.455270+0000","last_undegraded":"2024-04-17T19:53:45.455270+0000","last_fullsized":"2024-04-17T19:53:45.455270+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:42:22.878631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.457715+0000","last_change":"2024-04-17T19:53:05.456675+0000","last_active":"2024-04-17T19:53:45.457715+0000","last_peered":"2024-04-17T19:53:45.457715+0000","last_clean":"2024-04-17T19:53:45.457715+0000","last_became_active":"2024-04-17T19:53:05.455779+0000","last_became_peered":"2024-04-17T19:53:05.455779+0000","last_unstale":"2024-04-17T19:53:45.457715+0000","last_undegraded":"2024-04-17T19:53:45.457715+0000","last_fullsized":"2024-04-17T19:53:45.457715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:02:40.799364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.448945+0000","last_change":"2024-04-17T19:53:05.461773+0000","last_active":"2024-04-17T19:53:45.448945+0000","last_peered":"2024-04-17T19:53:45.448945+0000","last_clean":"2024-04-17T19:53:45.448945+0000","last_became_active":"2024-04-17T19:53:05.461324+0000","last_became_peered":"2024-04-17T19:53:05.461324+0000","last_unstale":"2024-04-17T19:53:45.448945+0000","last_undegraded":"2024-04-17T19:53:45.448945+0000","last_fullsized":"2024-04-17T19:53:45.448945+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:05:21.173050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6827,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":13654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":53,"ondisk_log_size":53,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509462,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":315392,"data_stored":124356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509461,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343928,"statfs":{"total":96636764160,"available":96608182272,"internally_reserved":0,"allocated":909312,"data_stored":714692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509461,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":331776,"data_stored":130933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509461,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":311296,"data_stored":124814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509461,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31492,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340348,"statfs":{"total":96636764160,"available":96604516352,"internally_reserved":0,"allocated":323584,"data_stored":130261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509460,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32068,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339772,"statfs":{"total":96636764160,"available":96603926528,"internally_reserved":0,"allocated":905216,"data_stored":714670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509461,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31492,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340348,"statfs":{"total":96636764160,"available":96604516352,"internally_reserved":0,"allocated":315392,"data_stored":124288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542165,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":307200,"data_stored":124232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":6029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":6701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T19:54:25.980 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T19:54:26.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.176+0000 7fed41ee2640 1 Processor -- start 2024-04-17T19:54:26.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.176+0000 7fed41ee2640 1 -- start start 2024-04-17T19:54:26.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.176+0000 7fed41ee2640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fed3c06cd60 0x7fed3c06d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:26.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.176+0000 7fed41ee2640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fed3c15d7c0 0x7fed3c15dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:26.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.176+0000 7fed41ee2640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed3c15fc90 con 0x7fed3c15c7c0 2024-04-17T19:54:26.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.176+0000 7fed41ee2640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fed3c06d6b0 con 0x7fed3c06cd60 2024-04-17T19:54:26.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.176+0000 7fed41ee2640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fed3c142870 con 0x7fed3c15d7c0 2024-04-17T19:54:26.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.176+0000 7fed3b7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fed3c06cd60 0x7fed3c06d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:26.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.176+0000 7fed3b7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fed3c06cd60 0x7fed3c06d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34140/0 (socket says 172.21.15.18:34140) 2024-04-17T19:54:26.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.176+0000 7fed3b7fe640 1 -- 172.21.15.18:0/684620851 learned_addr learned my addr 172.21.15.18:0/684620851 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:26.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.176+0000 7fed3bfff640 1 --2- 172.21.15.18:0/684620851 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fed3c15d7c0 0x7fed3c15dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:26.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.176+0000 7fed3b7fe640 1 -- 172.21.15.18:0/684620851 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fed3c15d7c0 msgr2=0x7fed3c15dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:26.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.176+0000 7fed3b7fe640 1 --2- 172.21.15.18:0/684620851 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fed3c15d7c0 0x7fed3c15dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:26.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.176+0000 7fed3b7fe640 1 -- 172.21.15.18:0/684620851 >> v1:172.21.15.173:6789/0 conn(0x7fed3c15c7c0 legacy=0x7fed3c15cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:26.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.176+0000 7fed3b7fe640 1 -- 172.21.15.18:0/684620851 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed3c15ff00 con 0x7fed3c06cd60 2024-04-17T19:54:26.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.180+0000 7fed3b7fe640 1 --2- 172.21.15.18:0/684620851 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed3c06cd60 0x7fed3c06d170 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fed300098a0 tx=0x7fed3001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a30b53d3ed39b44 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:26.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.180+0000 7fed3a7fc640 1 -- 172.21.15.18:0/684620851 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed300b1070 con 0x7fed3c06cd60 2024-04-17T19:54:26.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.180+0000 7fed3a7fc640 1 -- 172.21.15.18:0/684620851 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed300ac630 con 0x7fed3c06cd60 2024-04-17T19:54:26.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.180+0000 7fed3a7fc640 1 -- 172.21.15.18:0/684620851 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed300a8050 con 0x7fed3c06cd60 2024-04-17T19:54:26.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.180+0000 7fed41ee2640 1 -- 172.21.15.18:0/684620851 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed3c06cd60 msgr2=0x7fed3c06d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:26.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.180+0000 7fed41ee2640 1 --2- 172.21.15.18:0/684620851 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed3c06cd60 0x7fed3c06d170 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fed300098a0 tx=0x7fed3001c4e0 comp rx=0 tx=0).stop 2024-04-17T19:54:26.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.180+0000 7fed41ee2640 1 -- 172.21.15.18:0/684620851 shutdown_connections 2024-04-17T19:54:26.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.180+0000 7fed41ee2640 1 --2- 172.21.15.18:0/684620851 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fed3c15d7c0 0x7fed3c15dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:26.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.180+0000 7fed41ee2640 1 --2- 172.21.15.18:0/684620851 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed3c06cd60 0x7fed3c06d170 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:26.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.180+0000 7fed41ee2640 1 -- 172.21.15.18:0/684620851 >> 172.21.15.18:0/684620851 conn(0x7fed3c072bb0 msgr2=0x7fed3c072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:26.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.180+0000 7fed41ee2640 1 -- 172.21.15.18:0/684620851 shutdown_connections 2024-04-17T19:54:26.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.180+0000 7fed41ee2640 1 -- 172.21.15.18:0/684620851 wait complete. 2024-04-17T19:54:26.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.184+0000 7fed41ee2640 1 Processor -- start 2024-04-17T19:54:26.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.184+0000 7fed41ee2640 1 -- start start 2024-04-17T19:54:26.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.184+0000 7fed41ee2640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fed3c06cd60 0x7fed3c14bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:26.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.184+0000 7fed41ee2640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed3c15c7c0 0x7fed3c14eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:26.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.184+0000 7fed41ee2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed3c15d7c0 0x7fed3c14f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:26.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.184+0000 7fed41ee2640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fed3c1609e0 con 0x7fed3c15d7c0 2024-04-17T19:54:26.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.184+0000 7fed41ee2640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fed3c168f90 con 0x7fed3c15c7c0 2024-04-17T19:54:26.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.184+0000 7fed41ee2640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fed3c14b700 con 0x7fed3c06cd60 2024-04-17T19:54:26.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.184+0000 7fed3bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed3c15d7c0 0x7fed3c14f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:26.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.184+0000 7fed3bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed3c15d7c0 0x7fed3c14f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34142/0 (socket says 172.21.15.18:34142) 2024-04-17T19:54:26.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.184+0000 7fed3bfff640 1 -- 172.21.15.18:0/2411233998 learned_addr learned my addr 172.21.15.18:0/2411233998 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:26.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.184+0000 7fed3b7fe640 1 --2- 172.21.15.18:0/2411233998 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fed3c06cd60 0x7fed3c14bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:26.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.184+0000 7fed3affd640 1 --2- 172.21.15.18:0/2411233998 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed3c15c7c0 0x7fed3c14eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:26.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.184+0000 7fed3bfff640 1 -- 172.21.15.18:0/2411233998 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fed3c06cd60 msgr2=0x7fed3c14bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:26.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.184+0000 7fed3bfff640 1 --2- 172.21.15.18:0/2411233998 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fed3c06cd60 0x7fed3c14bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:26.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.184+0000 7fed3bfff640 1 -- 172.21.15.18:0/2411233998 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed3c15c7c0 msgr2=0x7fed3c14eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:26.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.184+0000 7fed3bfff640 1 --2- 172.21.15.18:0/2411233998 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed3c15c7c0 0x7fed3c14eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:26.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.184+0000 7fed3bfff640 1 -- 172.21.15.18:0/2411233998 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed3c13f670 con 0x7fed3c15d7c0 2024-04-17T19:54:26.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.184+0000 7fed3bfff640 1 --2- 172.21.15.18:0/2411233998 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed3c15d7c0 0x7fed3c14f080 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fed34007d80 tx=0x7fed3400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:26.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.184+0000 7fed23fff640 1 -- 172.21.15.18:0/2411233998 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed34014420 con 0x7fed3c15d7c0 2024-04-17T19:54:26.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.184+0000 7fed23fff640 1 -- 172.21.15.18:0/2411233998 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed34019070 con 0x7fed3c15d7c0 2024-04-17T19:54:26.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.184+0000 7fed41ee2640 1 -- 172.21.15.18:0/2411233998 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed3c1519b0 con 0x7fed3c15d7c0 2024-04-17T19:54:26.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.184+0000 7fed23fff640 1 -- 172.21.15.18:0/2411233998 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed34014800 con 0x7fed3c15d7c0 2024-04-17T19:54:26.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.184+0000 7fed41ee2640 1 -- 172.21.15.18:0/2411233998 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed3c14faf0 con 0x7fed3c15d7c0 2024-04-17T19:54:26.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.184+0000 7fed41ee2640 1 -- 172.21.15.18:0/2411233998 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed3c069950 con 0x7fed3c15d7c0 2024-04-17T19:54:26.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.188+0000 7fed23fff640 1 -- 172.21.15.18:0/2411233998 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fed340149a0 con 0x7fed3c15d7c0 2024-04-17T19:54:26.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.188+0000 7fed23fff640 1 --2- 172.21.15.18:0/2411233998 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fed28068380 0x7fed2806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:26.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.188+0000 7fed23fff640 1 -- 172.21.15.18:0/2411233998 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7fed34088050 con 0x7fed3c15d7c0 2024-04-17T19:54:26.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.188+0000 7fed3b7fe640 1 --2- 172.21.15.18:0/2411233998 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fed28068380 0x7fed2806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:26.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.188+0000 7fed3b7fe640 1 --2- 172.21.15.18:0/2411233998 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fed28068380 0x7fed2806a890 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fed300ae000 tx=0x7fed30008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:26.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.192+0000 7fed23fff640 1 -- 172.21.15.18:0/2411233998 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fed34058290 con 0x7fed3c15d7c0 2024-04-17T19:54:26.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.352+0000 7fed41ee2640 1 -- 172.21.15.18:0/2411233998 --> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fed3c0cee40 con 0x7fed28068380 2024-04-17T19:54:26.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.364+0000 7fed23fff640 1 -- 172.21.15.18:0/2411233998 <== mgr.4104 v2:172.21.15.18:6832/751466605 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332535 (secure 0 0 0) 0x7fed3c0cee40 con 0x7fed28068380 2024-04-17T19:54:26.365 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:54:26.367 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-17T19:54:26.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.368+0000 7fed41ee2640 1 -- 172.21.15.18:0/2411233998 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fed28068380 msgr2=0x7fed2806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:26.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.368+0000 7fed41ee2640 1 --2- 172.21.15.18:0/2411233998 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fed28068380 0x7fed2806a890 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fed300ae000 tx=0x7fed30008040 comp rx=0 tx=0).stop 2024-04-17T19:54:26.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.368+0000 7fed41ee2640 1 -- 172.21.15.18:0/2411233998 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed3c15d7c0 msgr2=0x7fed3c14f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:26.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.368+0000 7fed41ee2640 1 --2- 172.21.15.18:0/2411233998 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed3c15d7c0 0x7fed3c14f080 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fed34007d80 tx=0x7fed3400e4b0 comp rx=0 tx=0).stop 2024-04-17T19:54:26.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.368+0000 7fed41ee2640 1 -- 172.21.15.18:0/2411233998 shutdown_connections 2024-04-17T19:54:26.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.368+0000 7fed41ee2640 1 --2- 172.21.15.18:0/2411233998 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fed28068380 0x7fed2806a890 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:26.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.368+0000 7fed41ee2640 1 --2- 172.21.15.18:0/2411233998 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed3c15d7c0 0x7fed3c14f080 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:26.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.368+0000 7fed41ee2640 1 --2- 172.21.15.18:0/2411233998 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fed3c15c7c0 0x7fed3c14eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:26.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.368+0000 7fed41ee2640 1 --2- 172.21.15.18:0/2411233998 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fed3c06cd60 0x7fed3c14bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:26.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.368+0000 7fed41ee2640 1 -- 172.21.15.18:0/2411233998 >> 172.21.15.18:0/2411233998 conn(0x7fed3c072bb0 msgr2=0x7fed3c155d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:26.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.368+0000 7fed41ee2640 1 -- 172.21.15.18:0/2411233998 shutdown_connections 2024-04-17T19:54:26.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.368+0000 7fed41ee2640 1 -- 172.21.15.18:0/2411233998 wait complete. 2024-04-17T19:54:26.386 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2024-04-17T19:54:24.373504+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597195,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":218,"num_write_kb":2445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":170,"ondisk_log_size":170,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236448,"kb_used_data":3632,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738272,"statfs":{"total":773094113280,"available":772851990528,"internally_reserved":0,"allocated":3719168,"data_stored":2188246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":238276148},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005374"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.454644+0000","last_change":"2024-04-17T19:53:04.461184+0000","last_active":"2024-04-17T19:53:45.454644+0000","last_peered":"2024-04-17T19:53:45.454644+0000","last_clean":"2024-04-17T19:53:45.454644+0000","last_became_active":"2024-04-17T19:53:04.460006+0000","last_became_peered":"2024-04-17T19:53:04.460006+0000","last_unstale":"2024-04-17T19:53:45.454644+0000","last_undegraded":"2024-04-17T19:53:45.454644+0000","last_fullsized":"2024-04-17T19:53:45.454644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:23:02.868468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.461480+0000","last_change":"2024-04-17T19:53:05.474006+0000","last_active":"2024-04-17T19:53:45.461480+0000","last_peered":"2024-04-17T19:53:45.461480+0000","last_clean":"2024-04-17T19:53:45.461480+0000","last_became_active":"2024-04-17T19:53:05.467848+0000","last_became_peered":"2024-04-17T19:53:05.467848+0000","last_unstale":"2024-04-17T19:53:45.461480+0000","last_undegraded":"2024-04-17T19:53:45.461480+0000","last_fullsized":"2024-04-17T19:53:45.461480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:05:21.173050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.584776+0000","last_change":"2024-04-17T19:53:09.559397+0000","last_active":"2024-04-17T19:53:45.584776+0000","last_peered":"2024-04-17T19:53:45.584776+0000","last_clean":"2024-04-17T19:53:45.584776+0000","last_became_active":"2024-04-17T19:53:09.558504+0000","last_became_peered":"2024-04-17T19:53:09.558504+0000","last_unstale":"2024-04-17T19:53:45.584776+0000","last_undegraded":"2024-04-17T19:53:45.584776+0000","last_fullsized":"2024-04-17T19:53:45.584776+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:06:18.745394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.461903+0000","last_change":"2024-04-17T19:53:04.484961+0000","last_active":"2024-04-17T19:53:45.461903+0000","last_peered":"2024-04-17T19:53:45.461903+0000","last_clean":"2024-04-17T19:53:45.461903+0000","last_became_active":"2024-04-17T19:53:04.468291+0000","last_became_peered":"2024-04-17T19:53:04.468291+0000","last_unstale":"2024-04-17T19:53:45.461903+0000","last_undegraded":"2024-04-17T19:53:45.461903+0000","last_fullsized":"2024-04-17T19:53:45.461903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:06:00.469757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.459913+0000","last_change":"2024-04-17T19:53:05.475578+0000","last_active":"2024-04-17T19:53:45.459913+0000","last_peered":"2024-04-17T19:53:45.459913+0000","last_clean":"2024-04-17T19:53:45.459913+0000","last_became_active":"2024-04-17T19:53:05.473678+0000","last_became_peered":"2024-04-17T19:53:05.473678+0000","last_unstale":"2024-04-17T19:53:45.459913+0000","last_undegraded":"2024-04-17T19:53:45.459913+0000","last_fullsized":"2024-04-17T19:53:45.459913+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:47:05.354826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.449924+0000","last_change":"2024-04-17T19:53:09.545180+0000","last_active":"2024-04-17T19:53:45.449924+0000","last_peered":"2024-04-17T19:53:45.449924+0000","last_clean":"2024-04-17T19:53:45.449924+0000","last_became_active":"2024-04-17T19:53:09.544580+0000","last_became_peered":"2024-04-17T19:53:09.544580+0000","last_unstale":"2024-04-17T19:53:45.449924+0000","last_undegraded":"2024-04-17T19:53:45.449924+0000","last_fullsized":"2024-04-17T19:53:45.449924+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:02:44.844970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.448758+0000","last_change":"2024-04-17T19:53:04.468009+0000","last_active":"2024-04-17T19:53:45.448758+0000","last_peered":"2024-04-17T19:53:45.448758+0000","last_clean":"2024-04-17T19:53:45.448758+0000","last_became_active":"2024-04-17T19:53:04.467568+0000","last_became_peered":"2024-04-17T19:53:04.467568+0000","last_unstale":"2024-04-17T19:53:45.448758+0000","last_undegraded":"2024-04-17T19:53:45.448758+0000","last_fullsized":"2024-04-17T19:53:45.448758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:18:11.256327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.579947+0000","last_change":"2024-04-17T19:53:05.464961+0000","last_active":"2024-04-17T19:53:45.579947+0000","last_peered":"2024-04-17T19:53:45.579947+0000","last_clean":"2024-04-17T19:53:45.579947+0000","last_became_active":"2024-04-17T19:53:05.464601+0000","last_became_peered":"2024-04-17T19:53:05.464601+0000","last_unstale":"2024-04-17T19:53:45.579947+0000","last_undegraded":"2024-04-17T19:53:45.579947+0000","last_fullsized":"2024-04-17T19:53:45.579947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:12:03.449509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.450440+0000","last_change":"2024-04-17T19:53:09.529447+0000","last_active":"2024-04-17T19:53:45.450440+0000","last_peered":"2024-04-17T19:53:45.450440+0000","last_clean":"2024-04-17T19:53:45.450440+0000","last_became_active":"2024-04-17T19:53:09.528285+0000","last_became_peered":"2024-04-17T19:53:09.528285+0000","last_unstale":"2024-04-17T19:53:45.450440+0000","last_undegraded":"2024-04-17T19:53:45.450440+0000","last_fullsized":"2024-04-17T19:53:45.450440+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:47:09.400433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.448308+0000","last_change":"2024-04-17T19:53:04.467639+0000","last_active":"2024-04-17T19:53:45.448308+0000","last_peered":"2024-04-17T19:53:45.448308+0000","last_clean":"2024-04-17T19:53:45.448308+0000","last_became_active":"2024-04-17T19:53:04.467004+0000","last_became_peered":"2024-04-17T19:53:04.467004+0000","last_unstale":"2024-04-17T19:53:45.448308+0000","last_undegraded":"2024-04-17T19:53:45.448308+0000","last_fullsized":"2024-04-17T19:53:45.448308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:38:40.499868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.565298+0000","last_change":"2024-04-17T19:53:05.468179+0000","last_active":"2024-04-17T19:53:45.565298+0000","last_peered":"2024-04-17T19:53:45.565298+0000","last_clean":"2024-04-17T19:53:45.565298+0000","last_became_active":"2024-04-17T19:53:05.467217+0000","last_became_peered":"2024-04-17T19:53:05.467217+0000","last_unstale":"2024-04-17T19:53:45.565298+0000","last_undegraded":"2024-04-17T19:53:45.565298+0000","last_fullsized":"2024-04-17T19:53:45.565298+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:29:50.290114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.450089+0000","last_change":"2024-04-17T19:53:09.549722+0000","last_active":"2024-04-17T19:53:45.450089+0000","last_peered":"2024-04-17T19:53:45.450089+0000","last_clean":"2024-04-17T19:53:45.450089+0000","last_became_active":"2024-04-17T19:53:09.548876+0000","last_became_peered":"2024-04-17T19:53:09.548876+0000","last_unstale":"2024-04-17T19:53:45.450089+0000","last_undegraded":"2024-04-17T19:53:45.450089+0000","last_fullsized":"2024-04-17T19:53:45.450089+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:15:49.773156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.567108+0000","last_change":"2024-04-17T19:53:05.475996+0000","last_active":"2024-04-17T19:53:45.567108+0000","last_peered":"2024-04-17T19:53:45.567108+0000","last_clean":"2024-04-17T19:53:45.567108+0000","last_became_active":"2024-04-17T19:53:05.475517+0000","last_became_peered":"2024-04-17T19:53:05.475517+0000","last_unstale":"2024-04-17T19:53:45.567108+0000","last_undegraded":"2024-04-17T19:53:45.567108+0000","last_fullsized":"2024-04-17T19:53:45.567108+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:39:47.272961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.566537+0000","last_change":"2024-04-17T19:53:04.465884+0000","last_active":"2024-04-17T19:53:45.566537+0000","last_peered":"2024-04-17T19:53:45.566537+0000","last_clean":"2024-04-17T19:53:45.566537+0000","last_became_active":"2024-04-17T19:53:04.465108+0000","last_became_peered":"2024-04-17T19:53:04.465108+0000","last_unstale":"2024-04-17T19:53:45.566537+0000","last_undegraded":"2024-04-17T19:53:45.566537+0000","last_fullsized":"2024-04-17T19:53:45.566537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:23:02.868468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.566637+0000","last_change":"2024-04-17T19:53:09.545287+0000","last_active":"2024-04-17T19:53:45.566637+0000","last_peered":"2024-04-17T19:53:45.566637+0000","last_clean":"2024-04-17T19:53:45.566637+0000","last_became_active":"2024-04-17T19:53:09.544328+0000","last_became_peered":"2024-04-17T19:53:09.544328+0000","last_unstale":"2024-04-17T19:53:45.566637+0000","last_undegraded":"2024-04-17T19:53:45.566637+0000","last_fullsized":"2024-04-17T19:53:45.566637+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:47:26.887721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.582177+0000","last_change":"2024-04-17T19:53:05.496585+0000","last_active":"2024-04-17T19:53:45.582177+0000","last_peered":"2024-04-17T19:53:45.582177+0000","last_clean":"2024-04-17T19:53:45.582177+0000","last_became_active":"2024-04-17T19:53:05.495800+0000","last_became_peered":"2024-04-17T19:53:05.495800+0000","last_unstale":"2024-04-17T19:53:45.582177+0000","last_undegraded":"2024-04-17T19:53:45.582177+0000","last_fullsized":"2024-04-17T19:53:45.582177+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:18:12.267644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452508+0000","last_change":"2024-04-17T19:53:04.479274+0000","last_active":"2024-04-17T19:53:45.452508+0000","last_peered":"2024-04-17T19:53:45.452508+0000","last_clean":"2024-04-17T19:53:45.452508+0000","last_became_active":"2024-04-17T19:53:04.478425+0000","last_became_peered":"2024-04-17T19:53:04.478425+0000","last_unstale":"2024-04-17T19:53:45.452508+0000","last_undegraded":"2024-04-17T19:53:45.452508+0000","last_fullsized":"2024-04-17T19:53:45.452508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:16:15.623557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.447838+0000","last_change":"2024-04-17T19:53:09.526995+0000","last_active":"2024-04-17T19:53:45.447838+0000","last_peered":"2024-04-17T19:53:45.447838+0000","last_clean":"2024-04-17T19:53:45.447838+0000","last_became_active":"2024-04-17T19:53:09.525577+0000","last_became_peered":"2024-04-17T19:53:09.525577+0000","last_unstale":"2024-04-17T19:53:45.447838+0000","last_undegraded":"2024-04-17T19:53:45.447838+0000","last_fullsized":"2024-04-17T19:53:45.447838+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:52:59.924361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.451938+0000","last_change":"2024-04-17T19:53:05.463312+0000","last_active":"2024-04-17T19:53:45.451938+0000","last_peered":"2024-04-17T19:53:45.451938+0000","last_clean":"2024-04-17T19:53:45.451938+0000","last_became_active":"2024-04-17T19:53:05.462415+0000","last_became_peered":"2024-04-17T19:53:05.462415+0000","last_unstale":"2024-04-17T19:53:45.451938+0000","last_undegraded":"2024-04-17T19:53:45.451938+0000","last_fullsized":"2024-04-17T19:53:45.451938+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:27:51.520335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.460026+0000","last_change":"2024-04-17T19:53:04.471150+0000","last_active":"2024-04-17T19:53:45.460026+0000","last_peered":"2024-04-17T19:53:45.460026+0000","last_clean":"2024-04-17T19:53:45.460026+0000","last_became_active":"2024-04-17T19:53:04.470258+0000","last_became_peered":"2024-04-17T19:53:04.470258+0000","last_unstale":"2024-04-17T19:53:45.460026+0000","last_undegraded":"2024-04-17T19:53:45.460026+0000","last_fullsized":"2024-04-17T19:53:45.460026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:06:00.469757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.587281+0000","last_change":"2024-04-17T19:53:09.565387+0000","last_active":"2024-04-17T19:53:45.587281+0000","last_peered":"2024-04-17T19:53:45.587281+0000","last_clean":"2024-04-17T19:53:45.587281+0000","last_became_active":"2024-04-17T19:53:09.564134+0000","last_became_peered":"2024-04-17T19:53:09.564134+0000","last_unstale":"2024-04-17T19:53:45.587281+0000","last_undegraded":"2024-04-17T19:53:45.587281+0000","last_fullsized":"2024-04-17T19:53:45.587281+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:21:01.809464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.564723+0000","last_change":"2024-04-17T19:53:05.468962+0000","last_active":"2024-04-17T19:53:45.564723+0000","last_peered":"2024-04-17T19:53:45.564723+0000","last_clean":"2024-04-17T19:53:45.564723+0000","last_became_active":"2024-04-17T19:53:05.466996+0000","last_became_peered":"2024-04-17T19:53:05.466996+0000","last_unstale":"2024-04-17T19:53:45.564723+0000","last_undegraded":"2024-04-17T19:53:45.564723+0000","last_fullsized":"2024-04-17T19:53:45.564723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:04:55.125411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.446787+0000","last_change":"2024-04-17T19:53:04.472916+0000","last_active":"2024-04-17T19:53:45.446787+0000","last_peered":"2024-04-17T19:53:45.446787+0000","last_clean":"2024-04-17T19:53:45.446787+0000","last_became_active":"2024-04-17T19:53:04.468136+0000","last_became_peered":"2024-04-17T19:53:04.468136+0000","last_unstale":"2024-04-17T19:53:45.446787+0000","last_undegraded":"2024-04-17T19:53:45.446787+0000","last_fullsized":"2024-04-17T19:53:45.446787+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:23:02.868468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.587217+0000","last_change":"2024-04-17T19:53:45.587217+0000","last_active":"2024-04-17T19:53:45.587217+0000","last_peered":"2024-04-17T19:53:45.587217+0000","last_clean":"2024-04-17T19:53:45.587217+0000","last_became_active":"2024-04-17T19:53:45.586731+0000","last_became_peered":"2024-04-17T19:53:45.586731+0000","last_unstale":"2024-04-17T19:53:45.587217+0000","last_undegraded":"2024-04-17T19:53:45.587217+0000","last_fullsized":"2024-04-17T19:53:45.587217+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:41:58.423269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,7],"acting":[2,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452775+0000","last_change":"2024-04-17T19:53:05.467799+0000","last_active":"2024-04-17T19:53:45.452775+0000","last_peered":"2024-04-17T19:53:45.452775+0000","last_clean":"2024-04-17T19:53:45.452775+0000","last_became_active":"2024-04-17T19:53:05.465048+0000","last_became_peered":"2024-04-17T19:53:05.465048+0000","last_unstale":"2024-04-17T19:53:45.452775+0000","last_undegraded":"2024-04-17T19:53:45.452775+0000","last_fullsized":"2024-04-17T19:53:45.452775+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:19:09.456602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.567142+0000","last_change":"2024-04-17T19:53:04.469594+0000","last_active":"2024-04-17T19:53:45.567142+0000","last_peered":"2024-04-17T19:53:45.567142+0000","last_clean":"2024-04-17T19:53:45.567142+0000","last_became_active":"2024-04-17T19:53:04.469119+0000","last_became_peered":"2024-04-17T19:53:04.469119+0000","last_unstale":"2024-04-17T19:53:45.567142+0000","last_undegraded":"2024-04-17T19:53:45.567142+0000","last_fullsized":"2024-04-17T19:53:45.567142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:40:30.547343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.450404+0000","last_change":"2024-04-17T19:53:09.527277+0000","last_active":"2024-04-17T19:53:45.450404+0000","last_peered":"2024-04-17T19:53:45.450404+0000","last_clean":"2024-04-17T19:53:45.450404+0000","last_became_active":"2024-04-17T19:53:09.526436+0000","last_became_peered":"2024-04-17T19:53:09.526436+0000","last_unstale":"2024-04-17T19:53:45.450404+0000","last_undegraded":"2024-04-17T19:53:45.450404+0000","last_fullsized":"2024-04-17T19:53:45.450404+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:54:31.569576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.454142+0000","last_change":"2024-04-17T19:53:05.443712+0000","last_active":"2024-04-17T19:53:45.454142+0000","last_peered":"2024-04-17T19:53:45.454142+0000","last_clean":"2024-04-17T19:53:45.454142+0000","last_became_active":"2024-04-17T19:53:05.442881+0000","last_became_peered":"2024-04-17T19:53:05.442881+0000","last_unstale":"2024-04-17T19:53:45.454142+0000","last_undegraded":"2024-04-17T19:53:45.454142+0000","last_fullsized":"2024-04-17T19:53:45.454142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:20:57.763858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.453372+0000","last_change":"2024-04-17T19:53:04.465717+0000","last_active":"2024-04-17T19:53:45.453372+0000","last_peered":"2024-04-17T19:53:45.453372+0000","last_clean":"2024-04-17T19:53:45.453372+0000","last_became_active":"2024-04-17T19:53:04.464701+0000","last_became_peered":"2024-04-17T19:53:04.464701+0000","last_unstale":"2024-04-17T19:53:45.453372+0000","last_undegraded":"2024-04-17T19:53:45.453372+0000","last_fullsized":"2024-04-17T19:53:45.453372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:18:11.256327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.456232+0000","last_change":"2024-04-17T19:53:09.530585+0000","last_active":"2024-04-17T19:53:45.456232+0000","last_peered":"2024-04-17T19:53:45.456232+0000","last_clean":"2024-04-17T19:53:45.456232+0000","last_became_active":"2024-04-17T19:53:09.529345+0000","last_became_peered":"2024-04-17T19:53:09.529345+0000","last_unstale":"2024-04-17T19:53:45.456232+0000","last_undegraded":"2024-04-17T19:53:45.456232+0000","last_fullsized":"2024-04-17T19:53:45.456232+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:01:38.507428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452698+0000","last_change":"2024-04-17T19:53:05.452177+0000","last_active":"2024-04-17T19:53:45.452698+0000","last_peered":"2024-04-17T19:53:45.452698+0000","last_clean":"2024-04-17T19:53:45.452698+0000","last_became_active":"2024-04-17T19:53:05.451272+0000","last_became_peered":"2024-04-17T19:53:05.451272+0000","last_unstale":"2024-04-17T19:53:45.452698+0000","last_undegraded":"2024-04-17T19:53:45.452698+0000","last_fullsized":"2024-04-17T19:53:45.452698+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:51:17.675125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.567067+0000","last_change":"2024-04-17T19:53:04.471944+0000","last_active":"2024-04-17T19:53:45.567067+0000","last_peered":"2024-04-17T19:53:45.567067+0000","last_clean":"2024-04-17T19:53:45.567067+0000","last_became_active":"2024-04-17T19:53:04.471458+0000","last_became_peered":"2024-04-17T19:53:04.471458+0000","last_unstale":"2024-04-17T19:53:45.567067+0000","last_undegraded":"2024-04-17T19:53:45.567067+0000","last_fullsized":"2024-04-17T19:53:45.567067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:12:02.438192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452001+0000","last_change":"2024-04-17T19:53:09.549998+0000","last_active":"2024-04-17T19:53:45.452001+0000","last_peered":"2024-04-17T19:53:45.452001+0000","last_clean":"2024-04-17T19:53:45.452001+0000","last_became_active":"2024-04-17T19:53:09.548136+0000","last_became_peered":"2024-04-17T19:53:09.548136+0000","last_unstale":"2024-04-17T19:53:45.452001+0000","last_undegraded":"2024-04-17T19:53:45.452001+0000","last_fullsized":"2024-04-17T19:53:45.452001+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:02:14.459968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.451671+0000","last_change":"2024-04-17T19:53:05.472884+0000","last_active":"2024-04-17T19:53:45.451671+0000","last_peered":"2024-04-17T19:53:45.451671+0000","last_clean":"2024-04-17T19:53:45.451671+0000","last_became_active":"2024-04-17T19:53:05.472513+0000","last_became_peered":"2024-04-17T19:53:05.472513+0000","last_unstale":"2024-04-17T19:53:45.451671+0000","last_undegraded":"2024-04-17T19:53:45.451671+0000","last_fullsized":"2024-04-17T19:53:45.451671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:21:37.163564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.457647+0000","last_change":"2024-04-17T19:53:04.487713+0000","last_active":"2024-04-17T19:53:45.457647+0000","last_peered":"2024-04-17T19:53:45.457647+0000","last_clean":"2024-04-17T19:53:45.457647+0000","last_became_active":"2024-04-17T19:53:04.487005+0000","last_became_peered":"2024-04-17T19:53:04.487005+0000","last_unstale":"2024-04-17T19:53:45.457647+0000","last_undegraded":"2024-04-17T19:53:45.457647+0000","last_fullsized":"2024-04-17T19:53:45.457647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:53:36.130201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.451279+0000","last_change":"2024-04-17T19:53:09.547824+0000","last_active":"2024-04-17T19:53:45.451279+0000","last_peered":"2024-04-17T19:53:45.451279+0000","last_clean":"2024-04-17T19:53:45.451279+0000","last_became_active":"2024-04-17T19:53:09.545636+0000","last_became_peered":"2024-04-17T19:53:09.545636+0000","last_unstale":"2024-04-17T19:53:45.451279+0000","last_undegraded":"2024-04-17T19:53:45.451279+0000","last_fullsized":"2024-04-17T19:53:45.451279+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:06:17.885652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.447639+0000","last_change":"2024-04-17T19:53:05.465820+0000","last_active":"2024-04-17T19:53:45.447639+0000","last_peered":"2024-04-17T19:53:45.447639+0000","last_clean":"2024-04-17T19:53:45.447639+0000","last_became_active":"2024-04-17T19:53:05.464376+0000","last_became_peered":"2024-04-17T19:53:05.464376+0000","last_unstale":"2024-04-17T19:53:45.447639+0000","last_undegraded":"2024-04-17T19:53:45.447639+0000","last_fullsized":"2024-04-17T19:53:45.447639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:53:13.956259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.567378+0000","last_change":"2024-04-17T19:53:04.464706+0000","last_active":"2024-04-17T19:53:45.567378+0000","last_peered":"2024-04-17T19:53:45.567378+0000","last_clean":"2024-04-17T19:53:45.567378+0000","last_became_active":"2024-04-17T19:53:04.464109+0000","last_became_peered":"2024-04-17T19:53:04.464109+0000","last_unstale":"2024-04-17T19:53:45.567378+0000","last_undegraded":"2024-04-17T19:53:45.567378+0000","last_fullsized":"2024-04-17T19:53:45.567378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:38:40.499868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452114+0000","last_change":"2024-04-17T19:53:09.553078+0000","last_active":"2024-04-17T19:53:45.452114+0000","last_peered":"2024-04-17T19:53:45.452114+0000","last_clean":"2024-04-17T19:53:45.452114+0000","last_became_active":"2024-04-17T19:53:09.548806+0000","last_became_peered":"2024-04-17T19:53:09.548806+0000","last_unstale":"2024-04-17T19:53:45.452114+0000","last_undegraded":"2024-04-17T19:53:45.452114+0000","last_fullsized":"2024-04-17T19:53:45.452114+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:33:37.250066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452511+0000","last_change":"2024-04-17T19:53:05.476631+0000","last_active":"2024-04-17T19:53:45.452511+0000","last_peered":"2024-04-17T19:53:45.452511+0000","last_clean":"2024-04-17T19:53:45.452511+0000","last_became_active":"2024-04-17T19:53:05.474164+0000","last_became_peered":"2024-04-17T19:53:05.474164+0000","last_unstale":"2024-04-17T19:53:45.452511+0000","last_undegraded":"2024-04-17T19:53:45.452511+0000","last_fullsized":"2024-04-17T19:53:45.452511+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:53:13.956259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.585125+0000","last_change":"2024-04-17T19:53:04.486117+0000","last_active":"2024-04-17T19:53:45.585125+0000","last_peered":"2024-04-17T19:53:45.585125+0000","last_clean":"2024-04-17T19:53:45.585125+0000","last_became_active":"2024-04-17T19:53:04.485424+0000","last_became_peered":"2024-04-17T19:53:04.485424+0000","last_unstale":"2024-04-17T19:53:45.585125+0000","last_undegraded":"2024-04-17T19:53:45.585125+0000","last_fullsized":"2024-04-17T19:53:45.585125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:21:45.875274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.457318+0000","last_change":"2024-04-17T19:53:09.549846+0000","last_active":"2024-04-17T19:53:45.457318+0000","last_peered":"2024-04-17T19:53:45.457318+0000","last_clean":"2024-04-17T19:53:45.457318+0000","last_became_active":"2024-04-17T19:53:09.548070+0000","last_became_peered":"2024-04-17T19:53:09.548070+0000","last_unstale":"2024-04-17T19:53:45.457318+0000","last_undegraded":"2024-04-17T19:53:45.457318+0000","last_fullsized":"2024-04-17T19:53:45.457318+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:05.469665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452883+0000","last_change":"2024-04-17T19:53:05.469993+0000","last_active":"2024-04-17T19:53:45.452883+0000","last_peered":"2024-04-17T19:53:45.452883+0000","last_clean":"2024-04-17T19:53:45.452883+0000","last_became_active":"2024-04-17T19:53:05.468241+0000","last_became_peered":"2024-04-17T19:53:05.468241+0000","last_unstale":"2024-04-17T19:53:45.452883+0000","last_undegraded":"2024-04-17T19:53:45.452883+0000","last_fullsized":"2024-04-17T19:53:45.452883+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:39:15.005822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.565089+0000","last_change":"2024-04-17T19:53:04.484259+0000","last_active":"2024-04-17T19:53:45.565089+0000","last_peered":"2024-04-17T19:53:45.565089+0000","last_clean":"2024-04-17T19:53:45.565089+0000","last_became_active":"2024-04-17T19:53:04.483882+0000","last_became_peered":"2024-04-17T19:53:04.483882+0000","last_unstale":"2024-04-17T19:53:45.565089+0000","last_undegraded":"2024-04-17T19:53:45.565089+0000","last_fullsized":"2024-04-17T19:53:45.565089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:18:11.256327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.460808+0000","last_change":"2024-04-17T19:53:09.559932+0000","last_active":"2024-04-17T19:53:45.460808+0000","last_peered":"2024-04-17T19:53:45.460808+0000","last_clean":"2024-04-17T19:53:45.460808+0000","last_became_active":"2024-04-17T19:53:09.558888+0000","last_became_peered":"2024-04-17T19:53:09.558888+0000","last_unstale":"2024-04-17T19:53:45.460808+0000","last_undegraded":"2024-04-17T19:53:45.460808+0000","last_fullsized":"2024-04-17T19:53:45.460808+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:22:59.388953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452018+0000","last_change":"2024-04-17T19:53:05.463658+0000","last_active":"2024-04-17T19:53:45.452018+0000","last_peered":"2024-04-17T19:53:45.452018+0000","last_clean":"2024-04-17T19:53:45.452018+0000","last_became_active":"2024-04-17T19:53:05.462437+0000","last_became_peered":"2024-04-17T19:53:05.462437+0000","last_unstale":"2024-04-17T19:53:45.452018+0000","last_undegraded":"2024-04-17T19:53:45.452018+0000","last_fullsized":"2024-04-17T19:53:45.452018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:06:14.699788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.566591+0000","last_change":"2024-04-17T19:53:04.459172+0000","last_active":"2024-04-17T19:53:45.566591+0000","last_peered":"2024-04-17T19:53:45.566591+0000","last_clean":"2024-04-17T19:53:45.566591+0000","last_became_active":"2024-04-17T19:53:04.458798+0000","last_became_peered":"2024-04-17T19:53:04.458798+0000","last_unstale":"2024-04-17T19:53:45.566591+0000","last_undegraded":"2024-04-17T19:53:45.566591+0000","last_fullsized":"2024-04-17T19:53:45.566591+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:21:36.152247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":181,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.580414+0000","last_change":"2024-04-17T19:52:54.651873+0000","last_active":"2024-04-17T19:53:45.580414+0000","last_peered":"2024-04-17T19:53:45.580414+0000","last_clean":"2024-04-17T19:53:45.580414+0000","last_became_active":"2024-04-17T19:52:54.649700+0000","last_became_peered":"2024-04-17T19:52:54.649700+0000","last_unstale":"2024-04-17T19:53:45.580414+0000","last_undegraded":"2024-04-17T19:53:45.580414+0000","last_fullsized":"2024-04-17T19:53:45.580414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:52:53.245174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:52:53.245174+0000","last_clean_scrub_stamp":"2024-04-17T19:52:53.245174+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:26:16.094093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.468715+0000","last_change":"2024-04-17T19:53:45.466468+0000","last_active":"2024-04-17T19:53:45.468715+0000","last_peered":"2024-04-17T19:53:45.468715+0000","last_clean":"2024-04-17T19:53:45.468715+0000","last_became_active":"2024-04-17T19:53:45.464724+0000","last_became_peered":"2024-04-17T19:53:45.464724+0000","last_unstale":"2024-04-17T19:53:45.468715+0000","last_undegraded":"2024-04-17T19:53:45.468715+0000","last_fullsized":"2024-04-17T19:53:45.468715+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:07:11.268705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,2,0],"acting":[4,5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.566911+0000","last_change":"2024-04-17T19:53:05.475968+0000","last_active":"2024-04-17T19:53:45.566911+0000","last_peered":"2024-04-17T19:53:45.566911+0000","last_clean":"2024-04-17T19:53:45.566911+0000","last_became_active":"2024-04-17T19:53:05.475600+0000","last_became_peered":"2024-04-17T19:53:05.475600+0000","last_unstale":"2024-04-17T19:53:45.566911+0000","last_undegraded":"2024-04-17T19:53:45.566911+0000","last_fullsized":"2024-04-17T19:53:45.566911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:34:03.644428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452962+0000","last_change":"2024-04-17T19:53:04.457214+0000","last_active":"2024-04-17T19:53:45.452962+0000","last_peered":"2024-04-17T19:53:45.452962+0000","last_clean":"2024-04-17T19:53:45.452962+0000","last_became_active":"2024-04-17T19:53:04.453473+0000","last_became_peered":"2024-04-17T19:53:04.453473+0000","last_unstale":"2024-04-17T19:53:45.452962+0000","last_undegraded":"2024-04-17T19:53:45.452962+0000","last_fullsized":"2024-04-17T19:53:45.452962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:14:03.008171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.450160+0000","last_change":"2024-04-17T19:53:09.548981+0000","last_active":"2024-04-17T19:53:45.450160+0000","last_peered":"2024-04-17T19:53:45.450160+0000","last_clean":"2024-04-17T19:53:45.450160+0000","last_became_active":"2024-04-17T19:53:09.548575+0000","last_became_peered":"2024-04-17T19:53:09.548575+0000","last_unstale":"2024-04-17T19:53:45.450160+0000","last_undegraded":"2024-04-17T19:53:45.450160+0000","last_fullsized":"2024-04-17T19:53:45.450160+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:05:25.218656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.448148+0000","last_change":"2024-04-17T19:53:05.464697+0000","last_active":"2024-04-17T19:53:45.448148+0000","last_peered":"2024-04-17T19:53:45.448148+0000","last_clean":"2024-04-17T19:53:45.448148+0000","last_became_active":"2024-04-17T19:53:05.463935+0000","last_became_peered":"2024-04-17T19:53:05.463935+0000","last_unstale":"2024-04-17T19:53:45.448148+0000","last_undegraded":"2024-04-17T19:53:45.448148+0000","last_fullsized":"2024-04-17T19:53:45.448148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:15:45.727550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.461105+0000","last_change":"2024-04-17T19:53:04.475555+0000","last_active":"2024-04-17T19:53:45.461105+0000","last_peered":"2024-04-17T19:53:45.461105+0000","last_clean":"2024-04-17T19:53:45.461105+0000","last_became_active":"2024-04-17T19:53:04.467881+0000","last_became_peered":"2024-04-17T19:53:04.467881+0000","last_unstale":"2024-04-17T19:53:45.461105+0000","last_undegraded":"2024-04-17T19:53:45.461105+0000","last_fullsized":"2024-04-17T19:53:45.461105+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:22:17.837334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.457150+0000","last_change":"2024-04-17T19:53:09.535560+0000","last_active":"2024-04-17T19:53:45.457150+0000","last_peered":"2024-04-17T19:53:45.457150+0000","last_clean":"2024-04-17T19:53:45.457150+0000","last_became_active":"2024-04-17T19:53:09.534631+0000","last_became_peered":"2024-04-17T19:53:09.534631+0000","last_unstale":"2024-04-17T19:53:45.457150+0000","last_undegraded":"2024-04-17T19:53:45.457150+0000","last_fullsized":"2024-04-17T19:53:45.457150+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:30:27.062045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.449100+0000","last_change":"2024-04-17T19:53:05.460324+0000","last_active":"2024-04-17T19:53:45.449100+0000","last_peered":"2024-04-17T19:53:45.449100+0000","last_clean":"2024-04-17T19:53:45.449100+0000","last_became_active":"2024-04-17T19:53:05.459941+0000","last_became_peered":"2024-04-17T19:53:05.459941+0000","last_unstale":"2024-04-17T19:53:45.449100+0000","last_undegraded":"2024-04-17T19:53:45.449100+0000","last_fullsized":"2024-04-17T19:53:45.449100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:34:03.644428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.453037+0000","last_change":"2024-04-17T19:53:04.467765+0000","last_active":"2024-04-17T19:53:45.453037+0000","last_peered":"2024-04-17T19:53:45.453037+0000","last_clean":"2024-04-17T19:53:45.453037+0000","last_became_active":"2024-04-17T19:53:04.466753+0000","last_became_peered":"2024-04-17T19:53:04.466753+0000","last_unstale":"2024-04-17T19:53:45.453037+0000","last_undegraded":"2024-04-17T19:53:45.453037+0000","last_fullsized":"2024-04-17T19:53:45.453037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:53:36.130201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.564913+0000","last_change":"2024-04-17T19:53:09.519632+0000","last_active":"2024-04-17T19:53:45.564913+0000","last_peered":"2024-04-17T19:53:45.564913+0000","last_clean":"2024-04-17T19:53:45.564913+0000","last_became_active":"2024-04-17T19:53:09.518979+0000","last_became_peered":"2024-04-17T19:53:09.518979+0000","last_unstale":"2024-04-17T19:53:45.564913+0000","last_undegraded":"2024-04-17T19:53:45.564913+0000","last_fullsized":"2024-04-17T19:53:45.564913+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:07:11.268705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.451403+0000","last_change":"2024-04-17T19:53:05.464583+0000","last_active":"2024-04-17T19:53:45.451403+0000","last_peered":"2024-04-17T19:53:45.451403+0000","last_clean":"2024-04-17T19:53:45.451403+0000","last_became_active":"2024-04-17T19:53:05.464158+0000","last_became_peered":"2024-04-17T19:53:05.464158+0000","last_unstale":"2024-04-17T19:53:45.451403+0000","last_undegraded":"2024-04-17T19:53:45.451403+0000","last_fullsized":"2024-04-17T19:53:45.451403+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:38:41.511185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.449354+0000","last_change":"2024-04-17T19:53:04.477502+0000","last_active":"2024-04-17T19:53:45.449354+0000","last_peered":"2024-04-17T19:53:45.449354+0000","last_clean":"2024-04-17T19:53:45.449354+0000","last_became_active":"2024-04-17T19:53:04.477162+0000","last_became_peered":"2024-04-17T19:53:04.477162+0000","last_unstale":"2024-04-17T19:53:45.449354+0000","last_undegraded":"2024-04-17T19:53:45.449354+0000","last_fullsized":"2024-04-17T19:53:45.449354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:21:36.152247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.580275+0000","last_change":"2024-04-17T19:53:09.533476+0000","last_active":"2024-04-17T19:53:45.580275+0000","last_peered":"2024-04-17T19:53:45.580275+0000","last_clean":"2024-04-17T19:53:45.580275+0000","last_became_active":"2024-04-17T19:53:09.532715+0000","last_became_peered":"2024-04-17T19:53:09.532715+0000","last_unstale":"2024-04-17T19:53:45.580275+0000","last_undegraded":"2024-04-17T19:53:45.580275+0000","last_fullsized":"2024-04-17T19:53:45.580275+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:38:45.556791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.564867+0000","last_change":"2024-04-17T19:53:05.473330+0000","last_active":"2024-04-17T19:53:45.564867+0000","last_peered":"2024-04-17T19:53:45.564867+0000","last_clean":"2024-04-17T19:53:45.564867+0000","last_became_active":"2024-04-17T19:53:05.468223+0000","last_became_peered":"2024-04-17T19:53:05.468223+0000","last_unstale":"2024-04-17T19:53:45.564867+0000","last_undegraded":"2024-04-17T19:53:45.564867+0000","last_fullsized":"2024-04-17T19:53:45.564867+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:01:34.461822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452279+0000","last_change":"2024-04-17T19:53:04.461896+0000","last_active":"2024-04-17T19:53:45.452279+0000","last_peered":"2024-04-17T19:53:45.452279+0000","last_clean":"2024-04-17T19:53:45.452279+0000","last_became_active":"2024-04-17T19:53:04.460919+0000","last_became_peered":"2024-04-17T19:53:04.460919+0000","last_unstale":"2024-04-17T19:53:45.452279+0000","last_undegraded":"2024-04-17T19:53:45.452279+0000","last_fullsized":"2024-04-17T19:53:45.452279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:22:17.837334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.461171+0000","last_change":"2024-04-17T19:53:09.547397+0000","last_active":"2024-04-17T19:53:45.461171+0000","last_peered":"2024-04-17T19:53:45.461171+0000","last_clean":"2024-04-17T19:53:45.461171+0000","last_became_active":"2024-04-17T19:53:09.546048+0000","last_became_peered":"2024-04-17T19:53:09.546048+0000","last_unstale":"2024-04-17T19:53:45.461171+0000","last_undegraded":"2024-04-17T19:53:45.461171+0000","last_fullsized":"2024-04-17T19:53:45.461171+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:58:59.810415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.579920+0000","last_change":"2024-04-17T19:53:05.474322+0000","last_active":"2024-04-17T19:53:45.579920+0000","last_peered":"2024-04-17T19:53:45.579920+0000","last_clean":"2024-04-17T19:53:45.579920+0000","last_became_active":"2024-04-17T19:53:05.473892+0000","last_became_peered":"2024-04-17T19:53:05.473892+0000","last_unstale":"2024-04-17T19:53:45.579920+0000","last_undegraded":"2024-04-17T19:53:45.579920+0000","last_fullsized":"2024-04-17T19:53:45.579920+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:18:12.267644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.447293+0000","last_change":"2024-04-17T19:53:04.460138+0000","last_active":"2024-04-17T19:53:45.447293+0000","last_peered":"2024-04-17T19:53:45.447293+0000","last_clean":"2024-04-17T19:53:45.447293+0000","last_became_active":"2024-04-17T19:53:04.459663+0000","last_became_peered":"2024-04-17T19:53:04.459663+0000","last_unstale":"2024-04-17T19:53:45.447293+0000","last_undegraded":"2024-04-17T19:53:45.447293+0000","last_fullsized":"2024-04-17T19:53:45.447293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:06:00.469757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.459601+0000","last_change":"2024-04-17T19:53:09.533802+0000","last_active":"2024-04-17T19:53:45.459601+0000","last_peered":"2024-04-17T19:53:45.459601+0000","last_clean":"2024-04-17T19:53:45.459601+0000","last_became_active":"2024-04-17T19:53:09.532504+0000","last_became_peered":"2024-04-17T19:53:09.532504+0000","last_unstale":"2024-04-17T19:53:45.459601+0000","last_undegraded":"2024-04-17T19:53:45.459601+0000","last_fullsized":"2024-04-17T19:53:45.459601+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:04:59.171017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.566317+0000","last_change":"2024-04-17T19:53:05.467855+0000","last_active":"2024-04-17T19:53:45.566317+0000","last_peered":"2024-04-17T19:53:45.566317+0000","last_clean":"2024-04-17T19:53:45.566317+0000","last_became_active":"2024-04-17T19:53:05.467349+0000","last_became_peered":"2024-04-17T19:53:05.467349+0000","last_unstale":"2024-04-17T19:53:45.566317+0000","last_undegraded":"2024-04-17T19:53:45.566317+0000","last_fullsized":"2024-04-17T19:53:45.566317+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:52:55.878755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.567245+0000","last_change":"2024-04-17T19:53:04.465826+0000","last_active":"2024-04-17T19:53:45.567245+0000","last_peered":"2024-04-17T19:53:45.567245+0000","last_clean":"2024-04-17T19:53:45.567245+0000","last_became_active":"2024-04-17T19:53:04.465333+0000","last_became_peered":"2024-04-17T19:53:04.465333+0000","last_unstale":"2024-04-17T19:53:45.567245+0000","last_undegraded":"2024-04-17T19:53:45.567245+0000","last_fullsized":"2024-04-17T19:53:45.567245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:25:21.542158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.451925+0000","last_change":"2024-04-17T19:53:09.550127+0000","last_active":"2024-04-17T19:53:45.451925+0000","last_peered":"2024-04-17T19:53:45.451925+0000","last_clean":"2024-04-17T19:53:45.451925+0000","last_became_active":"2024-04-17T19:53:09.548109+0000","last_became_peered":"2024-04-17T19:53:09.548109+0000","last_unstale":"2024-04-17T19:53:45.451925+0000","last_undegraded":"2024-04-17T19:53:45.451925+0000","last_fullsized":"2024-04-17T19:53:45.451925+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:03:47.252621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452197+0000","last_change":"2024-04-17T19:53:05.455185+0000","last_active":"2024-04-17T19:53:45.452197+0000","last_peered":"2024-04-17T19:53:45.452197+0000","last_clean":"2024-04-17T19:53:45.452197+0000","last_became_active":"2024-04-17T19:53:05.454358+0000","last_became_peered":"2024-04-17T19:53:05.454358+0000","last_unstale":"2024-04-17T19:53:45.452197+0000","last_undegraded":"2024-04-17T19:53:45.452197+0000","last_fullsized":"2024-04-17T19:53:45.452197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:26:54.093651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.586332+0000","last_change":"2024-04-17T19:53:04.474288+0000","last_active":"2024-04-17T19:53:45.586332+0000","last_peered":"2024-04-17T19:53:45.586332+0000","last_clean":"2024-04-17T19:53:45.586332+0000","last_became_active":"2024-04-17T19:53:04.473389+0000","last_became_peered":"2024-04-17T19:53:04.473389+0000","last_unstale":"2024-04-17T19:53:45.586332+0000","last_undegraded":"2024-04-17T19:53:45.586332+0000","last_fullsized":"2024-04-17T19:53:45.586332+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:31:27.754909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.566775+0000","last_change":"2024-04-17T19:53:09.524630+0000","last_active":"2024-04-17T19:53:45.566775+0000","last_peered":"2024-04-17T19:53:45.566775+0000","last_clean":"2024-04-17T19:53:45.566775+0000","last_became_active":"2024-04-17T19:53:09.521522+0000","last_became_peered":"2024-04-17T19:53:09.521522+0000","last_unstale":"2024-04-17T19:53:45.566775+0000","last_undegraded":"2024-04-17T19:53:45.566775+0000","last_fullsized":"2024-04-17T19:53:45.566775+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:59:47.402073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.448592+0000","last_change":"2024-04-17T19:53:05.455865+0000","last_active":"2024-04-17T19:53:45.448592+0000","last_peered":"2024-04-17T19:53:45.448592+0000","last_clean":"2024-04-17T19:53:45.448592+0000","last_became_active":"2024-04-17T19:53:05.455429+0000","last_became_peered":"2024-04-17T19:53:05.455429+0000","last_unstale":"2024-04-17T19:53:45.448592+0000","last_undegraded":"2024-04-17T19:53:45.448592+0000","last_fullsized":"2024-04-17T19:53:45.448592+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:01:34.461822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"29'20","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:14.279048+0000","last_change":"2024-04-17T19:53:04.460295+0000","last_active":"2024-04-17T19:54:14.279048+0000","last_peered":"2024-04-17T19:54:14.279048+0000","last_clean":"2024-04-17T19:54:14.279048+0000","last_became_active":"2024-04-17T19:53:04.459855+0000","last_became_peered":"2024-04-17T19:53:04.459855+0000","last_unstale":"2024-04-17T19:54:14.279048+0000","last_undegraded":"2024-04-17T19:54:14.279048+0000","last_fullsized":"2024-04-17T19:54:14.279048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:21:45.875274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6029,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.451349+0000","last_change":"2024-04-17T19:53:09.530008+0000","last_active":"2024-04-17T19:53:45.451349+0000","last_peered":"2024-04-17T19:53:45.451349+0000","last_clean":"2024-04-17T19:53:45.451349+0000","last_became_active":"2024-04-17T19:53:09.528987+0000","last_became_peered":"2024-04-17T19:53:09.528987+0000","last_unstale":"2024-04-17T19:53:45.451349+0000","last_undegraded":"2024-04-17T19:53:45.451349+0000","last_fullsized":"2024-04-17T19:53:45.451349+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:34:07.690034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.564991+0000","last_change":"2024-04-17T19:53:05.472755+0000","last_active":"2024-04-17T19:53:45.564991+0000","last_peered":"2024-04-17T19:53:45.564991+0000","last_clean":"2024-04-17T19:53:45.564991+0000","last_became_active":"2024-04-17T19:53:05.468432+0000","last_became_peered":"2024-04-17T19:53:05.468432+0000","last_unstale":"2024-04-17T19:53:45.564991+0000","last_undegraded":"2024-04-17T19:53:45.564991+0000","last_fullsized":"2024-04-17T19:53:45.564991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:30:23.016439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.587107+0000","last_change":"2024-04-17T19:53:04.474378+0000","last_active":"2024-04-17T19:53:45.587107+0000","last_peered":"2024-04-17T19:53:45.587107+0000","last_clean":"2024-04-17T19:53:45.587107+0000","last_became_active":"2024-04-17T19:53:04.473458+0000","last_became_peered":"2024-04-17T19:53:04.473458+0000","last_unstale":"2024-04-17T19:53:45.587107+0000","last_undegraded":"2024-04-17T19:53:45.587107+0000","last_fullsized":"2024-04-17T19:53:45.587107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:16:30.888573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.450618+0000","last_change":"2024-04-17T19:53:09.558527+0000","last_active":"2024-04-17T19:53:45.450618+0000","last_peered":"2024-04-17T19:53:45.450618+0000","last_clean":"2024-04-17T19:53:45.450618+0000","last_became_active":"2024-04-17T19:53:09.557653+0000","last_became_peered":"2024-04-17T19:53:09.557653+0000","last_unstale":"2024-04-17T19:53:45.450618+0000","last_undegraded":"2024-04-17T19:53:45.450618+0000","last_fullsized":"2024-04-17T19:53:45.450618+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:01:38.507428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.460152+0000","last_change":"2024-04-17T19:53:05.467990+0000","last_active":"2024-04-17T19:53:45.460152+0000","last_peered":"2024-04-17T19:53:45.460152+0000","last_clean":"2024-04-17T19:53:45.460152+0000","last_became_active":"2024-04-17T19:53:05.461293+0000","last_became_peered":"2024-04-17T19:53:05.461293+0000","last_unstale":"2024-04-17T19:53:45.460152+0000","last_undegraded":"2024-04-17T19:53:45.460152+0000","last_fullsized":"2024-04-17T19:53:45.460152+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:01:34.461822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.449080+0000","last_change":"2024-04-17T19:53:04.472928+0000","last_active":"2024-04-17T19:53:45.449080+0000","last_peered":"2024-04-17T19:53:45.449080+0000","last_clean":"2024-04-17T19:53:45.449080+0000","last_became_active":"2024-04-17T19:53:04.467986+0000","last_became_peered":"2024-04-17T19:53:04.467986+0000","last_unstale":"2024-04-17T19:53:45.449080+0000","last_undegraded":"2024-04-17T19:53:45.449080+0000","last_fullsized":"2024-04-17T19:53:45.449080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:53:36.130201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.584286+0000","last_change":"2024-04-17T19:53:09.560792+0000","last_active":"2024-04-17T19:53:45.584286+0000","last_peered":"2024-04-17T19:53:45.584286+0000","last_clean":"2024-04-17T19:53:45.584286+0000","last_became_active":"2024-04-17T19:53:09.558779+0000","last_became_peered":"2024-04-17T19:53:09.558779+0000","last_unstale":"2024-04-17T19:53:45.584286+0000","last_undegraded":"2024-04-17T19:53:45.584286+0000","last_fullsized":"2024-04-17T19:53:45.584286+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:13:52.775623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.451247+0000","last_change":"2024-04-17T19:53:05.459934+0000","last_active":"2024-04-17T19:53:45.451247+0000","last_peered":"2024-04-17T19:53:45.451247+0000","last_clean":"2024-04-17T19:53:45.451247+0000","last_became_active":"2024-04-17T19:53:05.459538+0000","last_became_peered":"2024-04-17T19:53:05.459538+0000","last_unstale":"2024-04-17T19:53:45.451247+0000","last_undegraded":"2024-04-17T19:53:45.451247+0000","last_fullsized":"2024-04-17T19:53:45.451247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:25:22.553475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.581377+0000","last_change":"2024-04-17T19:53:04.460345+0000","last_active":"2024-04-17T19:53:45.581377+0000","last_peered":"2024-04-17T19:53:45.581377+0000","last_clean":"2024-04-17T19:53:45.581377+0000","last_became_active":"2024-04-17T19:53:04.459787+0000","last_became_peered":"2024-04-17T19:53:04.459787+0000","last_unstale":"2024-04-17T19:53:45.581377+0000","last_undegraded":"2024-04-17T19:53:45.581377+0000","last_fullsized":"2024-04-17T19:53:45.581377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:16:30.888573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.589100+0000","last_change":"2024-04-17T19:53:45.589100+0000","last_active":"2024-04-17T19:53:45.589100+0000","last_peered":"2024-04-17T19:53:45.589100+0000","last_clean":"2024-04-17T19:53:45.589100+0000","last_became_active":"2024-04-17T19:53:45.587729+0000","last_became_peered":"2024-04-17T19:53:45.587729+0000","last_unstale":"2024-04-17T19:53:45.589100+0000","last_undegraded":"2024-04-17T19:53:45.589100+0000","last_fullsized":"2024-04-17T19:53:45.589100+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:47:26.887721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,7],"acting":[4,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452474+0000","last_change":"2024-04-17T19:53:09.536930+0000","last_active":"2024-04-17T19:53:45.452474+0000","last_peered":"2024-04-17T19:53:45.452474+0000","last_clean":"2024-04-17T19:53:45.452474+0000","last_became_active":"2024-04-17T19:53:09.535559+0000","last_became_peered":"2024-04-17T19:53:09.535559+0000","last_unstale":"2024-04-17T19:53:45.452474+0000","last_undegraded":"2024-04-17T19:53:45.452474+0000","last_fullsized":"2024-04-17T19:53:45.452474+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:29:54.335720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.459931+0000","last_change":"2024-04-17T19:53:05.440653+0000","last_active":"2024-04-17T19:53:45.459931+0000","last_peered":"2024-04-17T19:53:45.459931+0000","last_clean":"2024-04-17T19:53:45.459931+0000","last_became_active":"2024-04-17T19:53:05.439793+0000","last_became_peered":"2024-04-17T19:53:05.439793+0000","last_unstale":"2024-04-17T19:53:45.459931+0000","last_undegraded":"2024-04-17T19:53:45.459931+0000","last_fullsized":"2024-04-17T19:53:45.459931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:10:21.772873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.565078+0000","last_change":"2024-04-17T19:53:04.461705+0000","last_active":"2024-04-17T19:53:45.565078+0000","last_peered":"2024-04-17T19:53:45.565078+0000","last_clean":"2024-04-17T19:53:45.565078+0000","last_became_active":"2024-04-17T19:53:04.461020+0000","last_became_peered":"2024-04-17T19:53:04.461020+0000","last_unstale":"2024-04-17T19:53:45.565078+0000","last_undegraded":"2024-04-17T19:53:45.565078+0000","last_fullsized":"2024-04-17T19:53:45.565078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:53:36.130201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.566746+0000","last_change":"2024-04-17T19:53:09.535147+0000","last_active":"2024-04-17T19:53:45.566746+0000","last_peered":"2024-04-17T19:53:45.566746+0000","last_clean":"2024-04-17T19:53:45.566746+0000","last_became_active":"2024-04-17T19:53:09.534655+0000","last_became_peered":"2024-04-17T19:53:09.534655+0000","last_unstale":"2024-04-17T19:53:45.566746+0000","last_undegraded":"2024-04-17T19:53:45.566746+0000","last_fullsized":"2024-04-17T19:53:45.566746+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:06:37.779654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452972+0000","last_change":"2024-04-17T19:53:05.455848+0000","last_active":"2024-04-17T19:53:45.452972+0000","last_peered":"2024-04-17T19:53:45.452972+0000","last_clean":"2024-04-17T19:53:45.452972+0000","last_became_active":"2024-04-17T19:53:05.452844+0000","last_became_peered":"2024-04-17T19:53:05.452844+0000","last_unstale":"2024-04-17T19:53:45.452972+0000","last_undegraded":"2024-04-17T19:53:45.452972+0000","last_fullsized":"2024-04-17T19:53:45.452972+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:54:27.523970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.453145+0000","last_change":"2024-04-17T19:53:04.470824+0000","last_active":"2024-04-17T19:53:45.453145+0000","last_peered":"2024-04-17T19:53:45.453145+0000","last_clean":"2024-04-17T19:53:45.453145+0000","last_became_active":"2024-04-17T19:53:04.469777+0000","last_became_peered":"2024-04-17T19:53:04.469777+0000","last_unstale":"2024-04-17T19:53:45.453145+0000","last_undegraded":"2024-04-17T19:53:45.453145+0000","last_fullsized":"2024-04-17T19:53:45.453145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:30:04.861958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.567218+0000","last_change":"2024-04-17T19:53:04.469785+0000","last_active":"2024-04-17T19:53:45.567218+0000","last_peered":"2024-04-17T19:53:45.567218+0000","last_clean":"2024-04-17T19:53:45.567218+0000","last_became_active":"2024-04-17T19:53:04.469297+0000","last_became_peered":"2024-04-17T19:53:04.469297+0000","last_unstale":"2024-04-17T19:53:45.567218+0000","last_undegraded":"2024-04-17T19:53:45.567218+0000","last_fullsized":"2024-04-17T19:53:45.567218+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:50:02.697725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452825+0000","last_change":"2024-04-17T19:53:05.460191+0000","last_active":"2024-04-17T19:53:45.452825+0000","last_peered":"2024-04-17T19:53:45.452825+0000","last_clean":"2024-04-17T19:53:45.452825+0000","last_became_active":"2024-04-17T19:53:05.459616+0000","last_became_peered":"2024-04-17T19:53:05.459616+0000","last_unstale":"2024-04-17T19:53:45.452825+0000","last_undegraded":"2024-04-17T19:53:45.452825+0000","last_fullsized":"2024-04-17T19:53:45.452825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:12:15.307126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.464499+0000","last_change":"2024-04-17T19:53:45.464499+0000","last_active":"2024-04-17T19:53:45.464499+0000","last_peered":"2024-04-17T19:53:45.464499+0000","last_clean":"2024-04-17T19:53:45.464499+0000","last_became_active":"2024-04-17T19:53:45.462598+0000","last_became_peered":"2024-04-17T19:53:45.462598+0000","last_unstale":"2024-04-17T19:53:45.464499+0000","last_undegraded":"2024-04-17T19:53:45.464499+0000","last_fullsized":"2024-04-17T19:53:45.464499+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:27:35.519260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,2],"acting":[4,6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.458228+0000","last_change":"2024-04-17T19:53:04.487292+0000","last_active":"2024-04-17T19:53:45.458228+0000","last_peered":"2024-04-17T19:53:45.458228+0000","last_clean":"2024-04-17T19:53:45.458228+0000","last_became_active":"2024-04-17T19:53:04.486707+0000","last_became_peered":"2024-04-17T19:53:04.486707+0000","last_unstale":"2024-04-17T19:53:45.458228+0000","last_undegraded":"2024-04-17T19:53:45.458228+0000","last_fullsized":"2024-04-17T19:53:45.458228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:48:50.049562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.580306+0000","last_change":"2024-04-17T19:53:05.449319+0000","last_active":"2024-04-17T19:53:45.580306+0000","last_peered":"2024-04-17T19:53:45.580306+0000","last_clean":"2024-04-17T19:53:45.580306+0000","last_became_active":"2024-04-17T19:53:05.448374+0000","last_became_peered":"2024-04-17T19:53:05.448374+0000","last_unstale":"2024-04-17T19:53:45.580306+0000","last_undegraded":"2024-04-17T19:53:45.580306+0000","last_fullsized":"2024-04-17T19:53:45.580306+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:21:37.163564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.586836+0000","last_change":"2024-04-17T19:53:09.561127+0000","last_active":"2024-04-17T19:53:45.586836+0000","last_peered":"2024-04-17T19:53:45.586836+0000","last_clean":"2024-04-17T19:53:45.586836+0000","last_became_active":"2024-04-17T19:53:09.560076+0000","last_became_peered":"2024-04-17T19:53:09.560076+0000","last_unstale":"2024-04-17T19:53:45.586836+0000","last_undegraded":"2024-04-17T19:53:45.586836+0000","last_fullsized":"2024-04-17T19:53:45.586836+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:25:20.343613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.450144+0000","last_change":"2024-04-17T19:53:05.472665+0000","last_active":"2024-04-17T19:53:45.450144+0000","last_peered":"2024-04-17T19:53:45.450144+0000","last_clean":"2024-04-17T19:53:45.450144+0000","last_became_active":"2024-04-17T19:53:05.472324+0000","last_became_peered":"2024-04-17T19:53:05.472324+0000","last_unstale":"2024-04-17T19:53:45.450144+0000","last_undegraded":"2024-04-17T19:53:45.450144+0000","last_fullsized":"2024-04-17T19:53:45.450144+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:50:03.709043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.584932+0000","last_change":"2024-04-17T19:53:05.477190+0000","last_active":"2024-04-17T19:53:45.584932+0000","last_peered":"2024-04-17T19:53:45.584932+0000","last_clean":"2024-04-17T19:53:45.584932+0000","last_became_active":"2024-04-17T19:53:05.475823+0000","last_became_peered":"2024-04-17T19:53:05.475823+0000","last_unstale":"2024-04-17T19:53:45.584932+0000","last_undegraded":"2024-04-17T19:53:45.584932+0000","last_fullsized":"2024-04-17T19:53:45.584932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:53:37.141518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.564743+0000","last_change":"2024-04-17T19:53:05.453565+0000","last_active":"2024-04-17T19:53:45.564743+0000","last_peered":"2024-04-17T19:53:45.564743+0000","last_clean":"2024-04-17T19:53:45.564743+0000","last_became_active":"2024-04-17T19:53:05.453142+0000","last_became_peered":"2024-04-17T19:53:05.453142+0000","last_unstale":"2024-04-17T19:53:45.564743+0000","last_undegraded":"2024-04-17T19:53:45.564743+0000","last_fullsized":"2024-04-17T19:53:45.564743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:39:58.812875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.457952+0000","last_change":"2024-04-17T19:53:05.476450+0000","last_active":"2024-04-17T19:53:45.457952+0000","last_peered":"2024-04-17T19:53:45.457952+0000","last_clean":"2024-04-17T19:53:45.457952+0000","last_became_active":"2024-04-17T19:53:05.473931+0000","last_became_peered":"2024-04-17T19:53:05.473931+0000","last_unstale":"2024-04-17T19:53:45.457952+0000","last_undegraded":"2024-04-17T19:53:45.457952+0000","last_fullsized":"2024-04-17T19:53:45.457952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:10:21.772873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452420+0000","last_change":"2024-04-17T19:53:05.469653+0000","last_active":"2024-04-17T19:53:45.452420+0000","last_peered":"2024-04-17T19:53:45.452420+0000","last_clean":"2024-04-17T19:53:45.452420+0000","last_became_active":"2024-04-17T19:53:05.467838+0000","last_became_peered":"2024-04-17T19:53:05.467838+0000","last_unstale":"2024-04-17T19:53:45.452420+0000","last_undegraded":"2024-04-17T19:53:45.452420+0000","last_fullsized":"2024-04-17T19:53:45.452420+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:38:51.699072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.454087+0000","last_change":"2024-04-17T19:53:05.462678+0000","last_active":"2024-04-17T19:53:45.454087+0000","last_peered":"2024-04-17T19:53:45.454087+0000","last_clean":"2024-04-17T19:53:45.454087+0000","last_became_active":"2024-04-17T19:53:05.461829+0000","last_became_peered":"2024-04-17T19:53:05.461829+0000","last_unstale":"2024-04-17T19:53:45.454087+0000","last_undegraded":"2024-04-17T19:53:45.454087+0000","last_fullsized":"2024-04-17T19:53:45.454087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:03:53.876774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.451061+0000","last_change":"2024-04-17T19:53:05.465993+0000","last_active":"2024-04-17T19:53:45.451061+0000","last_peered":"2024-04-17T19:53:45.451061+0000","last_clean":"2024-04-17T19:53:45.451061+0000","last_became_active":"2024-04-17T19:53:05.465547+0000","last_became_peered":"2024-04-17T19:53:05.465547+0000","last_unstale":"2024-04-17T19:53:45.451061+0000","last_undegraded":"2024-04-17T19:53:45.451061+0000","last_fullsized":"2024-04-17T19:53:45.451061+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:12:03.449509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.459282+0000","last_change":"2024-04-17T19:53:05.477188+0000","last_active":"2024-04-17T19:53:45.459282+0000","last_peered":"2024-04-17T19:53:45.459282+0000","last_clean":"2024-04-17T19:53:45.459282+0000","last_became_active":"2024-04-17T19:53:05.474798+0000","last_became_peered":"2024-04-17T19:53:05.474798+0000","last_unstale":"2024-04-17T19:53:45.459282+0000","last_undegraded":"2024-04-17T19:53:45.459282+0000","last_fullsized":"2024-04-17T19:53:45.459282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:15:45.727550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.564722+0000","last_change":"2024-04-17T19:53:05.484009+0000","last_active":"2024-04-17T19:53:45.564722+0000","last_peered":"2024-04-17T19:53:45.564722+0000","last_clean":"2024-04-17T19:53:45.564722+0000","last_became_active":"2024-04-17T19:53:05.483664+0000","last_became_peered":"2024-04-17T19:53:05.483664+0000","last_unstale":"2024-04-17T19:53:45.564722+0000","last_undegraded":"2024-04-17T19:53:45.564722+0000","last_fullsized":"2024-04-17T19:53:45.564722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:47:05.354826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.456386+0000","last_change":"2024-04-17T19:53:05.466532+0000","last_active":"2024-04-17T19:53:45.456386+0000","last_peered":"2024-04-17T19:53:45.456386+0000","last_clean":"2024-04-17T19:53:45.456386+0000","last_became_active":"2024-04-17T19:53:05.465302+0000","last_became_peered":"2024-04-17T19:53:05.465302+0000","last_unstale":"2024-04-17T19:53:45.456386+0000","last_undegraded":"2024-04-17T19:53:45.456386+0000","last_fullsized":"2024-04-17T19:53:45.456386+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:27:51.520335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.579924+0000","last_change":"2024-04-17T19:53:05.456313+0000","last_active":"2024-04-17T19:53:45.579924+0000","last_peered":"2024-04-17T19:53:45.579924+0000","last_clean":"2024-04-17T19:53:45.579924+0000","last_became_active":"2024-04-17T19:53:05.455862+0000","last_became_peered":"2024-04-17T19:53:05.455862+0000","last_unstale":"2024-04-17T19:53:45.579924+0000","last_undegraded":"2024-04-17T19:53:45.579924+0000","last_fullsized":"2024-04-17T19:53:45.579924+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:23:03.879786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452546+0000","last_change":"2024-04-17T19:53:05.465083+0000","last_active":"2024-04-17T19:53:45.452546+0000","last_peered":"2024-04-17T19:53:45.452546+0000","last_clean":"2024-04-17T19:53:45.452546+0000","last_became_active":"2024-04-17T19:53:05.463806+0000","last_became_peered":"2024-04-17T19:53:05.463806+0000","last_unstale":"2024-04-17T19:53:45.452546+0000","last_undegraded":"2024-04-17T19:53:45.452546+0000","last_fullsized":"2024-04-17T19:53:45.452546+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:25:16.298007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.448031+0000","last_change":"2024-04-17T19:53:05.464340+0000","last_active":"2024-04-17T19:53:45.448031+0000","last_peered":"2024-04-17T19:53:45.448031+0000","last_clean":"2024-04-17T19:53:45.448031+0000","last_became_active":"2024-04-17T19:53:05.463286+0000","last_became_peered":"2024-04-17T19:53:05.463286+0000","last_unstale":"2024-04-17T19:53:45.448031+0000","last_undegraded":"2024-04-17T19:53:45.448031+0000","last_fullsized":"2024-04-17T19:53:45.448031+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:54:27.523970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.565133+0000","last_change":"2024-04-17T19:53:05.475791+0000","last_active":"2024-04-17T19:53:45.565133+0000","last_peered":"2024-04-17T19:53:45.565133+0000","last_clean":"2024-04-17T19:53:45.565133+0000","last_became_active":"2024-04-17T19:53:05.475372+0000","last_became_peered":"2024-04-17T19:53:05.475372+0000","last_unstale":"2024-04-17T19:53:45.565133+0000","last_undegraded":"2024-04-17T19:53:45.565133+0000","last_fullsized":"2024-04-17T19:53:45.565133+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:10:32.839503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.582332+0000","last_change":"2024-04-17T19:53:05.496650+0000","last_active":"2024-04-17T19:53:45.582332+0000","last_peered":"2024-04-17T19:53:45.582332+0000","last_clean":"2024-04-17T19:53:45.582332+0000","last_became_active":"2024-04-17T19:53:05.495881+0000","last_became_peered":"2024-04-17T19:53:05.495881+0000","last_unstale":"2024-04-17T19:53:45.582332+0000","last_undegraded":"2024-04-17T19:53:45.582332+0000","last_fullsized":"2024-04-17T19:53:45.582332+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:23:03.879786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.565817+0000","last_change":"2024-04-17T19:53:05.461335+0000","last_active":"2024-04-17T19:53:45.565817+0000","last_peered":"2024-04-17T19:53:45.565817+0000","last_clean":"2024-04-17T19:53:45.565817+0000","last_became_active":"2024-04-17T19:53:05.460831+0000","last_became_peered":"2024-04-17T19:53:05.460831+0000","last_unstale":"2024-04-17T19:53:45.565817+0000","last_undegraded":"2024-04-17T19:53:45.565817+0000","last_fullsized":"2024-04-17T19:53:45.565817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:22:55.343347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.564726+0000","last_change":"2024-04-17T19:53:05.473875+0000","last_active":"2024-04-17T19:53:45.564726+0000","last_peered":"2024-04-17T19:53:45.564726+0000","last_clean":"2024-04-17T19:53:45.564726+0000","last_became_active":"2024-04-17T19:53:05.467366+0000","last_became_peered":"2024-04-17T19:53:05.467366+0000","last_unstale":"2024-04-17T19:53:45.564726+0000","last_undegraded":"2024-04-17T19:53:45.564726+0000","last_fullsized":"2024-04-17T19:53:45.564726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:05:21.173050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.588365+0000","last_change":"2024-04-17T19:53:45.588365+0000","last_active":"2024-04-17T19:53:45.588365+0000","last_peered":"2024-04-17T19:53:45.588365+0000","last_clean":"2024-04-17T19:53:45.588365+0000","last_became_active":"2024-04-17T19:53:45.587213+0000","last_became_peered":"2024-04-17T19:53:45.587213+0000","last_unstale":"2024-04-17T19:53:45.588365+0000","last_undegraded":"2024-04-17T19:53:45.588365+0000","last_fullsized":"2024-04-17T19:53:45.588365+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:25:48.397875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.451842+0000","last_change":"2024-04-17T19:53:05.465968+0000","last_active":"2024-04-17T19:53:45.451842+0000","last_peered":"2024-04-17T19:53:45.451842+0000","last_clean":"2024-04-17T19:53:45.451842+0000","last_became_active":"2024-04-17T19:53:05.465145+0000","last_became_peered":"2024-04-17T19:53:05.465145+0000","last_unstale":"2024-04-17T19:53:45.451842+0000","last_undegraded":"2024-04-17T19:53:45.451842+0000","last_fullsized":"2024-04-17T19:53:45.451842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:47:46.099722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.453510+0000","last_change":"2024-04-17T19:53:05.463993+0000","last_active":"2024-04-17T19:53:45.453510+0000","last_peered":"2024-04-17T19:53:45.453510+0000","last_clean":"2024-04-17T19:53:45.453510+0000","last_became_active":"2024-04-17T19:53:05.463172+0000","last_became_peered":"2024-04-17T19:53:05.463172+0000","last_unstale":"2024-04-17T19:53:45.453510+0000","last_undegraded":"2024-04-17T19:53:45.453510+0000","last_fullsized":"2024-04-17T19:53:45.453510+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:29:50.457953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.447976+0000","last_change":"2024-04-17T19:53:05.471782+0000","last_active":"2024-04-17T19:53:45.447976+0000","last_peered":"2024-04-17T19:53:45.447976+0000","last_clean":"2024-04-17T19:53:45.447976+0000","last_became_active":"2024-04-17T19:53:05.471347+0000","last_became_peered":"2024-04-17T19:53:05.471347+0000","last_unstale":"2024-04-17T19:53:45.447976+0000","last_undegraded":"2024-04-17T19:53:45.447976+0000","last_fullsized":"2024-04-17T19:53:45.447976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:42:22.878631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.448544+0000","last_change":"2024-04-17T19:53:05.460256+0000","last_active":"2024-04-17T19:53:45.448544+0000","last_peered":"2024-04-17T19:53:45.448544+0000","last_clean":"2024-04-17T19:53:45.448544+0000","last_became_active":"2024-04-17T19:53:05.459869+0000","last_became_peered":"2024-04-17T19:53:05.459869+0000","last_unstale":"2024-04-17T19:53:45.448544+0000","last_undegraded":"2024-04-17T19:53:45.448544+0000","last_fullsized":"2024-04-17T19:53:45.448544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:47:05.354826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.448801+0000","last_change":"2024-04-17T19:53:05.467331+0000","last_active":"2024-04-17T19:53:45.448801+0000","last_peered":"2024-04-17T19:53:45.448801+0000","last_clean":"2024-04-17T19:53:45.448801+0000","last_became_active":"2024-04-17T19:53:05.467015+0000","last_became_peered":"2024-04-17T19:53:05.467015+0000","last_unstale":"2024-04-17T19:53:45.448801+0000","last_undegraded":"2024-04-17T19:53:45.448801+0000","last_fullsized":"2024-04-17T19:53:45.448801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:10:32.839503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.581375+0000","last_change":"2024-04-17T19:53:05.462631+0000","last_active":"2024-04-17T19:53:45.581375+0000","last_peered":"2024-04-17T19:53:45.581375+0000","last_clean":"2024-04-17T19:53:45.581375+0000","last_became_active":"2024-04-17T19:53:05.462217+0000","last_became_peered":"2024-04-17T19:53:05.462217+0000","last_unstale":"2024-04-17T19:53:45.581375+0000","last_undegraded":"2024-04-17T19:53:45.581375+0000","last_fullsized":"2024-04-17T19:53:45.581375+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:50:03.709043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452168+0000","last_change":"2024-04-17T19:53:05.467941+0000","last_active":"2024-04-17T19:53:45.452168+0000","last_peered":"2024-04-17T19:53:45.452168+0000","last_clean":"2024-04-17T19:53:45.452168+0000","last_became_active":"2024-04-17T19:53:05.467093+0000","last_became_peered":"2024-04-17T19:53:05.467093+0000","last_unstale":"2024-04-17T19:53:45.452168+0000","last_undegraded":"2024-04-17T19:53:45.452168+0000","last_fullsized":"2024-04-17T19:53:45.452168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:12:15.307126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.447185+0000","last_change":"2024-04-17T19:53:05.465748+0000","last_active":"2024-04-17T19:53:45.447185+0000","last_peered":"2024-04-17T19:53:45.447185+0000","last_clean":"2024-04-17T19:53:45.447185+0000","last_became_active":"2024-04-17T19:53:05.465436+0000","last_became_peered":"2024-04-17T19:53:05.465436+0000","last_unstale":"2024-04-17T19:53:45.447185+0000","last_undegraded":"2024-04-17T19:53:45.447185+0000","last_fullsized":"2024-04-17T19:53:45.447185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:02:40.799364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.450402+0000","last_change":"2024-04-17T19:53:05.458098+0000","last_active":"2024-04-17T19:53:45.450402+0000","last_peered":"2024-04-17T19:53:45.450402+0000","last_clean":"2024-04-17T19:53:45.450402+0000","last_became_active":"2024-04-17T19:53:05.457656+0000","last_became_peered":"2024-04-17T19:53:05.457656+0000","last_unstale":"2024-04-17T19:53:45.450402+0000","last_undegraded":"2024-04-17T19:53:45.450402+0000","last_fullsized":"2024-04-17T19:53:45.450402+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:40:31.558660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.447486+0000","last_change":"2024-04-17T19:53:05.477086+0000","last_active":"2024-04-17T19:53:45.447486+0000","last_peered":"2024-04-17T19:53:45.447486+0000","last_clean":"2024-04-17T19:53:45.447486+0000","last_became_active":"2024-04-17T19:53:05.476734+0000","last_became_peered":"2024-04-17T19:53:05.476734+0000","last_unstale":"2024-04-17T19:53:45.447486+0000","last_undegraded":"2024-04-17T19:53:45.447486+0000","last_fullsized":"2024-04-17T19:53:45.447486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:10:21.772873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.450605+0000","last_change":"2024-04-17T19:53:05.458378+0000","last_active":"2024-04-17T19:53:45.450605+0000","last_peered":"2024-04-17T19:53:45.450605+0000","last_clean":"2024-04-17T19:53:45.450605+0000","last_became_active":"2024-04-17T19:53:05.457210+0000","last_became_peered":"2024-04-17T19:53:05.457210+0000","last_unstale":"2024-04-17T19:53:45.450605+0000","last_undegraded":"2024-04-17T19:53:45.450605+0000","last_fullsized":"2024-04-17T19:53:45.450605+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:23:03.879786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.455270+0000","last_change":"2024-04-17T19:53:05.455054+0000","last_active":"2024-04-17T19:53:45.455270+0000","last_peered":"2024-04-17T19:53:45.455270+0000","last_clean":"2024-04-17T19:53:45.455270+0000","last_became_active":"2024-04-17T19:53:05.454065+0000","last_became_peered":"2024-04-17T19:53:05.454065+0000","last_unstale":"2024-04-17T19:53:45.455270+0000","last_undegraded":"2024-04-17T19:53:45.455270+0000","last_fullsized":"2024-04-17T19:53:45.455270+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:42:22.878631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.457715+0000","last_change":"2024-04-17T19:53:05.456675+0000","last_active":"2024-04-17T19:53:45.457715+0000","last_peered":"2024-04-17T19:53:45.457715+0000","last_clean":"2024-04-17T19:53:45.457715+0000","last_became_active":"2024-04-17T19:53:05.455779+0000","last_became_peered":"2024-04-17T19:53:05.455779+0000","last_unstale":"2024-04-17T19:53:45.457715+0000","last_undegraded":"2024-04-17T19:53:45.457715+0000","last_fullsized":"2024-04-17T19:53:45.457715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:02:40.799364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.448945+0000","last_change":"2024-04-17T19:53:05.461773+0000","last_active":"2024-04-17T19:53:45.448945+0000","last_peered":"2024-04-17T19:53:45.448945+0000","last_clean":"2024-04-17T19:53:45.448945+0000","last_became_active":"2024-04-17T19:53:05.461324+0000","last_became_peered":"2024-04-17T19:53:05.461324+0000","last_unstale":"2024-04-17T19:53:45.448945+0000","last_undegraded":"2024-04-17T19:53:45.448945+0000","last_fullsized":"2024-04-17T19:53:45.448945+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:05:21.173050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6827,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":13654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":53,"ondisk_log_size":53,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509462,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":315392,"data_stored":124356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509461,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343928,"statfs":{"total":96636764160,"available":96608182272,"internally_reserved":0,"allocated":909312,"data_stored":714692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509461,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":331776,"data_stored":130933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509461,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":311296,"data_stored":124814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509461,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31492,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340348,"statfs":{"total":96636764160,"available":96604516352,"internally_reserved":0,"allocated":323584,"data_stored":130261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509460,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32068,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339772,"statfs":{"total":96636764160,"available":96603926528,"internally_reserved":0,"allocated":905216,"data_stored":714670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509461,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31492,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340348,"statfs":{"total":96636764160,"available":96604516352,"internally_reserved":0,"allocated":315392,"data_stored":124288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542165,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":307200,"data_stored":124232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":6029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":6701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T19:54:26.391 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-17T19:54:26.391 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T19:54:26.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.580+0000 7f0fbbb52640 1 Processor -- start 2024-04-17T19:54:26.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.580+0000 7f0fbbb52640 1 -- start start 2024-04-17T19:54:26.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.580+0000 7f0fbbb52640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0fb40b6f60 0x7f0fb40ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:26.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.580+0000 7f0fbbb52640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0fb40cd090 0x7f0fb40cd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:26.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.580+0000 7f0fbbb52640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fb40cf180 con 0x7f0fb40ced70 2024-04-17T19:54:26.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.580+0000 7f0fbbb52640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f0fb40b2c70 con 0x7f0fb40b6f60 2024-04-17T19:54:26.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.580+0000 7f0fbbb52640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f0fb40ce4d0 con 0x7f0fb40cd090 2024-04-17T19:54:26.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.580+0000 7f0fb90ed640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0fb40b6f60 0x7f0fb40ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:26.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.580+0000 7f0fb98ee640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f0fb40ced70 0x7f0fb40b6850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:44194/0 (socket says 172.21.15.18:44194) 2024-04-17T19:54:26.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.580+0000 7f0fb90ed640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0fb40b6f60 0x7f0fb40ccb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34152/0 (socket says 172.21.15.18:34152) 2024-04-17T19:54:26.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.580+0000 7f0fb98ee640 1 -- 172.21.15.18:0/763011115 learned_addr learned my addr 172.21.15.18:0/763011115 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:54:26.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.580+0000 7f0fba0ef640 1 --2- 172.21.15.18:0/763011115 >> v2:172.21.15.173:3300/0 conn(0x7f0fb40cd090 0x7f0fb40cd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:26.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.580+0000 7f0fb90ed640 1 -- 172.21.15.18:0/763011115 >> v2:172.21.15.173:3300/0 conn(0x7f0fb40cd090 msgr2=0x7f0fb40cd4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:26.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.580+0000 7f0fb90ed640 1 --2- 172.21.15.18:0/763011115 >> v2:172.21.15.173:3300/0 conn(0x7f0fb40cd090 0x7f0fb40cd4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:26.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.580+0000 7f0fb90ed640 1 -- 172.21.15.18:0/763011115 >> v1:172.21.15.18:6789/0 conn(0x7f0fb40ced70 legacy=0x7f0fb40b6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:26.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.580+0000 7f0fb88ec640 1 -- 172.21.15.18:0/763011115 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2857344440 0 0) 0x7f0fb0001120 con 0x7f0fb40ced70 2024-04-17T19:54:26.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.580+0000 7f0fb90ed640 1 -- 172.21.15.18:0/763011115 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fb40b33e0 con 0x7f0fb40b6f60 2024-04-17T19:54:26.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.584+0000 7f0fb90ed640 1 --2- 172.21.15.18:0/763011115 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0fb40b6f60 0x7f0fb40ccb50 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f0fb40738d0 tx=0x7f0fa401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bae1f0cba38acbdb server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:26.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.584+0000 7f0fb88ec640 1 -- 172.21.15.18:0/763011115 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa40b0070 con 0x7f0fb40b6f60 2024-04-17T19:54:26.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.584+0000 7f0fb88ec640 1 -- 172.21.15.18:0/763011115 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fa40ab600 con 0x7f0fb40b6f60 2024-04-17T19:54:26.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.584+0000 7f0fb88ec640 1 -- 172.21.15.18:0/763011115 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fa40ab9d0 con 0x7f0fb40b6f60 2024-04-17T19:54:26.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.584+0000 7f0fbbb52640 1 -- 172.21.15.18:0/763011115 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0fb40b6f60 msgr2=0x7f0fb40ccb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:26.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.584+0000 7f0fbbb52640 1 --2- 172.21.15.18:0/763011115 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0fb40b6f60 0x7f0fb40ccb50 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f0fb40738d0 tx=0x7f0fa401c480 comp rx=0 tx=0).stop 2024-04-17T19:54:26.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.584+0000 7f0fbbb52640 1 -- 172.21.15.18:0/763011115 shutdown_connections 2024-04-17T19:54:26.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.584+0000 7f0fbbb52640 1 --2- 172.21.15.18:0/763011115 >> v2:172.21.15.173:3300/0 conn(0x7f0fb40cd090 0x7f0fb40cd4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:26.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.584+0000 7f0fbbb52640 1 --2- 172.21.15.18:0/763011115 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0fb40b6f60 0x7f0fb40ccb50 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:26.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.584+0000 7f0fbbb52640 1 -- 172.21.15.18:0/763011115 >> 172.21.15.18:0/763011115 conn(0x7f0fb409aa70 msgr2=0x7f0fb409ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:26.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.584+0000 7f0fbbb52640 1 -- 172.21.15.18:0/763011115 shutdown_connections 2024-04-17T19:54:26.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.584+0000 7f0fbbb52640 1 -- 172.21.15.18:0/763011115 wait complete. 2024-04-17T19:54:26.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.588+0000 7f0fbbb52640 1 Processor -- start 2024-04-17T19:54:26.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.588+0000 7f0fbbb52640 1 -- start start 2024-04-17T19:54:26.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.588+0000 7f0fbbb52640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0fb40cd090 0x7f0fb40c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:26.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.588+0000 7f0fbbb52640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0fb40ced70 0x7f0fb4158630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:26.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.588+0000 7f0fbbb52640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0fb40d14d0 0x7f0fb40d18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:26.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.588+0000 7f0fbbb52640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb40d0db0 con 0x7f0fb40cd090 2024-04-17T19:54:26.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.588+0000 7f0fbbb52640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb40d0c30 con 0x7f0fb40ced70 2024-04-17T19:54:26.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.588+0000 7f0fbbb52640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f0fb40d2720 con 0x7f0fb40d14d0 2024-04-17T19:54:26.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.588+0000 7f0fb98ee640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0fb40cd090 0x7f0fb40c5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:26.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.588+0000 7f0fb98ee640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0fb40cd090 0x7f0fb40c5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34154/0 (socket says 172.21.15.18:34154) 2024-04-17T19:54:26.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.588+0000 7f0fb98ee640 1 -- 172.21.15.18:0/3541545406 learned_addr learned my addr 172.21.15.18:0/3541545406 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:26.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.588+0000 7f0fb90ed640 1 --2- 172.21.15.18:0/3541545406 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0fb40ced70 0x7f0fb4158630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:26.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.588+0000 7f0fba0ef640 1 --2- 172.21.15.18:0/3541545406 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0fb40d14d0 0x7f0fb40d18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:26.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.588+0000 7f0fb98ee640 1 -- 172.21.15.18:0/3541545406 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0fb40d14d0 msgr2=0x7f0fb40d18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:26.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.588+0000 7f0fb98ee640 1 --2- 172.21.15.18:0/3541545406 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0fb40d14d0 0x7f0fb40d18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:26.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.588+0000 7f0fb98ee640 1 -- 172.21.15.18:0/3541545406 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0fb40ced70 msgr2=0x7f0fb4158630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:26.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.588+0000 7f0fb98ee640 1 --2- 172.21.15.18:0/3541545406 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0fb40ced70 0x7f0fb4158630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:26.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.588+0000 7f0fb98ee640 1 -- 172.21.15.18:0/3541545406 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fb4158b70 con 0x7f0fb40cd090 2024-04-17T19:54:26.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.588+0000 7f0fb98ee640 1 --2- 172.21.15.18:0/3541545406 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0fb40cd090 0x7f0fb40c5a10 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f0fb000c480 tx=0x7f0fb000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:26.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.588+0000 7f0faa7fc640 1 -- 172.21.15.18:0/3541545406 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb0018070 con 0x7f0fb40cd090 2024-04-17T19:54:26.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.588+0000 7f0faa7fc640 1 -- 172.21.15.18:0/3541545406 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fb0007500 con 0x7f0fb40cd090 2024-04-17T19:54:26.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.588+0000 7f0fbbb52640 1 -- 172.21.15.18:0/3541545406 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fb40c64f0 con 0x7f0fb40cd090 2024-04-17T19:54:26.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.588+0000 7f0faa7fc640 1 -- 172.21.15.18:0/3541545406 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb0004a30 con 0x7f0fb40cd090 2024-04-17T19:54:26.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.588+0000 7f0fbbb52640 1 -- 172.21.15.18:0/3541545406 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fb40c5ff0 con 0x7f0fb40cd090 2024-04-17T19:54:26.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.592+0000 7f0fbbb52640 1 -- 172.21.15.18:0/3541545406 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fb4069950 con 0x7f0fb40cd090 2024-04-17T19:54:26.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.592+0000 7f0faa7fc640 1 -- 172.21.15.18:0/3541545406 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0fb001b070 con 0x7f0fb40cd090 2024-04-17T19:54:26.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.592+0000 7f0faa7fc640 1 --2- 172.21.15.18:0/3541545406 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0f98068380 0x7f0f9806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:26.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.592+0000 7f0faa7fc640 1 -- 172.21.15.18:0/3541545406 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7f0fb00863c0 con 0x7f0fb40cd090 2024-04-17T19:54:26.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.592+0000 7f0fb90ed640 1 --2- 172.21.15.18:0/3541545406 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0f98068380 0x7f0f9806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:26.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.592+0000 7f0fb90ed640 1 --2- 172.21.15.18:0/3541545406 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0f98068380 0x7f0f9806a890 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0fa40ad000 tx=0x7f0fa4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:26.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.596+0000 7f0faa7fc640 1 -- 172.21.15.18:0/3541545406 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0fb40c64f0 con 0x7f0fb40cd090 2024-04-17T19:54:26.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.756+0000 7f0fbbb52640 1 -- 172.21.15.18:0/3541545406 --> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0fb40b2690 con 0x7f0f98068380 2024-04-17T19:54:26.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.772+0000 7f0faa7fc640 1 -- 172.21.15.18:0/3541545406 <== mgr.4104 v2:172.21.15.18:6832/751466605 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332535 (secure 0 0 0) 0x7f0fb40b2690 con 0x7f0f98068380 2024-04-17T19:54:26.772 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:54:26.774 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-17T19:54:26.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.776+0000 7f0fbbb52640 1 -- 172.21.15.18:0/3541545406 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0f98068380 msgr2=0x7f0f9806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:26.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.776+0000 7f0fbbb52640 1 --2- 172.21.15.18:0/3541545406 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0f98068380 0x7f0f9806a890 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0fa40ad000 tx=0x7f0fa4008040 comp rx=0 tx=0).stop 2024-04-17T19:54:26.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.776+0000 7f0fbbb52640 1 -- 172.21.15.18:0/3541545406 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0fb40cd090 msgr2=0x7f0fb40c5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:26.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.776+0000 7f0fbbb52640 1 --2- 172.21.15.18:0/3541545406 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0fb40cd090 0x7f0fb40c5a10 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f0fb000c480 tx=0x7f0fb000c940 comp rx=0 tx=0).stop 2024-04-17T19:54:26.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.776+0000 7f0fbbb52640 1 -- 172.21.15.18:0/3541545406 shutdown_connections 2024-04-17T19:54:26.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.776+0000 7f0fbbb52640 1 --2- 172.21.15.18:0/3541545406 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0f98068380 0x7f0f9806a890 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:26.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.776+0000 7f0fbbb52640 1 --2- 172.21.15.18:0/3541545406 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0fb40d14d0 0x7f0fb40d18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:26.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.776+0000 7f0fbbb52640 1 --2- 172.21.15.18:0/3541545406 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0fb40ced70 0x7f0fb4158630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:26.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.776+0000 7f0fbbb52640 1 --2- 172.21.15.18:0/3541545406 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0fb40cd090 0x7f0fb40c5a10 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:26.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.776+0000 7f0fbbb52640 1 -- 172.21.15.18:0/3541545406 >> 172.21.15.18:0/3541545406 conn(0x7f0fb409aa70 msgr2=0x7f0fb409ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:26.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.776+0000 7f0fbbb52640 1 -- 172.21.15.18:0/3541545406 shutdown_connections 2024-04-17T19:54:26.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.776+0000 7f0fbbb52640 1 -- 172.21.15.18:0/3541545406 wait complete. 2024-04-17T19:54:26.794 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2024-04-17T19:54:26.374041+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597195,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":218,"num_write_kb":2445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":170,"ondisk_log_size":170,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236448,"kb_used_data":3632,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738272,"statfs":{"total":773094113280,"available":772851990528,"internally_reserved":0,"allocated":3719168,"data_stored":2188246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":238276148},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004649"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.454644+0000","last_change":"2024-04-17T19:53:04.461184+0000","last_active":"2024-04-17T19:53:45.454644+0000","last_peered":"2024-04-17T19:53:45.454644+0000","last_clean":"2024-04-17T19:53:45.454644+0000","last_became_active":"2024-04-17T19:53:04.460006+0000","last_became_peered":"2024-04-17T19:53:04.460006+0000","last_unstale":"2024-04-17T19:53:45.454644+0000","last_undegraded":"2024-04-17T19:53:45.454644+0000","last_fullsized":"2024-04-17T19:53:45.454644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:23:02.868468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.461480+0000","last_change":"2024-04-17T19:53:05.474006+0000","last_active":"2024-04-17T19:53:45.461480+0000","last_peered":"2024-04-17T19:53:45.461480+0000","last_clean":"2024-04-17T19:53:45.461480+0000","last_became_active":"2024-04-17T19:53:05.467848+0000","last_became_peered":"2024-04-17T19:53:05.467848+0000","last_unstale":"2024-04-17T19:53:45.461480+0000","last_undegraded":"2024-04-17T19:53:45.461480+0000","last_fullsized":"2024-04-17T19:53:45.461480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:05:21.173050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.584776+0000","last_change":"2024-04-17T19:53:09.559397+0000","last_active":"2024-04-17T19:53:45.584776+0000","last_peered":"2024-04-17T19:53:45.584776+0000","last_clean":"2024-04-17T19:53:45.584776+0000","last_became_active":"2024-04-17T19:53:09.558504+0000","last_became_peered":"2024-04-17T19:53:09.558504+0000","last_unstale":"2024-04-17T19:53:45.584776+0000","last_undegraded":"2024-04-17T19:53:45.584776+0000","last_fullsized":"2024-04-17T19:53:45.584776+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:06:18.745394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.461903+0000","last_change":"2024-04-17T19:53:04.484961+0000","last_active":"2024-04-17T19:53:45.461903+0000","last_peered":"2024-04-17T19:53:45.461903+0000","last_clean":"2024-04-17T19:53:45.461903+0000","last_became_active":"2024-04-17T19:53:04.468291+0000","last_became_peered":"2024-04-17T19:53:04.468291+0000","last_unstale":"2024-04-17T19:53:45.461903+0000","last_undegraded":"2024-04-17T19:53:45.461903+0000","last_fullsized":"2024-04-17T19:53:45.461903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:06:00.469757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.459913+0000","last_change":"2024-04-17T19:53:05.475578+0000","last_active":"2024-04-17T19:53:45.459913+0000","last_peered":"2024-04-17T19:53:45.459913+0000","last_clean":"2024-04-17T19:53:45.459913+0000","last_became_active":"2024-04-17T19:53:05.473678+0000","last_became_peered":"2024-04-17T19:53:05.473678+0000","last_unstale":"2024-04-17T19:53:45.459913+0000","last_undegraded":"2024-04-17T19:53:45.459913+0000","last_fullsized":"2024-04-17T19:53:45.459913+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:47:05.354826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.449924+0000","last_change":"2024-04-17T19:53:09.545180+0000","last_active":"2024-04-17T19:53:45.449924+0000","last_peered":"2024-04-17T19:53:45.449924+0000","last_clean":"2024-04-17T19:53:45.449924+0000","last_became_active":"2024-04-17T19:53:09.544580+0000","last_became_peered":"2024-04-17T19:53:09.544580+0000","last_unstale":"2024-04-17T19:53:45.449924+0000","last_undegraded":"2024-04-17T19:53:45.449924+0000","last_fullsized":"2024-04-17T19:53:45.449924+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:02:44.844970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.448758+0000","last_change":"2024-04-17T19:53:04.468009+0000","last_active":"2024-04-17T19:53:45.448758+0000","last_peered":"2024-04-17T19:53:45.448758+0000","last_clean":"2024-04-17T19:53:45.448758+0000","last_became_active":"2024-04-17T19:53:04.467568+0000","last_became_peered":"2024-04-17T19:53:04.467568+0000","last_unstale":"2024-04-17T19:53:45.448758+0000","last_undegraded":"2024-04-17T19:53:45.448758+0000","last_fullsized":"2024-04-17T19:53:45.448758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:18:11.256327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.579947+0000","last_change":"2024-04-17T19:53:05.464961+0000","last_active":"2024-04-17T19:53:45.579947+0000","last_peered":"2024-04-17T19:53:45.579947+0000","last_clean":"2024-04-17T19:53:45.579947+0000","last_became_active":"2024-04-17T19:53:05.464601+0000","last_became_peered":"2024-04-17T19:53:05.464601+0000","last_unstale":"2024-04-17T19:53:45.579947+0000","last_undegraded":"2024-04-17T19:53:45.579947+0000","last_fullsized":"2024-04-17T19:53:45.579947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:12:03.449509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.450440+0000","last_change":"2024-04-17T19:53:09.529447+0000","last_active":"2024-04-17T19:53:45.450440+0000","last_peered":"2024-04-17T19:53:45.450440+0000","last_clean":"2024-04-17T19:53:45.450440+0000","last_became_active":"2024-04-17T19:53:09.528285+0000","last_became_peered":"2024-04-17T19:53:09.528285+0000","last_unstale":"2024-04-17T19:53:45.450440+0000","last_undegraded":"2024-04-17T19:53:45.450440+0000","last_fullsized":"2024-04-17T19:53:45.450440+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:47:09.400433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.448308+0000","last_change":"2024-04-17T19:53:04.467639+0000","last_active":"2024-04-17T19:53:45.448308+0000","last_peered":"2024-04-17T19:53:45.448308+0000","last_clean":"2024-04-17T19:53:45.448308+0000","last_became_active":"2024-04-17T19:53:04.467004+0000","last_became_peered":"2024-04-17T19:53:04.467004+0000","last_unstale":"2024-04-17T19:53:45.448308+0000","last_undegraded":"2024-04-17T19:53:45.448308+0000","last_fullsized":"2024-04-17T19:53:45.448308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:38:40.499868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.565298+0000","last_change":"2024-04-17T19:53:05.468179+0000","last_active":"2024-04-17T19:53:45.565298+0000","last_peered":"2024-04-17T19:53:45.565298+0000","last_clean":"2024-04-17T19:53:45.565298+0000","last_became_active":"2024-04-17T19:53:05.467217+0000","last_became_peered":"2024-04-17T19:53:05.467217+0000","last_unstale":"2024-04-17T19:53:45.565298+0000","last_undegraded":"2024-04-17T19:53:45.565298+0000","last_fullsized":"2024-04-17T19:53:45.565298+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:29:50.290114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.450089+0000","last_change":"2024-04-17T19:53:09.549722+0000","last_active":"2024-04-17T19:53:45.450089+0000","last_peered":"2024-04-17T19:53:45.450089+0000","last_clean":"2024-04-17T19:53:45.450089+0000","last_became_active":"2024-04-17T19:53:09.548876+0000","last_became_peered":"2024-04-17T19:53:09.548876+0000","last_unstale":"2024-04-17T19:53:45.450089+0000","last_undegraded":"2024-04-17T19:53:45.450089+0000","last_fullsized":"2024-04-17T19:53:45.450089+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:15:49.773156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.567108+0000","last_change":"2024-04-17T19:53:05.475996+0000","last_active":"2024-04-17T19:53:45.567108+0000","last_peered":"2024-04-17T19:53:45.567108+0000","last_clean":"2024-04-17T19:53:45.567108+0000","last_became_active":"2024-04-17T19:53:05.475517+0000","last_became_peered":"2024-04-17T19:53:05.475517+0000","last_unstale":"2024-04-17T19:53:45.567108+0000","last_undegraded":"2024-04-17T19:53:45.567108+0000","last_fullsized":"2024-04-17T19:53:45.567108+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:39:47.272961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.566537+0000","last_change":"2024-04-17T19:53:04.465884+0000","last_active":"2024-04-17T19:53:45.566537+0000","last_peered":"2024-04-17T19:53:45.566537+0000","last_clean":"2024-04-17T19:53:45.566537+0000","last_became_active":"2024-04-17T19:53:04.465108+0000","last_became_peered":"2024-04-17T19:53:04.465108+0000","last_unstale":"2024-04-17T19:53:45.566537+0000","last_undegraded":"2024-04-17T19:53:45.566537+0000","last_fullsized":"2024-04-17T19:53:45.566537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:23:02.868468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.566637+0000","last_change":"2024-04-17T19:53:09.545287+0000","last_active":"2024-04-17T19:53:45.566637+0000","last_peered":"2024-04-17T19:53:45.566637+0000","last_clean":"2024-04-17T19:53:45.566637+0000","last_became_active":"2024-04-17T19:53:09.544328+0000","last_became_peered":"2024-04-17T19:53:09.544328+0000","last_unstale":"2024-04-17T19:53:45.566637+0000","last_undegraded":"2024-04-17T19:53:45.566637+0000","last_fullsized":"2024-04-17T19:53:45.566637+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:47:26.887721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.582177+0000","last_change":"2024-04-17T19:53:05.496585+0000","last_active":"2024-04-17T19:53:45.582177+0000","last_peered":"2024-04-17T19:53:45.582177+0000","last_clean":"2024-04-17T19:53:45.582177+0000","last_became_active":"2024-04-17T19:53:05.495800+0000","last_became_peered":"2024-04-17T19:53:05.495800+0000","last_unstale":"2024-04-17T19:53:45.582177+0000","last_undegraded":"2024-04-17T19:53:45.582177+0000","last_fullsized":"2024-04-17T19:53:45.582177+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:18:12.267644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452508+0000","last_change":"2024-04-17T19:53:04.479274+0000","last_active":"2024-04-17T19:53:45.452508+0000","last_peered":"2024-04-17T19:53:45.452508+0000","last_clean":"2024-04-17T19:53:45.452508+0000","last_became_active":"2024-04-17T19:53:04.478425+0000","last_became_peered":"2024-04-17T19:53:04.478425+0000","last_unstale":"2024-04-17T19:53:45.452508+0000","last_undegraded":"2024-04-17T19:53:45.452508+0000","last_fullsized":"2024-04-17T19:53:45.452508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:16:15.623557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.447838+0000","last_change":"2024-04-17T19:53:09.526995+0000","last_active":"2024-04-17T19:53:45.447838+0000","last_peered":"2024-04-17T19:53:45.447838+0000","last_clean":"2024-04-17T19:53:45.447838+0000","last_became_active":"2024-04-17T19:53:09.525577+0000","last_became_peered":"2024-04-17T19:53:09.525577+0000","last_unstale":"2024-04-17T19:53:45.447838+0000","last_undegraded":"2024-04-17T19:53:45.447838+0000","last_fullsized":"2024-04-17T19:53:45.447838+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:52:59.924361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.451938+0000","last_change":"2024-04-17T19:53:05.463312+0000","last_active":"2024-04-17T19:53:45.451938+0000","last_peered":"2024-04-17T19:53:45.451938+0000","last_clean":"2024-04-17T19:53:45.451938+0000","last_became_active":"2024-04-17T19:53:05.462415+0000","last_became_peered":"2024-04-17T19:53:05.462415+0000","last_unstale":"2024-04-17T19:53:45.451938+0000","last_undegraded":"2024-04-17T19:53:45.451938+0000","last_fullsized":"2024-04-17T19:53:45.451938+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:27:51.520335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.460026+0000","last_change":"2024-04-17T19:53:04.471150+0000","last_active":"2024-04-17T19:53:45.460026+0000","last_peered":"2024-04-17T19:53:45.460026+0000","last_clean":"2024-04-17T19:53:45.460026+0000","last_became_active":"2024-04-17T19:53:04.470258+0000","last_became_peered":"2024-04-17T19:53:04.470258+0000","last_unstale":"2024-04-17T19:53:45.460026+0000","last_undegraded":"2024-04-17T19:53:45.460026+0000","last_fullsized":"2024-04-17T19:53:45.460026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:06:00.469757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.587281+0000","last_change":"2024-04-17T19:53:09.565387+0000","last_active":"2024-04-17T19:53:45.587281+0000","last_peered":"2024-04-17T19:53:45.587281+0000","last_clean":"2024-04-17T19:53:45.587281+0000","last_became_active":"2024-04-17T19:53:09.564134+0000","last_became_peered":"2024-04-17T19:53:09.564134+0000","last_unstale":"2024-04-17T19:53:45.587281+0000","last_undegraded":"2024-04-17T19:53:45.587281+0000","last_fullsized":"2024-04-17T19:53:45.587281+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:21:01.809464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.564723+0000","last_change":"2024-04-17T19:53:05.468962+0000","last_active":"2024-04-17T19:53:45.564723+0000","last_peered":"2024-04-17T19:53:45.564723+0000","last_clean":"2024-04-17T19:53:45.564723+0000","last_became_active":"2024-04-17T19:53:05.466996+0000","last_became_peered":"2024-04-17T19:53:05.466996+0000","last_unstale":"2024-04-17T19:53:45.564723+0000","last_undegraded":"2024-04-17T19:53:45.564723+0000","last_fullsized":"2024-04-17T19:53:45.564723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:04:55.125411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.446787+0000","last_change":"2024-04-17T19:53:04.472916+0000","last_active":"2024-04-17T19:53:45.446787+0000","last_peered":"2024-04-17T19:53:45.446787+0000","last_clean":"2024-04-17T19:53:45.446787+0000","last_became_active":"2024-04-17T19:53:04.468136+0000","last_became_peered":"2024-04-17T19:53:04.468136+0000","last_unstale":"2024-04-17T19:53:45.446787+0000","last_undegraded":"2024-04-17T19:53:45.446787+0000","last_fullsized":"2024-04-17T19:53:45.446787+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:23:02.868468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.587217+0000","last_change":"2024-04-17T19:53:45.587217+0000","last_active":"2024-04-17T19:53:45.587217+0000","last_peered":"2024-04-17T19:53:45.587217+0000","last_clean":"2024-04-17T19:53:45.587217+0000","last_became_active":"2024-04-17T19:53:45.586731+0000","last_became_peered":"2024-04-17T19:53:45.586731+0000","last_unstale":"2024-04-17T19:53:45.587217+0000","last_undegraded":"2024-04-17T19:53:45.587217+0000","last_fullsized":"2024-04-17T19:53:45.587217+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:41:58.423269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,7],"acting":[2,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452775+0000","last_change":"2024-04-17T19:53:05.467799+0000","last_active":"2024-04-17T19:53:45.452775+0000","last_peered":"2024-04-17T19:53:45.452775+0000","last_clean":"2024-04-17T19:53:45.452775+0000","last_became_active":"2024-04-17T19:53:05.465048+0000","last_became_peered":"2024-04-17T19:53:05.465048+0000","last_unstale":"2024-04-17T19:53:45.452775+0000","last_undegraded":"2024-04-17T19:53:45.452775+0000","last_fullsized":"2024-04-17T19:53:45.452775+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:19:09.456602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.567142+0000","last_change":"2024-04-17T19:53:04.469594+0000","last_active":"2024-04-17T19:53:45.567142+0000","last_peered":"2024-04-17T19:53:45.567142+0000","last_clean":"2024-04-17T19:53:45.567142+0000","last_became_active":"2024-04-17T19:53:04.469119+0000","last_became_peered":"2024-04-17T19:53:04.469119+0000","last_unstale":"2024-04-17T19:53:45.567142+0000","last_undegraded":"2024-04-17T19:53:45.567142+0000","last_fullsized":"2024-04-17T19:53:45.567142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:40:30.547343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.450404+0000","last_change":"2024-04-17T19:53:09.527277+0000","last_active":"2024-04-17T19:53:45.450404+0000","last_peered":"2024-04-17T19:53:45.450404+0000","last_clean":"2024-04-17T19:53:45.450404+0000","last_became_active":"2024-04-17T19:53:09.526436+0000","last_became_peered":"2024-04-17T19:53:09.526436+0000","last_unstale":"2024-04-17T19:53:45.450404+0000","last_undegraded":"2024-04-17T19:53:45.450404+0000","last_fullsized":"2024-04-17T19:53:45.450404+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:54:31.569576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.454142+0000","last_change":"2024-04-17T19:53:05.443712+0000","last_active":"2024-04-17T19:53:45.454142+0000","last_peered":"2024-04-17T19:53:45.454142+0000","last_clean":"2024-04-17T19:53:45.454142+0000","last_became_active":"2024-04-17T19:53:05.442881+0000","last_became_peered":"2024-04-17T19:53:05.442881+0000","last_unstale":"2024-04-17T19:53:45.454142+0000","last_undegraded":"2024-04-17T19:53:45.454142+0000","last_fullsized":"2024-04-17T19:53:45.454142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:20:57.763858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.453372+0000","last_change":"2024-04-17T19:53:04.465717+0000","last_active":"2024-04-17T19:53:45.453372+0000","last_peered":"2024-04-17T19:53:45.453372+0000","last_clean":"2024-04-17T19:53:45.453372+0000","last_became_active":"2024-04-17T19:53:04.464701+0000","last_became_peered":"2024-04-17T19:53:04.464701+0000","last_unstale":"2024-04-17T19:53:45.453372+0000","last_undegraded":"2024-04-17T19:53:45.453372+0000","last_fullsized":"2024-04-17T19:53:45.453372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:18:11.256327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.456232+0000","last_change":"2024-04-17T19:53:09.530585+0000","last_active":"2024-04-17T19:53:45.456232+0000","last_peered":"2024-04-17T19:53:45.456232+0000","last_clean":"2024-04-17T19:53:45.456232+0000","last_became_active":"2024-04-17T19:53:09.529345+0000","last_became_peered":"2024-04-17T19:53:09.529345+0000","last_unstale":"2024-04-17T19:53:45.456232+0000","last_undegraded":"2024-04-17T19:53:45.456232+0000","last_fullsized":"2024-04-17T19:53:45.456232+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:01:38.507428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452698+0000","last_change":"2024-04-17T19:53:05.452177+0000","last_active":"2024-04-17T19:53:45.452698+0000","last_peered":"2024-04-17T19:53:45.452698+0000","last_clean":"2024-04-17T19:53:45.452698+0000","last_became_active":"2024-04-17T19:53:05.451272+0000","last_became_peered":"2024-04-17T19:53:05.451272+0000","last_unstale":"2024-04-17T19:53:45.452698+0000","last_undegraded":"2024-04-17T19:53:45.452698+0000","last_fullsized":"2024-04-17T19:53:45.452698+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:51:17.675125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.567067+0000","last_change":"2024-04-17T19:53:04.471944+0000","last_active":"2024-04-17T19:53:45.567067+0000","last_peered":"2024-04-17T19:53:45.567067+0000","last_clean":"2024-04-17T19:53:45.567067+0000","last_became_active":"2024-04-17T19:53:04.471458+0000","last_became_peered":"2024-04-17T19:53:04.471458+0000","last_unstale":"2024-04-17T19:53:45.567067+0000","last_undegraded":"2024-04-17T19:53:45.567067+0000","last_fullsized":"2024-04-17T19:53:45.567067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:12:02.438192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452001+0000","last_change":"2024-04-17T19:53:09.549998+0000","last_active":"2024-04-17T19:53:45.452001+0000","last_peered":"2024-04-17T19:53:45.452001+0000","last_clean":"2024-04-17T19:53:45.452001+0000","last_became_active":"2024-04-17T19:53:09.548136+0000","last_became_peered":"2024-04-17T19:53:09.548136+0000","last_unstale":"2024-04-17T19:53:45.452001+0000","last_undegraded":"2024-04-17T19:53:45.452001+0000","last_fullsized":"2024-04-17T19:53:45.452001+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:02:14.459968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.451671+0000","last_change":"2024-04-17T19:53:05.472884+0000","last_active":"2024-04-17T19:53:45.451671+0000","last_peered":"2024-04-17T19:53:45.451671+0000","last_clean":"2024-04-17T19:53:45.451671+0000","last_became_active":"2024-04-17T19:53:05.472513+0000","last_became_peered":"2024-04-17T19:53:05.472513+0000","last_unstale":"2024-04-17T19:53:45.451671+0000","last_undegraded":"2024-04-17T19:53:45.451671+0000","last_fullsized":"2024-04-17T19:53:45.451671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:21:37.163564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.457647+0000","last_change":"2024-04-17T19:53:04.487713+0000","last_active":"2024-04-17T19:53:45.457647+0000","last_peered":"2024-04-17T19:53:45.457647+0000","last_clean":"2024-04-17T19:53:45.457647+0000","last_became_active":"2024-04-17T19:53:04.487005+0000","last_became_peered":"2024-04-17T19:53:04.487005+0000","last_unstale":"2024-04-17T19:53:45.457647+0000","last_undegraded":"2024-04-17T19:53:45.457647+0000","last_fullsized":"2024-04-17T19:53:45.457647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:53:36.130201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.451279+0000","last_change":"2024-04-17T19:53:09.547824+0000","last_active":"2024-04-17T19:53:45.451279+0000","last_peered":"2024-04-17T19:53:45.451279+0000","last_clean":"2024-04-17T19:53:45.451279+0000","last_became_active":"2024-04-17T19:53:09.545636+0000","last_became_peered":"2024-04-17T19:53:09.545636+0000","last_unstale":"2024-04-17T19:53:45.451279+0000","last_undegraded":"2024-04-17T19:53:45.451279+0000","last_fullsized":"2024-04-17T19:53:45.451279+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:06:17.885652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.447639+0000","last_change":"2024-04-17T19:53:05.465820+0000","last_active":"2024-04-17T19:53:45.447639+0000","last_peered":"2024-04-17T19:53:45.447639+0000","last_clean":"2024-04-17T19:53:45.447639+0000","last_became_active":"2024-04-17T19:53:05.464376+0000","last_became_peered":"2024-04-17T19:53:05.464376+0000","last_unstale":"2024-04-17T19:53:45.447639+0000","last_undegraded":"2024-04-17T19:53:45.447639+0000","last_fullsized":"2024-04-17T19:53:45.447639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:53:13.956259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.567378+0000","last_change":"2024-04-17T19:53:04.464706+0000","last_active":"2024-04-17T19:53:45.567378+0000","last_peered":"2024-04-17T19:53:45.567378+0000","last_clean":"2024-04-17T19:53:45.567378+0000","last_became_active":"2024-04-17T19:53:04.464109+0000","last_became_peered":"2024-04-17T19:53:04.464109+0000","last_unstale":"2024-04-17T19:53:45.567378+0000","last_undegraded":"2024-04-17T19:53:45.567378+0000","last_fullsized":"2024-04-17T19:53:45.567378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:38:40.499868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452114+0000","last_change":"2024-04-17T19:53:09.553078+0000","last_active":"2024-04-17T19:53:45.452114+0000","last_peered":"2024-04-17T19:53:45.452114+0000","last_clean":"2024-04-17T19:53:45.452114+0000","last_became_active":"2024-04-17T19:53:09.548806+0000","last_became_peered":"2024-04-17T19:53:09.548806+0000","last_unstale":"2024-04-17T19:53:45.452114+0000","last_undegraded":"2024-04-17T19:53:45.452114+0000","last_fullsized":"2024-04-17T19:53:45.452114+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:33:37.250066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452511+0000","last_change":"2024-04-17T19:53:05.476631+0000","last_active":"2024-04-17T19:53:45.452511+0000","last_peered":"2024-04-17T19:53:45.452511+0000","last_clean":"2024-04-17T19:53:45.452511+0000","last_became_active":"2024-04-17T19:53:05.474164+0000","last_became_peered":"2024-04-17T19:53:05.474164+0000","last_unstale":"2024-04-17T19:53:45.452511+0000","last_undegraded":"2024-04-17T19:53:45.452511+0000","last_fullsized":"2024-04-17T19:53:45.452511+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:53:13.956259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.585125+0000","last_change":"2024-04-17T19:53:04.486117+0000","last_active":"2024-04-17T19:53:45.585125+0000","last_peered":"2024-04-17T19:53:45.585125+0000","last_clean":"2024-04-17T19:53:45.585125+0000","last_became_active":"2024-04-17T19:53:04.485424+0000","last_became_peered":"2024-04-17T19:53:04.485424+0000","last_unstale":"2024-04-17T19:53:45.585125+0000","last_undegraded":"2024-04-17T19:53:45.585125+0000","last_fullsized":"2024-04-17T19:53:45.585125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:21:45.875274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.457318+0000","last_change":"2024-04-17T19:53:09.549846+0000","last_active":"2024-04-17T19:53:45.457318+0000","last_peered":"2024-04-17T19:53:45.457318+0000","last_clean":"2024-04-17T19:53:45.457318+0000","last_became_active":"2024-04-17T19:53:09.548070+0000","last_became_peered":"2024-04-17T19:53:09.548070+0000","last_unstale":"2024-04-17T19:53:45.457318+0000","last_undegraded":"2024-04-17T19:53:45.457318+0000","last_fullsized":"2024-04-17T19:53:45.457318+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:05.469665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452883+0000","last_change":"2024-04-17T19:53:05.469993+0000","last_active":"2024-04-17T19:53:45.452883+0000","last_peered":"2024-04-17T19:53:45.452883+0000","last_clean":"2024-04-17T19:53:45.452883+0000","last_became_active":"2024-04-17T19:53:05.468241+0000","last_became_peered":"2024-04-17T19:53:05.468241+0000","last_unstale":"2024-04-17T19:53:45.452883+0000","last_undegraded":"2024-04-17T19:53:45.452883+0000","last_fullsized":"2024-04-17T19:53:45.452883+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:39:15.005822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.565089+0000","last_change":"2024-04-17T19:53:04.484259+0000","last_active":"2024-04-17T19:53:45.565089+0000","last_peered":"2024-04-17T19:53:45.565089+0000","last_clean":"2024-04-17T19:53:45.565089+0000","last_became_active":"2024-04-17T19:53:04.483882+0000","last_became_peered":"2024-04-17T19:53:04.483882+0000","last_unstale":"2024-04-17T19:53:45.565089+0000","last_undegraded":"2024-04-17T19:53:45.565089+0000","last_fullsized":"2024-04-17T19:53:45.565089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:18:11.256327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.460808+0000","last_change":"2024-04-17T19:53:09.559932+0000","last_active":"2024-04-17T19:53:45.460808+0000","last_peered":"2024-04-17T19:53:45.460808+0000","last_clean":"2024-04-17T19:53:45.460808+0000","last_became_active":"2024-04-17T19:53:09.558888+0000","last_became_peered":"2024-04-17T19:53:09.558888+0000","last_unstale":"2024-04-17T19:53:45.460808+0000","last_undegraded":"2024-04-17T19:53:45.460808+0000","last_fullsized":"2024-04-17T19:53:45.460808+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:22:59.388953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452018+0000","last_change":"2024-04-17T19:53:05.463658+0000","last_active":"2024-04-17T19:53:45.452018+0000","last_peered":"2024-04-17T19:53:45.452018+0000","last_clean":"2024-04-17T19:53:45.452018+0000","last_became_active":"2024-04-17T19:53:05.462437+0000","last_became_peered":"2024-04-17T19:53:05.462437+0000","last_unstale":"2024-04-17T19:53:45.452018+0000","last_undegraded":"2024-04-17T19:53:45.452018+0000","last_fullsized":"2024-04-17T19:53:45.452018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:06:14.699788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.566591+0000","last_change":"2024-04-17T19:53:04.459172+0000","last_active":"2024-04-17T19:53:45.566591+0000","last_peered":"2024-04-17T19:53:45.566591+0000","last_clean":"2024-04-17T19:53:45.566591+0000","last_became_active":"2024-04-17T19:53:04.458798+0000","last_became_peered":"2024-04-17T19:53:04.458798+0000","last_unstale":"2024-04-17T19:53:45.566591+0000","last_undegraded":"2024-04-17T19:53:45.566591+0000","last_fullsized":"2024-04-17T19:53:45.566591+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:21:36.152247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":181,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.580414+0000","last_change":"2024-04-17T19:52:54.651873+0000","last_active":"2024-04-17T19:53:45.580414+0000","last_peered":"2024-04-17T19:53:45.580414+0000","last_clean":"2024-04-17T19:53:45.580414+0000","last_became_active":"2024-04-17T19:52:54.649700+0000","last_became_peered":"2024-04-17T19:52:54.649700+0000","last_unstale":"2024-04-17T19:53:45.580414+0000","last_undegraded":"2024-04-17T19:53:45.580414+0000","last_fullsized":"2024-04-17T19:53:45.580414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:52:53.245174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:52:53.245174+0000","last_clean_scrub_stamp":"2024-04-17T19:52:53.245174+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:26:16.094093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.468715+0000","last_change":"2024-04-17T19:53:45.466468+0000","last_active":"2024-04-17T19:53:45.468715+0000","last_peered":"2024-04-17T19:53:45.468715+0000","last_clean":"2024-04-17T19:53:45.468715+0000","last_became_active":"2024-04-17T19:53:45.464724+0000","last_became_peered":"2024-04-17T19:53:45.464724+0000","last_unstale":"2024-04-17T19:53:45.468715+0000","last_undegraded":"2024-04-17T19:53:45.468715+0000","last_fullsized":"2024-04-17T19:53:45.468715+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:07:11.268705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,2,0],"acting":[4,5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.566911+0000","last_change":"2024-04-17T19:53:05.475968+0000","last_active":"2024-04-17T19:53:45.566911+0000","last_peered":"2024-04-17T19:53:45.566911+0000","last_clean":"2024-04-17T19:53:45.566911+0000","last_became_active":"2024-04-17T19:53:05.475600+0000","last_became_peered":"2024-04-17T19:53:05.475600+0000","last_unstale":"2024-04-17T19:53:45.566911+0000","last_undegraded":"2024-04-17T19:53:45.566911+0000","last_fullsized":"2024-04-17T19:53:45.566911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:34:03.644428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452962+0000","last_change":"2024-04-17T19:53:04.457214+0000","last_active":"2024-04-17T19:53:45.452962+0000","last_peered":"2024-04-17T19:53:45.452962+0000","last_clean":"2024-04-17T19:53:45.452962+0000","last_became_active":"2024-04-17T19:53:04.453473+0000","last_became_peered":"2024-04-17T19:53:04.453473+0000","last_unstale":"2024-04-17T19:53:45.452962+0000","last_undegraded":"2024-04-17T19:53:45.452962+0000","last_fullsized":"2024-04-17T19:53:45.452962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:14:03.008171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.450160+0000","last_change":"2024-04-17T19:53:09.548981+0000","last_active":"2024-04-17T19:53:45.450160+0000","last_peered":"2024-04-17T19:53:45.450160+0000","last_clean":"2024-04-17T19:53:45.450160+0000","last_became_active":"2024-04-17T19:53:09.548575+0000","last_became_peered":"2024-04-17T19:53:09.548575+0000","last_unstale":"2024-04-17T19:53:45.450160+0000","last_undegraded":"2024-04-17T19:53:45.450160+0000","last_fullsized":"2024-04-17T19:53:45.450160+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:05:25.218656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.448148+0000","last_change":"2024-04-17T19:53:05.464697+0000","last_active":"2024-04-17T19:53:45.448148+0000","last_peered":"2024-04-17T19:53:45.448148+0000","last_clean":"2024-04-17T19:53:45.448148+0000","last_became_active":"2024-04-17T19:53:05.463935+0000","last_became_peered":"2024-04-17T19:53:05.463935+0000","last_unstale":"2024-04-17T19:53:45.448148+0000","last_undegraded":"2024-04-17T19:53:45.448148+0000","last_fullsized":"2024-04-17T19:53:45.448148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:15:45.727550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.461105+0000","last_change":"2024-04-17T19:53:04.475555+0000","last_active":"2024-04-17T19:53:45.461105+0000","last_peered":"2024-04-17T19:53:45.461105+0000","last_clean":"2024-04-17T19:53:45.461105+0000","last_became_active":"2024-04-17T19:53:04.467881+0000","last_became_peered":"2024-04-17T19:53:04.467881+0000","last_unstale":"2024-04-17T19:53:45.461105+0000","last_undegraded":"2024-04-17T19:53:45.461105+0000","last_fullsized":"2024-04-17T19:53:45.461105+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:22:17.837334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.457150+0000","last_change":"2024-04-17T19:53:09.535560+0000","last_active":"2024-04-17T19:53:45.457150+0000","last_peered":"2024-04-17T19:53:45.457150+0000","last_clean":"2024-04-17T19:53:45.457150+0000","last_became_active":"2024-04-17T19:53:09.534631+0000","last_became_peered":"2024-04-17T19:53:09.534631+0000","last_unstale":"2024-04-17T19:53:45.457150+0000","last_undegraded":"2024-04-17T19:53:45.457150+0000","last_fullsized":"2024-04-17T19:53:45.457150+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:30:27.062045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.449100+0000","last_change":"2024-04-17T19:53:05.460324+0000","last_active":"2024-04-17T19:53:45.449100+0000","last_peered":"2024-04-17T19:53:45.449100+0000","last_clean":"2024-04-17T19:53:45.449100+0000","last_became_active":"2024-04-17T19:53:05.459941+0000","last_became_peered":"2024-04-17T19:53:05.459941+0000","last_unstale":"2024-04-17T19:53:45.449100+0000","last_undegraded":"2024-04-17T19:53:45.449100+0000","last_fullsized":"2024-04-17T19:53:45.449100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:34:03.644428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.453037+0000","last_change":"2024-04-17T19:53:04.467765+0000","last_active":"2024-04-17T19:53:45.453037+0000","last_peered":"2024-04-17T19:53:45.453037+0000","last_clean":"2024-04-17T19:53:45.453037+0000","last_became_active":"2024-04-17T19:53:04.466753+0000","last_became_peered":"2024-04-17T19:53:04.466753+0000","last_unstale":"2024-04-17T19:53:45.453037+0000","last_undegraded":"2024-04-17T19:53:45.453037+0000","last_fullsized":"2024-04-17T19:53:45.453037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:53:36.130201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.564913+0000","last_change":"2024-04-17T19:53:09.519632+0000","last_active":"2024-04-17T19:53:45.564913+0000","last_peered":"2024-04-17T19:53:45.564913+0000","last_clean":"2024-04-17T19:53:45.564913+0000","last_became_active":"2024-04-17T19:53:09.518979+0000","last_became_peered":"2024-04-17T19:53:09.518979+0000","last_unstale":"2024-04-17T19:53:45.564913+0000","last_undegraded":"2024-04-17T19:53:45.564913+0000","last_fullsized":"2024-04-17T19:53:45.564913+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:07:11.268705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.451403+0000","last_change":"2024-04-17T19:53:05.464583+0000","last_active":"2024-04-17T19:53:45.451403+0000","last_peered":"2024-04-17T19:53:45.451403+0000","last_clean":"2024-04-17T19:53:45.451403+0000","last_became_active":"2024-04-17T19:53:05.464158+0000","last_became_peered":"2024-04-17T19:53:05.464158+0000","last_unstale":"2024-04-17T19:53:45.451403+0000","last_undegraded":"2024-04-17T19:53:45.451403+0000","last_fullsized":"2024-04-17T19:53:45.451403+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:38:41.511185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.449354+0000","last_change":"2024-04-17T19:53:04.477502+0000","last_active":"2024-04-17T19:53:45.449354+0000","last_peered":"2024-04-17T19:53:45.449354+0000","last_clean":"2024-04-17T19:53:45.449354+0000","last_became_active":"2024-04-17T19:53:04.477162+0000","last_became_peered":"2024-04-17T19:53:04.477162+0000","last_unstale":"2024-04-17T19:53:45.449354+0000","last_undegraded":"2024-04-17T19:53:45.449354+0000","last_fullsized":"2024-04-17T19:53:45.449354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:21:36.152247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.580275+0000","last_change":"2024-04-17T19:53:09.533476+0000","last_active":"2024-04-17T19:53:45.580275+0000","last_peered":"2024-04-17T19:53:45.580275+0000","last_clean":"2024-04-17T19:53:45.580275+0000","last_became_active":"2024-04-17T19:53:09.532715+0000","last_became_peered":"2024-04-17T19:53:09.532715+0000","last_unstale":"2024-04-17T19:53:45.580275+0000","last_undegraded":"2024-04-17T19:53:45.580275+0000","last_fullsized":"2024-04-17T19:53:45.580275+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:38:45.556791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.564867+0000","last_change":"2024-04-17T19:53:05.473330+0000","last_active":"2024-04-17T19:53:45.564867+0000","last_peered":"2024-04-17T19:53:45.564867+0000","last_clean":"2024-04-17T19:53:45.564867+0000","last_became_active":"2024-04-17T19:53:05.468223+0000","last_became_peered":"2024-04-17T19:53:05.468223+0000","last_unstale":"2024-04-17T19:53:45.564867+0000","last_undegraded":"2024-04-17T19:53:45.564867+0000","last_fullsized":"2024-04-17T19:53:45.564867+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:01:34.461822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452279+0000","last_change":"2024-04-17T19:53:04.461896+0000","last_active":"2024-04-17T19:53:45.452279+0000","last_peered":"2024-04-17T19:53:45.452279+0000","last_clean":"2024-04-17T19:53:45.452279+0000","last_became_active":"2024-04-17T19:53:04.460919+0000","last_became_peered":"2024-04-17T19:53:04.460919+0000","last_unstale":"2024-04-17T19:53:45.452279+0000","last_undegraded":"2024-04-17T19:53:45.452279+0000","last_fullsized":"2024-04-17T19:53:45.452279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:22:17.837334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.461171+0000","last_change":"2024-04-17T19:53:09.547397+0000","last_active":"2024-04-17T19:53:45.461171+0000","last_peered":"2024-04-17T19:53:45.461171+0000","last_clean":"2024-04-17T19:53:45.461171+0000","last_became_active":"2024-04-17T19:53:09.546048+0000","last_became_peered":"2024-04-17T19:53:09.546048+0000","last_unstale":"2024-04-17T19:53:45.461171+0000","last_undegraded":"2024-04-17T19:53:45.461171+0000","last_fullsized":"2024-04-17T19:53:45.461171+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:58:59.810415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.579920+0000","last_change":"2024-04-17T19:53:05.474322+0000","last_active":"2024-04-17T19:53:45.579920+0000","last_peered":"2024-04-17T19:53:45.579920+0000","last_clean":"2024-04-17T19:53:45.579920+0000","last_became_active":"2024-04-17T19:53:05.473892+0000","last_became_peered":"2024-04-17T19:53:05.473892+0000","last_unstale":"2024-04-17T19:53:45.579920+0000","last_undegraded":"2024-04-17T19:53:45.579920+0000","last_fullsized":"2024-04-17T19:53:45.579920+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:18:12.267644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.447293+0000","last_change":"2024-04-17T19:53:04.460138+0000","last_active":"2024-04-17T19:53:45.447293+0000","last_peered":"2024-04-17T19:53:45.447293+0000","last_clean":"2024-04-17T19:53:45.447293+0000","last_became_active":"2024-04-17T19:53:04.459663+0000","last_became_peered":"2024-04-17T19:53:04.459663+0000","last_unstale":"2024-04-17T19:53:45.447293+0000","last_undegraded":"2024-04-17T19:53:45.447293+0000","last_fullsized":"2024-04-17T19:53:45.447293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:06:00.469757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.459601+0000","last_change":"2024-04-17T19:53:09.533802+0000","last_active":"2024-04-17T19:53:45.459601+0000","last_peered":"2024-04-17T19:53:45.459601+0000","last_clean":"2024-04-17T19:53:45.459601+0000","last_became_active":"2024-04-17T19:53:09.532504+0000","last_became_peered":"2024-04-17T19:53:09.532504+0000","last_unstale":"2024-04-17T19:53:45.459601+0000","last_undegraded":"2024-04-17T19:53:45.459601+0000","last_fullsized":"2024-04-17T19:53:45.459601+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:04:59.171017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.566317+0000","last_change":"2024-04-17T19:53:05.467855+0000","last_active":"2024-04-17T19:53:45.566317+0000","last_peered":"2024-04-17T19:53:45.566317+0000","last_clean":"2024-04-17T19:53:45.566317+0000","last_became_active":"2024-04-17T19:53:05.467349+0000","last_became_peered":"2024-04-17T19:53:05.467349+0000","last_unstale":"2024-04-17T19:53:45.566317+0000","last_undegraded":"2024-04-17T19:53:45.566317+0000","last_fullsized":"2024-04-17T19:53:45.566317+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:52:55.878755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.567245+0000","last_change":"2024-04-17T19:53:04.465826+0000","last_active":"2024-04-17T19:53:45.567245+0000","last_peered":"2024-04-17T19:53:45.567245+0000","last_clean":"2024-04-17T19:53:45.567245+0000","last_became_active":"2024-04-17T19:53:04.465333+0000","last_became_peered":"2024-04-17T19:53:04.465333+0000","last_unstale":"2024-04-17T19:53:45.567245+0000","last_undegraded":"2024-04-17T19:53:45.567245+0000","last_fullsized":"2024-04-17T19:53:45.567245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:25:21.542158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.451925+0000","last_change":"2024-04-17T19:53:09.550127+0000","last_active":"2024-04-17T19:53:45.451925+0000","last_peered":"2024-04-17T19:53:45.451925+0000","last_clean":"2024-04-17T19:53:45.451925+0000","last_became_active":"2024-04-17T19:53:09.548109+0000","last_became_peered":"2024-04-17T19:53:09.548109+0000","last_unstale":"2024-04-17T19:53:45.451925+0000","last_undegraded":"2024-04-17T19:53:45.451925+0000","last_fullsized":"2024-04-17T19:53:45.451925+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:03:47.252621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452197+0000","last_change":"2024-04-17T19:53:05.455185+0000","last_active":"2024-04-17T19:53:45.452197+0000","last_peered":"2024-04-17T19:53:45.452197+0000","last_clean":"2024-04-17T19:53:45.452197+0000","last_became_active":"2024-04-17T19:53:05.454358+0000","last_became_peered":"2024-04-17T19:53:05.454358+0000","last_unstale":"2024-04-17T19:53:45.452197+0000","last_undegraded":"2024-04-17T19:53:45.452197+0000","last_fullsized":"2024-04-17T19:53:45.452197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:26:54.093651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.586332+0000","last_change":"2024-04-17T19:53:04.474288+0000","last_active":"2024-04-17T19:53:45.586332+0000","last_peered":"2024-04-17T19:53:45.586332+0000","last_clean":"2024-04-17T19:53:45.586332+0000","last_became_active":"2024-04-17T19:53:04.473389+0000","last_became_peered":"2024-04-17T19:53:04.473389+0000","last_unstale":"2024-04-17T19:53:45.586332+0000","last_undegraded":"2024-04-17T19:53:45.586332+0000","last_fullsized":"2024-04-17T19:53:45.586332+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:31:27.754909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.566775+0000","last_change":"2024-04-17T19:53:09.524630+0000","last_active":"2024-04-17T19:53:45.566775+0000","last_peered":"2024-04-17T19:53:45.566775+0000","last_clean":"2024-04-17T19:53:45.566775+0000","last_became_active":"2024-04-17T19:53:09.521522+0000","last_became_peered":"2024-04-17T19:53:09.521522+0000","last_unstale":"2024-04-17T19:53:45.566775+0000","last_undegraded":"2024-04-17T19:53:45.566775+0000","last_fullsized":"2024-04-17T19:53:45.566775+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:59:47.402073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.448592+0000","last_change":"2024-04-17T19:53:05.455865+0000","last_active":"2024-04-17T19:53:45.448592+0000","last_peered":"2024-04-17T19:53:45.448592+0000","last_clean":"2024-04-17T19:53:45.448592+0000","last_became_active":"2024-04-17T19:53:05.455429+0000","last_became_peered":"2024-04-17T19:53:05.455429+0000","last_unstale":"2024-04-17T19:53:45.448592+0000","last_undegraded":"2024-04-17T19:53:45.448592+0000","last_fullsized":"2024-04-17T19:53:45.448592+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:01:34.461822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"29'20","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:14.279048+0000","last_change":"2024-04-17T19:53:04.460295+0000","last_active":"2024-04-17T19:54:14.279048+0000","last_peered":"2024-04-17T19:54:14.279048+0000","last_clean":"2024-04-17T19:54:14.279048+0000","last_became_active":"2024-04-17T19:53:04.459855+0000","last_became_peered":"2024-04-17T19:53:04.459855+0000","last_unstale":"2024-04-17T19:54:14.279048+0000","last_undegraded":"2024-04-17T19:54:14.279048+0000","last_fullsized":"2024-04-17T19:54:14.279048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:21:45.875274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6029,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.451349+0000","last_change":"2024-04-17T19:53:09.530008+0000","last_active":"2024-04-17T19:53:45.451349+0000","last_peered":"2024-04-17T19:53:45.451349+0000","last_clean":"2024-04-17T19:53:45.451349+0000","last_became_active":"2024-04-17T19:53:09.528987+0000","last_became_peered":"2024-04-17T19:53:09.528987+0000","last_unstale":"2024-04-17T19:53:45.451349+0000","last_undegraded":"2024-04-17T19:53:45.451349+0000","last_fullsized":"2024-04-17T19:53:45.451349+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:34:07.690034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.564991+0000","last_change":"2024-04-17T19:53:05.472755+0000","last_active":"2024-04-17T19:53:45.564991+0000","last_peered":"2024-04-17T19:53:45.564991+0000","last_clean":"2024-04-17T19:53:45.564991+0000","last_became_active":"2024-04-17T19:53:05.468432+0000","last_became_peered":"2024-04-17T19:53:05.468432+0000","last_unstale":"2024-04-17T19:53:45.564991+0000","last_undegraded":"2024-04-17T19:53:45.564991+0000","last_fullsized":"2024-04-17T19:53:45.564991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:30:23.016439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.587107+0000","last_change":"2024-04-17T19:53:04.474378+0000","last_active":"2024-04-17T19:53:45.587107+0000","last_peered":"2024-04-17T19:53:45.587107+0000","last_clean":"2024-04-17T19:53:45.587107+0000","last_became_active":"2024-04-17T19:53:04.473458+0000","last_became_peered":"2024-04-17T19:53:04.473458+0000","last_unstale":"2024-04-17T19:53:45.587107+0000","last_undegraded":"2024-04-17T19:53:45.587107+0000","last_fullsized":"2024-04-17T19:53:45.587107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:16:30.888573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.450618+0000","last_change":"2024-04-17T19:53:09.558527+0000","last_active":"2024-04-17T19:53:45.450618+0000","last_peered":"2024-04-17T19:53:45.450618+0000","last_clean":"2024-04-17T19:53:45.450618+0000","last_became_active":"2024-04-17T19:53:09.557653+0000","last_became_peered":"2024-04-17T19:53:09.557653+0000","last_unstale":"2024-04-17T19:53:45.450618+0000","last_undegraded":"2024-04-17T19:53:45.450618+0000","last_fullsized":"2024-04-17T19:53:45.450618+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:01:38.507428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.460152+0000","last_change":"2024-04-17T19:53:05.467990+0000","last_active":"2024-04-17T19:53:45.460152+0000","last_peered":"2024-04-17T19:53:45.460152+0000","last_clean":"2024-04-17T19:53:45.460152+0000","last_became_active":"2024-04-17T19:53:05.461293+0000","last_became_peered":"2024-04-17T19:53:05.461293+0000","last_unstale":"2024-04-17T19:53:45.460152+0000","last_undegraded":"2024-04-17T19:53:45.460152+0000","last_fullsized":"2024-04-17T19:53:45.460152+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:01:34.461822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.449080+0000","last_change":"2024-04-17T19:53:04.472928+0000","last_active":"2024-04-17T19:53:45.449080+0000","last_peered":"2024-04-17T19:53:45.449080+0000","last_clean":"2024-04-17T19:53:45.449080+0000","last_became_active":"2024-04-17T19:53:04.467986+0000","last_became_peered":"2024-04-17T19:53:04.467986+0000","last_unstale":"2024-04-17T19:53:45.449080+0000","last_undegraded":"2024-04-17T19:53:45.449080+0000","last_fullsized":"2024-04-17T19:53:45.449080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:53:36.130201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.584286+0000","last_change":"2024-04-17T19:53:09.560792+0000","last_active":"2024-04-17T19:53:45.584286+0000","last_peered":"2024-04-17T19:53:45.584286+0000","last_clean":"2024-04-17T19:53:45.584286+0000","last_became_active":"2024-04-17T19:53:09.558779+0000","last_became_peered":"2024-04-17T19:53:09.558779+0000","last_unstale":"2024-04-17T19:53:45.584286+0000","last_undegraded":"2024-04-17T19:53:45.584286+0000","last_fullsized":"2024-04-17T19:53:45.584286+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:13:52.775623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.451247+0000","last_change":"2024-04-17T19:53:05.459934+0000","last_active":"2024-04-17T19:53:45.451247+0000","last_peered":"2024-04-17T19:53:45.451247+0000","last_clean":"2024-04-17T19:53:45.451247+0000","last_became_active":"2024-04-17T19:53:05.459538+0000","last_became_peered":"2024-04-17T19:53:05.459538+0000","last_unstale":"2024-04-17T19:53:45.451247+0000","last_undegraded":"2024-04-17T19:53:45.451247+0000","last_fullsized":"2024-04-17T19:53:45.451247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:25:22.553475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.581377+0000","last_change":"2024-04-17T19:53:04.460345+0000","last_active":"2024-04-17T19:53:45.581377+0000","last_peered":"2024-04-17T19:53:45.581377+0000","last_clean":"2024-04-17T19:53:45.581377+0000","last_became_active":"2024-04-17T19:53:04.459787+0000","last_became_peered":"2024-04-17T19:53:04.459787+0000","last_unstale":"2024-04-17T19:53:45.581377+0000","last_undegraded":"2024-04-17T19:53:45.581377+0000","last_fullsized":"2024-04-17T19:53:45.581377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:16:30.888573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.589100+0000","last_change":"2024-04-17T19:53:45.589100+0000","last_active":"2024-04-17T19:53:45.589100+0000","last_peered":"2024-04-17T19:53:45.589100+0000","last_clean":"2024-04-17T19:53:45.589100+0000","last_became_active":"2024-04-17T19:53:45.587729+0000","last_became_peered":"2024-04-17T19:53:45.587729+0000","last_unstale":"2024-04-17T19:53:45.589100+0000","last_undegraded":"2024-04-17T19:53:45.589100+0000","last_fullsized":"2024-04-17T19:53:45.589100+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:47:26.887721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,7],"acting":[4,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452474+0000","last_change":"2024-04-17T19:53:09.536930+0000","last_active":"2024-04-17T19:53:45.452474+0000","last_peered":"2024-04-17T19:53:45.452474+0000","last_clean":"2024-04-17T19:53:45.452474+0000","last_became_active":"2024-04-17T19:53:09.535559+0000","last_became_peered":"2024-04-17T19:53:09.535559+0000","last_unstale":"2024-04-17T19:53:45.452474+0000","last_undegraded":"2024-04-17T19:53:45.452474+0000","last_fullsized":"2024-04-17T19:53:45.452474+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:29:54.335720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.459931+0000","last_change":"2024-04-17T19:53:05.440653+0000","last_active":"2024-04-17T19:53:45.459931+0000","last_peered":"2024-04-17T19:53:45.459931+0000","last_clean":"2024-04-17T19:53:45.459931+0000","last_became_active":"2024-04-17T19:53:05.439793+0000","last_became_peered":"2024-04-17T19:53:05.439793+0000","last_unstale":"2024-04-17T19:53:45.459931+0000","last_undegraded":"2024-04-17T19:53:45.459931+0000","last_fullsized":"2024-04-17T19:53:45.459931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:10:21.772873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.565078+0000","last_change":"2024-04-17T19:53:04.461705+0000","last_active":"2024-04-17T19:53:45.565078+0000","last_peered":"2024-04-17T19:53:45.565078+0000","last_clean":"2024-04-17T19:53:45.565078+0000","last_became_active":"2024-04-17T19:53:04.461020+0000","last_became_peered":"2024-04-17T19:53:04.461020+0000","last_unstale":"2024-04-17T19:53:45.565078+0000","last_undegraded":"2024-04-17T19:53:45.565078+0000","last_fullsized":"2024-04-17T19:53:45.565078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:53:36.130201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.566746+0000","last_change":"2024-04-17T19:53:09.535147+0000","last_active":"2024-04-17T19:53:45.566746+0000","last_peered":"2024-04-17T19:53:45.566746+0000","last_clean":"2024-04-17T19:53:45.566746+0000","last_became_active":"2024-04-17T19:53:09.534655+0000","last_became_peered":"2024-04-17T19:53:09.534655+0000","last_unstale":"2024-04-17T19:53:45.566746+0000","last_undegraded":"2024-04-17T19:53:45.566746+0000","last_fullsized":"2024-04-17T19:53:45.566746+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:06:37.779654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452972+0000","last_change":"2024-04-17T19:53:05.455848+0000","last_active":"2024-04-17T19:53:45.452972+0000","last_peered":"2024-04-17T19:53:45.452972+0000","last_clean":"2024-04-17T19:53:45.452972+0000","last_became_active":"2024-04-17T19:53:05.452844+0000","last_became_peered":"2024-04-17T19:53:05.452844+0000","last_unstale":"2024-04-17T19:53:45.452972+0000","last_undegraded":"2024-04-17T19:53:45.452972+0000","last_fullsized":"2024-04-17T19:53:45.452972+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:54:27.523970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.453145+0000","last_change":"2024-04-17T19:53:04.470824+0000","last_active":"2024-04-17T19:53:45.453145+0000","last_peered":"2024-04-17T19:53:45.453145+0000","last_clean":"2024-04-17T19:53:45.453145+0000","last_became_active":"2024-04-17T19:53:04.469777+0000","last_became_peered":"2024-04-17T19:53:04.469777+0000","last_unstale":"2024-04-17T19:53:45.453145+0000","last_undegraded":"2024-04-17T19:53:45.453145+0000","last_fullsized":"2024-04-17T19:53:45.453145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:30:04.861958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.567218+0000","last_change":"2024-04-17T19:53:04.469785+0000","last_active":"2024-04-17T19:53:45.567218+0000","last_peered":"2024-04-17T19:53:45.567218+0000","last_clean":"2024-04-17T19:53:45.567218+0000","last_became_active":"2024-04-17T19:53:04.469297+0000","last_became_peered":"2024-04-17T19:53:04.469297+0000","last_unstale":"2024-04-17T19:53:45.567218+0000","last_undegraded":"2024-04-17T19:53:45.567218+0000","last_fullsized":"2024-04-17T19:53:45.567218+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:50:02.697725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452825+0000","last_change":"2024-04-17T19:53:05.460191+0000","last_active":"2024-04-17T19:53:45.452825+0000","last_peered":"2024-04-17T19:53:45.452825+0000","last_clean":"2024-04-17T19:53:45.452825+0000","last_became_active":"2024-04-17T19:53:05.459616+0000","last_became_peered":"2024-04-17T19:53:05.459616+0000","last_unstale":"2024-04-17T19:53:45.452825+0000","last_undegraded":"2024-04-17T19:53:45.452825+0000","last_fullsized":"2024-04-17T19:53:45.452825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:12:15.307126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.464499+0000","last_change":"2024-04-17T19:53:45.464499+0000","last_active":"2024-04-17T19:53:45.464499+0000","last_peered":"2024-04-17T19:53:45.464499+0000","last_clean":"2024-04-17T19:53:45.464499+0000","last_became_active":"2024-04-17T19:53:45.462598+0000","last_became_peered":"2024-04-17T19:53:45.462598+0000","last_unstale":"2024-04-17T19:53:45.464499+0000","last_undegraded":"2024-04-17T19:53:45.464499+0000","last_fullsized":"2024-04-17T19:53:45.464499+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:27:35.519260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,2],"acting":[4,6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.458228+0000","last_change":"2024-04-17T19:53:04.487292+0000","last_active":"2024-04-17T19:53:45.458228+0000","last_peered":"2024-04-17T19:53:45.458228+0000","last_clean":"2024-04-17T19:53:45.458228+0000","last_became_active":"2024-04-17T19:53:04.486707+0000","last_became_peered":"2024-04-17T19:53:04.486707+0000","last_unstale":"2024-04-17T19:53:45.458228+0000","last_undegraded":"2024-04-17T19:53:45.458228+0000","last_fullsized":"2024-04-17T19:53:45.458228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:48:50.049562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.580306+0000","last_change":"2024-04-17T19:53:05.449319+0000","last_active":"2024-04-17T19:53:45.580306+0000","last_peered":"2024-04-17T19:53:45.580306+0000","last_clean":"2024-04-17T19:53:45.580306+0000","last_became_active":"2024-04-17T19:53:05.448374+0000","last_became_peered":"2024-04-17T19:53:05.448374+0000","last_unstale":"2024-04-17T19:53:45.580306+0000","last_undegraded":"2024-04-17T19:53:45.580306+0000","last_fullsized":"2024-04-17T19:53:45.580306+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:21:37.163564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.586836+0000","last_change":"2024-04-17T19:53:09.561127+0000","last_active":"2024-04-17T19:53:45.586836+0000","last_peered":"2024-04-17T19:53:45.586836+0000","last_clean":"2024-04-17T19:53:45.586836+0000","last_became_active":"2024-04-17T19:53:09.560076+0000","last_became_peered":"2024-04-17T19:53:09.560076+0000","last_unstale":"2024-04-17T19:53:45.586836+0000","last_undegraded":"2024-04-17T19:53:45.586836+0000","last_fullsized":"2024-04-17T19:53:45.586836+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:25:20.343613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.450144+0000","last_change":"2024-04-17T19:53:05.472665+0000","last_active":"2024-04-17T19:53:45.450144+0000","last_peered":"2024-04-17T19:53:45.450144+0000","last_clean":"2024-04-17T19:53:45.450144+0000","last_became_active":"2024-04-17T19:53:05.472324+0000","last_became_peered":"2024-04-17T19:53:05.472324+0000","last_unstale":"2024-04-17T19:53:45.450144+0000","last_undegraded":"2024-04-17T19:53:45.450144+0000","last_fullsized":"2024-04-17T19:53:45.450144+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:50:03.709043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.584932+0000","last_change":"2024-04-17T19:53:05.477190+0000","last_active":"2024-04-17T19:53:45.584932+0000","last_peered":"2024-04-17T19:53:45.584932+0000","last_clean":"2024-04-17T19:53:45.584932+0000","last_became_active":"2024-04-17T19:53:05.475823+0000","last_became_peered":"2024-04-17T19:53:05.475823+0000","last_unstale":"2024-04-17T19:53:45.584932+0000","last_undegraded":"2024-04-17T19:53:45.584932+0000","last_fullsized":"2024-04-17T19:53:45.584932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:53:37.141518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.564743+0000","last_change":"2024-04-17T19:53:05.453565+0000","last_active":"2024-04-17T19:53:45.564743+0000","last_peered":"2024-04-17T19:53:45.564743+0000","last_clean":"2024-04-17T19:53:45.564743+0000","last_became_active":"2024-04-17T19:53:05.453142+0000","last_became_peered":"2024-04-17T19:53:05.453142+0000","last_unstale":"2024-04-17T19:53:45.564743+0000","last_undegraded":"2024-04-17T19:53:45.564743+0000","last_fullsized":"2024-04-17T19:53:45.564743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:39:58.812875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.457952+0000","last_change":"2024-04-17T19:53:05.476450+0000","last_active":"2024-04-17T19:53:45.457952+0000","last_peered":"2024-04-17T19:53:45.457952+0000","last_clean":"2024-04-17T19:53:45.457952+0000","last_became_active":"2024-04-17T19:53:05.473931+0000","last_became_peered":"2024-04-17T19:53:05.473931+0000","last_unstale":"2024-04-17T19:53:45.457952+0000","last_undegraded":"2024-04-17T19:53:45.457952+0000","last_fullsized":"2024-04-17T19:53:45.457952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:10:21.772873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452420+0000","last_change":"2024-04-17T19:53:05.469653+0000","last_active":"2024-04-17T19:53:45.452420+0000","last_peered":"2024-04-17T19:53:45.452420+0000","last_clean":"2024-04-17T19:53:45.452420+0000","last_became_active":"2024-04-17T19:53:05.467838+0000","last_became_peered":"2024-04-17T19:53:05.467838+0000","last_unstale":"2024-04-17T19:53:45.452420+0000","last_undegraded":"2024-04-17T19:53:45.452420+0000","last_fullsized":"2024-04-17T19:53:45.452420+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:38:51.699072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.454087+0000","last_change":"2024-04-17T19:53:05.462678+0000","last_active":"2024-04-17T19:53:45.454087+0000","last_peered":"2024-04-17T19:53:45.454087+0000","last_clean":"2024-04-17T19:53:45.454087+0000","last_became_active":"2024-04-17T19:53:05.461829+0000","last_became_peered":"2024-04-17T19:53:05.461829+0000","last_unstale":"2024-04-17T19:53:45.454087+0000","last_undegraded":"2024-04-17T19:53:45.454087+0000","last_fullsized":"2024-04-17T19:53:45.454087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:03:53.876774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.451061+0000","last_change":"2024-04-17T19:53:05.465993+0000","last_active":"2024-04-17T19:53:45.451061+0000","last_peered":"2024-04-17T19:53:45.451061+0000","last_clean":"2024-04-17T19:53:45.451061+0000","last_became_active":"2024-04-17T19:53:05.465547+0000","last_became_peered":"2024-04-17T19:53:05.465547+0000","last_unstale":"2024-04-17T19:53:45.451061+0000","last_undegraded":"2024-04-17T19:53:45.451061+0000","last_fullsized":"2024-04-17T19:53:45.451061+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:12:03.449509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.459282+0000","last_change":"2024-04-17T19:53:05.477188+0000","last_active":"2024-04-17T19:53:45.459282+0000","last_peered":"2024-04-17T19:53:45.459282+0000","last_clean":"2024-04-17T19:53:45.459282+0000","last_became_active":"2024-04-17T19:53:05.474798+0000","last_became_peered":"2024-04-17T19:53:05.474798+0000","last_unstale":"2024-04-17T19:53:45.459282+0000","last_undegraded":"2024-04-17T19:53:45.459282+0000","last_fullsized":"2024-04-17T19:53:45.459282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:15:45.727550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.564722+0000","last_change":"2024-04-17T19:53:05.484009+0000","last_active":"2024-04-17T19:53:45.564722+0000","last_peered":"2024-04-17T19:53:45.564722+0000","last_clean":"2024-04-17T19:53:45.564722+0000","last_became_active":"2024-04-17T19:53:05.483664+0000","last_became_peered":"2024-04-17T19:53:05.483664+0000","last_unstale":"2024-04-17T19:53:45.564722+0000","last_undegraded":"2024-04-17T19:53:45.564722+0000","last_fullsized":"2024-04-17T19:53:45.564722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:47:05.354826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.456386+0000","last_change":"2024-04-17T19:53:05.466532+0000","last_active":"2024-04-17T19:53:45.456386+0000","last_peered":"2024-04-17T19:53:45.456386+0000","last_clean":"2024-04-17T19:53:45.456386+0000","last_became_active":"2024-04-17T19:53:05.465302+0000","last_became_peered":"2024-04-17T19:53:05.465302+0000","last_unstale":"2024-04-17T19:53:45.456386+0000","last_undegraded":"2024-04-17T19:53:45.456386+0000","last_fullsized":"2024-04-17T19:53:45.456386+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:27:51.520335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.579924+0000","last_change":"2024-04-17T19:53:05.456313+0000","last_active":"2024-04-17T19:53:45.579924+0000","last_peered":"2024-04-17T19:53:45.579924+0000","last_clean":"2024-04-17T19:53:45.579924+0000","last_became_active":"2024-04-17T19:53:05.455862+0000","last_became_peered":"2024-04-17T19:53:05.455862+0000","last_unstale":"2024-04-17T19:53:45.579924+0000","last_undegraded":"2024-04-17T19:53:45.579924+0000","last_fullsized":"2024-04-17T19:53:45.579924+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:23:03.879786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452546+0000","last_change":"2024-04-17T19:53:05.465083+0000","last_active":"2024-04-17T19:53:45.452546+0000","last_peered":"2024-04-17T19:53:45.452546+0000","last_clean":"2024-04-17T19:53:45.452546+0000","last_became_active":"2024-04-17T19:53:05.463806+0000","last_became_peered":"2024-04-17T19:53:05.463806+0000","last_unstale":"2024-04-17T19:53:45.452546+0000","last_undegraded":"2024-04-17T19:53:45.452546+0000","last_fullsized":"2024-04-17T19:53:45.452546+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:25:16.298007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.448031+0000","last_change":"2024-04-17T19:53:05.464340+0000","last_active":"2024-04-17T19:53:45.448031+0000","last_peered":"2024-04-17T19:53:45.448031+0000","last_clean":"2024-04-17T19:53:45.448031+0000","last_became_active":"2024-04-17T19:53:05.463286+0000","last_became_peered":"2024-04-17T19:53:05.463286+0000","last_unstale":"2024-04-17T19:53:45.448031+0000","last_undegraded":"2024-04-17T19:53:45.448031+0000","last_fullsized":"2024-04-17T19:53:45.448031+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:54:27.523970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.565133+0000","last_change":"2024-04-17T19:53:05.475791+0000","last_active":"2024-04-17T19:53:45.565133+0000","last_peered":"2024-04-17T19:53:45.565133+0000","last_clean":"2024-04-17T19:53:45.565133+0000","last_became_active":"2024-04-17T19:53:05.475372+0000","last_became_peered":"2024-04-17T19:53:05.475372+0000","last_unstale":"2024-04-17T19:53:45.565133+0000","last_undegraded":"2024-04-17T19:53:45.565133+0000","last_fullsized":"2024-04-17T19:53:45.565133+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:10:32.839503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.582332+0000","last_change":"2024-04-17T19:53:05.496650+0000","last_active":"2024-04-17T19:53:45.582332+0000","last_peered":"2024-04-17T19:53:45.582332+0000","last_clean":"2024-04-17T19:53:45.582332+0000","last_became_active":"2024-04-17T19:53:05.495881+0000","last_became_peered":"2024-04-17T19:53:05.495881+0000","last_unstale":"2024-04-17T19:53:45.582332+0000","last_undegraded":"2024-04-17T19:53:45.582332+0000","last_fullsized":"2024-04-17T19:53:45.582332+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:23:03.879786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.565817+0000","last_change":"2024-04-17T19:53:05.461335+0000","last_active":"2024-04-17T19:53:45.565817+0000","last_peered":"2024-04-17T19:53:45.565817+0000","last_clean":"2024-04-17T19:53:45.565817+0000","last_became_active":"2024-04-17T19:53:05.460831+0000","last_became_peered":"2024-04-17T19:53:05.460831+0000","last_unstale":"2024-04-17T19:53:45.565817+0000","last_undegraded":"2024-04-17T19:53:45.565817+0000","last_fullsized":"2024-04-17T19:53:45.565817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:22:55.343347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.564726+0000","last_change":"2024-04-17T19:53:05.473875+0000","last_active":"2024-04-17T19:53:45.564726+0000","last_peered":"2024-04-17T19:53:45.564726+0000","last_clean":"2024-04-17T19:53:45.564726+0000","last_became_active":"2024-04-17T19:53:05.467366+0000","last_became_peered":"2024-04-17T19:53:05.467366+0000","last_unstale":"2024-04-17T19:53:45.564726+0000","last_undegraded":"2024-04-17T19:53:45.564726+0000","last_fullsized":"2024-04-17T19:53:45.564726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:05:21.173050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.588365+0000","last_change":"2024-04-17T19:53:45.588365+0000","last_active":"2024-04-17T19:53:45.588365+0000","last_peered":"2024-04-17T19:53:45.588365+0000","last_clean":"2024-04-17T19:53:45.588365+0000","last_became_active":"2024-04-17T19:53:45.587213+0000","last_became_peered":"2024-04-17T19:53:45.587213+0000","last_unstale":"2024-04-17T19:53:45.588365+0000","last_undegraded":"2024-04-17T19:53:45.588365+0000","last_fullsized":"2024-04-17T19:53:45.588365+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:25:48.397875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.451842+0000","last_change":"2024-04-17T19:53:05.465968+0000","last_active":"2024-04-17T19:53:45.451842+0000","last_peered":"2024-04-17T19:53:45.451842+0000","last_clean":"2024-04-17T19:53:45.451842+0000","last_became_active":"2024-04-17T19:53:05.465145+0000","last_became_peered":"2024-04-17T19:53:05.465145+0000","last_unstale":"2024-04-17T19:53:45.451842+0000","last_undegraded":"2024-04-17T19:53:45.451842+0000","last_fullsized":"2024-04-17T19:53:45.451842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:47:46.099722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.453510+0000","last_change":"2024-04-17T19:53:05.463993+0000","last_active":"2024-04-17T19:53:45.453510+0000","last_peered":"2024-04-17T19:53:45.453510+0000","last_clean":"2024-04-17T19:53:45.453510+0000","last_became_active":"2024-04-17T19:53:05.463172+0000","last_became_peered":"2024-04-17T19:53:05.463172+0000","last_unstale":"2024-04-17T19:53:45.453510+0000","last_undegraded":"2024-04-17T19:53:45.453510+0000","last_fullsized":"2024-04-17T19:53:45.453510+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:29:50.457953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.447976+0000","last_change":"2024-04-17T19:53:05.471782+0000","last_active":"2024-04-17T19:53:45.447976+0000","last_peered":"2024-04-17T19:53:45.447976+0000","last_clean":"2024-04-17T19:53:45.447976+0000","last_became_active":"2024-04-17T19:53:05.471347+0000","last_became_peered":"2024-04-17T19:53:05.471347+0000","last_unstale":"2024-04-17T19:53:45.447976+0000","last_undegraded":"2024-04-17T19:53:45.447976+0000","last_fullsized":"2024-04-17T19:53:45.447976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:42:22.878631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.448544+0000","last_change":"2024-04-17T19:53:05.460256+0000","last_active":"2024-04-17T19:53:45.448544+0000","last_peered":"2024-04-17T19:53:45.448544+0000","last_clean":"2024-04-17T19:53:45.448544+0000","last_became_active":"2024-04-17T19:53:05.459869+0000","last_became_peered":"2024-04-17T19:53:05.459869+0000","last_unstale":"2024-04-17T19:53:45.448544+0000","last_undegraded":"2024-04-17T19:53:45.448544+0000","last_fullsized":"2024-04-17T19:53:45.448544+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:47:05.354826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.448801+0000","last_change":"2024-04-17T19:53:05.467331+0000","last_active":"2024-04-17T19:53:45.448801+0000","last_peered":"2024-04-17T19:53:45.448801+0000","last_clean":"2024-04-17T19:53:45.448801+0000","last_became_active":"2024-04-17T19:53:05.467015+0000","last_became_peered":"2024-04-17T19:53:05.467015+0000","last_unstale":"2024-04-17T19:53:45.448801+0000","last_undegraded":"2024-04-17T19:53:45.448801+0000","last_fullsized":"2024-04-17T19:53:45.448801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:10:32.839503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.581375+0000","last_change":"2024-04-17T19:53:05.462631+0000","last_active":"2024-04-17T19:53:45.581375+0000","last_peered":"2024-04-17T19:53:45.581375+0000","last_clean":"2024-04-17T19:53:45.581375+0000","last_became_active":"2024-04-17T19:53:05.462217+0000","last_became_peered":"2024-04-17T19:53:05.462217+0000","last_unstale":"2024-04-17T19:53:45.581375+0000","last_undegraded":"2024-04-17T19:53:45.581375+0000","last_fullsized":"2024-04-17T19:53:45.581375+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:50:03.709043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452168+0000","last_change":"2024-04-17T19:53:05.467941+0000","last_active":"2024-04-17T19:53:45.452168+0000","last_peered":"2024-04-17T19:53:45.452168+0000","last_clean":"2024-04-17T19:53:45.452168+0000","last_became_active":"2024-04-17T19:53:05.467093+0000","last_became_peered":"2024-04-17T19:53:05.467093+0000","last_unstale":"2024-04-17T19:53:45.452168+0000","last_undegraded":"2024-04-17T19:53:45.452168+0000","last_fullsized":"2024-04-17T19:53:45.452168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:12:15.307126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.447185+0000","last_change":"2024-04-17T19:53:05.465748+0000","last_active":"2024-04-17T19:53:45.447185+0000","last_peered":"2024-04-17T19:53:45.447185+0000","last_clean":"2024-04-17T19:53:45.447185+0000","last_became_active":"2024-04-17T19:53:05.465436+0000","last_became_peered":"2024-04-17T19:53:05.465436+0000","last_unstale":"2024-04-17T19:53:45.447185+0000","last_undegraded":"2024-04-17T19:53:45.447185+0000","last_fullsized":"2024-04-17T19:53:45.447185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:02:40.799364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.450402+0000","last_change":"2024-04-17T19:53:05.458098+0000","last_active":"2024-04-17T19:53:45.450402+0000","last_peered":"2024-04-17T19:53:45.450402+0000","last_clean":"2024-04-17T19:53:45.450402+0000","last_became_active":"2024-04-17T19:53:05.457656+0000","last_became_peered":"2024-04-17T19:53:05.457656+0000","last_unstale":"2024-04-17T19:53:45.450402+0000","last_undegraded":"2024-04-17T19:53:45.450402+0000","last_fullsized":"2024-04-17T19:53:45.450402+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:40:31.558660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.447486+0000","last_change":"2024-04-17T19:53:05.477086+0000","last_active":"2024-04-17T19:53:45.447486+0000","last_peered":"2024-04-17T19:53:45.447486+0000","last_clean":"2024-04-17T19:53:45.447486+0000","last_became_active":"2024-04-17T19:53:05.476734+0000","last_became_peered":"2024-04-17T19:53:05.476734+0000","last_unstale":"2024-04-17T19:53:45.447486+0000","last_undegraded":"2024-04-17T19:53:45.447486+0000","last_fullsized":"2024-04-17T19:53:45.447486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:10:21.772873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.450605+0000","last_change":"2024-04-17T19:53:05.458378+0000","last_active":"2024-04-17T19:53:45.450605+0000","last_peered":"2024-04-17T19:53:45.450605+0000","last_clean":"2024-04-17T19:53:45.450605+0000","last_became_active":"2024-04-17T19:53:05.457210+0000","last_became_peered":"2024-04-17T19:53:05.457210+0000","last_unstale":"2024-04-17T19:53:45.450605+0000","last_undegraded":"2024-04-17T19:53:45.450605+0000","last_fullsized":"2024-04-17T19:53:45.450605+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:23:03.879786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.455270+0000","last_change":"2024-04-17T19:53:05.455054+0000","last_active":"2024-04-17T19:53:45.455270+0000","last_peered":"2024-04-17T19:53:45.455270+0000","last_clean":"2024-04-17T19:53:45.455270+0000","last_became_active":"2024-04-17T19:53:05.454065+0000","last_became_peered":"2024-04-17T19:53:05.454065+0000","last_unstale":"2024-04-17T19:53:45.455270+0000","last_undegraded":"2024-04-17T19:53:45.455270+0000","last_fullsized":"2024-04-17T19:53:45.455270+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:42:22.878631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.457715+0000","last_change":"2024-04-17T19:53:05.456675+0000","last_active":"2024-04-17T19:53:45.457715+0000","last_peered":"2024-04-17T19:53:45.457715+0000","last_clean":"2024-04-17T19:53:45.457715+0000","last_became_active":"2024-04-17T19:53:05.455779+0000","last_became_peered":"2024-04-17T19:53:05.455779+0000","last_unstale":"2024-04-17T19:53:45.457715+0000","last_undegraded":"2024-04-17T19:53:45.457715+0000","last_fullsized":"2024-04-17T19:53:45.457715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:02:40.799364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.448945+0000","last_change":"2024-04-17T19:53:05.461773+0000","last_active":"2024-04-17T19:53:45.448945+0000","last_peered":"2024-04-17T19:53:45.448945+0000","last_clean":"2024-04-17T19:53:45.448945+0000","last_became_active":"2024-04-17T19:53:05.461324+0000","last_became_peered":"2024-04-17T19:53:05.461324+0000","last_unstale":"2024-04-17T19:53:45.448945+0000","last_undegraded":"2024-04-17T19:53:45.448945+0000","last_fullsized":"2024-04-17T19:53:45.448945+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:05:21.173050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6827,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":13654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":53,"ondisk_log_size":53,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509462,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":315392,"data_stored":124356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509461,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343928,"statfs":{"total":96636764160,"available":96608182272,"internally_reserved":0,"allocated":909312,"data_stored":714692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509461,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":331776,"data_stored":130933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509461,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31488,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340352,"statfs":{"total":96636764160,"available":96604520448,"internally_reserved":0,"allocated":311296,"data_stored":124814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509461,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31492,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340348,"statfs":{"total":96636764160,"available":96604516352,"internally_reserved":0,"allocated":323584,"data_stored":130261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509460,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32068,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339772,"statfs":{"total":96636764160,"available":96603926528,"internally_reserved":0,"allocated":905216,"data_stored":714670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509461,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31492,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340348,"statfs":{"total":96636764160,"available":96604516352,"internally_reserved":0,"allocated":315392,"data_stored":124288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542166,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":307200,"data_stored":124232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":6029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":6701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T19:54:26.799 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T19:54:26.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.988+0000 7fa313121640 1 Processor -- start 2024-04-17T19:54:26.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.988+0000 7fa313121640 1 -- start start 2024-04-17T19:54:26.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.992+0000 7fa313121640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa30c0cece0 0x7fa30c161500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:26.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.992+0000 7fa313121640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa30c0cdc10 con 0x7fa30c0cf0f0 2024-04-17T19:54:26.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.992+0000 7fa313121640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa30c0cdef0 con 0x7fa30c161a40 2024-04-17T19:54:26.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.992+0000 7fa313121640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7fa30c0ce4b0 con 0x7fa30c0cece0 2024-04-17T19:54:26.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.992+0000 7fa30bfff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fa30c0cf0f0 0x7fa30c0b1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:44208/0 (socket says 172.21.15.18:44208) 2024-04-17T19:54:26.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.992+0000 7fa30bfff640 1 -- 172.21.15.18:0/2099155319 learned_addr learned my addr 172.21.15.18:0/2099155319 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:54:26.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.992+0000 7fa310ebd640 1 --2- 172.21.15.18:0/2099155319 >> v2:172.21.15.173:3300/0 conn(0x7fa30c0cece0 0x7fa30c161500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:26.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.992+0000 7fa30b7fe640 1 -- 172.21.15.18:0/2099155319 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 328272562 0 0) 0x7fa30c0cdc10 con 0x7fa30c0cf0f0 2024-04-17T19:54:26.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.992+0000 7fa30b7fe640 1 -- 172.21.15.18:0/2099155319 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2f4003530 con 0x7fa30c0cf0f0 2024-04-17T19:54:26.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.992+0000 7fa30b7fe640 1 -- 172.21.15.18:0/2099155319 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1609890232 0 0) 0x7fa2f4003530 con 0x7fa30c0cf0f0 2024-04-17T19:54:26.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.992+0000 7fa30b7fe640 1 -- 172.21.15.18:0/2099155319 >> v2:172.21.15.173:3300/0 conn(0x7fa30c0cece0 msgr2=0x7fa30c161500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:26.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.992+0000 7fa30b7fe640 1 --2- 172.21.15.18:0/2099155319 >> v2:172.21.15.173:3300/0 conn(0x7fa30c0cece0 0x7fa30c161500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:26.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.992+0000 7fa30b7fe640 1 -- 172.21.15.18:0/2099155319 >> v1:172.21.15.173:6789/0 conn(0x7fa30c161a40 legacy=0x7fa30c0b6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:26.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.992+0000 7fa30b7fe640 1 -- 172.21.15.18:0/2099155319 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa30c0ce1d0 con 0x7fa30c0cf0f0 2024-04-17T19:54:26.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.992+0000 7fa30b7fe640 1 -- 172.21.15.18:0/2099155319 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3208559991 0 0) 0x7fa300001680 con 0x7fa30c0cf0f0 2024-04-17T19:54:26.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.992+0000 7fa30b7fe640 1 -- 172.21.15.18:0/2099155319 >> v1:172.21.15.18:6789/0 conn(0x7fa30c0cf0f0 legacy=0x7fa30c0b1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:26.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.992+0000 7fa30b7fe640 1 --2- 172.21.15.18:0/2099155319 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2f40039c0 0x7fa2f4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:26.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.992+0000 7fa30b7fe640 1 --2- 172.21.15.18:0/2099155319 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2f4004810 0x7fa2f4004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:26.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.992+0000 7fa30b7fe640 1 --2- 172.21.15.18:0/2099155319 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa2f40051d0 0x7fa2f400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:26.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.992+0000 7fa30b7fe640 1 -- 172.21.15.18:0/2099155319 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f400c140 con 0x7fa2f40039c0 2024-04-17T19:54:26.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.992+0000 7fa30b7fe640 1 -- 172.21.15.18:0/2099155319 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f400c2f0 con 0x7fa2f4004810 2024-04-17T19:54:26.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.992+0000 7fa30b7fe640 1 -- 172.21.15.18:0/2099155319 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fa2f400c4f0 con 0x7fa2f40051d0 2024-04-17T19:54:26.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.992+0000 7fa310ebd640 1 --2- 172.21.15.18:0/2099155319 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2f40039c0 0x7fa2f4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:26.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.992+0000 7fa30bfff640 1 --2- 172.21.15.18:0/2099155319 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2f4004810 0x7fa2f4004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:26.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.992+0000 7fa3116be640 1 --2- 172.21.15.18:0/2099155319 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa2f40051d0 0x7fa2f400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:26.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.992+0000 7fa310ebd640 1 -- 172.21.15.18:0/2099155319 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa2f40051d0 msgr2=0x7fa2f400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:26.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.992+0000 7fa310ebd640 1 --2- 172.21.15.18:0/2099155319 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa2f40051d0 0x7fa2f400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:26.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.992+0000 7fa310ebd640 1 -- 172.21.15.18:0/2099155319 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2f4004810 msgr2=0x7fa2f4004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:26.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.992+0000 7fa310ebd640 1 --2- 172.21.15.18:0/2099155319 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2f4004810 0x7fa2f4004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:26.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.992+0000 7fa310ebd640 1 -- 172.21.15.18:0/2099155319 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2f4003530 con 0x7fa2f40039c0 2024-04-17T19:54:26.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.992+0000 7fa3116be640 1 -- 172.21.15.18:0/2099155319 reap_dead start 2024-04-17T19:54:26.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.996+0000 7fa310ebd640 1 --2- 172.21.15.18:0/2099155319 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2f40039c0 0x7fa2f4003e30 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc009fc0 tx=0x7fa2fc01cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b0a8f56786878f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:26.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.996+0000 7fa30b7fe640 1 -- 172.21.15.18:0/2099155319 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc0b2070 con 0x7fa2f40039c0 2024-04-17T19:54:26.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.996+0000 7fa30b7fe640 1 -- 172.21.15.18:0/2099155319 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2fc0a59b0 con 0x7fa2f40039c0 2024-04-17T19:54:26.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.996+0000 7fa30b7fe640 1 -- 172.21.15.18:0/2099155319 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc009c10 con 0x7fa2f40039c0 2024-04-17T19:54:26.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.996+0000 7fa313121640 1 -- 172.21.15.18:0/2099155319 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2f40039c0 msgr2=0x7fa2f4003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:26.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.996+0000 7fa313121640 1 --2- 172.21.15.18:0/2099155319 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2f40039c0 0x7fa2f4003e30 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc009fc0 tx=0x7fa2fc01cbc0 comp rx=0 tx=0).stop 2024-04-17T19:54:26.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.996+0000 7fa313121640 1 -- 172.21.15.18:0/2099155319 shutdown_connections 2024-04-17T19:54:26.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.996+0000 7fa313121640 1 --2- 172.21.15.18:0/2099155319 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2f40039c0 0x7fa2f4003e30 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:26.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.996+0000 7fa313121640 1 -- 172.21.15.18:0/2099155319 >> 172.21.15.18:0/2099155319 conn(0x7fa30c09aa70 msgr2=0x7fa30c09ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:26.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.996+0000 7fa313121640 1 -- 172.21.15.18:0/2099155319 shutdown_connections 2024-04-17T19:54:26.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.996+0000 7fa313121640 1 -- 172.21.15.18:0/2099155319 wait complete. 2024-04-17T19:54:26.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:26.996+0000 7fa313121640 1 Processor -- start 2024-04-17T19:54:26.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:27.000+0000 7fa313121640 1 -- start start 2024-04-17T19:54:26.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:27.000+0000 7fa313121640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa2f40039c0 0x7fa30c0c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:26.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:27.000+0000 7fa313121640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa30c14fcf0 0x7fa30c150100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:26.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:27.000+0000 7fa313121640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa30c0c4120 0x7fa30c0c4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:26.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:27.000+0000 7fa313121640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa30c0b6be0 con 0x7fa30c0c4120 2024-04-17T19:54:26.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:27.000+0000 7fa313121640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa30c0b6a60 con 0x7fa30c14fcf0 2024-04-17T19:54:26.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:27.000+0000 7fa313121640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fa30c0b6d60 con 0x7fa2f40039c0 2024-04-17T19:54:26.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:27.000+0000 7fa3116be640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa30c0c4120 0x7fa30c0c4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:26.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:27.000+0000 7fa3116be640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa30c0c4120 0x7fa30c0c4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34164/0 (socket says 172.21.15.18:34164) 2024-04-17T19:54:26.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:27.000+0000 7fa3116be640 1 -- 172.21.15.18:0/3472010389 learned_addr learned my addr 172.21.15.18:0/3472010389 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:27.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:27.000+0000 7fa30bfff640 1 --2- 172.21.15.18:0/3472010389 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa30c14fcf0 0x7fa30c150100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:27.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:27.000+0000 7fa310ebd640 1 --2- 172.21.15.18:0/3472010389 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa2f40039c0 0x7fa30c0c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:27.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:27.000+0000 7fa3116be640 1 -- 172.21.15.18:0/3472010389 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa2f40039c0 msgr2=0x7fa30c0c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:27.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:27.000+0000 7fa3116be640 1 --2- 172.21.15.18:0/3472010389 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa2f40039c0 0x7fa30c0c8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:27.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:27.000+0000 7fa3116be640 1 -- 172.21.15.18:0/3472010389 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa30c14fcf0 msgr2=0x7fa30c150100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:27.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:27.000+0000 7fa3116be640 1 --2- 172.21.15.18:0/3472010389 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa30c14fcf0 0x7fa30c150100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:27.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:27.000+0000 7fa3116be640 1 -- 172.21.15.18:0/3472010389 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa30c150640 con 0x7fa30c0c4120 2024-04-17T19:54:27.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:27.000+0000 7fa3116be640 1 --2- 172.21.15.18:0/3472010389 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa30c0c4120 0x7fa30c0c4530 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa30c0b10e0 tx=0x7fa30400e820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:27.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:27.000+0000 7fa3097fa640 1 -- 172.21.15.18:0/3472010389 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa304019070 con 0x7fa30c0c4120 2024-04-17T19:54:27.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:27.000+0000 7fa3097fa640 1 -- 172.21.15.18:0/3472010389 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3040052e0 con 0x7fa30c0c4120 2024-04-17T19:54:27.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:27.000+0000 7fa3097fa640 1 -- 172.21.15.18:0/3472010389 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa304003820 con 0x7fa30c0c4120 2024-04-17T19:54:27.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:27.000+0000 7fa313121640 1 -- 172.21.15.18:0/3472010389 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa30c0d0420 con 0x7fa30c0c4120 2024-04-17T19:54:27.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:27.000+0000 7fa313121640 1 -- 172.21.15.18:0/3472010389 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa30c0d09e0 con 0x7fa30c0c4120 2024-04-17T19:54:27.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:27.000+0000 7fa313121640 1 -- 172.21.15.18:0/3472010389 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa30c069950 con 0x7fa30c0c4120 2024-04-17T19:54:27.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:27.000+0000 7fa3097fa640 1 -- 172.21.15.18:0/3472010389 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa30401c070 con 0x7fa30c0c4120 2024-04-17T19:54:27.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:27.004+0000 7fa3097fa640 1 --2- 172.21.15.18:0/3472010389 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fa2f8068380 0x7fa2f806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:27.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:27.004+0000 7fa3097fa640 1 -- 172.21.15.18:0/3472010389 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7fa3040861a0 con 0x7fa30c0c4120 2024-04-17T19:54:27.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:27.004+0000 7fa310ebd640 1 --2- 172.21.15.18:0/3472010389 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fa2f8068380 0x7fa2f806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:27.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:27.004+0000 7fa310ebd640 1 --2- 172.21.15.18:0/3472010389 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fa2f8068380 0x7fa2f806a890 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc0af000 tx=0x7fa2fc004ac0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:27.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:27.008+0000 7fa3097fa640 1 -- 172.21.15.18:0/3472010389 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa30c150640 con 0x7fa30c0c4120 2024-04-17T19:54:27.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:27.172+0000 7fa313121640 1 -- 172.21.15.18:0/3472010389 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa30c06f020 con 0x7fa30c0c4120 2024-04-17T19:54:27.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:27.176+0000 7fa3097fa640 1 -- 172.21.15.18:0/3472010389 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18759 (secure 0 0 0) 0x7fa304056300 con 0x7fa30c0c4120 2024-04-17T19:54:27.173 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:54:27.173 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":29,"fsid":"dd480169-5a81-4623-be5f-0499aa244b28","created":"2024-04-17T19:52:39.533760+0000","modified":"2024-04-17T19:53:45.435889+0000","last_up_change":"2024-04-17T19:52:51.229698+0000","last_in_change":"2024-04-17T19:52:42.144259+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T19:52:52.391648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T19:53:02.734240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T19:53:03.813028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T19:53:07.478812+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e232d577-2508-4ea4-b355-29fbae1ff025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6801","nonce":2323038417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6803","nonce":2323038417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6807","nonce":2323038417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6805","nonce":2323038417}]},"public_addr":"172.21.15.18:6801/2323038417","cluster_addr":"172.21.15.18:6803/2323038417","heartbeat_back_addr":"172.21.15.18:6807/2323038417","heartbeat_front_addr":"172.21.15.18:6805/2323038417","state":["exists","up"]},{"osd":1,"uuid":"31810ef3-2c71-48d6-8748-b74a2968d23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6817","nonce":1283678238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6819","nonce":1283678238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6823","nonce":1283678238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6821","nonce":1283678238}]},"public_addr":"172.21.15.18:6817/1283678238","cluster_addr":"172.21.15.18:6819/1283678238","heartbeat_back_addr":"172.21.15.18:6823/1283678238","heartbeat_front_addr":"172.21.15.18:6821/1283678238","state":["exists","up"]},{"osd":2,"uuid":"5a783cc5-a41c-4967-9e11-6b8330f97d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6809","nonce":1212875862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6811","nonce":1212875862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6815","nonce":1212875862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6813","nonce":1212875862}]},"public_addr":"172.21.15.18:6809/1212875862","cluster_addr":"172.21.15.18:6811/1212875862","heartbeat_back_addr":"172.21.15.18:6815/1212875862","heartbeat_front_addr":"172.21.15.18:6813/1212875862","state":["exists","up"]},{"osd":3,"uuid":"b7e056d9-9da5-46e1-810d-0c3e242fe5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6825","nonce":2428878428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6827","nonce":2428878428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6831","nonce":2428878428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6829","nonce":2428878428}]},"public_addr":"172.21.15.18:6825/2428878428","cluster_addr":"172.21.15.18:6827/2428878428","heartbeat_back_addr":"172.21.15.18:6831/2428878428","heartbeat_front_addr":"172.21.15.18:6829/2428878428","state":["exists","up"]},{"osd":4,"uuid":"21df023f-bc8b-4abb-93e5-0ecc91acda0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6825","nonce":1421511819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6827","nonce":1421511819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6831","nonce":1421511819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6829","nonce":1421511819}]},"public_addr":"172.21.15.173:6825/1421511819","cluster_addr":"172.21.15.173:6827/1421511819","heartbeat_back_addr":"172.21.15.173:6831/1421511819","heartbeat_front_addr":"172.21.15.173:6829/1421511819","state":["exists","up"]},{"osd":5,"uuid":"e270098a-6d33-49f8-84ed-94e09a880cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6801","nonce":4221907702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6803","nonce":4221907702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6807","nonce":4221907702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6805","nonce":4221907702}]},"public_addr":"172.21.15.173:6801/4221907702","cluster_addr":"172.21.15.173:6803/4221907702","heartbeat_back_addr":"172.21.15.173:6807/4221907702","heartbeat_front_addr":"172.21.15.173:6805/4221907702","state":["exists","up"]},{"osd":6,"uuid":"93c67c8c-268d-4e32-877c-043cd3acd87c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6809","nonce":761678552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6811","nonce":761678552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6815","nonce":761678552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6813","nonce":761678552}]},"public_addr":"172.21.15.173:6809/761678552","cluster_addr":"172.21.15.173:6811/761678552","heartbeat_back_addr":"172.21.15.173:6815/761678552","heartbeat_front_addr":"172.21.15.173:6813/761678552","state":["exists","up"]},{"osd":7,"uuid":"faf10eea-80de-40f6-abbb-34d07d3f59ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6817","nonce":383724537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6819","nonce":383724537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6823","nonce":383724537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6821","nonce":383724537}]},"public_addr":"172.21.15.173:6817/383724537","cluster_addr":"172.21.15.173:6819/383724537","heartbeat_back_addr":"172.21.15.173:6823/383724537","heartbeat_front_addr":"172.21.15.173:6821/383724537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.668924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.761747+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.768128+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.632252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.742608+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.734327+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.477107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.818292+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.31","mappings":[{"from":0,"to":7}]},{"pgid":"4.5","mappings":[{"from":3,"to":4},{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":0}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]},{"pgid":"4.1c","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T19:54:27.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:27.176+0000 7fa313121640 1 -- 172.21.15.18:0/3472010389 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fa2f8068380 msgr2=0x7fa2f806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:27.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:27.176+0000 7fa313121640 1 --2- 172.21.15.18:0/3472010389 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fa2f8068380 0x7fa2f806a890 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc0af000 tx=0x7fa2fc004ac0 comp rx=0 tx=0).stop 2024-04-17T19:54:27.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:27.176+0000 7fa313121640 1 -- 172.21.15.18:0/3472010389 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa30c0c4120 msgr2=0x7fa30c0c4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:27.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:27.176+0000 7fa313121640 1 --2- 172.21.15.18:0/3472010389 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa30c0c4120 0x7fa30c0c4530 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa30c0b10e0 tx=0x7fa30400e820 comp rx=0 tx=0).stop 2024-04-17T19:54:27.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:27.176+0000 7fa313121640 1 -- 172.21.15.18:0/3472010389 shutdown_connections 2024-04-17T19:54:27.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:27.176+0000 7fa313121640 1 --2- 172.21.15.18:0/3472010389 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fa2f8068380 0x7fa2f806a890 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:27.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:27.176+0000 7fa313121640 1 --2- 172.21.15.18:0/3472010389 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa30c0c4120 0x7fa30c0c4530 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:27.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:27.176+0000 7fa313121640 1 --2- 172.21.15.18:0/3472010389 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa30c14fcf0 0x7fa30c150100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:27.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:27.176+0000 7fa313121640 1 --2- 172.21.15.18:0/3472010389 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa2f40039c0 0x7fa30c0c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:27.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:27.176+0000 7fa313121640 1 -- 172.21.15.18:0/3472010389 >> 172.21.15.18:0/3472010389 conn(0x7fa30c09aa70 msgr2=0x7fa30c0aea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:27.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:27.176+0000 7fa313121640 1 -- 172.21.15.18:0/3472010389 shutdown_connections 2024-04-17T19:54:27.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:27.176+0000 7fa313121640 1 -- 172.21.15.18:0/3472010389 wait complete. 2024-04-17T19:54:28.195 INFO:tasks.ceph:Scrubbing osd.0 2024-04-17T19:54:28.196 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-17T19:54:28.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.368+0000 7f977d509640 1 Processor -- start 2024-04-17T19:54:28.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.368+0000 7f977d509640 1 -- start start 2024-04-17T19:54:28.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.372+0000 7f977d509640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f977806eee0 0x7f9778070cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:28.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.372+0000 7f977d509640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9778071620 con 0x7f97780ce470 2024-04-17T19:54:28.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.372+0000 7f977d509640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f977806de40 con 0x7f9778071210 2024-04-17T19:54:28.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.372+0000 7f977d509640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f977806e120 con 0x7f977806eee0 2024-04-17T19:54:28.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.372+0000 7f97777fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f97780ce470 0x7f97780d07c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:44212/0 (socket says 172.21.15.18:44212) 2024-04-17T19:54:28.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.372+0000 7f97777fe640 1 -- 172.21.15.18:0/4060604666 learned_addr learned my addr 172.21.15.18:0/4060604666 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:54:28.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.372+0000 7f9776ffd640 1 --2- 172.21.15.18:0/4060604666 >> v2:172.21.15.173:3300/0 conn(0x7f977806eee0 0x7f9778070cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:28.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.372+0000 7f9775ffb640 1 -- 172.21.15.18:0/4060604666 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2818513004 0 0) 0x7f97700014a0 con 0x7f97780ce470 2024-04-17T19:54:28.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.372+0000 7f9775ffb640 1 -- 172.21.15.18:0/4060604666 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9760003530 con 0x7f97780ce470 2024-04-17T19:54:28.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.372+0000 7f9775ffb640 1 -- 172.21.15.18:0/4060604666 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 226265528 0 0) 0x7f9760003530 con 0x7f97780ce470 2024-04-17T19:54:28.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.372+0000 7f9775ffb640 1 -- 172.21.15.18:0/4060604666 >> v2:172.21.15.173:3300/0 conn(0x7f977806eee0 msgr2=0x7f9778070cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:28.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.372+0000 7f9775ffb640 1 --2- 172.21.15.18:0/4060604666 >> v2:172.21.15.173:3300/0 conn(0x7f977806eee0 0x7f9778070cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:28.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.372+0000 7f9775ffb640 1 -- 172.21.15.18:0/4060604666 >> v1:172.21.15.173:6789/0 conn(0x7f9778071210 legacy=0x7f97780cdd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:28.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.372+0000 7f9775ffb640 1 -- 172.21.15.18:0/4060604666 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f977806e400 con 0x7f97780ce470 2024-04-17T19:54:28.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.372+0000 7f9775ffb640 1 -- 172.21.15.18:0/4060604666 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3208559991 0 0) 0x7f9770001bd0 con 0x7f97780ce470 2024-04-17T19:54:28.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.372+0000 7f9775ffb640 1 -- 172.21.15.18:0/4060604666 >> v1:172.21.15.18:6789/0 conn(0x7f97780ce470 legacy=0x7f97780d07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:28.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.372+0000 7f9775ffb640 1 --2- 172.21.15.18:0/4060604666 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97600039c0 0x7f9760003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:28.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.372+0000 7f9775ffb640 1 --2- 172.21.15.18:0/4060604666 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9760004810 0x7f9760004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:28.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.372+0000 7f9775ffb640 1 --2- 172.21.15.18:0/4060604666 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f97600051d0 0x7f976000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:28.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.372+0000 7f9775ffb640 1 -- 172.21.15.18:0/4060604666 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f977806e120 con 0x7f97600039c0 2024-04-17T19:54:28.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.372+0000 7f9775ffb640 1 -- 172.21.15.18:0/4060604666 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f976000c160 con 0x7f9760004810 2024-04-17T19:54:28.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.372+0000 7f9775ffb640 1 -- 172.21.15.18:0/4060604666 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f976000c360 con 0x7f97600051d0 2024-04-17T19:54:28.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.372+0000 7f9776ffd640 1 --2- 172.21.15.18:0/4060604666 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97600039c0 0x7f9760003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:28.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.372+0000 7f97767fc640 1 --2- 172.21.15.18:0/4060604666 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9760004810 0x7f9760004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:28.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.372+0000 7f9776ffd640 1 -- 172.21.15.18:0/4060604666 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f97600051d0 msgr2=0x7f976000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:28.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.372+0000 7f9776ffd640 1 --2- 172.21.15.18:0/4060604666 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f97600051d0 0x7f976000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:28.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.372+0000 7f9776ffd640 1 -- 172.21.15.18:0/4060604666 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9760004810 msgr2=0x7f9760004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:28.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.372+0000 7f9776ffd640 1 --2- 172.21.15.18:0/4060604666 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9760004810 0x7f9760004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:28.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.372+0000 7f9776ffd640 1 -- 172.21.15.18:0/4060604666 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9760003530 con 0x7f97600039c0 2024-04-17T19:54:28.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.372+0000 7f97777fe640 1 -- 172.21.15.18:0/4060604666 reap_dead start 2024-04-17T19:54:28.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.376+0000 7f9776ffd640 1 --2- 172.21.15.18:0/4060604666 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97600039c0 0x7f9760003e30 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9768009ae0 tx=0x7f976801c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7dc5060c2d5640 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:28.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.376+0000 7f9775ffb640 1 -- 172.21.15.18:0/4060604666 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97680096b0 con 0x7f97600039c0 2024-04-17T19:54:28.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.376+0000 7f9775ffb640 1 -- 172.21.15.18:0/4060604666 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97680a64f0 con 0x7f97600039c0 2024-04-17T19:54:28.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.376+0000 7f9775ffb640 1 -- 172.21.15.18:0/4060604666 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97680a68e0 con 0x7f97600039c0 2024-04-17T19:54:28.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.376+0000 7f977d509640 1 -- 172.21.15.18:0/4060604666 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97600039c0 msgr2=0x7f9760003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:28.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.376+0000 7f977d509640 1 --2- 172.21.15.18:0/4060604666 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97600039c0 0x7f9760003e30 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9768009ae0 tx=0x7f976801c8f0 comp rx=0 tx=0).stop 2024-04-17T19:54:28.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.376+0000 7f977d509640 1 -- 172.21.15.18:0/4060604666 shutdown_connections 2024-04-17T19:54:28.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.376+0000 7f977d509640 1 --2- 172.21.15.18:0/4060604666 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97600039c0 0x7f9760003e30 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:28.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.376+0000 7f977d509640 1 -- 172.21.15.18:0/4060604666 >> 172.21.15.18:0/4060604666 conn(0x7f97780d2bf0 msgr2=0x7f97780d3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:28.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.376+0000 7f977d509640 1 -- 172.21.15.18:0/4060604666 shutdown_connections 2024-04-17T19:54:28.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.376+0000 7f977d509640 1 -- 172.21.15.18:0/4060604666 wait complete. 2024-04-17T19:54:28.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.380+0000 7f977d509640 1 Processor -- start 2024-04-17T19:54:28.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.380+0000 7f977d509640 1 -- start start 2024-04-17T19:54:28.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.380+0000 7f977d509640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97600039c0 0x7f977814aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:28.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.380+0000 7f977d509640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97780caf70 0x7f97780cb380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:28.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.380+0000 7f977d509640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f977815ba10 0x7f977815be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:28.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.380+0000 7f977d509640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f977815f8f0 con 0x7f97780caf70 2024-04-17T19:54:28.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.380+0000 7f977d509640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f977806e9c0 con 0x7f97600039c0 2024-04-17T19:54:28.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.380+0000 7f977d509640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f977806daf0 con 0x7f977815ba10 2024-04-17T19:54:28.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.380+0000 7f97767fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97780caf70 0x7f97780cb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:28.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.380+0000 7f97767fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97780caf70 0x7f97780cb380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34174/0 (socket says 172.21.15.18:34174) 2024-04-17T19:54:28.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.380+0000 7f97767fc640 1 -- 172.21.15.18:0/3284538429 learned_addr learned my addr 172.21.15.18:0/3284538429 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:28.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.380+0000 7f9776ffd640 1 --2- 172.21.15.18:0/3284538429 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97600039c0 0x7f977814aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:28.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.380+0000 7f97777fe640 1 --2- 172.21.15.18:0/3284538429 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f977815ba10 0x7f977815be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:28.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.380+0000 7f97767fc640 1 -- 172.21.15.18:0/3284538429 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f977815ba10 msgr2=0x7f977815be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:28.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.380+0000 7f97767fc640 1 --2- 172.21.15.18:0/3284538429 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f977815ba10 0x7f977815be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:28.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.380+0000 7f97767fc640 1 -- 172.21.15.18:0/3284538429 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97600039c0 msgr2=0x7f977814aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:28.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.380+0000 7f97767fc640 1 --2- 172.21.15.18:0/3284538429 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f97600039c0 0x7f977814aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:28.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.380+0000 7f97767fc640 1 -- 172.21.15.18:0/3284538429 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97780cbbd0 con 0x7f97780caf70 2024-04-17T19:54:28.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.380+0000 7f97767fc640 1 --2- 172.21.15.18:0/3284538429 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97780caf70 0x7f97780cb380 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f976c00e460 tx=0x7f976c00e920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:28.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.380+0000 7f975f7fe640 1 -- 172.21.15.18:0/3284538429 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f976c0052e0 con 0x7f97780caf70 2024-04-17T19:54:28.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.380+0000 7f975f7fe640 1 -- 172.21.15.18:0/3284538429 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f976c018070 con 0x7f97780caf70 2024-04-17T19:54:28.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.380+0000 7f975f7fe640 1 -- 172.21.15.18:0/3284538429 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f976c003840 con 0x7f97780caf70 2024-04-17T19:54:28.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.380+0000 7f977d509640 1 -- 172.21.15.18:0/3284538429 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97780cbeb0 con 0x7f97780caf70 2024-04-17T19:54:28.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.380+0000 7f977d509640 1 -- 172.21.15.18:0/3284538429 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97780cc470 con 0x7f97780caf70 2024-04-17T19:54:28.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.380+0000 7f977d509640 1 -- 172.21.15.18:0/3284538429 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f97780b72e0 con 0x7f97780caf70 2024-04-17T19:54:28.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.384+0000 7f975f7fe640 1 -- 172.21.15.18:0/3284538429 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f976c0039e0 con 0x7f97780caf70 2024-04-17T19:54:28.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.384+0000 7f975f7fe640 1 --2- 172.21.15.18:0/3284538429 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f9764068380 0x7f976406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:28.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.384+0000 7f975f7fe640 1 -- 172.21.15.18:0/3284538429 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7f976c0874a0 con 0x7f97780caf70 2024-04-17T19:54:28.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.384+0000 7f9776ffd640 1 --2- 172.21.15.18:0/3284538429 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f9764068380 0x7f976406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:28.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.384+0000 7f975f7fe640 1 --2- 172.21.15.18:0/3284538429 >> [v2:172.21.15.18:6800/2323038417,v1:172.21.15.18:6801/2323038417] conn(0x7f9764071ce0 0x7f97640741d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:28.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.384+0000 7f975f7fe640 1 -- 172.21.15.18:0/3284538429 --> [v2:172.21.15.18:6800/2323038417,v1:172.21.15.18:6801/2323038417] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f97640748a0 con 0x7f9764071ce0 2024-04-17T19:54:28.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.384+0000 7f975f7fe640 1 -- 172.21.15.18:0/3284538429 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f976c087850 con 0x7f97780caf70 2024-04-17T19:54:28.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.384+0000 7f97777fe640 1 --2- 172.21.15.18:0/3284538429 >> [v2:172.21.15.18:6800/2323038417,v1:172.21.15.18:6801/2323038417] conn(0x7f9764071ce0 0x7f97640741d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:28.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.384+0000 7f9776ffd640 1 --2- 172.21.15.18:0/3284538429 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f9764068380 0x7f976406a890 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f97680af000 tx=0x7f97680a8040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:28.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.384+0000 7f97777fe640 1 --2- 172.21.15.18:0/3284538429 >> [v2:172.21.15.18:6800/2323038417,v1:172.21.15.18:6801/2323038417] conn(0x7f9764071ce0 0x7f97640741d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:28.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.384+0000 7f975f7fe640 1 -- 172.21.15.18:0/3284538429 <== osd.0 v2:172.21.15.18:6800/2323038417 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f97640748a0 con 0x7f9764071ce0 2024-04-17T19:54:28.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.396+0000 7f977d509640 1 -- 172.21.15.18:0/3284538429 --> [v2:172.21.15.18:6800/2323038417,v1:172.21.15.18:6801/2323038417] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f97780b7090 con 0x7f9764071ce0 2024-04-17T19:54:28.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.400+0000 7f975f7fe640 1 -- 172.21.15.18:0/3284538429 <== osd.0 v2:172.21.15.18:6800/2323038417 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f97780b7090 con 0x7f9764071ce0 2024-04-17T19:54:28.396 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-17T19:54:28.396 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-17T19:54:28.397 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-17T19:54:28.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.400+0000 7f977d509640 1 -- 172.21.15.18:0/3284538429 >> [v2:172.21.15.18:6800/2323038417,v1:172.21.15.18:6801/2323038417] conn(0x7f9764071ce0 msgr2=0x7f97640741d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:28.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.400+0000 7f977d509640 1 --2- 172.21.15.18:0/3284538429 >> [v2:172.21.15.18:6800/2323038417,v1:172.21.15.18:6801/2323038417] conn(0x7f9764071ce0 0x7f97640741d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:28.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.400+0000 7f977d509640 1 -- 172.21.15.18:0/3284538429 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f9764068380 msgr2=0x7f976406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:28.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.400+0000 7f977d509640 1 --2- 172.21.15.18:0/3284538429 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f9764068380 0x7f976406a890 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f97680af000 tx=0x7f97680a8040 comp rx=0 tx=0).stop 2024-04-17T19:54:28.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.400+0000 7f977d509640 1 -- 172.21.15.18:0/3284538429 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97780caf70 msgr2=0x7f97780cb380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:28.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.400+0000 7f977d509640 1 --2- 172.21.15.18:0/3284538429 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97780caf70 0x7f97780cb380 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f976c00e460 tx=0x7f976c00e920 comp rx=0 tx=0).stop 2024-04-17T19:54:28.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.400+0000 7f97777fe640 1 -- 172.21.15.18:0/3284538429 reap_dead start 2024-04-17T19:54:28.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.400+0000 7f977d509640 1 -- 172.21.15.18:0/3284538429 shutdown_connections 2024-04-17T19:54:28.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.400+0000 7f977d509640 1 -- 172.21.15.18:0/3284538429 >> 172.21.15.18:0/3284538429 conn(0x7f97780d2bf0 msgr2=0x7f97780b4bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:28.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.400+0000 7f977d509640 1 -- 172.21.15.18:0/3284538429 shutdown_connections 2024-04-17T19:54:28.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.400+0000 7f977d509640 1 -- 172.21.15.18:0/3284538429 wait complete. 2024-04-17T19:54:28.416 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-17T19:54:28.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.560+0000 7fe7313d2640 1 Processor -- start 2024-04-17T19:54:28.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.560+0000 7fe7313d2640 1 -- start start 2024-04-17T19:54:28.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.564+0000 7fe7313d2640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe72c06cd60 0x7fe72c06d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:28.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.564+0000 7fe7313d2640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe72c15fc90 con 0x7fe72c15d7c0 2024-04-17T19:54:28.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.564+0000 7fe7313d2640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe72c06d6b0 con 0x7fe72c15c7c0 2024-04-17T19:54:28.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.564+0000 7fe7313d2640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fe72c142870 con 0x7fe72c06cd60 2024-04-17T19:54:28.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.564+0000 7fe72b7fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fe72c15d7c0 0x7fe72c15dbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:44214/0 (socket says 172.21.15.18:44214) 2024-04-17T19:54:28.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.564+0000 7fe72b7fe640 1 -- 172.21.15.18:0/1963738343 learned_addr learned my addr 172.21.15.18:0/1963738343 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:54:28.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.564+0000 7fe72affd640 1 --2- 172.21.15.18:0/1963738343 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe72c06cd60 0x7fe72c06d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:28.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.564+0000 7fe72a7fc640 1 -- 172.21.15.18:0/1963738343 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 806626508 0 0) 0x7fe72c15fc90 con 0x7fe72c15d7c0 2024-04-17T19:54:28.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.564+0000 7fe72a7fc640 1 -- 172.21.15.18:0/1963738343 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe718003530 con 0x7fe72c15d7c0 2024-04-17T19:54:28.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.564+0000 7fe72a7fc640 1 -- 172.21.15.18:0/1963738343 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4225559910 0 0) 0x7fe718003530 con 0x7fe72c15d7c0 2024-04-17T19:54:28.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.564+0000 7fe72a7fc640 1 -- 172.21.15.18:0/1963738343 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe72c06cd60 msgr2=0x7fe72c06d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:28.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.564+0000 7fe72a7fc640 1 --2- 172.21.15.18:0/1963738343 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe72c06cd60 0x7fe72c06d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:28.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.564+0000 7fe72a7fc640 1 -- 172.21.15.18:0/1963738343 >> v1:172.21.15.173:6789/0 conn(0x7fe72c15c7c0 legacy=0x7fe72c15cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:28.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.564+0000 7fe72a7fc640 1 -- 172.21.15.18:0/1963738343 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe72c15ff00 con 0x7fe72c15d7c0 2024-04-17T19:54:28.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.564+0000 7fe72a7fc640 1 -- 172.21.15.18:0/1963738343 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3208559991 0 0) 0x7fe724001a00 con 0x7fe72c15d7c0 2024-04-17T19:54:28.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.564+0000 7fe72a7fc640 1 -- 172.21.15.18:0/1963738343 >> v1:172.21.15.18:6789/0 conn(0x7fe72c15d7c0 legacy=0x7fe72c15dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:28.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.564+0000 7fe72a7fc640 1 --2- 172.21.15.18:0/1963738343 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe72c06cd60 0x7fe7180039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:28.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.564+0000 7fe72a7fc640 1 --2- 172.21.15.18:0/1963738343 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe718003f70 0x7fe718004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:28.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.564+0000 7fe72a7fc640 1 --2- 172.21.15.18:0/1963738343 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe718004d50 0x7fe718005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:28.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.564+0000 7fe72a7fc640 1 -- 172.21.15.18:0/1963738343 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe72c142870 con 0x7fe718003f70 2024-04-17T19:54:28.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.564+0000 7fe72a7fc640 1 -- 172.21.15.18:0/1963738343 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe71800bb60 con 0x7fe718004d50 2024-04-17T19:54:28.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.564+0000 7fe72a7fc640 1 -- 172.21.15.18:0/1963738343 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fe71800bd60 con 0x7fe72c06cd60 2024-04-17T19:54:28.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.564+0000 7fe723fff640 1 --2- 172.21.15.18:0/1963738343 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe718003f70 0x7fe718004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:28.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.564+0000 7fe72affd640 1 --2- 172.21.15.18:0/1963738343 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe72c06cd60 0x7fe7180039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:28.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.564+0000 7fe72b7fe640 1 --2- 172.21.15.18:0/1963738343 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe718004d50 0x7fe718005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:28.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.564+0000 7fe723fff640 1 -- 172.21.15.18:0/1963738343 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe72c06cd60 msgr2=0x7fe7180039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:28.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.564+0000 7fe723fff640 1 --2- 172.21.15.18:0/1963738343 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe72c06cd60 0x7fe7180039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:28.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.564+0000 7fe723fff640 1 -- 172.21.15.18:0/1963738343 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe718004d50 msgr2=0x7fe718005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:28.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.564+0000 7fe723fff640 1 --2- 172.21.15.18:0/1963738343 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe718004d50 0x7fe718005160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:28.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.564+0000 7fe723fff640 1 -- 172.21.15.18:0/1963738343 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe718003530 con 0x7fe718003f70 2024-04-17T19:54:28.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.568+0000 7fe723fff640 1 --2- 172.21.15.18:0/1963738343 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe718003f70 0x7fe718004810 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fe72c072760 tx=0x7fe71401c1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cf72d9a7bcaf62d server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:28.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.568+0000 7fe72a7fc640 1 -- 172.21.15.18:0/1963738343 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7140013a0 con 0x7fe718003f70 2024-04-17T19:54:28.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.568+0000 7fe72a7fc640 1 -- 172.21.15.18:0/1963738343 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7140050d0 con 0x7fe718003f70 2024-04-17T19:54:28.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.568+0000 7fe72a7fc640 1 -- 172.21.15.18:0/1963738343 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7140054a0 con 0x7fe718003f70 2024-04-17T19:54:28.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.568+0000 7fe7313d2640 1 -- 172.21.15.18:0/1963738343 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe718003f70 msgr2=0x7fe718004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:28.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.568+0000 7fe7313d2640 1 --2- 172.21.15.18:0/1963738343 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe718003f70 0x7fe718004810 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fe72c072760 tx=0x7fe71401c1e0 comp rx=0 tx=0).stop 2024-04-17T19:54:28.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.568+0000 7fe72b7fe640 1 -- 172.21.15.18:0/1963738343 reap_dead start 2024-04-17T19:54:28.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.568+0000 7fe7313d2640 1 -- 172.21.15.18:0/1963738343 shutdown_connections 2024-04-17T19:54:28.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.568+0000 7fe7313d2640 1 -- 172.21.15.18:0/1963738343 >> 172.21.15.18:0/1963738343 conn(0x7fe72c072bb0 msgr2=0x7fe72c072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:28.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.568+0000 7fe7313d2640 1 -- 172.21.15.18:0/1963738343 shutdown_connections 2024-04-17T19:54:28.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.568+0000 7fe7313d2640 1 -- 172.21.15.18:0/1963738343 wait complete. 2024-04-17T19:54:28.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.572+0000 7fe7313d2640 1 Processor -- start 2024-04-17T19:54:28.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.572+0000 7fe7313d2640 1 -- start start 2024-04-17T19:54:28.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.572+0000 7fe7313d2640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe718003f70 0x7fe72c1f3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:28.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.572+0000 7fe7313d2640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe72c0afe30 0x7fe72c1f37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:28.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.572+0000 7fe7313d2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe72c13ce40 0x7fe72c13d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:28.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.572+0000 7fe7313d2640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe72c15d4f0 con 0x7fe72c13ce40 2024-04-17T19:54:28.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.572+0000 7fe7313d2640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe72c1604c0 con 0x7fe72c0afe30 2024-04-17T19:54:28.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.572+0000 7fe7313d2640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fe72c1609e0 con 0x7fe718003f70 2024-04-17T19:54:28.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.572+0000 7fe72b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe72c13ce40 0x7fe72c13d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:28.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.572+0000 7fe72b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe72c13ce40 0x7fe72c13d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34180/0 (socket says 172.21.15.18:34180) 2024-04-17T19:54:28.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.572+0000 7fe72b7fe640 1 -- 172.21.15.18:0/3990121320 learned_addr learned my addr 172.21.15.18:0/3990121320 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:28.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.572+0000 7fe72affd640 1 --2- 172.21.15.18:0/3990121320 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe718003f70 0x7fe72c1f3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:28.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.572+0000 7fe723fff640 1 --2- 172.21.15.18:0/3990121320 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe72c0afe30 0x7fe72c1f37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:28.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.572+0000 7fe72b7fe640 1 -- 172.21.15.18:0/3990121320 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe718003f70 msgr2=0x7fe72c1f3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:28.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.572+0000 7fe72b7fe640 1 --2- 172.21.15.18:0/3990121320 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe718003f70 0x7fe72c1f3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:28.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.572+0000 7fe72b7fe640 1 -- 172.21.15.18:0/3990121320 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe72c0afe30 msgr2=0x7fe72c1f37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:28.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.572+0000 7fe72b7fe640 1 --2- 172.21.15.18:0/3990121320 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe72c0afe30 0x7fe72c1f37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:28.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.572+0000 7fe72b7fe640 1 -- 172.21.15.18:0/3990121320 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe72c13bda0 con 0x7fe72c13ce40 2024-04-17T19:54:28.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.572+0000 7fe72b7fe640 1 --2- 172.21.15.18:0/3990121320 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe72c13ce40 0x7fe72c13d250 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fe724004c00 tx=0x7fe724012e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:28.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.572+0000 7fe7237fe640 1 -- 172.21.15.18:0/3990121320 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe724010d30 con 0x7fe72c13ce40 2024-04-17T19:54:28.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.572+0000 7fe7237fe640 1 -- 172.21.15.18:0/3990121320 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe724017030 con 0x7fe72c13ce40 2024-04-17T19:54:28.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.572+0000 7fe7313d2640 1 -- 172.21.15.18:0/3990121320 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe72c13c080 con 0x7fe72c13ce40 2024-04-17T19:54:28.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.572+0000 7fe7237fe640 1 -- 172.21.15.18:0/3990121320 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe72401c660 con 0x7fe72c13ce40 2024-04-17T19:54:28.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.572+0000 7fe7313d2640 1 -- 172.21.15.18:0/3990121320 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe72c13c640 con 0x7fe72c13ce40 2024-04-17T19:54:28.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.576+0000 7fe7313d2640 1 -- 172.21.15.18:0/3990121320 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe72c069950 con 0x7fe72c13ce40 2024-04-17T19:54:28.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.576+0000 7fe7237fe640 1 -- 172.21.15.18:0/3990121320 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe724013400 con 0x7fe72c13ce40 2024-04-17T19:54:28.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.576+0000 7fe7237fe640 1 --2- 172.21.15.18:0/3990121320 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fe70c068380 0x7fe70c06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:28.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.576+0000 7fe7237fe640 1 -- 172.21.15.18:0/3990121320 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7fe72408c0c0 con 0x7fe72c13ce40 2024-04-17T19:54:28.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.576+0000 7fe72affd640 1 --2- 172.21.15.18:0/3990121320 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fe70c068380 0x7fe70c06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:28.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.576+0000 7fe72affd640 1 --2- 172.21.15.18:0/3990121320 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fe70c068380 0x7fe70c06a890 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe72c0b0750 tx=0x7fe71c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:28.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.580+0000 7fe7237fe640 1 -- 172.21.15.18:0/3990121320 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe72405c180 con 0x7fe72c13ce40 2024-04-17T19:54:28.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.748+0000 7fe7313d2640 1 -- 172.21.15.18:0/3990121320 --> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fe72c0b13e0 con 0x7fe70c068380 2024-04-17T19:54:28.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.748+0000 7fe7237fe640 1 -- 172.21.15.18:0/3990121320 <== mgr.4104 v2:172.21.15.18:6832/751466605 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe72c0b13e0 con 0x7fe70c068380 2024-04-17T19:54:28.745 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 0 to deep-scrub 2024-04-17T19:54:28.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.748+0000 7fe7313d2640 1 -- 172.21.15.18:0/3990121320 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fe70c068380 msgr2=0x7fe70c06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:28.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.748+0000 7fe7313d2640 1 --2- 172.21.15.18:0/3990121320 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fe70c068380 0x7fe70c06a890 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe72c0b0750 tx=0x7fe71c008040 comp rx=0 tx=0).stop 2024-04-17T19:54:28.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.748+0000 7fe7313d2640 1 -- 172.21.15.18:0/3990121320 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe72c13ce40 msgr2=0x7fe72c13d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:28.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.748+0000 7fe7313d2640 1 --2- 172.21.15.18:0/3990121320 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe72c13ce40 0x7fe72c13d250 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fe724004c00 tx=0x7fe724012e20 comp rx=0 tx=0).stop 2024-04-17T19:54:28.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.748+0000 7fe7313d2640 1 -- 172.21.15.18:0/3990121320 shutdown_connections 2024-04-17T19:54:28.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.748+0000 7fe7313d2640 1 --2- 172.21.15.18:0/3990121320 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fe70c068380 0x7fe70c06a890 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:28.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.748+0000 7fe7313d2640 1 --2- 172.21.15.18:0/3990121320 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe72c13ce40 0x7fe72c13d250 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:28.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.748+0000 7fe7313d2640 1 --2- 172.21.15.18:0/3990121320 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe72c0afe30 0x7fe72c1f37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:28.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.748+0000 7fe7313d2640 1 --2- 172.21.15.18:0/3990121320 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe718003f70 0x7fe72c1f3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:28.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.748+0000 7fe7313d2640 1 -- 172.21.15.18:0/3990121320 >> 172.21.15.18:0/3990121320 conn(0x7fe72c072bb0 msgr2=0x7fe72c156390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:28.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.748+0000 7fe7313d2640 1 -- 172.21.15.18:0/3990121320 shutdown_connections 2024-04-17T19:54:28.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.748+0000 7fe7313d2640 1 -- 172.21.15.18:0/3990121320 wait complete. 2024-04-17T19:54:28.768 INFO:tasks.ceph:Scrubbing osd.1 2024-04-17T19:54:28.768 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-17T19:54:28.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.932+0000 7f39432da640 1 Processor -- start 2024-04-17T19:54:28.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.932+0000 7f39432da640 1 -- start start 2024-04-17T19:54:28.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.932+0000 7f39432da640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f393c164f70 0x7f393c167390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:28.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.932+0000 7f39432da640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f393c15fc90 con 0x7f393c15c7c0 2024-04-17T19:54:28.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.932+0000 7f39432da640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f393c142870 con 0x7f393c06cd60 2024-04-17T19:54:28.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.932+0000 7f39432da640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f393c15e7d0 con 0x7f393c164f70 2024-04-17T19:54:28.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.936+0000 7f3940875640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f393c15c7c0 0x7f393c15cbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:44224/0 (socket says 172.21.15.18:44224) 2024-04-17T19:54:28.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.936+0000 7f3940875640 1 -- 172.21.15.18:0/136430000 learned_addr learned my addr 172.21.15.18:0/136430000 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:54:28.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.936+0000 7f3941877640 1 --2- 172.21.15.18:0/136430000 >> v2:172.21.15.173:3300/0 conn(0x7f393c164f70 0x7f393c167390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:28.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.936+0000 7f392ffff640 1 -- 172.21.15.18:0/136430000 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2661419606 0 0) 0x7f393c15fc90 con 0x7f393c15c7c0 2024-04-17T19:54:28.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.936+0000 7f392ffff640 1 -- 172.21.15.18:0/136430000 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3928003530 con 0x7f393c15c7c0 2024-04-17T19:54:28.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.936+0000 7f392ffff640 1 -- 172.21.15.18:0/136430000 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2046411474 0 0) 0x7f3928003530 con 0x7f393c15c7c0 2024-04-17T19:54:28.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.936+0000 7f392ffff640 1 -- 172.21.15.18:0/136430000 >> v2:172.21.15.173:3300/0 conn(0x7f393c164f70 msgr2=0x7f393c167390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:28.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.936+0000 7f392ffff640 1 --2- 172.21.15.18:0/136430000 >> v2:172.21.15.173:3300/0 conn(0x7f393c164f70 0x7f393c167390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:28.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.936+0000 7f392ffff640 1 -- 172.21.15.18:0/136430000 >> v1:172.21.15.173:6789/0 conn(0x7f393c06cd60 legacy=0x7f393c06d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:28.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.936+0000 7f392ffff640 1 -- 172.21.15.18:0/136430000 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f393c15ff00 con 0x7f393c15c7c0 2024-04-17T19:54:28.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.936+0000 7f392ffff640 1 -- 172.21.15.18:0/136430000 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3208559991 0 0) 0x7f39300016a0 con 0x7f393c15c7c0 2024-04-17T19:54:28.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.936+0000 7f392ffff640 1 -- 172.21.15.18:0/136430000 >> v1:172.21.15.18:6789/0 conn(0x7f393c15c7c0 legacy=0x7f393c15cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:28.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.936+0000 7f392ffff640 1 --2- 172.21.15.18:0/136430000 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39280039c0 0x7f3928003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:28.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.936+0000 7f392ffff640 1 --2- 172.21.15.18:0/136430000 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3928004810 0x7f3928004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:28.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.936+0000 7f392ffff640 1 --2- 172.21.15.18:0/136430000 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3928005260 0x7f392800dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:28.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.936+0000 7f392ffff640 1 -- 172.21.15.18:0/136430000 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f393c15e7d0 con 0x7f3928005260 2024-04-17T19:54:28.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.936+0000 7f392ffff640 1 -- 172.21.15.18:0/136430000 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f392800e400 con 0x7f39280039c0 2024-04-17T19:54:28.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.936+0000 7f392ffff640 1 -- 172.21.15.18:0/136430000 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f392800e600 con 0x7f3928004810 2024-04-17T19:54:28.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.936+0000 7f3941877640 1 --2- 172.21.15.18:0/136430000 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3928005260 0x7f392800dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:28.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.936+0000 7f3940875640 1 --2- 172.21.15.18:0/136430000 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3928004810 0x7f3928004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:28.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.936+0000 7f3941877640 1 -- 172.21.15.18:0/136430000 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3928004810 msgr2=0x7f3928004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:28.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.936+0000 7f3941877640 1 --2- 172.21.15.18:0/136430000 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3928004810 0x7f3928004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:28.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.936+0000 7f3941877640 1 -- 172.21.15.18:0/136430000 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39280039c0 msgr2=0x7f3928003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:28.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.936+0000 7f3941877640 1 --2- 172.21.15.18:0/136430000 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39280039c0 0x7f3928003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:28.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.936+0000 7f3941877640 1 -- 172.21.15.18:0/136430000 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3928003530 con 0x7f3928005260 2024-04-17T19:54:28.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.936+0000 7f3941877640 1 -- 172.21.15.18:0/136430000 reap_dead start 2024-04-17T19:54:28.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.936+0000 7f3941877640 1 --2- 172.21.15.18:0/136430000 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3928005260 0x7f392800dbe0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f3934009ae0 tx=0x7f393401cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b47d1e53b2b2869c server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:28.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.936+0000 7f392ffff640 1 -- 172.21.15.18:0/136430000 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39340096b0 con 0x7f3928005260 2024-04-17T19:54:28.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.936+0000 7f392ffff640 1 -- 172.21.15.18:0/136430000 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3934004020 con 0x7f3928005260 2024-04-17T19:54:28.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.936+0000 7f392ffff640 1 -- 172.21.15.18:0/136430000 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3934004410 con 0x7f3928005260 2024-04-17T19:54:28.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.940+0000 7f39432da640 1 -- 172.21.15.18:0/136430000 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3928005260 msgr2=0x7f392800dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:28.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.940+0000 7f39432da640 1 --2- 172.21.15.18:0/136430000 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3928005260 0x7f392800dbe0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f3934009ae0 tx=0x7f393401cab0 comp rx=0 tx=0).stop 2024-04-17T19:54:28.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.940+0000 7f39432da640 1 -- 172.21.15.18:0/136430000 shutdown_connections 2024-04-17T19:54:28.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.940+0000 7f39432da640 1 --2- 172.21.15.18:0/136430000 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3928005260 0x7f392800dbe0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:28.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.940+0000 7f39432da640 1 -- 172.21.15.18:0/136430000 >> 172.21.15.18:0/136430000 conn(0x7f393c072bb0 msgr2=0x7f393c072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:28.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.940+0000 7f39432da640 1 -- 172.21.15.18:0/136430000 shutdown_connections 2024-04-17T19:54:28.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.940+0000 7f39432da640 1 -- 172.21.15.18:0/136430000 wait complete. 2024-04-17T19:54:28.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.940+0000 7f39432da640 1 Processor -- start 2024-04-17T19:54:28.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.940+0000 7f39432da640 1 -- start start 2024-04-17T19:54:28.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.944+0000 7f39432da640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3928005260 0x7f393c156450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:28.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.944+0000 7f39432da640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f393c162220 0x7f393c13d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:28.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.944+0000 7f39432da640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f393c162630 0x7f393c1f5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:28.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.944+0000 7f39432da640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f393c1609e0 con 0x7f393c162220 2024-04-17T19:54:28.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.944+0000 7f39432da640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f393c1604c0 con 0x7f3928005260 2024-04-17T19:54:28.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.944+0000 7f39432da640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f393c1f69c0 con 0x7f393c162630 2024-04-17T19:54:28.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.944+0000 7f3940875640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f393c162220 0x7f393c13d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:28.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.944+0000 7f3940875640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f393c162220 0x7f393c13d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34196/0 (socket says 172.21.15.18:34196) 2024-04-17T19:54:28.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.944+0000 7f3940875640 1 -- 172.21.15.18:0/658462476 learned_addr learned my addr 172.21.15.18:0/658462476 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:28.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.944+0000 7f3941877640 1 --2- 172.21.15.18:0/658462476 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f393c162630 0x7f393c1f5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:28.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.944+0000 7f3941076640 1 --2- 172.21.15.18:0/658462476 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3928005260 0x7f393c156450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:28.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.944+0000 7f3940875640 1 -- 172.21.15.18:0/658462476 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f393c162630 msgr2=0x7f393c1f5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:28.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.944+0000 7f3940875640 1 --2- 172.21.15.18:0/658462476 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f393c162630 0x7f393c1f5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:28.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.944+0000 7f3940875640 1 -- 172.21.15.18:0/658462476 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3928005260 msgr2=0x7f393c156450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:28.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.944+0000 7f3940875640 1 --2- 172.21.15.18:0/658462476 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3928005260 0x7f393c156450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:28.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.944+0000 7f3940875640 1 -- 172.21.15.18:0/658462476 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f393c161180 con 0x7f393c162220 2024-04-17T19:54:28.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.944+0000 7f3940875640 1 --2- 172.21.15.18:0/658462476 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f393c162220 0x7f393c13d640 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f3930011850 tx=0x7f3930011d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:28.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.944+0000 7f392dffb640 1 -- 172.21.15.18:0/658462476 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3930010040 con 0x7f393c162220 2024-04-17T19:54:28.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.944+0000 7f392dffb640 1 -- 172.21.15.18:0/658462476 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f393001a070 con 0x7f393c162220 2024-04-17T19:54:28.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.944+0000 7f39432da640 1 -- 172.21.15.18:0/658462476 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f393c161460 con 0x7f393c162220 2024-04-17T19:54:28.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.944+0000 7f392dffb640 1 -- 172.21.15.18:0/658462476 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f393000fd80 con 0x7f393c162220 2024-04-17T19:54:28.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.944+0000 7f39432da640 1 -- 172.21.15.18:0/658462476 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f393c161a20 con 0x7f393c162220 2024-04-17T19:54:28.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.944+0000 7f39432da640 1 -- 172.21.15.18:0/658462476 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f393c069950 con 0x7f393c162220 2024-04-17T19:54:28.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.944+0000 7f392dffb640 1 -- 172.21.15.18:0/658462476 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f393001f460 con 0x7f393c162220 2024-04-17T19:54:28.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.944+0000 7f392dffb640 1 --2- 172.21.15.18:0/658462476 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f39200683b0 0x7f392006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:28.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.944+0000 7f3941076640 1 --2- 172.21.15.18:0/658462476 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f39200683b0 0x7f392006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:28.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.944+0000 7f392dffb640 1 -- 172.21.15.18:0/658462476 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7f393008a060 con 0x7f393c162220 2024-04-17T19:54:28.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.944+0000 7f392dffb640 1 --2- 172.21.15.18:0/658462476 >> [v2:172.21.15.18:6816/1283678238,v1:172.21.15.18:6817/1283678238] conn(0x7f3920071d20 0x7f3920074210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:28.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.944+0000 7f392dffb640 1 -- 172.21.15.18:0/658462476 --> [v2:172.21.15.18:6816/1283678238,v1:172.21.15.18:6817/1283678238] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3930014e50 con 0x7f3920071d20 2024-04-17T19:54:28.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.944+0000 7f392dffb640 1 -- 172.21.15.18:0/658462476 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3930091050 con 0x7f393c162220 2024-04-17T19:54:28.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.944+0000 7f3941877640 1 --2- 172.21.15.18:0/658462476 >> [v2:172.21.15.18:6816/1283678238,v1:172.21.15.18:6817/1283678238] conn(0x7f3920071d20 0x7f3920074210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:28.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.948+0000 7f3941076640 1 --2- 172.21.15.18:0/658462476 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f39200683b0 0x7f392006a8c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f393c0b0750 tx=0x7f3938009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:28.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.948+0000 7f3941877640 1 --2- 172.21.15.18:0/658462476 >> [v2:172.21.15.18:6816/1283678238,v1:172.21.15.18:6817/1283678238] conn(0x7f3920071d20 0x7f3920074210 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:28.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.948+0000 7f392dffb640 1 -- 172.21.15.18:0/658462476 <== osd.1 v2:172.21.15.18:6816/1283678238 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3930014e50 con 0x7f3920071d20 2024-04-17T19:54:28.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.960+0000 7f39432da640 1 -- 172.21.15.18:0/658462476 --> [v2:172.21.15.18:6816/1283678238,v1:172.21.15.18:6817/1283678238] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f393c160f30 con 0x7f3920071d20 2024-04-17T19:54:28.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.960+0000 7f392dffb640 1 -- 172.21.15.18:0/658462476 <== osd.1 v2:172.21.15.18:6816/1283678238 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f393c160f30 con 0x7f3920071d20 2024-04-17T19:54:28.959 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-17T19:54:28.959 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-17T19:54:28.959 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-17T19:54:28.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.960+0000 7f39432da640 1 -- 172.21.15.18:0/658462476 >> [v2:172.21.15.18:6816/1283678238,v1:172.21.15.18:6817/1283678238] conn(0x7f3920071d20 msgr2=0x7f3920074210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:28.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.960+0000 7f39432da640 1 --2- 172.21.15.18:0/658462476 >> [v2:172.21.15.18:6816/1283678238,v1:172.21.15.18:6817/1283678238] conn(0x7f3920071d20 0x7f3920074210 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:28.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.960+0000 7f39432da640 1 -- 172.21.15.18:0/658462476 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f39200683b0 msgr2=0x7f392006a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:28.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.960+0000 7f39432da640 1 --2- 172.21.15.18:0/658462476 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f39200683b0 0x7f392006a8c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f393c0b0750 tx=0x7f3938009040 comp rx=0 tx=0).stop 2024-04-17T19:54:28.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.960+0000 7f39432da640 1 -- 172.21.15.18:0/658462476 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f393c162220 msgr2=0x7f393c13d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:28.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.960+0000 7f39432da640 1 --2- 172.21.15.18:0/658462476 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f393c162220 0x7f393c13d640 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f3930011850 tx=0x7f3930011d10 comp rx=0 tx=0).stop 2024-04-17T19:54:28.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.960+0000 7f3941877640 1 -- 172.21.15.18:0/658462476 reap_dead start 2024-04-17T19:54:28.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.960+0000 7f39432da640 1 -- 172.21.15.18:0/658462476 shutdown_connections 2024-04-17T19:54:28.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.960+0000 7f39432da640 1 -- 172.21.15.18:0/658462476 >> 172.21.15.18:0/658462476 conn(0x7f393c072bb0 msgr2=0x7f393c13e390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:28.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.960+0000 7f39432da640 1 -- 172.21.15.18:0/658462476 shutdown_connections 2024-04-17T19:54:28.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:28.960+0000 7f39432da640 1 -- 172.21.15.18:0/658462476 wait complete. 2024-04-17T19:54:28.979 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-17T19:54:29.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.132+0000 7fa5ae948640 1 Processor -- start 2024-04-17T19:54:29.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.132+0000 7fa5ae948640 1 -- start start 2024-04-17T19:54:29.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.132+0000 7fa5ae948640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fa5a80b0120 0x7fa5a815f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:29.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.132+0000 7fa5ae948640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa5a80b44b0 0x7fa5a80b48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:29.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.132+0000 7fa5ae948640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5a81607b0 con 0x7fa5a806cd60 2024-04-17T19:54:29.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.132+0000 7fa5ae948640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fa5a80b0530 con 0x7fa5a80b44b0 2024-04-17T19:54:29.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.132+0000 7fa5ae948640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7fa5a815ff10 con 0x7fa5a80b0120 2024-04-17T19:54:29.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.132+0000 7fa5acee5640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa5a80b44b0 0x7fa5a80b48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:29.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.132+0000 7fa5acee5640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa5a80b44b0 0x7fa5a80b48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34208/0 (socket says 172.21.15.18:34208) 2024-04-17T19:54:29.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.132+0000 7fa5acee5640 1 -- 172.21.15.18:0/858823338 learned_addr learned my addr 172.21.15.18:0/858823338 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:29.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.132+0000 7fa5a7fff640 1 --2- 172.21.15.18:0/858823338 >> v2:172.21.15.173:3300/0 conn(0x7fa5a80b0120 0x7fa5a815f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:29.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.132+0000 7fa5acee5640 1 -- 172.21.15.18:0/858823338 >> v2:172.21.15.173:3300/0 conn(0x7fa5a80b0120 msgr2=0x7fa5a815f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:29.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.132+0000 7fa5acee5640 1 --2- 172.21.15.18:0/858823338 >> v2:172.21.15.173:3300/0 conn(0x7fa5a80b0120 0x7fa5a815f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:29.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.132+0000 7fa5acee5640 1 -- 172.21.15.18:0/858823338 >> v1:172.21.15.173:6789/0 conn(0x7fa5a806cd60 legacy=0x7fa5a806d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:29.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.132+0000 7fa5acee5640 1 -- 172.21.15.18:0/858823338 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5a81601f0 con 0x7fa5a80b44b0 2024-04-17T19:54:29.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.136+0000 7fa5acee5640 1 --2- 172.21.15.18:0/858823338 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5a80b44b0 0x7fa5a80b48c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fa5a80701b0 tx=0x7fa5a001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea3024305472c83a server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:29.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.136+0000 7fa5a6ffd640 1 -- 172.21.15.18:0/858823338 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a00ab620 con 0x7fa5a80b44b0 2024-04-17T19:54:29.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.136+0000 7fa5a6ffd640 1 -- 172.21.15.18:0/858823338 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5a00b0070 con 0x7fa5a80b44b0 2024-04-17T19:54:29.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.136+0000 7fa5a6ffd640 1 -- 172.21.15.18:0/858823338 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a00ab9e0 con 0x7fa5a80b44b0 2024-04-17T19:54:29.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.136+0000 7fa5ae948640 1 -- 172.21.15.18:0/858823338 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5a80b44b0 msgr2=0x7fa5a80b48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:29.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.136+0000 7fa5ae948640 1 --2- 172.21.15.18:0/858823338 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5a80b44b0 0x7fa5a80b48c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fa5a80701b0 tx=0x7fa5a001c420 comp rx=0 tx=0).stop 2024-04-17T19:54:29.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.136+0000 7fa5ae948640 1 -- 172.21.15.18:0/858823338 shutdown_connections 2024-04-17T19:54:29.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.136+0000 7fa5ae948640 1 --2- 172.21.15.18:0/858823338 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5a80b44b0 0x7fa5a80b48c0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:29.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.136+0000 7fa5ae948640 1 --2- 172.21.15.18:0/858823338 >> v2:172.21.15.173:3300/0 conn(0x7fa5a80b0120 0x7fa5a815f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:29.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.136+0000 7fa5ae948640 1 -- 172.21.15.18:0/858823338 >> 172.21.15.18:0/858823338 conn(0x7fa5a8072bb0 msgr2=0x7fa5a8072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:29.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.136+0000 7fa5ae948640 1 -- 172.21.15.18:0/858823338 shutdown_connections 2024-04-17T19:54:29.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.136+0000 7fa5ae948640 1 -- 172.21.15.18:0/858823338 wait complete. 2024-04-17T19:54:29.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.140+0000 7fa5ae948640 1 Processor -- start 2024-04-17T19:54:29.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.140+0000 7fa5ae948640 1 -- start start 2024-04-17T19:54:29.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.140+0000 7fa5ae948640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5a806cd60 0x7fa5a8149170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:29.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.140+0000 7fa5ae948640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5a80b0120 0x7fa5a8150430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:29.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.140+0000 7fa5ae948640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa5a80b44b0 0x7fa5a8150970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:29.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.140+0000 7fa5ae948640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a816c200 con 0x7fa5a80b0120 2024-04-17T19:54:29.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.140+0000 7fa5ae948640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a816c080 con 0x7fa5a806cd60 2024-04-17T19:54:29.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.140+0000 7fa5ae948640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fa5a816c380 con 0x7fa5a80b44b0 2024-04-17T19:54:29.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.140+0000 7fa5a77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5a80b0120 0x7fa5a8150430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:29.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.140+0000 7fa5a77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5a80b0120 0x7fa5a8150430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34222/0 (socket says 172.21.15.18:34222) 2024-04-17T19:54:29.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.140+0000 7fa5a77fe640 1 -- 172.21.15.18:0/208372103 learned_addr learned my addr 172.21.15.18:0/208372103 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:29.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.140+0000 7fa5a7fff640 1 --2- 172.21.15.18:0/208372103 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5a806cd60 0x7fa5a8149170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:29.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.140+0000 7fa5acee5640 1 --2- 172.21.15.18:0/208372103 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa5a80b44b0 0x7fa5a8150970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:29.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.140+0000 7fa5a77fe640 1 -- 172.21.15.18:0/208372103 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa5a80b44b0 msgr2=0x7fa5a8150970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:29.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.140+0000 7fa5a77fe640 1 --2- 172.21.15.18:0/208372103 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa5a80b44b0 0x7fa5a8150970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:29.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.140+0000 7fa5a77fe640 1 -- 172.21.15.18:0/208372103 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5a806cd60 msgr2=0x7fa5a8149170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:29.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.140+0000 7fa5a77fe640 1 --2- 172.21.15.18:0/208372103 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5a806cd60 0x7fa5a8149170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:29.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.140+0000 7fa5a77fe640 1 -- 172.21.15.18:0/208372103 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5a8158130 con 0x7fa5a80b0120 2024-04-17T19:54:29.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.140+0000 7fa5a77fe640 1 --2- 172.21.15.18:0/208372103 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5a80b0120 0x7fa5a8150430 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa59000b9e0 tx=0x7fa59000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:29.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.140+0000 7fa5a4ff9640 1 -- 172.21.15.18:0/208372103 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa590019070 con 0x7fa5a80b0120 2024-04-17T19:54:29.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.140+0000 7fa5a4ff9640 1 -- 172.21.15.18:0/208372103 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa59000cba0 con 0x7fa5a80b0120 2024-04-17T19:54:29.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.140+0000 7fa5ae948640 1 -- 172.21.15.18:0/208372103 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5a8158410 con 0x7fa5a80b0120 2024-04-17T19:54:29.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.140+0000 7fa5a4ff9640 1 -- 172.21.15.18:0/208372103 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa590014440 con 0x7fa5a80b0120 2024-04-17T19:54:29.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.140+0000 7fa5ae948640 1 -- 172.21.15.18:0/208372103 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5a81496b0 con 0x7fa5a80b0120 2024-04-17T19:54:29.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.144+0000 7fa5ae948640 1 -- 172.21.15.18:0/208372103 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5a8069950 con 0x7fa5a80b0120 2024-04-17T19:54:29.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.144+0000 7fa5a4ff9640 1 -- 172.21.15.18:0/208372103 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa59001c070 con 0x7fa5a80b0120 2024-04-17T19:54:29.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.144+0000 7fa5a4ff9640 1 --2- 172.21.15.18:0/208372103 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fa5880683b0 0x7fa58806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:29.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.144+0000 7fa5a4ff9640 1 -- 172.21.15.18:0/208372103 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7fa5900869b0 con 0x7fa5a80b0120 2024-04-17T19:54:29.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.144+0000 7fa5a7fff640 1 --2- 172.21.15.18:0/208372103 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fa5880683b0 0x7fa58806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:29.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.144+0000 7fa5a7fff640 1 --2- 172.21.15.18:0/208372103 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fa5880683b0 0x7fa58806a8c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa5a806fbe0 tx=0x7fa598008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:29.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.148+0000 7fa5a4ff9640 1 -- 172.21.15.18:0/208372103 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa590056c30 con 0x7fa5a80b0120 2024-04-17T19:54:29.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.324+0000 7fa5ae948640 1 -- 172.21.15.18:0/208372103 --> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fa5a8157ee0 con 0x7fa5880683b0 2024-04-17T19:54:29.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.324+0000 7fa5a4ff9640 1 -- 172.21.15.18:0/208372103 <== mgr.4104 v2:172.21.15.18:6832/751466605 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa5a8157ee0 con 0x7fa5880683b0 2024-04-17T19:54:29.324 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 1 to deep-scrub 2024-04-17T19:54:29.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.328+0000 7fa5ae948640 1 -- 172.21.15.18:0/208372103 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fa5880683b0 msgr2=0x7fa58806a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:29.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.328+0000 7fa5ae948640 1 --2- 172.21.15.18:0/208372103 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fa5880683b0 0x7fa58806a8c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa5a806fbe0 tx=0x7fa598008040 comp rx=0 tx=0).stop 2024-04-17T19:54:29.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.328+0000 7fa5ae948640 1 -- 172.21.15.18:0/208372103 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5a80b0120 msgr2=0x7fa5a8150430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:29.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.328+0000 7fa5ae948640 1 --2- 172.21.15.18:0/208372103 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5a80b0120 0x7fa5a8150430 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa59000b9e0 tx=0x7fa59000bea0 comp rx=0 tx=0).stop 2024-04-17T19:54:29.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.328+0000 7fa5ae948640 1 -- 172.21.15.18:0/208372103 shutdown_connections 2024-04-17T19:54:29.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.328+0000 7fa5ae948640 1 --2- 172.21.15.18:0/208372103 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fa5880683b0 0x7fa58806a8c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:29.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.328+0000 7fa5ae948640 1 --2- 172.21.15.18:0/208372103 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa5a80b44b0 0x7fa5a8150970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:29.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.328+0000 7fa5ae948640 1 --2- 172.21.15.18:0/208372103 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5a80b0120 0x7fa5a8150430 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:29.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.328+0000 7fa5ae948640 1 --2- 172.21.15.18:0/208372103 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5a806cd60 0x7fa5a8149170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:29.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.328+0000 7fa5ae948640 1 -- 172.21.15.18:0/208372103 >> 172.21.15.18:0/208372103 conn(0x7fa5a8072bb0 msgr2=0x7fa5a8155b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:29.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.328+0000 7fa5ae948640 1 -- 172.21.15.18:0/208372103 shutdown_connections 2024-04-17T19:54:29.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.328+0000 7fa5ae948640 1 -- 172.21.15.18:0/208372103 wait complete. 2024-04-17T19:54:29.346 INFO:tasks.ceph:Scrubbing osd.2 2024-04-17T19:54:29.346 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-17T19:54:29.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.492+0000 7f4e439ec640 1 Processor -- start 2024-04-17T19:54:29.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.492+0000 7f4e439ec640 1 -- start start 2024-04-17T19:54:29.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.496+0000 7f4e439ec640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4e3c0b86b0 0x7f4e3c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:29.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.496+0000 7f4e439ec640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4e3c0d3420 0x7f4e3c0d3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:29.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.496+0000 7f4e439ec640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e3c06be80 con 0x7f4e3c0b82a0 2024-04-17T19:54:29.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.496+0000 7f4e439ec640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f4e3c0cfd90 con 0x7f4e3c0d3420 2024-04-17T19:54:29.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.496+0000 7f4e439ec640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f4e3c06c160 con 0x7f4e3c0b86b0 2024-04-17T19:54:29.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.496+0000 7f4e41f89640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4e3c0d3420 0x7f4e3c0d3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:29.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.496+0000 7f4e41f89640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4e3c0d3420 0x7f4e3c0d3830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34236/0 (socket says 172.21.15.18:34236) 2024-04-17T19:54:29.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.496+0000 7f4e41f89640 1 -- 172.21.15.18:0/756629636 learned_addr learned my addr 172.21.15.18:0/756629636 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:29.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.496+0000 7f4e40f87640 1 --2- 172.21.15.18:0/756629636 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4e3c0b86b0 0x7f4e3c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:29.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.496+0000 7f4e41f89640 1 -- 172.21.15.18:0/756629636 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4e3c0b86b0 msgr2=0x7f4e3c06d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:29.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.496+0000 7f4e41f89640 1 --2- 172.21.15.18:0/756629636 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4e3c0b86b0 0x7f4e3c06d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:29.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.496+0000 7f4e41f89640 1 -- 172.21.15.18:0/756629636 >> v1:172.21.15.173:6789/0 conn(0x7f4e3c0b82a0 legacy=0x7f4e3c06cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:29.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.496+0000 7f4e41f89640 1 -- 172.21.15.18:0/756629636 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e3c06c440 con 0x7f4e3c0d3420 2024-04-17T19:54:29.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.496+0000 7f4e41f89640 1 --2- 172.21.15.18:0/756629636 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e3c0d3420 0x7f4e3c0d3830 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f4e34009870 tx=0x7f4e3401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a08e4c953a5fd93 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:29.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.500+0000 7f4e2ffff640 1 -- 172.21.15.18:0/756629636 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e340b0070 con 0x7f4e3c0d3420 2024-04-17T19:54:29.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.500+0000 7f4e2ffff640 1 -- 172.21.15.18:0/756629636 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e340ab600 con 0x7f4e3c0d3420 2024-04-17T19:54:29.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.500+0000 7f4e2ffff640 1 -- 172.21.15.18:0/756629636 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e340ab9d0 con 0x7f4e3c0d3420 2024-04-17T19:54:29.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.500+0000 7f4e439ec640 1 -- 172.21.15.18:0/756629636 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e3c0d3420 msgr2=0x7f4e3c0d3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:29.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.500+0000 7f4e439ec640 1 --2- 172.21.15.18:0/756629636 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e3c0d3420 0x7f4e3c0d3830 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f4e34009870 tx=0x7f4e3401c410 comp rx=0 tx=0).stop 2024-04-17T19:54:29.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.500+0000 7f4e439ec640 1 -- 172.21.15.18:0/756629636 shutdown_connections 2024-04-17T19:54:29.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.500+0000 7f4e439ec640 1 --2- 172.21.15.18:0/756629636 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e3c0d3420 0x7f4e3c0d3830 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:29.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.500+0000 7f4e439ec640 1 --2- 172.21.15.18:0/756629636 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4e3c0b86b0 0x7f4e3c06d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:29.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.500+0000 7f4e439ec640 1 -- 172.21.15.18:0/756629636 >> 172.21.15.18:0/756629636 conn(0x7f4e3c0b6cf0 msgr2=0x7f4e3c0b7100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:29.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.500+0000 7f4e439ec640 1 -- 172.21.15.18:0/756629636 shutdown_connections 2024-04-17T19:54:29.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.500+0000 7f4e439ec640 1 -- 172.21.15.18:0/756629636 wait complete. 2024-04-17T19:54:29.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.500+0000 7f4e439ec640 1 Processor -- start 2024-04-17T19:54:29.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.500+0000 7f4e439ec640 1 -- start start 2024-04-17T19:54:29.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.504+0000 7f4e439ec640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e3c0b82a0 0x7f4e3c163660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:29.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.504+0000 7f4e439ec640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e3c0b86b0 0x7f4e3c15bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:29.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.504+0000 7f4e439ec640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4e3c0d3420 0x7f4e3c1fc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:29.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.504+0000 7f4e439ec640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4e3c16c6b0 con 0x7f4e3c0b86b0 2024-04-17T19:54:29.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.504+0000 7f4e439ec640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4e3c16c530 con 0x7f4e3c0b82a0 2024-04-17T19:54:29.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.504+0000 7f4e439ec640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f4e3c16c830 con 0x7f4e3c0d3420 2024-04-17T19:54:29.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.504+0000 7f4e40f87640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e3c0b86b0 0x7f4e3c15bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:29.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.504+0000 7f4e40f87640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e3c0b86b0 0x7f4e3c15bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34242/0 (socket says 172.21.15.18:34242) 2024-04-17T19:54:29.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.504+0000 7f4e40f87640 1 -- 172.21.15.18:0/981730442 learned_addr learned my addr 172.21.15.18:0/981730442 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:29.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.504+0000 7f4e41f89640 1 --2- 172.21.15.18:0/981730442 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4e3c0d3420 0x7f4e3c1fc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:29.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.504+0000 7f4e41788640 1 --2- 172.21.15.18:0/981730442 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e3c0b82a0 0x7f4e3c163660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:29.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.504+0000 7f4e40f87640 1 -- 172.21.15.18:0/981730442 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4e3c0d3420 msgr2=0x7f4e3c1fc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:29.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.504+0000 7f4e40f87640 1 --2- 172.21.15.18:0/981730442 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4e3c0d3420 0x7f4e3c1fc5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:29.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.504+0000 7f4e40f87640 1 -- 172.21.15.18:0/981730442 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e3c0b82a0 msgr2=0x7f4e3c163660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:29.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.504+0000 7f4e40f87640 1 --2- 172.21.15.18:0/981730442 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e3c0b82a0 0x7f4e3c163660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:29.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.504+0000 7f4e40f87640 1 -- 172.21.15.18:0/981730442 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e3c155a20 con 0x7f4e3c0b86b0 2024-04-17T19:54:29.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.504+0000 7f4e41f89640 1 --2- 172.21.15.18:0/981730442 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4e3c0d3420 0x7f4e3c1fc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:54:29.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.504+0000 7f4e41788640 1 --2- 172.21.15.18:0/981730442 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e3c0b82a0 0x7f4e3c163660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:54:29.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.504+0000 7f4e40f87640 1 --2- 172.21.15.18:0/981730442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e3c0b86b0 0x7f4e3c15bf50 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f4e38007e40 tx=0x7f4e3800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:29.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.504+0000 7f4e2dffb640 1 -- 172.21.15.18:0/981730442 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e38014620 con 0x7f4e3c0b86b0 2024-04-17T19:54:29.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.504+0000 7f4e2dffb640 1 -- 172.21.15.18:0/981730442 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e38019070 con 0x7f4e3c0b86b0 2024-04-17T19:54:29.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.504+0000 7f4e439ec640 1 -- 172.21.15.18:0/981730442 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e3c155d00 con 0x7f4e3c0b86b0 2024-04-17T19:54:29.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.504+0000 7f4e2dffb640 1 -- 172.21.15.18:0/981730442 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e38014a00 con 0x7f4e3c0b86b0 2024-04-17T19:54:29.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.504+0000 7f4e439ec640 1 -- 172.21.15.18:0/981730442 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e3c15c490 con 0x7f4e3c0b86b0 2024-04-17T19:54:29.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.504+0000 7f4e439ec640 1 -- 172.21.15.18:0/981730442 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4e3c068ae0 con 0x7f4e3c0b86b0 2024-04-17T19:54:29.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.504+0000 7f4e2dffb640 1 -- 172.21.15.18:0/981730442 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4e38014ba0 con 0x7f4e3c0b86b0 2024-04-17T19:54:29.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.504+0000 7f4e2dffb640 1 --2- 172.21.15.18:0/981730442 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f4e20068380 0x7f4e2006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:29.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.504+0000 7f4e2dffb640 1 -- 172.21.15.18:0/981730442 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7f4e38088480 con 0x7f4e3c0b86b0 2024-04-17T19:54:29.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.504+0000 7f4e41788640 1 --2- 172.21.15.18:0/981730442 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f4e20068380 0x7f4e2006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:29.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.504+0000 7f4e2dffb640 1 --2- 172.21.15.18:0/981730442 >> [v2:172.21.15.18:6808/1212875862,v1:172.21.15.18:6809/1212875862] conn(0x7f4e20071cf0 0x7f4e200741e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:29.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.504+0000 7f4e2dffb640 1 -- 172.21.15.18:0/981730442 --> [v2:172.21.15.18:6808/1212875862,v1:172.21.15.18:6809/1212875862] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4e3800df30 con 0x7f4e20071cf0 2024-04-17T19:54:29.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.504+0000 7f4e2dffb640 1 -- 172.21.15.18:0/981730442 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4e38088910 con 0x7f4e3c0b86b0 2024-04-17T19:54:29.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.504+0000 7f4e41f89640 1 --2- 172.21.15.18:0/981730442 >> [v2:172.21.15.18:6808/1212875862,v1:172.21.15.18:6809/1212875862] conn(0x7f4e20071cf0 0x7f4e200741e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:29.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.504+0000 7f4e41788640 1 --2- 172.21.15.18:0/981730442 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f4e20068380 0x7f4e2006a890 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c08db30 tx=0x7f4e30009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:29.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.504+0000 7f4e41f89640 1 --2- 172.21.15.18:0/981730442 >> [v2:172.21.15.18:6808/1212875862,v1:172.21.15.18:6809/1212875862] conn(0x7f4e20071cf0 0x7f4e200741e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:29.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.508+0000 7f4e2dffb640 1 -- 172.21.15.18:0/981730442 <== osd.2 v2:172.21.15.18:6808/1212875862 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4e3800df30 con 0x7f4e20071cf0 2024-04-17T19:54:29.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.520+0000 7f4e439ec640 1 -- 172.21.15.18:0/981730442 --> [v2:172.21.15.18:6808/1212875862,v1:172.21.15.18:6809/1212875862] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f4e3c160e80 con 0x7f4e20071cf0 2024-04-17T19:54:29.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.520+0000 7f4e2dffb640 1 -- 172.21.15.18:0/981730442 <== osd.2 v2:172.21.15.18:6808/1212875862 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f4e3c160e80 con 0x7f4e20071cf0 2024-04-17T19:54:29.519 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-17T19:54:29.519 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-17T19:54:29.519 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-17T19:54:29.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.520+0000 7f4e439ec640 1 -- 172.21.15.18:0/981730442 >> [v2:172.21.15.18:6808/1212875862,v1:172.21.15.18:6809/1212875862] conn(0x7f4e20071cf0 msgr2=0x7f4e200741e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:29.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.520+0000 7f4e439ec640 1 --2- 172.21.15.18:0/981730442 >> [v2:172.21.15.18:6808/1212875862,v1:172.21.15.18:6809/1212875862] conn(0x7f4e20071cf0 0x7f4e200741e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:29.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.520+0000 7f4e439ec640 1 -- 172.21.15.18:0/981730442 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f4e20068380 msgr2=0x7f4e2006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:29.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.520+0000 7f4e439ec640 1 --2- 172.21.15.18:0/981730442 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f4e20068380 0x7f4e2006a890 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c08db30 tx=0x7f4e30009040 comp rx=0 tx=0).stop 2024-04-17T19:54:29.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.520+0000 7f4e439ec640 1 -- 172.21.15.18:0/981730442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e3c0b86b0 msgr2=0x7f4e3c15bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:29.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.520+0000 7f4e439ec640 1 --2- 172.21.15.18:0/981730442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e3c0b86b0 0x7f4e3c15bf50 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f4e38007e40 tx=0x7f4e3800e4b0 comp rx=0 tx=0).stop 2024-04-17T19:54:29.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.520+0000 7f4e41f89640 1 -- 172.21.15.18:0/981730442 reap_dead start 2024-04-17T19:54:29.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.520+0000 7f4e439ec640 1 -- 172.21.15.18:0/981730442 shutdown_connections 2024-04-17T19:54:29.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.520+0000 7f4e439ec640 1 -- 172.21.15.18:0/981730442 >> 172.21.15.18:0/981730442 conn(0x7f4e3c0b6cf0 msgr2=0x7f4e3c0b5d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:29.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.520+0000 7f4e439ec640 1 -- 172.21.15.18:0/981730442 shutdown_connections 2024-04-17T19:54:29.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.520+0000 7f4e439ec640 1 -- 172.21.15.18:0/981730442 wait complete. 2024-04-17T19:54:29.537 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-17T19:54:29.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.680+0000 7f12dfbcd640 1 Processor -- start 2024-04-17T19:54:29.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.680+0000 7f12dfbcd640 1 -- start start 2024-04-17T19:54:29.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.684+0000 7f12dfbcd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f12d806cd60 0x7f12d806d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:29.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.684+0000 7f12dfbcd640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f12d815d7c0 0x7f12d815dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:29.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.684+0000 7f12dfbcd640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12d815fc90 con 0x7f12d815c7c0 2024-04-17T19:54:29.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.684+0000 7f12dfbcd640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f12d806d6b0 con 0x7f12d806cd60 2024-04-17T19:54:29.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.684+0000 7f12dfbcd640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f12d8142870 con 0x7f12d815d7c0 2024-04-17T19:54:29.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.684+0000 7f12dd969640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f12d806cd60 0x7f12d806d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:29.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.684+0000 7f12dd969640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f12d806cd60 0x7f12d806d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34250/0 (socket says 172.21.15.18:34250) 2024-04-17T19:54:29.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.684+0000 7f12dd969640 1 -- 172.21.15.18:0/1399478216 learned_addr learned my addr 172.21.15.18:0/1399478216 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:29.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.684+0000 7f12de16a640 1 --2- 172.21.15.18:0/1399478216 >> v2:172.21.15.173:3300/0 conn(0x7f12d815d7c0 0x7f12d815dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:29.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.684+0000 7f12dd969640 1 -- 172.21.15.18:0/1399478216 >> v2:172.21.15.173:3300/0 conn(0x7f12d815d7c0 msgr2=0x7f12d815dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:29.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.684+0000 7f12dd969640 1 --2- 172.21.15.18:0/1399478216 >> v2:172.21.15.173:3300/0 conn(0x7f12d815d7c0 0x7f12d815dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:29.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.684+0000 7f12dd969640 1 -- 172.21.15.18:0/1399478216 >> v1:172.21.15.18:6789/0 conn(0x7f12d815c7c0 legacy=0x7f12d815cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:29.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.684+0000 7f12dd969640 1 -- 172.21.15.18:0/1399478216 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12d815ff00 con 0x7f12d806cd60 2024-04-17T19:54:29.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.684+0000 7f12dd969640 1 --2- 172.21.15.18:0/1399478216 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12d806cd60 0x7f12d806d170 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f12d400bb10 tx=0x7f12d401e9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=469b909903f76640 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:29.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.684+0000 7f12dc967640 1 -- 172.21.15.18:0/1399478216 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d40b4070 con 0x7f12d806cd60 2024-04-17T19:54:29.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.684+0000 7f12dc967640 1 -- 172.21.15.18:0/1399478216 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12d40a7aa0 con 0x7f12d806cd60 2024-04-17T19:54:29.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.684+0000 7f12dc967640 1 -- 172.21.15.18:0/1399478216 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d40af440 con 0x7f12d806cd60 2024-04-17T19:54:29.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.688+0000 7f12dfbcd640 1 -- 172.21.15.18:0/1399478216 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12d806cd60 msgr2=0x7f12d806d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:29.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.688+0000 7f12dfbcd640 1 --2- 172.21.15.18:0/1399478216 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12d806cd60 0x7f12d806d170 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f12d400bb10 tx=0x7f12d401e9f0 comp rx=0 tx=0).stop 2024-04-17T19:54:29.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.688+0000 7f12dfbcd640 1 -- 172.21.15.18:0/1399478216 shutdown_connections 2024-04-17T19:54:29.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.688+0000 7f12dfbcd640 1 --2- 172.21.15.18:0/1399478216 >> v2:172.21.15.173:3300/0 conn(0x7f12d815d7c0 0x7f12d815dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:29.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.688+0000 7f12dfbcd640 1 --2- 172.21.15.18:0/1399478216 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12d806cd60 0x7f12d806d170 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:29.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.688+0000 7f12dfbcd640 1 -- 172.21.15.18:0/1399478216 >> 172.21.15.18:0/1399478216 conn(0x7f12d8072bb0 msgr2=0x7f12d8072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:29.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.688+0000 7f12dfbcd640 1 -- 172.21.15.18:0/1399478216 shutdown_connections 2024-04-17T19:54:29.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.688+0000 7f12dfbcd640 1 -- 172.21.15.18:0/1399478216 wait complete. 2024-04-17T19:54:29.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.688+0000 7f12dfbcd640 1 Processor -- start 2024-04-17T19:54:29.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.688+0000 7f12dfbcd640 1 -- start start 2024-04-17T19:54:29.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.688+0000 7f12dfbcd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12d806cd60 0x7f12d8148290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:29.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.688+0000 7f12dfbcd640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f12d815c7c0 0x7f12d8139f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:29.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.688+0000 7f12dfbcd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12d815d7c0 0x7f12d8135ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:29.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.688+0000 7f12dfbcd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f12d815d4f0 con 0x7f12d815d7c0 2024-04-17T19:54:29.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.688+0000 7f12dfbcd640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f12d81604c0 con 0x7f12d806cd60 2024-04-17T19:54:29.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.688+0000 7f12dfbcd640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f12d81609e0 con 0x7f12d815c7c0 2024-04-17T19:54:29.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.688+0000 7f12de16a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12d815d7c0 0x7f12d8135ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:29.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.688+0000 7f12de16a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12d815d7c0 0x7f12d8135ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34264/0 (socket says 172.21.15.18:34264) 2024-04-17T19:54:29.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.688+0000 7f12de16a640 1 -- 172.21.15.18:0/1036678655 learned_addr learned my addr 172.21.15.18:0/1036678655 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:29.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.688+0000 7f12dd969640 1 --2- 172.21.15.18:0/1036678655 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12d806cd60 0x7f12d8148290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:29.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.688+0000 7f12dd168640 1 --2- 172.21.15.18:0/1036678655 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f12d815c7c0 0x7f12d8139f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:29.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.688+0000 7f12de16a640 1 -- 172.21.15.18:0/1036678655 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f12d815c7c0 msgr2=0x7f12d8139f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:29.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.688+0000 7f12de16a640 1 --2- 172.21.15.18:0/1036678655 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f12d815c7c0 0x7f12d8139f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:29.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.688+0000 7f12de16a640 1 -- 172.21.15.18:0/1036678655 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12d806cd60 msgr2=0x7f12d8148290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:29.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.688+0000 7f12de16a640 1 --2- 172.21.15.18:0/1036678655 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12d806cd60 0x7f12d8148290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:29.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.688+0000 7f12de16a640 1 -- 172.21.15.18:0/1036678655 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12d81e5f30 con 0x7f12d815d7c0 2024-04-17T19:54:29.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.688+0000 7f12dd168640 1 --2- 172.21.15.18:0/1036678655 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f12d815c7c0 0x7f12d8139f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:54:29.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.692+0000 7f12de16a640 1 --2- 172.21.15.18:0/1036678655 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12d815d7c0 0x7f12d8135ad0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f12d0007e90 tx=0x7f12d000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:29.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.692+0000 7f12ce7fc640 1 -- 172.21.15.18:0/1036678655 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d0014420 con 0x7f12d815d7c0 2024-04-17T19:54:29.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.692+0000 7f12ce7fc640 1 -- 172.21.15.18:0/1036678655 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12d0019070 con 0x7f12d815d7c0 2024-04-17T19:54:29.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.692+0000 7f12dfbcd640 1 -- 172.21.15.18:0/1036678655 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12d81386d0 con 0x7f12d815d7c0 2024-04-17T19:54:29.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.692+0000 7f12ce7fc640 1 -- 172.21.15.18:0/1036678655 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12d0014800 con 0x7f12d815d7c0 2024-04-17T19:54:29.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.692+0000 7f12dfbcd640 1 -- 172.21.15.18:0/1036678655 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12d8138b40 con 0x7f12d815d7c0 2024-04-17T19:54:29.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.692+0000 7f12dfbcd640 1 -- 172.21.15.18:0/1036678655 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12d8069950 con 0x7f12d815d7c0 2024-04-17T19:54:29.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.692+0000 7f12ce7fc640 1 -- 172.21.15.18:0/1036678655 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f12d00149a0 con 0x7f12d815d7c0 2024-04-17T19:54:29.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.692+0000 7f12ce7fc640 1 --2- 172.21.15.18:0/1036678655 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f12bc0683b0 0x7f12bc06a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:29.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.692+0000 7f12ce7fc640 1 -- 172.21.15.18:0/1036678655 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7f12d00884f0 con 0x7f12d815d7c0 2024-04-17T19:54:29.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.692+0000 7f12dd969640 1 --2- 172.21.15.18:0/1036678655 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f12bc0683b0 0x7f12bc06a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:29.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.692+0000 7f12dd969640 1 --2- 172.21.15.18:0/1036678655 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f12bc0683b0 0x7f12bc06a8c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f12d40b1000 tx=0x7f12d40a9070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:29.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.696+0000 7f12ce7fc640 1 -- 172.21.15.18:0/1036678655 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f12d00586c0 con 0x7f12d815d7c0 2024-04-17T19:54:29.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.856+0000 7f12dfbcd640 1 -- 172.21.15.18:0/1036678655 --> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f12d81487d0 con 0x7f12bc0683b0 2024-04-17T19:54:29.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.856+0000 7f12ce7fc640 1 -- 172.21.15.18:0/1036678655 <== mgr.4104 v2:172.21.15.18:6832/751466605 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f12d40a7a20 con 0x7f12bc0683b0 2024-04-17T19:54:29.855 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 2 to deep-scrub 2024-04-17T19:54:29.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.860+0000 7f12dfbcd640 1 -- 172.21.15.18:0/1036678655 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f12bc0683b0 msgr2=0x7f12bc06a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:29.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.860+0000 7f12dfbcd640 1 --2- 172.21.15.18:0/1036678655 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f12bc0683b0 0x7f12bc06a8c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f12d40b1000 tx=0x7f12d40a9070 comp rx=0 tx=0).stop 2024-04-17T19:54:29.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.860+0000 7f12dfbcd640 1 -- 172.21.15.18:0/1036678655 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12d815d7c0 msgr2=0x7f12d8135ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:29.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.860+0000 7f12dfbcd640 1 --2- 172.21.15.18:0/1036678655 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12d815d7c0 0x7f12d8135ad0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f12d0007e90 tx=0x7f12d000e4b0 comp rx=0 tx=0).stop 2024-04-17T19:54:29.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.860+0000 7f12dfbcd640 1 -- 172.21.15.18:0/1036678655 shutdown_connections 2024-04-17T19:54:29.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.860+0000 7f12dfbcd640 1 --2- 172.21.15.18:0/1036678655 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f12bc0683b0 0x7f12bc06a8c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:29.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.860+0000 7f12dfbcd640 1 --2- 172.21.15.18:0/1036678655 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12d815d7c0 0x7f12d8135ad0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:29.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.860+0000 7f12dfbcd640 1 --2- 172.21.15.18:0/1036678655 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f12d815c7c0 0x7f12d8139f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:29.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.860+0000 7f12dfbcd640 1 --2- 172.21.15.18:0/1036678655 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12d806cd60 0x7f12d8148290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:29.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.860+0000 7f12dfbcd640 1 -- 172.21.15.18:0/1036678655 >> 172.21.15.18:0/1036678655 conn(0x7f12d8072bb0 msgr2=0x7f12d8070030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:29.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.860+0000 7f12dfbcd640 1 -- 172.21.15.18:0/1036678655 shutdown_connections 2024-04-17T19:54:29.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:29.860+0000 7f12dfbcd640 1 -- 172.21.15.18:0/1036678655 wait complete. 2024-04-17T19:54:29.876 INFO:tasks.ceph:Scrubbing osd.3 2024-04-17T19:54:29.876 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-17T19:54:29.898 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T19:54:29.921 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T19:54:30.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.028+0000 7ffb3f774640 1 Processor -- start 2024-04-17T19:54:30.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.028+0000 7ffb3f774640 1 -- start start 2024-04-17T19:54:30.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.032+0000 7ffb3f774640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ffb3806cd60 0x7ffb3806d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:30.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.032+0000 7ffb3f774640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ffb380cf290 0x7ffb380cf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:30.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.032+0000 7ffb3f774640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb3806d6b0 con 0x7ffb38148fc0 2024-04-17T19:54:30.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.032+0000 7ffb3f774640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7ffb38164bf0 con 0x7ffb3806cd60 2024-04-17T19:54:30.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.032+0000 7ffb3f774640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7ffb38163e30 con 0x7ffb380cf290 2024-04-17T19:54:30.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.032+0000 7ffb3d510640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ffb3806cd60 0x7ffb3806d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:30.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.032+0000 7ffb3d510640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ffb3806cd60 0x7ffb3806d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34280/0 (socket says 172.21.15.18:34280) 2024-04-17T19:54:30.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.032+0000 7ffb3d510640 1 -- 172.21.15.18:0/3968292101 learned_addr learned my addr 172.21.15.18:0/3968292101 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:30.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.032+0000 7ffb3dd11640 1 --2- 172.21.15.18:0/3968292101 >> v2:172.21.15.173:3300/0 conn(0x7ffb380cf290 0x7ffb380cf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:30.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.032+0000 7ffb3d510640 1 -- 172.21.15.18:0/3968292101 >> v2:172.21.15.173:3300/0 conn(0x7ffb380cf290 msgr2=0x7ffb380cf6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:30.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.032+0000 7ffb3d510640 1 --2- 172.21.15.18:0/3968292101 >> v2:172.21.15.173:3300/0 conn(0x7ffb380cf290 0x7ffb380cf6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:30.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.032+0000 7ffb3d510640 1 -- 172.21.15.18:0/3968292101 >> v1:172.21.15.173:6789/0 conn(0x7ffb38148fc0 legacy=0x7ffb381493d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:30.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.032+0000 7ffb3d510640 1 -- 172.21.15.18:0/3968292101 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb38164110 con 0x7ffb3806cd60 2024-04-17T19:54:30.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.036+0000 7ffb3d510640 1 --2- 172.21.15.18:0/3968292101 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb3806cd60 0x7ffb3806d170 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ffb3815e290 tx=0x7ffb3001c300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18334d72bf7696b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:30.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.036+0000 7ffb2ffff640 1 -- 172.21.15.18:0/3968292101 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb300b0070 con 0x7ffb3806cd60 2024-04-17T19:54:30.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.036+0000 7ffb2ffff640 1 -- 172.21.15.18:0/3968292101 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb300ab600 con 0x7ffb3806cd60 2024-04-17T19:54:30.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.036+0000 7ffb2ffff640 1 -- 172.21.15.18:0/3968292101 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb300ab9d0 con 0x7ffb3806cd60 2024-04-17T19:54:30.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.036+0000 7ffb3f774640 1 -- 172.21.15.18:0/3968292101 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb3806cd60 msgr2=0x7ffb3806d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:30.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.036+0000 7ffb3f774640 1 --2- 172.21.15.18:0/3968292101 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb3806cd60 0x7ffb3806d170 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ffb3815e290 tx=0x7ffb3001c300 comp rx=0 tx=0).stop 2024-04-17T19:54:30.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.036+0000 7ffb3f774640 1 -- 172.21.15.18:0/3968292101 shutdown_connections 2024-04-17T19:54:30.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.036+0000 7ffb3f774640 1 --2- 172.21.15.18:0/3968292101 >> v2:172.21.15.173:3300/0 conn(0x7ffb380cf290 0x7ffb380cf6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:30.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.036+0000 7ffb3f774640 1 --2- 172.21.15.18:0/3968292101 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb3806cd60 0x7ffb3806d170 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:30.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.036+0000 7ffb3f774640 1 -- 172.21.15.18:0/3968292101 >> 172.21.15.18:0/3968292101 conn(0x7ffb38072bb0 msgr2=0x7ffb38072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:30.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.036+0000 7ffb3f774640 1 -- 172.21.15.18:0/3968292101 shutdown_connections 2024-04-17T19:54:30.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.036+0000 7ffb3f774640 1 -- 172.21.15.18:0/3968292101 wait complete. 2024-04-17T19:54:30.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.036+0000 7ffb3f774640 1 Processor -- start 2024-04-17T19:54:30.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.036+0000 7ffb3f774640 1 -- start start 2024-04-17T19:54:30.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.040+0000 7ffb3f774640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffb3806cd60 0x7ffb381ffd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:30.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.040+0000 7ffb3f774640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb380cf290 0x7ffb3815afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:30.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.040+0000 7ffb3f774640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffb38148fc0 0x7ffb3816d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:30.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.040+0000 7ffb3f774640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ffb38170750 con 0x7ffb380cf290 2024-04-17T19:54:30.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.040+0000 7ffb3f774640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ffb381705d0 con 0x7ffb38148fc0 2024-04-17T19:54:30.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.040+0000 7ffb3f774640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7ffb381708d0 con 0x7ffb3806cd60 2024-04-17T19:54:30.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.040+0000 7ffb3cd0f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb380cf290 0x7ffb3815afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:30.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.040+0000 7ffb3cd0f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb380cf290 0x7ffb3815afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34296/0 (socket says 172.21.15.18:34296) 2024-04-17T19:54:30.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.040+0000 7ffb3cd0f640 1 -- 172.21.15.18:0/2638080138 learned_addr learned my addr 172.21.15.18:0/2638080138 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:30.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.040+0000 7ffb3dd11640 1 --2- 172.21.15.18:0/2638080138 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffb38148fc0 0x7ffb3816d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:30.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.040+0000 7ffb3d510640 1 --2- 172.21.15.18:0/2638080138 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffb3806cd60 0x7ffb381ffd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:30.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.040+0000 7ffb3cd0f640 1 -- 172.21.15.18:0/2638080138 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffb3806cd60 msgr2=0x7ffb381ffd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:30.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.040+0000 7ffb3cd0f640 1 --2- 172.21.15.18:0/2638080138 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffb3806cd60 0x7ffb381ffd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:30.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.040+0000 7ffb3cd0f640 1 -- 172.21.15.18:0/2638080138 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffb38148fc0 msgr2=0x7ffb3816d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:30.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.040+0000 7ffb3cd0f640 1 --2- 172.21.15.18:0/2638080138 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffb38148fc0 0x7ffb3816d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:30.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.040+0000 7ffb3cd0f640 1 -- 172.21.15.18:0/2638080138 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb3816ad10 con 0x7ffb380cf290 2024-04-17T19:54:30.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.040+0000 7ffb3dd11640 1 --2- 172.21.15.18:0/2638080138 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffb38148fc0 0x7ffb3816d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:54:30.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.040+0000 7ffb3d510640 1 --2- 172.21.15.18:0/2638080138 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffb3806cd60 0x7ffb381ffd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:54:30.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.040+0000 7ffb3cd0f640 1 --2- 172.21.15.18:0/2638080138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb380cf290 0x7ffb3815afc0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ffb2800b410 tx=0x7ffb2800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:30.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.040+0000 7ffb2dffb640 1 -- 172.21.15.18:0/2638080138 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb28015030 con 0x7ffb380cf290 2024-04-17T19:54:30.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.040+0000 7ffb2dffb640 1 -- 172.21.15.18:0/2638080138 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb28004020 con 0x7ffb380cf290 2024-04-17T19:54:30.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.040+0000 7ffb3f774640 1 -- 172.21.15.18:0/2638080138 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb3816aff0 con 0x7ffb380cf290 2024-04-17T19:54:30.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.040+0000 7ffb2dffb640 1 -- 172.21.15.18:0/2638080138 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb28004410 con 0x7ffb380cf290 2024-04-17T19:54:30.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.040+0000 7ffb3f774640 1 -- 172.21.15.18:0/2638080138 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb3816b5b0 con 0x7ffb380cf290 2024-04-17T19:54:30.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.040+0000 7ffb3f774640 1 -- 172.21.15.18:0/2638080138 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ffb38069950 con 0x7ffb380cf290 2024-04-17T19:54:30.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.040+0000 7ffb2dffb640 1 -- 172.21.15.18:0/2638080138 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ffb28018070 con 0x7ffb380cf290 2024-04-17T19:54:30.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.040+0000 7ffb2dffb640 1 --2- 172.21.15.18:0/2638080138 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7ffb1c068380 0x7ffb1c06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:30.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.040+0000 7ffb2dffb640 1 -- 172.21.15.18:0/2638080138 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7ffb28087290 con 0x7ffb380cf290 2024-04-17T19:54:30.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.040+0000 7ffb3d510640 1 --2- 172.21.15.18:0/2638080138 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7ffb1c068380 0x7ffb1c06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:30.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.040+0000 7ffb2dffb640 1 --2- 172.21.15.18:0/2638080138 >> [v2:172.21.15.18:6824/2428878428,v1:172.21.15.18:6825/2428878428] conn(0x7ffb1c071cf0 0x7ffb1c0741e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:30.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.040+0000 7ffb2dffb640 1 -- 172.21.15.18:0/2638080138 --> [v2:172.21.15.18:6824/2428878428,v1:172.21.15.18:6825/2428878428] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffb1c0748b0 con 0x7ffb1c071cf0 2024-04-17T19:54:30.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.040+0000 7ffb2dffb640 1 -- 172.21.15.18:0/2638080138 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ffb28087720 con 0x7ffb380cf290 2024-04-17T19:54:30.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.040+0000 7ffb3dd11640 1 --2- 172.21.15.18:0/2638080138 >> [v2:172.21.15.18:6824/2428878428,v1:172.21.15.18:6825/2428878428] conn(0x7ffb1c071cf0 0x7ffb1c0741e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:30.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.044+0000 7ffb3d510640 1 --2- 172.21.15.18:0/2638080138 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7ffb1c068380 0x7ffb1c06a890 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ffb300ad000 tx=0x7ffb30008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:30.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.044+0000 7ffb3dd11640 1 --2- 172.21.15.18:0/2638080138 >> [v2:172.21.15.18:6824/2428878428,v1:172.21.15.18:6825/2428878428] conn(0x7ffb1c071cf0 0x7ffb1c0741e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:30.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.044+0000 7ffb2dffb640 1 -- 172.21.15.18:0/2638080138 <== osd.3 v2:172.21.15.18:6824/2428878428 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ffb1c0748b0 con 0x7ffb1c071cf0 2024-04-17T19:54:30.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.056+0000 7ffb3f774640 1 -- 172.21.15.18:0/2638080138 --> [v2:172.21.15.18:6824/2428878428,v1:172.21.15.18:6825/2428878428] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ffb3816aac0 con 0x7ffb1c071cf0 2024-04-17T19:54:30.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.056+0000 7ffb2dffb640 1 -- 172.21.15.18:0/2638080138 <== osd.3 v2:172.21.15.18:6824/2428878428 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ffb3816aac0 con 0x7ffb1c071cf0 2024-04-17T19:54:30.054 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-17T19:54:30.054 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-17T19:54:30.054 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-17T19:54:30.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.056+0000 7ffb3f774640 1 -- 172.21.15.18:0/2638080138 >> [v2:172.21.15.18:6824/2428878428,v1:172.21.15.18:6825/2428878428] conn(0x7ffb1c071cf0 msgr2=0x7ffb1c0741e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:30.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.056+0000 7ffb3f774640 1 --2- 172.21.15.18:0/2638080138 >> [v2:172.21.15.18:6824/2428878428,v1:172.21.15.18:6825/2428878428] conn(0x7ffb1c071cf0 0x7ffb1c0741e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:30.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.056+0000 7ffb3f774640 1 -- 172.21.15.18:0/2638080138 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7ffb1c068380 msgr2=0x7ffb1c06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:30.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.056+0000 7ffb3f774640 1 --2- 172.21.15.18:0/2638080138 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7ffb1c068380 0x7ffb1c06a890 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ffb300ad000 tx=0x7ffb30008040 comp rx=0 tx=0).stop 2024-04-17T19:54:30.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.056+0000 7ffb3f774640 1 -- 172.21.15.18:0/2638080138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb380cf290 msgr2=0x7ffb3815afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:30.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.056+0000 7ffb3f774640 1 --2- 172.21.15.18:0/2638080138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb380cf290 0x7ffb3815afc0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ffb2800b410 tx=0x7ffb2800b8d0 comp rx=0 tx=0).stop 2024-04-17T19:54:30.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.056+0000 7ffb3dd11640 1 -- 172.21.15.18:0/2638080138 reap_dead start 2024-04-17T19:54:30.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.056+0000 7ffb3f774640 1 -- 172.21.15.18:0/2638080138 shutdown_connections 2024-04-17T19:54:30.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.056+0000 7ffb3f774640 1 -- 172.21.15.18:0/2638080138 >> 172.21.15.18:0/2638080138 conn(0x7ffb38072bb0 msgr2=0x7ffb381484c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:30.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.056+0000 7ffb3f774640 1 -- 172.21.15.18:0/2638080138 shutdown_connections 2024-04-17T19:54:30.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.056+0000 7ffb3f774640 1 -- 172.21.15.18:0/2638080138 wait complete. 2024-04-17T19:54:30.072 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-17T19:54:30.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.216+0000 7efd71ffd640 1 Processor -- start 2024-04-17T19:54:30.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.216+0000 7efd71ffd640 1 -- start start 2024-04-17T19:54:30.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.216+0000 7efd71ffd640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7efd6c15e1a0 0x7efd6c0ce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:30.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.216+0000 7efd71ffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7efd6c06cd60 0x7efd6c06d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:30.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.216+0000 7efd71ffd640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd6c06d6b0 con 0x7efd6c0cef10 2024-04-17T19:54:30.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.216+0000 7efd71ffd640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7efd6c0d0020 con 0x7efd6c06cd60 2024-04-17T19:54:30.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.216+0000 7efd71ffd640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7efd6c0cd930 con 0x7efd6c15e1a0 2024-04-17T19:54:30.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.216+0000 7efd6bfff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7efd6c06cd60 0x7efd6c06d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:30.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.216+0000 7efd6bfff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7efd6c06cd60 0x7efd6c06d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34300/0 (socket says 172.21.15.18:34300) 2024-04-17T19:54:30.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.216+0000 7efd6bfff640 1 -- 172.21.15.18:0/3268490985 learned_addr learned my addr 172.21.15.18:0/3268490985 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:30.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.216+0000 7efd6affd640 1 --1- 172.21.15.18:0/3268490985 >> v1:172.21.15.18:6789/0 conn(0x7efd6c0cef10 0x7efd6c15e910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:44244/0 (socket says 172.21.15.18:44244) 2024-04-17T19:54:30.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.216+0000 7efd6b7fe640 1 --2- 172.21.15.18:0/3268490985 >> v2:172.21.15.173:3300/0 conn(0x7efd6c15e1a0 0x7efd6c0ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:30.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.216+0000 7efd6bfff640 1 -- 172.21.15.18:0/3268490985 >> v2:172.21.15.173:3300/0 conn(0x7efd6c15e1a0 msgr2=0x7efd6c0ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:30.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.216+0000 7efd6bfff640 1 --2- 172.21.15.18:0/3268490985 >> v2:172.21.15.173:3300/0 conn(0x7efd6c15e1a0 0x7efd6c0ce9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:30.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.216+0000 7efd6bfff640 1 -- 172.21.15.18:0/3268490985 >> v1:172.21.15.18:6789/0 conn(0x7efd6c0cef10 legacy=0x7efd6c15e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:30.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.216+0000 7efd6a7fc640 1 -- 172.21.15.18:0/3268490985 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2755277118 0 0) 0x7efd54001120 con 0x7efd6c0cef10 2024-04-17T19:54:30.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.216+0000 7efd6bfff640 1 -- 172.21.15.18:0/3268490985 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd6c0cdc10 con 0x7efd6c06cd60 2024-04-17T19:54:30.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.220+0000 7efd6bfff640 1 --2- 172.21.15.18:0/3268490985 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd6c06cd60 0x7efd6c06d170 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7efd6c06fdc0 tx=0x7efd6401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=867e84ca9e885789 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:30.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.220+0000 7efd6a7fc640 1 -- 172.21.15.18:0/3268490985 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd640ab660 con 0x7efd6c06cd60 2024-04-17T19:54:30.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.220+0000 7efd6a7fc640 1 -- 172.21.15.18:0/3268490985 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd640b0070 con 0x7efd6c06cd60 2024-04-17T19:54:30.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.220+0000 7efd6a7fc640 1 -- 172.21.15.18:0/3268490985 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd640aba20 con 0x7efd6c06cd60 2024-04-17T19:54:30.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.224+0000 7efd71ffd640 1 -- 172.21.15.18:0/3268490985 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd6c06cd60 msgr2=0x7efd6c06d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:30.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.224+0000 7efd71ffd640 1 --2- 172.21.15.18:0/3268490985 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd6c06cd60 0x7efd6c06d170 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7efd6c06fdc0 tx=0x7efd6401c460 comp rx=0 tx=0).stop 2024-04-17T19:54:30.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.224+0000 7efd71ffd640 1 -- 172.21.15.18:0/3268490985 shutdown_connections 2024-04-17T19:54:30.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.224+0000 7efd71ffd640 1 --2- 172.21.15.18:0/3268490985 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd6c06cd60 0x7efd6c06d170 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:30.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.224+0000 7efd71ffd640 1 --2- 172.21.15.18:0/3268490985 >> v2:172.21.15.173:3300/0 conn(0x7efd6c15e1a0 0x7efd6c0ce9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:30.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.224+0000 7efd71ffd640 1 -- 172.21.15.18:0/3268490985 >> 172.21.15.18:0/3268490985 conn(0x7efd6c072bb0 msgr2=0x7efd6c072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:30.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.224+0000 7efd71ffd640 1 -- 172.21.15.18:0/3268490985 shutdown_connections 2024-04-17T19:54:30.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.224+0000 7efd71ffd640 1 -- 172.21.15.18:0/3268490985 wait complete. 2024-04-17T19:54:30.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.224+0000 7efd71ffd640 1 Processor -- start 2024-04-17T19:54:30.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.224+0000 7efd71ffd640 1 -- start start 2024-04-17T19:54:30.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.224+0000 7efd71ffd640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd6c06cd60 0x7efd6c139bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:30.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.224+0000 7efd71ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd6c0cef10 0x7efd6c152610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:30.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.224+0000 7efd71ffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd6c15e1a0 0x7efd6c155e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:30.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.224+0000 7efd71ffd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efd6c15e730 con 0x7efd6c0cef10 2024-04-17T19:54:30.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.224+0000 7efd71ffd640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7efd6c15e5b0 con 0x7efd6c15e1a0 2024-04-17T19:54:30.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.224+0000 7efd71ffd640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7efd6c15f020 con 0x7efd6c06cd60 2024-04-17T19:54:30.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.224+0000 7efd6affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd6c0cef10 0x7efd6c152610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:30.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.224+0000 7efd6affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd6c0cef10 0x7efd6c152610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34312/0 (socket says 172.21.15.18:34312) 2024-04-17T19:54:30.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.224+0000 7efd6affd640 1 -- 172.21.15.18:0/4266466149 learned_addr learned my addr 172.21.15.18:0/4266466149 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:30.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.224+0000 7efd6bfff640 1 --2- 172.21.15.18:0/4266466149 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd6c15e1a0 0x7efd6c155e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:30.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.224+0000 7efd6b7fe640 1 --2- 172.21.15.18:0/4266466149 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd6c06cd60 0x7efd6c139bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:30.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.224+0000 7efd6affd640 1 -- 172.21.15.18:0/4266466149 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd6c06cd60 msgr2=0x7efd6c139bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:30.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.224+0000 7efd6affd640 1 --2- 172.21.15.18:0/4266466149 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd6c06cd60 0x7efd6c139bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:30.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.224+0000 7efd6affd640 1 -- 172.21.15.18:0/4266466149 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd6c15e1a0 msgr2=0x7efd6c155e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:30.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.224+0000 7efd6affd640 1 --2- 172.21.15.18:0/4266466149 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd6c15e1a0 0x7efd6c155e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:30.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.224+0000 7efd6affd640 1 -- 172.21.15.18:0/4266466149 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd6c153380 con 0x7efd6c0cef10 2024-04-17T19:54:30.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.224+0000 7efd6bfff640 1 --2- 172.21.15.18:0/4266466149 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd6c15e1a0 0x7efd6c155e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:54:30.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.228+0000 7efd6affd640 1 --2- 172.21.15.18:0/4266466149 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd6c0cef10 0x7efd6c152610 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7efd5400c450 tx=0x7efd5400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:30.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.228+0000 7efd63fff640 1 -- 172.21.15.18:0/4266466149 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd54018070 con 0x7efd6c0cef10 2024-04-17T19:54:30.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.228+0000 7efd63fff640 1 -- 172.21.15.18:0/4266466149 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd540074e0 con 0x7efd6c0cef10 2024-04-17T19:54:30.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.228+0000 7efd71ffd640 1 -- 172.21.15.18:0/4266466149 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd6c13a5c0 con 0x7efd6c0cef10 2024-04-17T19:54:30.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.228+0000 7efd63fff640 1 -- 172.21.15.18:0/4266466149 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd540049f0 con 0x7efd6c0cef10 2024-04-17T19:54:30.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.228+0000 7efd71ffd640 1 -- 172.21.15.18:0/4266466149 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd6c13ab80 con 0x7efd6c0cef10 2024-04-17T19:54:30.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.228+0000 7efd71ffd640 1 -- 172.21.15.18:0/4266466149 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd6c1530f0 con 0x7efd6c0cef10 2024-04-17T19:54:30.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.228+0000 7efd63fff640 1 -- 172.21.15.18:0/4266466149 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efd5401b070 con 0x7efd6c0cef10 2024-04-17T19:54:30.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.228+0000 7efd63fff640 1 --2- 172.21.15.18:0/4266466149 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7efd4c068380 0x7efd4c06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:30.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.228+0000 7efd63fff640 1 -- 172.21.15.18:0/4266466149 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7efd540860f0 con 0x7efd6c0cef10 2024-04-17T19:54:30.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.228+0000 7efd6b7fe640 1 --2- 172.21.15.18:0/4266466149 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7efd4c068380 0x7efd4c06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:30.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.228+0000 7efd6b7fe640 1 --2- 172.21.15.18:0/4266466149 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7efd4c068380 0x7efd4c06a890 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7efd6c0b5f30 tx=0x7efd5c00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:30.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.232+0000 7efd63fff640 1 -- 172.21.15.18:0/4266466149 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efd6c06d6b0 con 0x7efd6c0cef10 2024-04-17T19:54:30.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.396+0000 7efd71ffd640 1 -- 172.21.15.18:0/4266466149 --> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7efd6c069950 con 0x7efd4c068380 2024-04-17T19:54:30.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.396+0000 7efd63fff640 1 -- 172.21.15.18:0/4266466149 <== mgr.4104 v2:172.21.15.18:6832/751466605 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7efd6c069950 con 0x7efd4c068380 2024-04-17T19:54:30.394 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 3 to deep-scrub 2024-04-17T19:54:30.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.400+0000 7efd71ffd640 1 -- 172.21.15.18:0/4266466149 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7efd4c068380 msgr2=0x7efd4c06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:30.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.400+0000 7efd71ffd640 1 --2- 172.21.15.18:0/4266466149 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7efd4c068380 0x7efd4c06a890 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7efd6c0b5f30 tx=0x7efd5c00b040 comp rx=0 tx=0).stop 2024-04-17T19:54:30.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.400+0000 7efd71ffd640 1 -- 172.21.15.18:0/4266466149 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd6c0cef10 msgr2=0x7efd6c152610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:30.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.400+0000 7efd71ffd640 1 --2- 172.21.15.18:0/4266466149 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd6c0cef10 0x7efd6c152610 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7efd5400c450 tx=0x7efd5400c910 comp rx=0 tx=0).stop 2024-04-17T19:54:30.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.400+0000 7efd71ffd640 1 -- 172.21.15.18:0/4266466149 shutdown_connections 2024-04-17T19:54:30.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.400+0000 7efd71ffd640 1 --2- 172.21.15.18:0/4266466149 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7efd4c068380 0x7efd4c06a890 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:30.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.400+0000 7efd71ffd640 1 --2- 172.21.15.18:0/4266466149 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd6c15e1a0 0x7efd6c155e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:30.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.400+0000 7efd71ffd640 1 --2- 172.21.15.18:0/4266466149 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd6c0cef10 0x7efd6c152610 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:30.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.400+0000 7efd71ffd640 1 --2- 172.21.15.18:0/4266466149 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd6c06cd60 0x7efd6c139bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:30.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.400+0000 7efd71ffd640 1 -- 172.21.15.18:0/4266466149 >> 172.21.15.18:0/4266466149 conn(0x7efd6c072bb0 msgr2=0x7efd6c06e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:30.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.400+0000 7efd71ffd640 1 -- 172.21.15.18:0/4266466149 shutdown_connections 2024-04-17T19:54:30.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.400+0000 7efd71ffd640 1 -- 172.21.15.18:0/4266466149 wait complete. 2024-04-17T19:54:30.416 INFO:tasks.ceph:Scrubbing osd.4 2024-04-17T19:54:30.416 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-17T19:54:30.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.568+0000 7f6f53629640 1 Processor -- start 2024-04-17T19:54:30.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.568+0000 7f6f53629640 1 -- start start 2024-04-17T19:54:30.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.568+0000 7f6f53629640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6f4c15e1a0 0x7f6f4c0ce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:30.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.568+0000 7f6f53629640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6f4c0cef10 0x7f6f4c15e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:30.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.568+0000 7f6f53629640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f4c0d0020 con 0x7f6f4c15ee50 2024-04-17T19:54:30.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.568+0000 7f6f53629640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f6f4c0cd930 con 0x7f6f4c0cef10 2024-04-17T19:54:30.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.568+0000 7f6f53629640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f6f4c0cdc10 con 0x7f6f4c15e1a0 2024-04-17T19:54:30.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.568+0000 7f6f50bc4640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6f4c0cef10 0x7f6f4c15e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:30.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.568+0000 7f6f50bc4640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6f4c0cef10 0x7f6f4c15e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34314/0 (socket says 172.21.15.18:34314) 2024-04-17T19:54:30.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.568+0000 7f6f50bc4640 1 -- 172.21.15.18:0/2777276808 learned_addr learned my addr 172.21.15.18:0/2777276808 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:30.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.568+0000 7f6f513c5640 1 --2- 172.21.15.18:0/2777276808 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6f4c15e1a0 0x7f6f4c0ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:30.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.568+0000 7f6f50bc4640 1 -- 172.21.15.18:0/2777276808 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6f4c15e1a0 msgr2=0x7f6f4c0ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:30.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.568+0000 7f6f50bc4640 1 --2- 172.21.15.18:0/2777276808 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6f4c15e1a0 0x7f6f4c0ce9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:30.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.568+0000 7f6f50bc4640 1 -- 172.21.15.18:0/2777276808 >> v1:172.21.15.173:6789/0 conn(0x7f6f4c15ee50 legacy=0x7f6f4c06cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:30.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.568+0000 7f6f50bc4640 1 -- 172.21.15.18:0/2777276808 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f4c0cdef0 con 0x7f6f4c0cef10 2024-04-17T19:54:30.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.572+0000 7f6f50bc4640 1 --2- 172.21.15.18:0/2777276808 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f4c0cef10 0x7f6f4c15e910 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c009870 tx=0x7f6f3c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a4546582b09e4e server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:30.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.572+0000 7f6f43fff640 1 -- 172.21.15.18:0/2777276808 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c0b1070 con 0x7f6f4c0cef10 2024-04-17T19:54:30.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.572+0000 7f6f43fff640 1 -- 172.21.15.18:0/2777276808 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f3c0ac620 con 0x7f6f4c0cef10 2024-04-17T19:54:30.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.572+0000 7f6f43fff640 1 -- 172.21.15.18:0/2777276808 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c0ac9f0 con 0x7f6f4c0cef10 2024-04-17T19:54:30.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.572+0000 7f6f53629640 1 -- 172.21.15.18:0/2777276808 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f4c0cef10 msgr2=0x7f6f4c15e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:30.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.572+0000 7f6f53629640 1 --2- 172.21.15.18:0/2777276808 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f4c0cef10 0x7f6f4c15e910 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c009870 tx=0x7f6f3c01c4d0 comp rx=0 tx=0).stop 2024-04-17T19:54:30.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.572+0000 7f6f53629640 1 -- 172.21.15.18:0/2777276808 shutdown_connections 2024-04-17T19:54:30.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.572+0000 7f6f53629640 1 --2- 172.21.15.18:0/2777276808 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f4c0cef10 0x7f6f4c15e910 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:30.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.572+0000 7f6f53629640 1 --2- 172.21.15.18:0/2777276808 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6f4c15e1a0 0x7f6f4c0ce9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:30.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.572+0000 7f6f53629640 1 -- 172.21.15.18:0/2777276808 >> 172.21.15.18:0/2777276808 conn(0x7f6f4c072bb0 msgr2=0x7f6f4c072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:30.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.572+0000 7f6f53629640 1 -- 172.21.15.18:0/2777276808 shutdown_connections 2024-04-17T19:54:30.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.572+0000 7f6f53629640 1 -- 172.21.15.18:0/2777276808 wait complete. 2024-04-17T19:54:30.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.576+0000 7f6f53629640 1 Processor -- start 2024-04-17T19:54:30.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.576+0000 7f6f53629640 1 -- start start 2024-04-17T19:54:30.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.576+0000 7f6f53629640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6f4c0cef10 0x7f6f4c146b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:30.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.576+0000 7f6f53629640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f4c15e1a0 0x7f6f4c1567f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:30.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.576+0000 7f6f53629640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f4c15ee50 0x7f6f4c156d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:30.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.576+0000 7f6f53629640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6f4c157b90 con 0x7f6f4c15ee50 2024-04-17T19:54:30.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.576+0000 7f6f53629640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6f4c157a10 con 0x7f6f4c15e1a0 2024-04-17T19:54:30.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.576+0000 7f6f53629640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f6f4c06d470 con 0x7f6f4c0cef10 2024-04-17T19:54:30.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.576+0000 7f6f51bc6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f4c15ee50 0x7f6f4c156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:30.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.576+0000 7f6f51bc6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f4c15ee50 0x7f6f4c156d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34316/0 (socket says 172.21.15.18:34316) 2024-04-17T19:54:30.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.576+0000 7f6f51bc6640 1 -- 172.21.15.18:0/1621691445 learned_addr learned my addr 172.21.15.18:0/1621691445 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:30.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.576+0000 7f6f50bc4640 1 --2- 172.21.15.18:0/1621691445 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f4c15e1a0 0x7f6f4c1567f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:30.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.576+0000 7f6f513c5640 1 --2- 172.21.15.18:0/1621691445 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6f4c0cef10 0x7f6f4c146b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:30.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.576+0000 7f6f51bc6640 1 -- 172.21.15.18:0/1621691445 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6f4c0cef10 msgr2=0x7f6f4c146b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:30.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.576+0000 7f6f51bc6640 1 --2- 172.21.15.18:0/1621691445 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6f4c0cef10 0x7f6f4c146b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:30.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.576+0000 7f6f51bc6640 1 -- 172.21.15.18:0/1621691445 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f4c15e1a0 msgr2=0x7f6f4c1567f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:30.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.576+0000 7f6f51bc6640 1 --2- 172.21.15.18:0/1621691445 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f4c15e1a0 0x7f6f4c1567f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:30.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.576+0000 7f6f51bc6640 1 -- 172.21.15.18:0/1621691445 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f4c1f6640 con 0x7f6f4c15ee50 2024-04-17T19:54:30.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.576+0000 7f6f50bc4640 1 --2- 172.21.15.18:0/1621691445 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f4c15e1a0 0x7f6f4c1567f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:54:30.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.576+0000 7f6f51bc6640 1 --2- 172.21.15.18:0/1621691445 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f4c15ee50 0x7f6f4c156d30 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f6f4400c730 tx=0x7f6f4400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:30.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.576+0000 7f6f41ffb640 1 -- 172.21.15.18:0/1621691445 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f44003b80 con 0x7f6f4c15ee50 2024-04-17T19:54:30.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.576+0000 7f6f41ffb640 1 -- 172.21.15.18:0/1621691445 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f44003d20 con 0x7f6f4c15ee50 2024-04-17T19:54:30.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.576+0000 7f6f53629640 1 -- 172.21.15.18:0/1621691445 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f4c1f6920 con 0x7f6f4c15ee50 2024-04-17T19:54:30.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.576+0000 7f6f41ffb640 1 -- 172.21.15.18:0/1621691445 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f44005310 con 0x7f6f4c15ee50 2024-04-17T19:54:30.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.576+0000 7f6f53629640 1 -- 172.21.15.18:0/1621691445 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f4c1f6ee0 con 0x7f6f4c15ee50 2024-04-17T19:54:30.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.576+0000 7f6f53629640 1 -- 172.21.15.18:0/1621691445 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6f4c069950 con 0x7f6f4c15ee50 2024-04-17T19:54:30.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.580+0000 7f6f41ffb640 1 -- 172.21.15.18:0/1621691445 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6f440056c0 con 0x7f6f4c15ee50 2024-04-17T19:54:30.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.580+0000 7f6f41ffb640 1 --2- 172.21.15.18:0/1621691445 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f6f300683b0 0x7f6f3006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:30.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.580+0000 7f6f41ffb640 1 -- 172.21.15.18:0/1621691445 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7f6f44087800 con 0x7f6f4c15ee50 2024-04-17T19:54:30.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.580+0000 7f6f513c5640 1 --2- 172.21.15.18:0/1621691445 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f6f300683b0 0x7f6f3006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:30.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.580+0000 7f6f41ffb640 1 --2- 172.21.15.18:0/1621691445 >> [v2:172.21.15.173:6824/1421511819,v1:172.21.15.173:6825/1421511819] conn(0x7f6f30071d20 0x7f6f30074210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:30.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.580+0000 7f6f41ffb640 1 -- 172.21.15.18:0/1621691445 --> [v2:172.21.15.173:6824/1421511819,v1:172.21.15.173:6825/1421511819] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6f44014e50 con 0x7f6f30071d20 2024-04-17T19:54:30.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.580+0000 7f6f41ffb640 1 -- 172.21.15.18:0/1621691445 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6f44087bb0 con 0x7f6f4c15ee50 2024-04-17T19:54:30.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.580+0000 7f6f513c5640 1 --2- 172.21.15.18:0/1621691445 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f6f300683b0 0x7f6f3006a8c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c0b5f30 tx=0x7f6f48008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:30.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.580+0000 7f6f50bc4640 1 --2- 172.21.15.18:0/1621691445 >> [v2:172.21.15.173:6824/1421511819,v1:172.21.15.173:6825/1421511819] conn(0x7f6f30071d20 0x7f6f30074210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:30.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.580+0000 7f6f50bc4640 1 --2- 172.21.15.18:0/1621691445 >> [v2:172.21.15.173:6824/1421511819,v1:172.21.15.173:6825/1421511819] conn(0x7f6f30071d20 0x7f6f30074210 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:30.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.584+0000 7f6f41ffb640 1 -- 172.21.15.18:0/1621691445 <== osd.4 v2:172.21.15.173:6824/1421511819 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6f44014e50 con 0x7f6f30071d20 2024-04-17T19:54:30.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.596+0000 7f6f53629640 1 -- 172.21.15.18:0/1621691445 --> [v2:172.21.15.173:6824/1421511819,v1:172.21.15.173:6825/1421511819] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6f4c1572f0 con 0x7f6f30071d20 2024-04-17T19:54:30.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.596+0000 7f6f41ffb640 1 -- 172.21.15.18:0/1621691445 <== osd.4 v2:172.21.15.173:6824/1421511819 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f6f4c1572f0 con 0x7f6f30071d20 2024-04-17T19:54:30.594 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-17T19:54:30.594 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-17T19:54:30.594 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-17T19:54:30.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.596+0000 7f6f53629640 1 -- 172.21.15.18:0/1621691445 >> [v2:172.21.15.173:6824/1421511819,v1:172.21.15.173:6825/1421511819] conn(0x7f6f30071d20 msgr2=0x7f6f30074210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:30.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.596+0000 7f6f53629640 1 --2- 172.21.15.18:0/1621691445 >> [v2:172.21.15.173:6824/1421511819,v1:172.21.15.173:6825/1421511819] conn(0x7f6f30071d20 0x7f6f30074210 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:30.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.596+0000 7f6f53629640 1 -- 172.21.15.18:0/1621691445 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f6f300683b0 msgr2=0x7f6f3006a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:30.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.596+0000 7f6f53629640 1 --2- 172.21.15.18:0/1621691445 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f6f300683b0 0x7f6f3006a8c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c0b5f30 tx=0x7f6f48008040 comp rx=0 tx=0).stop 2024-04-17T19:54:30.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.596+0000 7f6f53629640 1 -- 172.21.15.18:0/1621691445 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f4c15ee50 msgr2=0x7f6f4c156d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:30.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.596+0000 7f6f53629640 1 --2- 172.21.15.18:0/1621691445 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f4c15ee50 0x7f6f4c156d30 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f6f4400c730 tx=0x7f6f4400cbf0 comp rx=0 tx=0).stop 2024-04-17T19:54:30.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.596+0000 7f6f51bc6640 1 -- 172.21.15.18:0/1621691445 reap_dead start 2024-04-17T19:54:30.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.596+0000 7f6f53629640 1 -- 172.21.15.18:0/1621691445 shutdown_connections 2024-04-17T19:54:30.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.596+0000 7f6f53629640 1 -- 172.21.15.18:0/1621691445 >> 172.21.15.18:0/1621691445 conn(0x7f6f4c072bb0 msgr2=0x7f6f4c158390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:30.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.596+0000 7f6f53629640 1 -- 172.21.15.18:0/1621691445 shutdown_connections 2024-04-17T19:54:30.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.596+0000 7f6f53629640 1 -- 172.21.15.18:0/1621691445 wait complete. 2024-04-17T19:54:30.612 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-17T19:54:30.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.752+0000 7f04976df640 1 Processor -- start 2024-04-17T19:54:30.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.752+0000 7f04976df640 1 -- start start 2024-04-17T19:54:30.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.752+0000 7f04976df640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f049015e1a0 0x7f04900ce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:30.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.752+0000 7f04976df640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f04900cef10 0x7f049015e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:30.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.752+0000 7f04976df640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f049015ee50 0x7f049006cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:30.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.752+0000 7f04976df640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f04900d0020 con 0x7f049015e1a0 2024-04-17T19:54:30.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.752+0000 7f04976df640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f04900cd930 con 0x7f04900cef10 2024-04-17T19:54:30.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.752+0000 7f04976df640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f04900cdc10 con 0x7f049015ee50 2024-04-17T19:54:30.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.752+0000 7f049547b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f049015e1a0 0x7f04900ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:30.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.752+0000 7f049547b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f049015e1a0 0x7f04900ce9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34324/0 (socket says 172.21.15.18:34324) 2024-04-17T19:54:30.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.752+0000 7f049547b640 1 -- 172.21.15.18:0/1093944805 learned_addr learned my addr 172.21.15.18:0/1093944805 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:30.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.752+0000 7f0494c7a640 1 --2- 172.21.15.18:0/1093944805 >> v2:172.21.15.173:3300/0 conn(0x7f04900cef10 0x7f049015e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:30.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.752+0000 7f0495c7c640 1 --2- 172.21.15.18:0/1093944805 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f049015ee50 0x7f049006cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:30.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.752+0000 7f049547b640 1 -- 172.21.15.18:0/1093944805 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f049015ee50 msgr2=0x7f049006cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:30.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.752+0000 7f049547b640 1 --2- 172.21.15.18:0/1093944805 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f049015ee50 0x7f049006cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:30.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.752+0000 7f049547b640 1 -- 172.21.15.18:0/1093944805 >> v2:172.21.15.173:3300/0 conn(0x7f04900cef10 msgr2=0x7f049015e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:30.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.752+0000 7f049547b640 1 --2- 172.21.15.18:0/1093944805 >> v2:172.21.15.173:3300/0 conn(0x7f04900cef10 0x7f049015e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:30.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.752+0000 7f049547b640 1 -- 172.21.15.18:0/1093944805 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04900cdef0 con 0x7f049015e1a0 2024-04-17T19:54:30.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.756+0000 7f049547b640 1 --2- 172.21.15.18:0/1093944805 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f049015e1a0 0x7f04900ce9d0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f04900b6110 tx=0x7f048c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23be1afa1cc2623a server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:30.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.756+0000 7f0487fff640 1 -- 172.21.15.18:0/1093944805 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f048c0b0070 con 0x7f049015e1a0 2024-04-17T19:54:30.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.756+0000 7f0487fff640 1 -- 172.21.15.18:0/1093944805 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f048c0ab600 con 0x7f049015e1a0 2024-04-17T19:54:30.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.756+0000 7f0487fff640 1 -- 172.21.15.18:0/1093944805 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f048c0ab9d0 con 0x7f049015e1a0 2024-04-17T19:54:30.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.756+0000 7f04976df640 1 -- 172.21.15.18:0/1093944805 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f049015e1a0 msgr2=0x7f04900ce9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:30.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.756+0000 7f04976df640 1 --2- 172.21.15.18:0/1093944805 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f049015e1a0 0x7f04900ce9d0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f04900b6110 tx=0x7f048c01c490 comp rx=0 tx=0).stop 2024-04-17T19:54:30.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.756+0000 7f04976df640 1 -- 172.21.15.18:0/1093944805 shutdown_connections 2024-04-17T19:54:30.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.756+0000 7f04976df640 1 --2- 172.21.15.18:0/1093944805 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f049015ee50 0x7f049006cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:30.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.756+0000 7f04976df640 1 --2- 172.21.15.18:0/1093944805 >> v2:172.21.15.173:3300/0 conn(0x7f04900cef10 0x7f049015e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:30.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.756+0000 7f04976df640 1 --2- 172.21.15.18:0/1093944805 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f049015e1a0 0x7f04900ce9d0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:30.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.756+0000 7f04976df640 1 -- 172.21.15.18:0/1093944805 >> 172.21.15.18:0/1093944805 conn(0x7f0490072bb0 msgr2=0x7f0490072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:30.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.756+0000 7f04976df640 1 -- 172.21.15.18:0/1093944805 shutdown_connections 2024-04-17T19:54:30.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.756+0000 7f04976df640 1 -- 172.21.15.18:0/1093944805 wait complete. 2024-04-17T19:54:30.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.760+0000 7f04976df640 1 Processor -- start 2024-04-17T19:54:30.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.760+0000 7f04976df640 1 -- start start 2024-04-17T19:54:30.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.760+0000 7f04976df640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f04900cef10 0x7f049014b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:30.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.760+0000 7f04976df640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f049015e1a0 0x7f049015a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:30.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.760+0000 7f04976df640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f049015ee50 0x7f049015a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:30.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.760+0000 7f04976df640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0490157b90 con 0x7f049015ee50 2024-04-17T19:54:30.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.760+0000 7f04976df640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0490157a10 con 0x7f049015e1a0 2024-04-17T19:54:30.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.760+0000 7f04976df640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f049006f0f0 con 0x7f04900cef10 2024-04-17T19:54:30.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.760+0000 7f0495c7c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f049015ee50 0x7f049015a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:30.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.760+0000 7f0495c7c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f049015ee50 0x7f049015a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34338/0 (socket says 172.21.15.18:34338) 2024-04-17T19:54:30.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.760+0000 7f0495c7c640 1 -- 172.21.15.18:0/621813718 learned_addr learned my addr 172.21.15.18:0/621813718 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:30.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.760+0000 7f0494c7a640 1 --2- 172.21.15.18:0/621813718 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f049015e1a0 0x7f049015a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:30.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.760+0000 7f049547b640 1 --2- 172.21.15.18:0/621813718 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f04900cef10 0x7f049014b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:30.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.760+0000 7f0495c7c640 1 -- 172.21.15.18:0/621813718 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f04900cef10 msgr2=0x7f049014b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:30.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.760+0000 7f0495c7c640 1 --2- 172.21.15.18:0/621813718 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f04900cef10 0x7f049014b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:30.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.760+0000 7f0495c7c640 1 -- 172.21.15.18:0/621813718 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f049015e1a0 msgr2=0x7f049015a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:30.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.760+0000 7f0495c7c640 1 --2- 172.21.15.18:0/621813718 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f049015e1a0 0x7f049015a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:30.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.760+0000 7f0495c7c640 1 -- 172.21.15.18:0/621813718 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04901f6bb0 con 0x7f049015ee50 2024-04-17T19:54:30.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.760+0000 7f0494c7a640 1 --2- 172.21.15.18:0/621813718 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f049015e1a0 0x7f049015a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:54:30.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.760+0000 7f049547b640 1 --2- 172.21.15.18:0/621813718 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f04900cef10 0x7f049014b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:54:30.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.760+0000 7f0495c7c640 1 --2- 172.21.15.18:0/621813718 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f049015ee50 0x7f049015a6a0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f0488007e90 tx=0x7f048800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:30.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.760+0000 7f0485ffb640 1 -- 172.21.15.18:0/621813718 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0488014420 con 0x7f049015ee50 2024-04-17T19:54:30.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.760+0000 7f0485ffb640 1 -- 172.21.15.18:0/621813718 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0488019070 con 0x7f049015ee50 2024-04-17T19:54:30.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.760+0000 7f04976df640 1 -- 172.21.15.18:0/621813718 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f049015c540 con 0x7f049015ee50 2024-04-17T19:54:30.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.760+0000 7f0485ffb640 1 -- 172.21.15.18:0/621813718 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0488014800 con 0x7f049015ee50 2024-04-17T19:54:30.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.760+0000 7f04976df640 1 -- 172.21.15.18:0/621813718 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f049014e8a0 con 0x7f049015ee50 2024-04-17T19:54:30.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.760+0000 7f04976df640 1 -- 172.21.15.18:0/621813718 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f049015c2a0 con 0x7f049015ee50 2024-04-17T19:54:30.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.764+0000 7f0485ffb640 1 -- 172.21.15.18:0/621813718 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f04880149a0 con 0x7f049015ee50 2024-04-17T19:54:30.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.764+0000 7f0485ffb640 1 --2- 172.21.15.18:0/621813718 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0474068380 0x7f047406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:30.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.764+0000 7f0485ffb640 1 -- 172.21.15.18:0/621813718 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7f0488087610 con 0x7f049015ee50 2024-04-17T19:54:30.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.764+0000 7f049547b640 1 --2- 172.21.15.18:0/621813718 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0474068380 0x7f047406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:30.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.764+0000 7f049547b640 1 --2- 172.21.15.18:0/621813718 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0474068380 0x7f047406a890 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f048c0ad000 tx=0x7f048c0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:30.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.768+0000 7f0485ffb640 1 -- 172.21.15.18:0/621813718 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f049015c2a0 con 0x7f049015ee50 2024-04-17T19:54:30.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.924+0000 7f04976df640 1 -- 172.21.15.18:0/621813718 --> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f049015ca60 con 0x7f0474068380 2024-04-17T19:54:30.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.924+0000 7f0485ffb640 1 -- 172.21.15.18:0/621813718 <== mgr.4104 v2:172.21.15.18:6832/751466605 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f049015ca60 con 0x7f0474068380 2024-04-17T19:54:30.923 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 4 to deep-scrub 2024-04-17T19:54:30.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.924+0000 7f04976df640 1 -- 172.21.15.18:0/621813718 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0474068380 msgr2=0x7f047406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:30.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.924+0000 7f04976df640 1 --2- 172.21.15.18:0/621813718 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0474068380 0x7f047406a890 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f048c0ad000 tx=0x7f048c0a6000 comp rx=0 tx=0).stop 2024-04-17T19:54:30.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.924+0000 7f04976df640 1 -- 172.21.15.18:0/621813718 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f049015ee50 msgr2=0x7f049015a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:30.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.924+0000 7f04976df640 1 --2- 172.21.15.18:0/621813718 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f049015ee50 0x7f049015a6a0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f0488007e90 tx=0x7f048800e4b0 comp rx=0 tx=0).stop 2024-04-17T19:54:30.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.928+0000 7f04976df640 1 -- 172.21.15.18:0/621813718 shutdown_connections 2024-04-17T19:54:30.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.928+0000 7f04976df640 1 --2- 172.21.15.18:0/621813718 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0474068380 0x7f047406a890 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:30.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.928+0000 7f04976df640 1 --2- 172.21.15.18:0/621813718 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f049015ee50 0x7f049015a6a0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:30.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.928+0000 7f04976df640 1 --2- 172.21.15.18:0/621813718 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f049015e1a0 0x7f049015a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:30.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.928+0000 7f04976df640 1 --2- 172.21.15.18:0/621813718 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f04900cef10 0x7f049014b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:30.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.928+0000 7f04976df640 1 -- 172.21.15.18:0/621813718 >> 172.21.15.18:0/621813718 conn(0x7f0490072bb0 msgr2=0x7f0490157d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:30.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.928+0000 7f04976df640 1 -- 172.21.15.18:0/621813718 shutdown_connections 2024-04-17T19:54:30.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:30.928+0000 7f04976df640 1 -- 172.21.15.18:0/621813718 wait complete. 2024-04-17T19:54:30.943 INFO:tasks.ceph:Scrubbing osd.5 2024-04-17T19:54:30.943 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-17T19:54:31.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.104+0000 7fb3db823640 1 Processor -- start 2024-04-17T19:54:31.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.104+0000 7fb3db823640 1 -- start start 2024-04-17T19:54:31.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.108+0000 7fb3db823640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb3d40cd4c0 0x7fb3d415cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:31.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.108+0000 7fb3db823640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb3d40d1720 0x7fb3d40d1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:31.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.108+0000 7fb3db823640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3d41610c0 con 0x7fb3d406f900 2024-04-17T19:54:31.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.108+0000 7fb3db823640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fb3d41613a0 con 0x7fb3d40d1720 2024-04-17T19:54:31.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.108+0000 7fb3db823640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fb3d4161680 con 0x7fb3d40cd4c0 2024-04-17T19:54:31.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.108+0000 7fb3d9dc0640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb3d40d1720 0x7fb3d40d1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:31.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.108+0000 7fb3d8dbe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fb3d406f900 0x7fb3d406fd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:44248/0 (socket says 172.21.15.18:44248) 2024-04-17T19:54:31.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.108+0000 7fb3d8dbe640 1 -- 172.21.15.18:0/4034690241 learned_addr learned my addr 172.21.15.18:0/4034690241 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:54:31.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.108+0000 7fb3d95bf640 1 --2- 172.21.15.18:0/4034690241 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb3d40cd4c0 0x7fb3d415cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:31.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.108+0000 7fb3d9dc0640 1 -- 172.21.15.18:0/4034690241 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb3d40cd4c0 msgr2=0x7fb3d415cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:31.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.108+0000 7fb3d9dc0640 1 --2- 172.21.15.18:0/4034690241 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb3d40cd4c0 0x7fb3d415cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:31.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.108+0000 7fb3d9dc0640 1 -- 172.21.15.18:0/4034690241 >> v1:172.21.15.18:6789/0 conn(0x7fb3d406f900 legacy=0x7fb3d406fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:31.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.108+0000 7fb3cbfff640 1 -- 172.21.15.18:0/4034690241 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1796831030 0 0) 0x7fb3d41610c0 con 0x7fb3d406f900 2024-04-17T19:54:31.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.108+0000 7fb3d9dc0640 1 -- 172.21.15.18:0/4034690241 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3d4161960 con 0x7fb3d40d1720 2024-04-17T19:54:31.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.112+0000 7fb3d9dc0640 1 --2- 172.21.15.18:0/4034690241 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3d40d1720 0x7fb3d40d1b30 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc0097c0 tx=0x7fb3cc01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=842e5c8feec6831b server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:31.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.112+0000 7fb3cbfff640 1 -- 172.21.15.18:0/4034690241 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc0ab5f0 con 0x7fb3d40d1720 2024-04-17T19:54:31.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.112+0000 7fb3cbfff640 1 -- 172.21.15.18:0/4034690241 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3cc0b0070 con 0x7fb3d40d1720 2024-04-17T19:54:31.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.112+0000 7fb3cbfff640 1 -- 172.21.15.18:0/4034690241 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc0ab9b0 con 0x7fb3d40d1720 2024-04-17T19:54:31.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.112+0000 7fb3db823640 1 -- 172.21.15.18:0/4034690241 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3d40d1720 msgr2=0x7fb3d40d1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:31.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.112+0000 7fb3db823640 1 --2- 172.21.15.18:0/4034690241 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3d40d1720 0x7fb3d40d1b30 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc0097c0 tx=0x7fb3cc01c410 comp rx=0 tx=0).stop 2024-04-17T19:54:31.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.112+0000 7fb3db823640 1 -- 172.21.15.18:0/4034690241 shutdown_connections 2024-04-17T19:54:31.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.112+0000 7fb3db823640 1 --2- 172.21.15.18:0/4034690241 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3d40d1720 0x7fb3d40d1b30 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:31.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.112+0000 7fb3db823640 1 --2- 172.21.15.18:0/4034690241 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb3d40cd4c0 0x7fb3d415cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:31.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.112+0000 7fb3db823640 1 -- 172.21.15.18:0/4034690241 >> 172.21.15.18:0/4034690241 conn(0x7fb3d40cf6e0 msgr2=0x7fb3d40cfaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:31.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.112+0000 7fb3db823640 1 -- 172.21.15.18:0/4034690241 shutdown_connections 2024-04-17T19:54:31.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.112+0000 7fb3db823640 1 -- 172.21.15.18:0/4034690241 wait complete. 2024-04-17T19:54:31.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.112+0000 7fb3db823640 1 Processor -- start 2024-04-17T19:54:31.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.112+0000 7fb3db823640 1 -- start start 2024-04-17T19:54:31.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.116+0000 7fb3db823640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3d406f900 0x7fb3d40b82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:31.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.116+0000 7fb3db823640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3d40cd4c0 0x7fb3d40b6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:31.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.116+0000 7fb3db823640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb3d40d1720 0x7fb3d40b6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:31.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.116+0000 7fb3db823640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d416a270 con 0x7fb3d40cd4c0 2024-04-17T19:54:31.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.116+0000 7fb3db823640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d416a0f0 con 0x7fb3d406f900 2024-04-17T19:54:31.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.116+0000 7fb3db823640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fb3d416a3f0 con 0x7fb3d40d1720 2024-04-17T19:54:31.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.116+0000 7fb3d8dbe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3d40cd4c0 0x7fb3d40b6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:31.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.116+0000 7fb3d8dbe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3d40cd4c0 0x7fb3d40b6430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34358/0 (socket says 172.21.15.18:34358) 2024-04-17T19:54:31.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.116+0000 7fb3d8dbe640 1 -- 172.21.15.18:0/373407528 learned_addr learned my addr 172.21.15.18:0/373407528 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:31.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.116+0000 7fb3d95bf640 1 --2- 172.21.15.18:0/373407528 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3d406f900 0x7fb3d40b82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:31.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.116+0000 7fb3d9dc0640 1 --2- 172.21.15.18:0/373407528 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb3d40d1720 0x7fb3d40b6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:31.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.116+0000 7fb3d8dbe640 1 -- 172.21.15.18:0/373407528 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb3d40d1720 msgr2=0x7fb3d40b6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:31.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.116+0000 7fb3d8dbe640 1 --2- 172.21.15.18:0/373407528 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb3d40d1720 0x7fb3d40b6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:31.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.116+0000 7fb3d8dbe640 1 -- 172.21.15.18:0/373407528 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3d406f900 msgr2=0x7fb3d40b82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:31.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.116+0000 7fb3d8dbe640 1 --2- 172.21.15.18:0/373407528 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3d406f900 0x7fb3d40b82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:31.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.116+0000 7fb3d8dbe640 1 -- 172.21.15.18:0/373407528 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3d40c79b0 con 0x7fb3d40cd4c0 2024-04-17T19:54:31.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.116+0000 7fb3d8dbe640 1 --2- 172.21.15.18:0/373407528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3d40cd4c0 0x7fb3d40b6430 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb3c400c450 tx=0x7fb3c400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:31.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.116+0000 7fb3c9ffb640 1 -- 172.21.15.18:0/373407528 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c4018070 con 0x7fb3d40cd4c0 2024-04-17T19:54:31.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.116+0000 7fb3c9ffb640 1 -- 172.21.15.18:0/373407528 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3c40074e0 con 0x7fb3d40cd4c0 2024-04-17T19:54:31.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.116+0000 7fb3c9ffb640 1 -- 172.21.15.18:0/373407528 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c40049f0 con 0x7fb3d40cd4c0 2024-04-17T19:54:31.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.116+0000 7fb3db823640 1 -- 172.21.15.18:0/373407528 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3d40c7c90 con 0x7fb3d40cd4c0 2024-04-17T19:54:31.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.116+0000 7fb3db823640 1 -- 172.21.15.18:0/373407528 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3d40c8250 con 0x7fb3d40cd4c0 2024-04-17T19:54:31.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.116+0000 7fb3db823640 1 -- 172.21.15.18:0/373407528 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb3d4069950 con 0x7fb3d40cd4c0 2024-04-17T19:54:31.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.120+0000 7fb3c9ffb640 1 -- 172.21.15.18:0/373407528 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb3c401b360 con 0x7fb3d40cd4c0 2024-04-17T19:54:31.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.120+0000 7fb3c9ffb640 1 --2- 172.21.15.18:0/373407528 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fb3b80683b0 0x7fb3b806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:31.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.120+0000 7fb3c9ffb640 1 -- 172.21.15.18:0/373407528 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7fb3c40862b0 con 0x7fb3d40cd4c0 2024-04-17T19:54:31.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.120+0000 7fb3d95bf640 1 --2- 172.21.15.18:0/373407528 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fb3b80683b0 0x7fb3b806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:31.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.120+0000 7fb3c9ffb640 1 --2- 172.21.15.18:0/373407528 >> [v2:172.21.15.173:6800/4221907702,v1:172.21.15.173:6801/4221907702] conn(0x7fb3b8071d10 0x7fb3b8074200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:31.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.120+0000 7fb3c9ffb640 1 -- 172.21.15.18:0/373407528 --> [v2:172.21.15.173:6800/4221907702,v1:172.21.15.173:6801/4221907702] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb3c4006e50 con 0x7fb3b8071d10 2024-04-17T19:54:31.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.120+0000 7fb3c9ffb640 1 -- 172.21.15.18:0/373407528 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb3c4086740 con 0x7fb3d40cd4c0 2024-04-17T19:54:31.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.120+0000 7fb3d95bf640 1 --2- 172.21.15.18:0/373407528 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fb3b80683b0 0x7fb3b806a8c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb3d0003fd0 tx=0x7fb3d00039a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:31.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.120+0000 7fb3d9dc0640 1 --2- 172.21.15.18:0/373407528 >> [v2:172.21.15.173:6800/4221907702,v1:172.21.15.173:6801/4221907702] conn(0x7fb3b8071d10 0x7fb3b8074200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:31.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.120+0000 7fb3d9dc0640 1 --2- 172.21.15.18:0/373407528 >> [v2:172.21.15.173:6800/4221907702,v1:172.21.15.173:6801/4221907702] conn(0x7fb3b8071d10 0x7fb3b8074200 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:31.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.120+0000 7fb3c9ffb640 1 -- 172.21.15.18:0/373407528 <== osd.5 v2:172.21.15.173:6800/4221907702 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb3c4006e50 con 0x7fb3b8071d10 2024-04-17T19:54:31.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.136+0000 7fb3db823640 1 -- 172.21.15.18:0/373407528 --> [v2:172.21.15.173:6800/4221907702,v1:172.21.15.173:6801/4221907702] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb3d40b6fd0 con 0x7fb3b8071d10 2024-04-17T19:54:31.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.136+0000 7fb3c9ffb640 1 -- 172.21.15.18:0/373407528 <== osd.5 v2:172.21.15.173:6800/4221907702 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb3d40b6fd0 con 0x7fb3b8071d10 2024-04-17T19:54:31.134 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-17T19:54:31.134 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-17T19:54:31.134 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-17T19:54:31.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.136+0000 7fb3db823640 1 -- 172.21.15.18:0/373407528 >> [v2:172.21.15.173:6800/4221907702,v1:172.21.15.173:6801/4221907702] conn(0x7fb3b8071d10 msgr2=0x7fb3b8074200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:31.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.136+0000 7fb3db823640 1 --2- 172.21.15.18:0/373407528 >> [v2:172.21.15.173:6800/4221907702,v1:172.21.15.173:6801/4221907702] conn(0x7fb3b8071d10 0x7fb3b8074200 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:31.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.136+0000 7fb3db823640 1 -- 172.21.15.18:0/373407528 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fb3b80683b0 msgr2=0x7fb3b806a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:31.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.136+0000 7fb3db823640 1 --2- 172.21.15.18:0/373407528 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fb3b80683b0 0x7fb3b806a8c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb3d0003fd0 tx=0x7fb3d00039a0 comp rx=0 tx=0).stop 2024-04-17T19:54:31.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.136+0000 7fb3db823640 1 -- 172.21.15.18:0/373407528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3d40cd4c0 msgr2=0x7fb3d40b6430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:31.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.136+0000 7fb3db823640 1 --2- 172.21.15.18:0/373407528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3d40cd4c0 0x7fb3d40b6430 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb3c400c450 tx=0x7fb3c400c910 comp rx=0 tx=0).stop 2024-04-17T19:54:31.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.136+0000 7fb3d9dc0640 1 -- 172.21.15.18:0/373407528 reap_dead start 2024-04-17T19:54:31.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.136+0000 7fb3db823640 1 -- 172.21.15.18:0/373407528 shutdown_connections 2024-04-17T19:54:31.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.136+0000 7fb3db823640 1 -- 172.21.15.18:0/373407528 >> 172.21.15.18:0/373407528 conn(0x7fb3d40cf6e0 msgr2=0x7fb3d415bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:31.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.136+0000 7fb3db823640 1 -- 172.21.15.18:0/373407528 shutdown_connections 2024-04-17T19:54:31.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.136+0000 7fb3db823640 1 -- 172.21.15.18:0/373407528 wait complete. 2024-04-17T19:54:31.153 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-17T19:54:31.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.300+0000 7f9d21978640 1 Processor -- start 2024-04-17T19:54:31.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.300+0000 7f9d21978640 1 -- start start 2024-04-17T19:54:31.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.304+0000 7f9d21978640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f9d1c0d3b80 0x7f9d1c0cff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:31.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.304+0000 7f9d21978640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9d1c0d0450 0x7f9d1c1631c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:31.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.304+0000 7f9d21978640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d1c0d0860 con 0x7f9d1c163700 2024-04-17T19:54:31.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.304+0000 7f9d21978640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f9d1c0d3f90 con 0x7f9d1c0d0450 2024-04-17T19:54:31.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.304+0000 7f9d21978640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f9d1c160be0 con 0x7f9d1c0d3b80 2024-04-17T19:54:31.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.304+0000 7f9d1b7fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f9d1c163700 0x7f9d1c06c1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:44254/0 (socket says 172.21.15.18:44254) 2024-04-17T19:54:31.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.304+0000 7f9d1b7fe640 1 -- 172.21.15.18:0/1021755052 learned_addr learned my addr 172.21.15.18:0/1021755052 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:54:31.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.304+0000 7f9d1a7fc640 1 --2- 172.21.15.18:0/1021755052 >> v2:172.21.15.18:3300/0 conn(0x7f9d1c0d0450 0x7f9d1c1631c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:31.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.304+0000 7f9d1affd640 1 --2- 172.21.15.18:0/1021755052 >> v2:172.21.15.173:3300/0 conn(0x7f9d1c0d3b80 0x7f9d1c0cff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:31.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.304+0000 7f9d19ffb640 1 -- 172.21.15.18:0/1021755052 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2083655954 0 0) 0x7f9d140014a0 con 0x7f9d1c163700 2024-04-17T19:54:31.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.304+0000 7f9d19ffb640 1 -- 172.21.15.18:0/1021755052 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d04003530 con 0x7f9d1c163700 2024-04-17T19:54:31.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.304+0000 7f9d1a7fc640 1 -- 172.21.15.18:0/1021755052 >> v2:172.21.15.173:3300/0 conn(0x7f9d1c0d3b80 msgr2=0x7f9d1c0cff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:31.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.304+0000 7f9d1a7fc640 1 --2- 172.21.15.18:0/1021755052 >> v2:172.21.15.173:3300/0 conn(0x7f9d1c0d3b80 0x7f9d1c0cff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:31.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.304+0000 7f9d1a7fc640 1 -- 172.21.15.18:0/1021755052 >> v1:172.21.15.18:6789/0 conn(0x7f9d1c163700 legacy=0x7f9d1c06c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:31.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.304+0000 7f9d1a7fc640 1 -- 172.21.15.18:0/1021755052 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d1c0d41b0 con 0x7f9d1c0d0450 2024-04-17T19:54:31.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.308+0000 7f9d1a7fc640 1 --2- 172.21.15.18:0/1021755052 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d1c0d0450 0x7f9d1c1631c0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c08d1c0 tx=0x7f9d1001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=169f2bfafd848069 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:31.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.308+0000 7f9d19ffb640 1 -- 172.21.15.18:0/1021755052 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d100b0070 con 0x7f9d1c0d0450 2024-04-17T19:54:31.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.308+0000 7f9d19ffb640 1 -- 172.21.15.18:0/1021755052 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d10004230 con 0x7f9d1c0d0450 2024-04-17T19:54:31.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.308+0000 7f9d19ffb640 1 -- 172.21.15.18:0/1021755052 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d10003620 con 0x7f9d1c0d0450 2024-04-17T19:54:31.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.308+0000 7f9d21978640 1 -- 172.21.15.18:0/1021755052 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d1c0d0450 msgr2=0x7f9d1c1631c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:31.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.308+0000 7f9d21978640 1 --2- 172.21.15.18:0/1021755052 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d1c0d0450 0x7f9d1c1631c0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c08d1c0 tx=0x7f9d1001c460 comp rx=0 tx=0).stop 2024-04-17T19:54:31.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.308+0000 7f9d21978640 1 -- 172.21.15.18:0/1021755052 shutdown_connections 2024-04-17T19:54:31.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.308+0000 7f9d21978640 1 --2- 172.21.15.18:0/1021755052 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d1c0d0450 0x7f9d1c1631c0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:31.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.308+0000 7f9d21978640 1 --2- 172.21.15.18:0/1021755052 >> v2:172.21.15.173:3300/0 conn(0x7f9d1c0d3b80 0x7f9d1c0cff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:31.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.308+0000 7f9d21978640 1 -- 172.21.15.18:0/1021755052 >> 172.21.15.18:0/1021755052 conn(0x7f9d1c0d4ed0 msgr2=0x7f9d1c0d52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:31.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.308+0000 7f9d21978640 1 -- 172.21.15.18:0/1021755052 shutdown_connections 2024-04-17T19:54:31.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.308+0000 7f9d21978640 1 -- 172.21.15.18:0/1021755052 wait complete. 2024-04-17T19:54:31.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.308+0000 7f9d21978640 1 Processor -- start 2024-04-17T19:54:31.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.308+0000 7f9d21978640 1 -- start start 2024-04-17T19:54:31.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.312+0000 7f9d21978640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d1c0d3b80 0x7f9d1c14c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:31.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.312+0000 7f9d21978640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d1c163700 0x7f9d1c15b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:31.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.312+0000 7f9d21978640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9d1c0cdce0 0x7f9d1c0ce0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:31.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.312+0000 7f9d21978640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9d1c15fdd0 con 0x7f9d1c163700 2024-04-17T19:54:31.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.312+0000 7f9d21978640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9d1c163f20 con 0x7f9d1c0d3b80 2024-04-17T19:54:31.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.312+0000 7f9d21978640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f9d1c15ff50 con 0x7f9d1c0cdce0 2024-04-17T19:54:31.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.312+0000 7f9d1a7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d1c163700 0x7f9d1c15b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:31.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.312+0000 7f9d1a7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d1c163700 0x7f9d1c15b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34382/0 (socket says 172.21.15.18:34382) 2024-04-17T19:54:31.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.312+0000 7f9d1a7fc640 1 -- 172.21.15.18:0/3730675162 learned_addr learned my addr 172.21.15.18:0/3730675162 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:31.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.312+0000 7f9d1affd640 1 --2- 172.21.15.18:0/3730675162 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d1c0d3b80 0x7f9d1c14c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:31.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.312+0000 7f9d1b7fe640 1 --2- 172.21.15.18:0/3730675162 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9d1c0cdce0 0x7f9d1c0ce0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:31.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.312+0000 7f9d1a7fc640 1 -- 172.21.15.18:0/3730675162 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9d1c0cdce0 msgr2=0x7f9d1c0ce0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:31.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.312+0000 7f9d1a7fc640 1 --2- 172.21.15.18:0/3730675162 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9d1c0cdce0 0x7f9d1c0ce0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:31.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.312+0000 7f9d1a7fc640 1 -- 172.21.15.18:0/3730675162 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d1c0d3b80 msgr2=0x7f9d1c14c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:31.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.312+0000 7f9d1a7fc640 1 --2- 172.21.15.18:0/3730675162 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d1c0d3b80 0x7f9d1c14c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:31.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.312+0000 7f9d1a7fc640 1 -- 172.21.15.18:0/3730675162 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d1c15f0f0 con 0x7f9d1c163700 2024-04-17T19:54:31.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.312+0000 7f9d1affd640 1 --2- 172.21.15.18:0/3730675162 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d1c0d3b80 0x7f9d1c14c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:54:31.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.312+0000 7f9d1b7fe640 1 --2- 172.21.15.18:0/3730675162 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9d1c0cdce0 0x7f9d1c0ce0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:54:31.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.312+0000 7f9d1a7fc640 1 --2- 172.21.15.18:0/3730675162 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d1c163700 0x7f9d1c15b0a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f9d1001c940 tx=0x7f9d10019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:31.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.312+0000 7f9d03fff640 1 -- 172.21.15.18:0/3730675162 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d100b0040 con 0x7f9d1c163700 2024-04-17T19:54:31.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.312+0000 7f9d03fff640 1 -- 172.21.15.18:0/3730675162 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d100bb070 con 0x7f9d1c163700 2024-04-17T19:54:31.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.312+0000 7f9d21978640 1 -- 172.21.15.18:0/3730675162 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d1c06f6c0 con 0x7f9d1c163700 2024-04-17T19:54:31.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.312+0000 7f9d03fff640 1 -- 172.21.15.18:0/3730675162 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d10006e20 con 0x7f9d1c163700 2024-04-17T19:54:31.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.312+0000 7f9d21978640 1 -- 172.21.15.18:0/3730675162 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d1c153110 con 0x7f9d1c163700 2024-04-17T19:54:31.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.312+0000 7f9d21978640 1 -- 172.21.15.18:0/3730675162 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d1c1532e0 con 0x7f9d1c163700 2024-04-17T19:54:31.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.312+0000 7f9d03fff640 1 -- 172.21.15.18:0/3730675162 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9d100b3070 con 0x7f9d1c163700 2024-04-17T19:54:31.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.312+0000 7f9d03fff640 1 --2- 172.21.15.18:0/3730675162 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f9d08068380 0x7f9d0806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:31.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.316+0000 7f9d03fff640 1 -- 172.21.15.18:0/3730675162 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7f9d10120a50 con 0x7f9d1c163700 2024-04-17T19:54:31.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.316+0000 7f9d1affd640 1 --2- 172.21.15.18:0/3730675162 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f9d08068380 0x7f9d0806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:31.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.316+0000 7f9d1affd640 1 --2- 172.21.15.18:0/3730675162 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f9d08068380 0x7f9d0806a890 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c0b7a90 tx=0x7f9d0c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:31.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.320+0000 7f9d03fff640 1 -- 172.21.15.18:0/3730675162 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9d1c1532e0 con 0x7f9d1c163700 2024-04-17T19:54:31.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.476+0000 7f9d21978640 1 -- 172.21.15.18:0/3730675162 --> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f9d1c069950 con 0x7f9d08068380 2024-04-17T19:54:31.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.476+0000 7f9d03fff640 1 -- 172.21.15.18:0/3730675162 <== mgr.4104 v2:172.21.15.18:6832/751466605 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f9d1c069950 con 0x7f9d08068380 2024-04-17T19:54:31.476 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 5 to deep-scrub 2024-04-17T19:54:31.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.480+0000 7f9d21978640 1 -- 172.21.15.18:0/3730675162 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f9d08068380 msgr2=0x7f9d0806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:31.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.480+0000 7f9d21978640 1 --2- 172.21.15.18:0/3730675162 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f9d08068380 0x7f9d0806a890 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c0b7a90 tx=0x7f9d0c008040 comp rx=0 tx=0).stop 2024-04-17T19:54:31.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.480+0000 7f9d21978640 1 -- 172.21.15.18:0/3730675162 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d1c163700 msgr2=0x7f9d1c15b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:31.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.480+0000 7f9d21978640 1 --2- 172.21.15.18:0/3730675162 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d1c163700 0x7f9d1c15b0a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f9d1001c940 tx=0x7f9d10019200 comp rx=0 tx=0).stop 2024-04-17T19:54:31.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.480+0000 7f9d21978640 1 -- 172.21.15.18:0/3730675162 shutdown_connections 2024-04-17T19:54:31.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.480+0000 7f9d21978640 1 --2- 172.21.15.18:0/3730675162 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f9d08068380 0x7f9d0806a890 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:31.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.480+0000 7f9d21978640 1 --2- 172.21.15.18:0/3730675162 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9d1c0cdce0 0x7f9d1c0ce0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:31.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.480+0000 7f9d21978640 1 --2- 172.21.15.18:0/3730675162 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d1c163700 0x7f9d1c15b0a0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:31.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.480+0000 7f9d21978640 1 --2- 172.21.15.18:0/3730675162 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d1c0d3b80 0x7f9d1c14c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:31.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.480+0000 7f9d21978640 1 -- 172.21.15.18:0/3730675162 >> 172.21.15.18:0/3730675162 conn(0x7f9d1c0d4ed0 msgr2=0x7f9d1c15e220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:31.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.480+0000 7f9d21978640 1 -- 172.21.15.18:0/3730675162 shutdown_connections 2024-04-17T19:54:31.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.480+0000 7f9d21978640 1 -- 172.21.15.18:0/3730675162 wait complete. 2024-04-17T19:54:31.496 INFO:tasks.ceph:Scrubbing osd.6 2024-04-17T19:54:31.497 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-17T19:54:31.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.640+0000 7f9175537640 1 Processor -- start 2024-04-17T19:54:31.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.640+0000 7f9175537640 1 -- start start 2024-04-17T19:54:31.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.644+0000 7f9175537640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f917015b810 0x7f91700cde90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:31.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.644+0000 7f9175537640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f91700cfb20 0x7f91700cff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:31.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.644+0000 7f9175537640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f917015f2c0 0x7f917015f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:31.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.644+0000 7f9175537640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f91700b5990 con 0x7f917015f2c0 2024-04-17T19:54:31.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.644+0000 7f9175537640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f91700b53d0 con 0x7f91700cfb20 2024-04-17T19:54:31.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.644+0000 7f9175537640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f91700b56b0 con 0x7f917015b810 2024-04-17T19:54:31.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.644+0000 7f916f7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f917015f2c0 0x7f917015f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:31.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.644+0000 7f916f7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f917015f2c0 0x7f917015f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34388/0 (socket says 172.21.15.18:34388) 2024-04-17T19:54:31.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.644+0000 7f916f7fe640 1 -- 172.21.15.18:0/1640633994 learned_addr learned my addr 172.21.15.18:0/1640633994 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:31.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.644+0000 7f91667fc640 1 --2- 172.21.15.18:0/1640633994 >> v2:172.21.15.173:3300/0 conn(0x7f91700cfb20 0x7f91700cff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:31.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.644+0000 7f916effd640 1 --2- 172.21.15.18:0/1640633994 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f917015b810 0x7f91700cde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:31.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.644+0000 7f916f7fe640 1 -- 172.21.15.18:0/1640633994 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f917015b810 msgr2=0x7f91700cde90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:31.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.644+0000 7f916f7fe640 1 --2- 172.21.15.18:0/1640633994 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f917015b810 0x7f91700cde90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:31.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.644+0000 7f916f7fe640 1 -- 172.21.15.18:0/1640633994 >> v2:172.21.15.173:3300/0 conn(0x7f91700cfb20 msgr2=0x7f91700cff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:31.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.644+0000 7f916f7fe640 1 --2- 172.21.15.18:0/1640633994 >> v2:172.21.15.173:3300/0 conn(0x7f91700cfb20 0x7f91700cff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:31.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.644+0000 7f916f7fe640 1 -- 172.21.15.18:0/1640633994 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f917006ea10 con 0x7f917015f2c0 2024-04-17T19:54:31.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.648+0000 7f916f7fe640 1 --2- 172.21.15.18:0/1640633994 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f917015f2c0 0x7f917015f6d0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f9170073b90 tx=0x7f916801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe6844f8e573f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:31.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.648+0000 7f916e7fc640 1 -- 172.21.15.18:0/1640633994 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91680a5670 con 0x7f917015f2c0 2024-04-17T19:54:31.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.648+0000 7f916e7fc640 1 -- 172.21.15.18:0/1640633994 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91680a5810 con 0x7f917015f2c0 2024-04-17T19:54:31.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.648+0000 7f916e7fc640 1 -- 172.21.15.18:0/1640633994 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91680a5be0 con 0x7f917015f2c0 2024-04-17T19:54:31.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.648+0000 7f9175537640 1 -- 172.21.15.18:0/1640633994 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f917015f2c0 msgr2=0x7f917015f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:31.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.648+0000 7f9175537640 1 --2- 172.21.15.18:0/1640633994 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f917015f2c0 0x7f917015f6d0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f9170073b90 tx=0x7f916801c960 comp rx=0 tx=0).stop 2024-04-17T19:54:31.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.648+0000 7f9175537640 1 -- 172.21.15.18:0/1640633994 shutdown_connections 2024-04-17T19:54:31.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.648+0000 7f9175537640 1 --2- 172.21.15.18:0/1640633994 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f917015f2c0 0x7f917015f6d0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:31.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.648+0000 7f9175537640 1 --2- 172.21.15.18:0/1640633994 >> v2:172.21.15.173:3300/0 conn(0x7f91700cfb20 0x7f91700cff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:31.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.648+0000 7f9175537640 1 --2- 172.21.15.18:0/1640633994 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f917015b810 0x7f91700cde90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:31.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.648+0000 7f9175537640 1 -- 172.21.15.18:0/1640633994 >> 172.21.15.18:0/1640633994 conn(0x7f9170072bb0 msgr2=0x7f9170072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:31.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.648+0000 7f9175537640 1 -- 172.21.15.18:0/1640633994 shutdown_connections 2024-04-17T19:54:31.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.648+0000 7f9175537640 1 -- 172.21.15.18:0/1640633994 wait complete. 2024-04-17T19:54:31.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.648+0000 7f9175537640 1 Processor -- start 2024-04-17T19:54:31.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.648+0000 7f9175537640 1 -- start start 2024-04-17T19:54:31.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.652+0000 7f9175537640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f91700cfb20 0x7f91701433d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:31.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.652+0000 7f9175537640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f917015b810 0x7f91701580c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:31.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.652+0000 7f9175537640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f917015f2c0 0x7f917014dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:31.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.652+0000 7f9175537640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f917006f0b0 con 0x7f917015b810 2024-04-17T19:54:31.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.652+0000 7f9175537640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f917006ef30 con 0x7f917015f2c0 2024-04-17T19:54:31.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.652+0000 7f9175537640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f917006f230 con 0x7f91700cfb20 2024-04-17T19:54:31.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.652+0000 7f91667fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f917015b810 0x7f91701580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:31.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.652+0000 7f91667fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f917015b810 0x7f91701580c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34404/0 (socket says 172.21.15.18:34404) 2024-04-17T19:54:31.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.652+0000 7f91667fc640 1 -- 172.21.15.18:0/4131838493 learned_addr learned my addr 172.21.15.18:0/4131838493 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:31.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.652+0000 7f916f7fe640 1 --2- 172.21.15.18:0/4131838493 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f917015f2c0 0x7f917014dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:31.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.652+0000 7f91667fc640 1 -- 172.21.15.18:0/4131838493 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f91700cfb20 msgr2=0x7f91701433d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:31.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.652+0000 7f91667fc640 1 --2- 172.21.15.18:0/4131838493 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f91700cfb20 0x7f91701433d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:31.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.652+0000 7f91667fc640 1 -- 172.21.15.18:0/4131838493 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f917015f2c0 msgr2=0x7f917014dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:31.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.652+0000 7f91667fc640 1 --2- 172.21.15.18:0/4131838493 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f917015f2c0 0x7f917014dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:31.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.652+0000 7f91667fc640 1 -- 172.21.15.18:0/4131838493 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f917015c660 con 0x7f917015b810 2024-04-17T19:54:31.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.652+0000 7f916f7fe640 1 --2- 172.21.15.18:0/4131838493 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f917015f2c0 0x7f917014dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:54:31.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.652+0000 7f91667fc640 1 --2- 172.21.15.18:0/4131838493 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f917015b810 0x7f91701580c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f915800d5e0 tx=0x7f915800daa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:31.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.652+0000 7f9167fff640 1 -- 172.21.15.18:0/4131838493 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9158018020 con 0x7f917015b810 2024-04-17T19:54:31.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.652+0000 7f9167fff640 1 -- 172.21.15.18:0/4131838493 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9158014620 con 0x7f917015b810 2024-04-17T19:54:31.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.652+0000 7f9167fff640 1 -- 172.21.15.18:0/4131838493 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91580149d0 con 0x7f917015b810 2024-04-17T19:54:31.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.652+0000 7f9175537640 1 -- 172.21.15.18:0/4131838493 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f917015c940 con 0x7f917015b810 2024-04-17T19:54:31.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.652+0000 7f9175537640 1 -- 172.21.15.18:0/4131838493 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f917015cf00 con 0x7f917015b810 2024-04-17T19:54:31.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.652+0000 7f9175537640 1 -- 172.21.15.18:0/4131838493 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9170069950 con 0x7f917015b810 2024-04-17T19:54:31.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.652+0000 7f9167fff640 1 -- 172.21.15.18:0/4131838493 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f915801b020 con 0x7f917015b810 2024-04-17T19:54:31.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.652+0000 7f9167fff640 1 --2- 172.21.15.18:0/4131838493 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f91500683b0 0x7f915006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:31.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.652+0000 7f9167fff640 1 -- 172.21.15.18:0/4131838493 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7f91580877b0 con 0x7f917015b810 2024-04-17T19:54:31.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.652+0000 7f916effd640 1 --2- 172.21.15.18:0/4131838493 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f91500683b0 0x7f915006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:31.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.652+0000 7f9167fff640 1 --2- 172.21.15.18:0/4131838493 >> [v2:172.21.15.173:6808/761678552,v1:172.21.15.173:6809/761678552] conn(0x7f9150071d10 0x7f9150074200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:31.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.652+0000 7f9167fff640 1 -- 172.21.15.18:0/4131838493 --> [v2:172.21.15.173:6808/761678552,v1:172.21.15.173:6809/761678552] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9158028e50 con 0x7f9150071d10 2024-04-17T19:54:31.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.652+0000 7f9167fff640 1 -- 172.21.15.18:0/4131838493 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9158087c40 con 0x7f917015b810 2024-04-17T19:54:31.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.652+0000 7f916effd640 1 --2- 172.21.15.18:0/4131838493 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f91500683b0 0x7f915006a8c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f91700afc10 tx=0x7f9160008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:31.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.656+0000 7f916f7fe640 1 --2- 172.21.15.18:0/4131838493 >> [v2:172.21.15.173:6808/761678552,v1:172.21.15.173:6809/761678552] conn(0x7f9150071d10 0x7f9150074200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:31.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.656+0000 7f916f7fe640 1 --2- 172.21.15.18:0/4131838493 >> [v2:172.21.15.173:6808/761678552,v1:172.21.15.173:6809/761678552] conn(0x7f9150071d10 0x7f9150074200 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:31.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.656+0000 7f9167fff640 1 -- 172.21.15.18:0/4131838493 <== osd.6 v2:172.21.15.173:6808/761678552 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9158028e50 con 0x7f9150071d10 2024-04-17T19:54:31.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.672+0000 7f9175537640 1 -- 172.21.15.18:0/4131838493 --> [v2:172.21.15.173:6808/761678552,v1:172.21.15.173:6809/761678552] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f917015c410 con 0x7f9150071d10 2024-04-17T19:54:31.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.672+0000 7f9167fff640 1 -- 172.21.15.18:0/4131838493 <== osd.6 v2:172.21.15.173:6808/761678552 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f917015c410 con 0x7f9150071d10 2024-04-17T19:54:31.669 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-17T19:54:31.670 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-17T19:54:31.670 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-17T19:54:31.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.672+0000 7f9175537640 1 -- 172.21.15.18:0/4131838493 >> [v2:172.21.15.173:6808/761678552,v1:172.21.15.173:6809/761678552] conn(0x7f9150071d10 msgr2=0x7f9150074200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:31.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.672+0000 7f9175537640 1 --2- 172.21.15.18:0/4131838493 >> [v2:172.21.15.173:6808/761678552,v1:172.21.15.173:6809/761678552] conn(0x7f9150071d10 0x7f9150074200 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:31.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.672+0000 7f9175537640 1 -- 172.21.15.18:0/4131838493 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f91500683b0 msgr2=0x7f915006a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:31.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.672+0000 7f9175537640 1 --2- 172.21.15.18:0/4131838493 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f91500683b0 0x7f915006a8c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f91700afc10 tx=0x7f9160008040 comp rx=0 tx=0).stop 2024-04-17T19:54:31.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.672+0000 7f9175537640 1 -- 172.21.15.18:0/4131838493 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f917015b810 msgr2=0x7f91701580c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:31.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.672+0000 7f9175537640 1 --2- 172.21.15.18:0/4131838493 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f917015b810 0x7f91701580c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f915800d5e0 tx=0x7f915800daa0 comp rx=0 tx=0).stop 2024-04-17T19:54:31.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.672+0000 7f916f7fe640 1 -- 172.21.15.18:0/4131838493 reap_dead start 2024-04-17T19:54:31.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.672+0000 7f9175537640 1 -- 172.21.15.18:0/4131838493 shutdown_connections 2024-04-17T19:54:31.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.672+0000 7f9175537640 1 -- 172.21.15.18:0/4131838493 >> 172.21.15.18:0/4131838493 conn(0x7f9170072bb0 msgr2=0x7f917015aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:31.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.672+0000 7f9175537640 1 -- 172.21.15.18:0/4131838493 shutdown_connections 2024-04-17T19:54:31.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.672+0000 7f9175537640 1 -- 172.21.15.18:0/4131838493 wait complete. 2024-04-17T19:54:31.687 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-17T19:54:31.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.828+0000 7fd00ec2c640 1 Processor -- start 2024-04-17T19:54:31.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.828+0000 7fd00ec2c640 1 -- start start 2024-04-17T19:54:31.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.828+0000 7fd00ec2c640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd00806ed50 0x7fd00809aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:31.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.828+0000 7fd00ec2c640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd0080b31a0 0x7fd00809afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:31.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.828+0000 7fd00ec2c640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0080b13d0 con 0x7fd0080aea10 2024-04-17T19:54:31.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.828+0000 7fd00ec2c640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7fd0080d1850 con 0x7fd00806ed50 2024-04-17T19:54:31.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.828+0000 7fd00ec2c640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fd0080d1aa0 con 0x7fd0080b31a0 2024-04-17T19:54:31.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.828+0000 7fcffffff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fd0080aea10 0x7fd008163080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:44260/0 (socket says 172.21.15.18:44260) 2024-04-17T19:54:31.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.828+0000 7fcffffff640 1 -- 172.21.15.18:0/540938703 learned_addr learned my addr 172.21.15.18:0/540938703 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:54:31.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.828+0000 7fd00d1c9640 1 --2- 172.21.15.18:0/540938703 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd0080b31a0 0x7fd00809afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:31.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.828+0000 7fd00c9c8640 1 --2- 172.21.15.18:0/540938703 >> v2:172.21.15.173:3300/0 conn(0x7fd00806ed50 0x7fd00809aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:31.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.828+0000 7fcfff7fe640 1 -- 172.21.15.18:0/540938703 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4169630643 0 0) 0x7fcff8001120 con 0x7fd0080aea10 2024-04-17T19:54:31.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.828+0000 7fcfff7fe640 1 -- 172.21.15.18:0/540938703 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcff0003530 con 0x7fd0080aea10 2024-04-17T19:54:31.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.828+0000 7fcfff7fe640 1 -- 172.21.15.18:0/540938703 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1715493365 0 0) 0x7fcff0003530 con 0x7fd0080aea10 2024-04-17T19:54:31.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.832+0000 7fcfff7fe640 1 -- 172.21.15.18:0/540938703 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd0080b31a0 msgr2=0x7fd00809afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:31.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.832+0000 7fcfff7fe640 1 --2- 172.21.15.18:0/540938703 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd0080b31a0 0x7fd00809afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:31.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.832+0000 7fcfff7fe640 1 -- 172.21.15.18:0/540938703 >> v2:172.21.15.173:3300/0 conn(0x7fd00806ed50 msgr2=0x7fd00809aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:31.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.832+0000 7fcfff7fe640 1 --2- 172.21.15.18:0/540938703 >> v2:172.21.15.173:3300/0 conn(0x7fd00806ed50 0x7fd00809aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:31.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.832+0000 7fcfff7fe640 1 -- 172.21.15.18:0/540938703 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0080d1d80 con 0x7fd0080aea10 2024-04-17T19:54:31.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.832+0000 7fcfff7fe640 1 -- 172.21.15.18:0/540938703 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3208559991 0 0) 0x7fcff8001850 con 0x7fd0080aea10 2024-04-17T19:54:31.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.832+0000 7fcfff7fe640 1 -- 172.21.15.18:0/540938703 >> v1:172.21.15.18:6789/0 conn(0x7fd0080aea10 legacy=0x7fd008163080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:31.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.832+0000 7fcfff7fe640 1 --2- 172.21.15.18:0/540938703 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcff00039c0 0x7fcff0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:31.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.832+0000 7fcfff7fe640 1 --2- 172.21.15.18:0/540938703 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcff0004810 0x7fcff0004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:31.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.832+0000 7fcfff7fe640 1 --2- 172.21.15.18:0/540938703 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd0080b31a0 0x7fcff0005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:31.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.832+0000 7fcfff7fe640 1 -- 172.21.15.18:0/540938703 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd0080d1850 con 0x7fcff0004810 2024-04-17T19:54:31.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.832+0000 7fcfff7fe640 1 -- 172.21.15.18:0/540938703 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd0080d1aa0 con 0x7fcff00039c0 2024-04-17T19:54:31.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.832+0000 7fcfff7fe640 1 -- 172.21.15.18:0/540938703 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fcff000b9d0 con 0x7fd0080b31a0 2024-04-17T19:54:31.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.832+0000 7fcffffff640 1 --2- 172.21.15.18:0/540938703 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcff0004810 0x7fcff0004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:31.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.832+0000 7fd00c9c8640 1 --2- 172.21.15.18:0/540938703 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcff00039c0 0x7fcff0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:31.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.832+0000 7fd00d1c9640 1 --2- 172.21.15.18:0/540938703 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd0080b31a0 0x7fcff0005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:31.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.832+0000 7fcffffff640 1 -- 172.21.15.18:0/540938703 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd0080b31a0 msgr2=0x7fcff0005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:31.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.832+0000 7fcffffff640 1 --2- 172.21.15.18:0/540938703 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd0080b31a0 0x7fcff0005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:31.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.832+0000 7fcffffff640 1 -- 172.21.15.18:0/540938703 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcff00039c0 msgr2=0x7fcff0003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:31.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.832+0000 7fcffffff640 1 --2- 172.21.15.18:0/540938703 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcff00039c0 0x7fcff0003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:31.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.832+0000 7fcffffff640 1 -- 172.21.15.18:0/540938703 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcff0003530 con 0x7fcff0004810 2024-04-17T19:54:31.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.832+0000 7fd00d1c9640 1 --2- 172.21.15.18:0/540938703 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd0080b31a0 0x7fcff0005160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:54:31.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.832+0000 7fcffffff640 1 --2- 172.21.15.18:0/540938703 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcff0004810 0x7fcff0004c20 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fcff800c4c0 tx=0x7fcff801f440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3844da197f82d4e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:31.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.832+0000 7fcfff7fe640 1 -- 172.21.15.18:0/540938703 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff800c0e0 con 0x7fcff0004810 2024-04-17T19:54:31.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.832+0000 7fcfff7fe640 1 -- 172.21.15.18:0/540938703 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcff8005b00 con 0x7fcff0004810 2024-04-17T19:54:31.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.832+0000 7fcfff7fe640 1 -- 172.21.15.18:0/540938703 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff8007070 con 0x7fcff0004810 2024-04-17T19:54:31.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.832+0000 7fd00ec2c640 1 -- 172.21.15.18:0/540938703 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcff0004810 msgr2=0x7fcff0004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:31.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.832+0000 7fd00ec2c640 1 --2- 172.21.15.18:0/540938703 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcff0004810 0x7fcff0004c20 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fcff800c4c0 tx=0x7fcff801f440 comp rx=0 tx=0).stop 2024-04-17T19:54:31.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.832+0000 7fd00d1c9640 1 -- 172.21.15.18:0/540938703 reap_dead start 2024-04-17T19:54:31.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.832+0000 7fd00ec2c640 1 -- 172.21.15.18:0/540938703 shutdown_connections 2024-04-17T19:54:31.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.832+0000 7fd00ec2c640 1 -- 172.21.15.18:0/540938703 >> 172.21.15.18:0/540938703 conn(0x7fd0080b6990 msgr2=0x7fd0080b6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:31.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.832+0000 7fd00ec2c640 1 -- 172.21.15.18:0/540938703 shutdown_connections 2024-04-17T19:54:31.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.832+0000 7fd00ec2c640 1 -- 172.21.15.18:0/540938703 wait complete. 2024-04-17T19:54:31.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.836+0000 7fd00ec2c640 1 Processor -- start 2024-04-17T19:54:31.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.836+0000 7fd00ec2c640 1 -- start start 2024-04-17T19:54:31.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.836+0000 7fd00ec2c640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcff0004810 0x7fd008140cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:31.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.836+0000 7fd00ec2c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd008143670 0x7fd008143a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:31.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.836+0000 7fd00ec2c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd00815dd10 0x7fd00815e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:31.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.836+0000 7fd00ec2c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd0080d2620 con 0x7fd00815dd10 2024-04-17T19:54:31.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.836+0000 7fd00ec2c640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd0080d2340 con 0x7fd008143670 2024-04-17T19:54:31.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.836+0000 7fd00ec2c640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fd00809afb0 con 0x7fcff0004810 2024-04-17T19:54:31.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.836+0000 7fd00d1c9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd00815dd10 0x7fd00815e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:31.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.836+0000 7fd00d1c9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd00815dd10 0x7fd00815e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34418/0 (socket says 172.21.15.18:34418) 2024-04-17T19:54:31.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.836+0000 7fd00d1c9640 1 -- 172.21.15.18:0/3080450313 learned_addr learned my addr 172.21.15.18:0/3080450313 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:31.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.836+0000 7fcffffff640 1 --2- 172.21.15.18:0/3080450313 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd008143670 0x7fd008143a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:31.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.836+0000 7fd00c9c8640 1 --2- 172.21.15.18:0/3080450313 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcff0004810 0x7fd008140cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:31.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.836+0000 7fd00d1c9640 1 -- 172.21.15.18:0/3080450313 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcff0004810 msgr2=0x7fd008140cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:31.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.836+0000 7fd00d1c9640 1 --2- 172.21.15.18:0/3080450313 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcff0004810 0x7fd008140cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:31.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.836+0000 7fd00d1c9640 1 -- 172.21.15.18:0/3080450313 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd008143670 msgr2=0x7fd008143a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:31.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.836+0000 7fd00d1c9640 1 --2- 172.21.15.18:0/3080450313 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd008143670 0x7fd008143a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:31.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.836+0000 7fd00d1c9640 1 -- 172.21.15.18:0/3080450313 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd00815e660 con 0x7fd00815dd10 2024-04-17T19:54:31.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.836+0000 7fd00c9c8640 1 --2- 172.21.15.18:0/3080450313 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcff0004810 0x7fd008140cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:54:31.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.836+0000 7fd00d1c9640 1 --2- 172.21.15.18:0/3080450313 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd00815dd10 0x7fd00815e120 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fd0080b7810 tx=0x7fd00000f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:31.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.836+0000 7fcffd7fa640 1 -- 172.21.15.18:0/3080450313 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd00001c070 con 0x7fd00815dd10 2024-04-17T19:54:31.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.836+0000 7fcffd7fa640 1 -- 172.21.15.18:0/3080450313 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd000017400 con 0x7fd00815dd10 2024-04-17T19:54:31.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.836+0000 7fcffd7fa640 1 -- 172.21.15.18:0/3080450313 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0000177d0 con 0x7fd00815dd10 2024-04-17T19:54:31.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.836+0000 7fd00ec2c640 1 -- 172.21.15.18:0/3080450313 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd008144430 con 0x7fd00815dd10 2024-04-17T19:54:31.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.836+0000 7fd00ec2c640 1 -- 172.21.15.18:0/3080450313 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0081f9900 con 0x7fd00815dd10 2024-04-17T19:54:31.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.840+0000 7fd00ec2c640 1 -- 172.21.15.18:0/3080450313 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0081441a0 con 0x7fd00815dd10 2024-04-17T19:54:31.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.840+0000 7fcffd7fa640 1 -- 172.21.15.18:0/3080450313 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd00001f070 con 0x7fd00815dd10 2024-04-17T19:54:31.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.840+0000 7fcffd7fa640 1 --2- 172.21.15.18:0/3080450313 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fcff40683b0 0x7fcff406a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:31.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.840+0000 7fcffd7fa640 1 -- 172.21.15.18:0/3080450313 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7fd000086e40 con 0x7fd00815dd10 2024-04-17T19:54:31.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.840+0000 7fd00c9c8640 1 --2- 172.21.15.18:0/3080450313 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fcff40683b0 0x7fcff406a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:31.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.840+0000 7fd00c9c8640 1 --2- 172.21.15.18:0/3080450313 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fcff40683b0 0x7fcff406a8c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd0040099a0 tx=0x7fd004008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:31.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:31.844+0000 7fcffd7fa640 1 -- 172.21.15.18:0/3080450313 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd00815e660 con 0x7fd00815dd10 2024-04-17T19:54:32.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.008+0000 7fd00ec2c640 1 -- 172.21.15.18:0/3080450313 --> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fd008069950 con 0x7fcff40683b0 2024-04-17T19:54:32.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.008+0000 7fcffd7fa640 1 -- 172.21.15.18:0/3080450313 <== mgr.4104 v2:172.21.15.18:6832/751466605 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd008069950 con 0x7fcff40683b0 2024-04-17T19:54:32.006 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 6 to deep-scrub 2024-04-17T19:54:32.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.008+0000 7fd00ec2c640 1 -- 172.21.15.18:0/3080450313 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fcff40683b0 msgr2=0x7fcff406a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:32.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.008+0000 7fd00ec2c640 1 --2- 172.21.15.18:0/3080450313 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fcff40683b0 0x7fcff406a8c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd0040099a0 tx=0x7fd004008040 comp rx=0 tx=0).stop 2024-04-17T19:54:32.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.008+0000 7fd00ec2c640 1 -- 172.21.15.18:0/3080450313 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd00815dd10 msgr2=0x7fd00815e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:32.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.008+0000 7fd00ec2c640 1 --2- 172.21.15.18:0/3080450313 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd00815dd10 0x7fd00815e120 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fd0080b7810 tx=0x7fd00000f4a0 comp rx=0 tx=0).stop 2024-04-17T19:54:32.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.008+0000 7fd00ec2c640 1 -- 172.21.15.18:0/3080450313 shutdown_connections 2024-04-17T19:54:32.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.008+0000 7fd00ec2c640 1 --2- 172.21.15.18:0/3080450313 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fcff40683b0 0x7fcff406a8c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:32.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.008+0000 7fd00ec2c640 1 --2- 172.21.15.18:0/3080450313 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd00815dd10 0x7fd00815e120 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:32.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.008+0000 7fd00ec2c640 1 --2- 172.21.15.18:0/3080450313 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd008143670 0x7fd008143a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:32.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.008+0000 7fd00ec2c640 1 --2- 172.21.15.18:0/3080450313 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcff0004810 0x7fd008140cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:32.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.008+0000 7fd00ec2c640 1 -- 172.21.15.18:0/3080450313 >> 172.21.15.18:0/3080450313 conn(0x7fd0080b6990 msgr2=0x7fd00806c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:32.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.008+0000 7fd00ec2c640 1 -- 172.21.15.18:0/3080450313 shutdown_connections 2024-04-17T19:54:32.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.008+0000 7fd00ec2c640 1 -- 172.21.15.18:0/3080450313 wait complete. 2024-04-17T19:54:32.028 INFO:tasks.ceph:Scrubbing osd.7 2024-04-17T19:54:32.028 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-17T19:54:32.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.176+0000 7fc69bf0e640 1 Processor -- start 2024-04-17T19:54:32.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.176+0000 7fc69bf0e640 1 -- start start 2024-04-17T19:54:32.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.180+0000 7fc69bf0e640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc69415e910 0x7fc69415ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:32.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.180+0000 7fc69bf0e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc69406cd60 0x7fc69406d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:32.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.180+0000 7fc69bf0e640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc69406d6b0 con 0x7fc69415e1a0 2024-04-17T19:54:32.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.180+0000 7fc69bf0e640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fc6940d0020 con 0x7fc69406cd60 2024-04-17T19:54:32.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.180+0000 7fc69bf0e640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fc6940cd930 con 0x7fc69415e910 2024-04-17T19:54:32.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.180+0000 7fc69a4ab640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc69406cd60 0x7fc69406d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:32.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.180+0000 7fc69a4ab640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc69406cd60 0x7fc69406d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34420/0 (socket says 172.21.15.18:34420) 2024-04-17T19:54:32.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.180+0000 7fc69a4ab640 1 -- 172.21.15.18:0/4035199186 learned_addr learned my addr 172.21.15.18:0/4035199186 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:32.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.180+0000 7fc6994a9640 1 --2- 172.21.15.18:0/4035199186 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc69415e910 0x7fc69415ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:32.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.180+0000 7fc69a4ab640 1 -- 172.21.15.18:0/4035199186 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc69415e910 msgr2=0x7fc69415ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:32.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.180+0000 7fc69a4ab640 1 --2- 172.21.15.18:0/4035199186 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc69415e910 0x7fc69415ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:32.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.180+0000 7fc69a4ab640 1 -- 172.21.15.18:0/4035199186 >> v1:172.21.15.173:6789/0 conn(0x7fc69415e1a0 legacy=0x7fc6940ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:32.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.180+0000 7fc69a4ab640 1 -- 172.21.15.18:0/4035199186 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6940cdc10 con 0x7fc69406cd60 2024-04-17T19:54:32.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.180+0000 7fc69a4ab640 1 --2- 172.21.15.18:0/4035199186 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc69406cd60 0x7fc69406d170 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fc68c009e50 tx=0x7fc68c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de948199554277ac server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:32.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.180+0000 7fc698ca8640 1 -- 172.21.15.18:0/4035199186 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc68c0a5750 con 0x7fc69406cd60 2024-04-17T19:54:32.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.180+0000 7fc698ca8640 1 -- 172.21.15.18:0/4035199186 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc68c0a58f0 con 0x7fc69406cd60 2024-04-17T19:54:32.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.180+0000 7fc698ca8640 1 -- 172.21.15.18:0/4035199186 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc68c0a5cc0 con 0x7fc69406cd60 2024-04-17T19:54:32.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.184+0000 7fc69bf0e640 1 -- 172.21.15.18:0/4035199186 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc69406cd60 msgr2=0x7fc69406d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:32.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.184+0000 7fc69bf0e640 1 --2- 172.21.15.18:0/4035199186 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc69406cd60 0x7fc69406d170 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fc68c009e50 tx=0x7fc68c01c9a0 comp rx=0 tx=0).stop 2024-04-17T19:54:32.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.184+0000 7fc69bf0e640 1 -- 172.21.15.18:0/4035199186 shutdown_connections 2024-04-17T19:54:32.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.184+0000 7fc69bf0e640 1 --2- 172.21.15.18:0/4035199186 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc69406cd60 0x7fc69406d170 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:32.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.184+0000 7fc69bf0e640 1 --2- 172.21.15.18:0/4035199186 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc69415e910 0x7fc69415ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:32.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.184+0000 7fc69bf0e640 1 -- 172.21.15.18:0/4035199186 >> 172.21.15.18:0/4035199186 conn(0x7fc694072bb0 msgr2=0x7fc694072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:32.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.184+0000 7fc69bf0e640 1 -- 172.21.15.18:0/4035199186 shutdown_connections 2024-04-17T19:54:32.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.184+0000 7fc69bf0e640 1 -- 172.21.15.18:0/4035199186 wait complete. 2024-04-17T19:54:32.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.184+0000 7fc69bf0e640 1 Processor -- start 2024-04-17T19:54:32.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.184+0000 7fc69bf0e640 1 -- start start 2024-04-17T19:54:32.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.184+0000 7fc69bf0e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc69406cd60 0x7fc6940aa150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:32.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.188+0000 7fc69bf0e640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc69415e1a0 0x7fc69415a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:32.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.188+0000 7fc69bf0e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc69415e910 0x7fc69414bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:32.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.188+0000 7fc69bf0e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc69415e730 con 0x7fc69415e910 2024-04-17T19:54:32.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.188+0000 7fc69bf0e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc69415e5b0 con 0x7fc69406cd60 2024-04-17T19:54:32.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.188+0000 7fc69bf0e640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fc6940cf0e0 con 0x7fc69415e1a0 2024-04-17T19:54:32.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.188+0000 7fc69a4ab640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc69415e910 0x7fc69414bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:32.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.188+0000 7fc69a4ab640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc69415e910 0x7fc69414bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34432/0 (socket says 172.21.15.18:34432) 2024-04-17T19:54:32.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.188+0000 7fc69a4ab640 1 -- 172.21.15.18:0/1604185901 learned_addr learned my addr 172.21.15.18:0/1604185901 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:32.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.188+0000 7fc699caa640 1 --2- 172.21.15.18:0/1604185901 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc69406cd60 0x7fc6940aa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:32.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.188+0000 7fc6994a9640 1 --2- 172.21.15.18:0/1604185901 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc69415e1a0 0x7fc69415a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:32.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.188+0000 7fc69a4ab640 1 -- 172.21.15.18:0/1604185901 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc69415e1a0 msgr2=0x7fc69415a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:32.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.188+0000 7fc69a4ab640 1 --2- 172.21.15.18:0/1604185901 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc69415e1a0 0x7fc69415a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:32.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.188+0000 7fc69a4ab640 1 -- 172.21.15.18:0/1604185901 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc69406cd60 msgr2=0x7fc6940aa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:32.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.188+0000 7fc69a4ab640 1 --2- 172.21.15.18:0/1604185901 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc69406cd60 0x7fc6940aa150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:32.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.188+0000 7fc69a4ab640 1 -- 172.21.15.18:0/1604185901 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc69415b080 con 0x7fc69415e910 2024-04-17T19:54:32.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.188+0000 7fc69a4ab640 1 --2- 172.21.15.18:0/1604185901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc69415e910 0x7fc69414bcb0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc68c009e50 tx=0x7fc68c019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:32.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.188+0000 7fc68a7fc640 1 -- 172.21.15.18:0/1604185901 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc68c0bc020 con 0x7fc69415e910 2024-04-17T19:54:32.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.188+0000 7fc68a7fc640 1 -- 172.21.15.18:0/1604185901 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc68c0b8670 con 0x7fc69415e910 2024-04-17T19:54:32.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.188+0000 7fc68a7fc640 1 -- 172.21.15.18:0/1604185901 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc68c0b8a60 con 0x7fc69415e910 2024-04-17T19:54:32.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.188+0000 7fc69bf0e640 1 -- 172.21.15.18:0/1604185901 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc694159880 con 0x7fc69415e910 2024-04-17T19:54:32.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.188+0000 7fc69bf0e640 1 -- 172.21.15.18:0/1604185901 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc694159b60 con 0x7fc69415e910 2024-04-17T19:54:32.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.188+0000 7fc69bf0e640 1 -- 172.21.15.18:0/1604185901 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc694069950 con 0x7fc69415e910 2024-04-17T19:54:32.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.188+0000 7fc68a7fc640 1 -- 172.21.15.18:0/1604185901 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc68c0bf020 con 0x7fc69415e910 2024-04-17T19:54:32.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.188+0000 7fc68a7fc640 1 --2- 172.21.15.18:0/1604185901 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fc678068380 0x7fc67806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:32.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.188+0000 7fc68a7fc640 1 -- 172.21.15.18:0/1604185901 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7fc68c1222e0 con 0x7fc69415e910 2024-04-17T19:54:32.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.188+0000 7fc699caa640 1 --2- 172.21.15.18:0/1604185901 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fc678068380 0x7fc67806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:32.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.188+0000 7fc68a7fc640 1 --2- 172.21.15.18:0/1604185901 >> [v2:172.21.15.173:6816/383724537,v1:172.21.15.173:6817/383724537] conn(0x7fc678071ce0 0x7fc6780741d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:32.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.188+0000 7fc68a7fc640 1 -- 172.21.15.18:0/1604185901 --> [v2:172.21.15.173:6816/383724537,v1:172.21.15.173:6817/383724537] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc6780748a0 con 0x7fc678071ce0 2024-04-17T19:54:32.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.188+0000 7fc68a7fc640 1 -- 172.21.15.18:0/1604185901 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc68c122770 con 0x7fc69415e910 2024-04-17T19:54:32.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.188+0000 7fc699caa640 1 --2- 172.21.15.18:0/1604185901 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fc678068380 0x7fc67806a890 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc6940b5f30 tx=0x7fc690009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:32.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.188+0000 7fc6994a9640 1 --2- 172.21.15.18:0/1604185901 >> [v2:172.21.15.173:6816/383724537,v1:172.21.15.173:6817/383724537] conn(0x7fc678071ce0 0x7fc6780741d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:32.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.192+0000 7fc6994a9640 1 --2- 172.21.15.18:0/1604185901 >> [v2:172.21.15.173:6816/383724537,v1:172.21.15.173:6817/383724537] conn(0x7fc678071ce0 0x7fc6780741d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:32.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.192+0000 7fc68a7fc640 1 -- 172.21.15.18:0/1604185901 <== osd.7 v2:172.21.15.173:6816/383724537 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc6780748a0 con 0x7fc678071ce0 2024-04-17T19:54:32.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.204+0000 7fc69bf0e640 1 -- 172.21.15.18:0/1604185901 --> [v2:172.21.15.173:6816/383724537,v1:172.21.15.173:6817/383724537] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc69414cc70 con 0x7fc678071ce0 2024-04-17T19:54:32.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.204+0000 7fc68a7fc640 1 -- 172.21.15.18:0/1604185901 <== osd.7 v2:172.21.15.173:6816/383724537 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc6840093e0 con 0x7fc678071ce0 2024-04-17T19:54:32.204 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-17T19:54:32.204 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-17T19:54:32.204 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-17T19:54:32.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.208+0000 7fc69bf0e640 1 -- 172.21.15.18:0/1604185901 >> [v2:172.21.15.173:6816/383724537,v1:172.21.15.173:6817/383724537] conn(0x7fc678071ce0 msgr2=0x7fc6780741d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:32.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.208+0000 7fc69bf0e640 1 --2- 172.21.15.18:0/1604185901 >> [v2:172.21.15.173:6816/383724537,v1:172.21.15.173:6817/383724537] conn(0x7fc678071ce0 0x7fc6780741d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:32.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.208+0000 7fc69bf0e640 1 -- 172.21.15.18:0/1604185901 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fc678068380 msgr2=0x7fc67806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:32.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.208+0000 7fc69bf0e640 1 --2- 172.21.15.18:0/1604185901 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fc678068380 0x7fc67806a890 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc6940b5f30 tx=0x7fc690009040 comp rx=0 tx=0).stop 2024-04-17T19:54:32.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.208+0000 7fc69bf0e640 1 -- 172.21.15.18:0/1604185901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc69415e910 msgr2=0x7fc69414bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:32.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.208+0000 7fc69bf0e640 1 --2- 172.21.15.18:0/1604185901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc69415e910 0x7fc69414bcb0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc68c009e50 tx=0x7fc68c019740 comp rx=0 tx=0).stop 2024-04-17T19:54:32.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.208+0000 7fc69a4ab640 1 -- 172.21.15.18:0/1604185901 reap_dead start 2024-04-17T19:54:32.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.208+0000 7fc69bf0e640 1 -- 172.21.15.18:0/1604185901 shutdown_connections 2024-04-17T19:54:32.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.208+0000 7fc69bf0e640 1 -- 172.21.15.18:0/1604185901 >> 172.21.15.18:0/1604185901 conn(0x7fc694072bb0 msgr2=0x7fc6940b0780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:32.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.208+0000 7fc69bf0e640 1 -- 172.21.15.18:0/1604185901 shutdown_connections 2024-04-17T19:54:32.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.208+0000 7fc69bf0e640 1 -- 172.21.15.18:0/1604185901 wait complete. 2024-04-17T19:54:32.222 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-17T19:54:32.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.368+0000 7f5af6343640 1 Processor -- start 2024-04-17T19:54:32.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.368+0000 7f5af6343640 1 -- start start 2024-04-17T19:54:32.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.372+0000 7f5af6343640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5af00cd260 0x7f5af016b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:32.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.372+0000 7f5af6343640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5af00cf180 con 0x7f5af00b6f60 2024-04-17T19:54:32.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.372+0000 7f5af6343640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5af00b33e0 con 0x7f5af00ced70 2024-04-17T19:54:32.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.372+0000 7f5af6343640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f5af00b2c70 con 0x7f5af00cd260 2024-04-17T19:54:32.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.372+0000 7f5af48e0640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5af00cd260 0x7f5af016b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:32.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.372+0000 7f5af48e0640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5af00cd260 0x7f5af016b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34440/0 (socket says 172.21.15.18:34440) 2024-04-17T19:54:32.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.372+0000 7f5af48e0640 1 -- 172.21.15.18:0/1084593156 learned_addr learned my addr 172.21.15.18:0/1084593156 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:32.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.372+0000 7f5aef7fe640 1 --1- 172.21.15.18:0/1084593156 >> v1:172.21.15.18:6789/0 conn(0x7f5af00b6f60 0x7f5af00ccb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:44272/0 (socket says 172.21.15.18:44272) 2024-04-17T19:54:32.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.372+0000 7f5af48e0640 1 -- 172.21.15.18:0/1084593156 >> v1:172.21.15.173:6789/0 conn(0x7f5af00ced70 legacy=0x7f5af00b6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:32.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.372+0000 7f5af48e0640 1 -- 172.21.15.18:0/1084593156 >> v1:172.21.15.18:6789/0 conn(0x7f5af00b6f60 legacy=0x7f5af00ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:32.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.372+0000 7f5af48e0640 1 -- 172.21.15.18:0/1084593156 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5af00b0db0 con 0x7f5af00cd260 2024-04-17T19:54:32.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.376+0000 7f5af48e0640 1 --2- 172.21.15.18:0/1084593156 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5af00cd260 0x7f5af016b1a0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8009e50 tx=0x7f5ae801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=869d09e2c5761898 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:32.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.376+0000 7f5aeeffd640 1 -- 172.21.15.18:0/1084593156 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae80a5720 con 0x7f5af00cd260 2024-04-17T19:54:32.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.376+0000 7f5aeeffd640 1 -- 172.21.15.18:0/1084593156 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ae80a58c0 con 0x7f5af00cd260 2024-04-17T19:54:32.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.376+0000 7f5aeeffd640 1 -- 172.21.15.18:0/1084593156 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae80a5c90 con 0x7f5af00cd260 2024-04-17T19:54:32.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.376+0000 7f5af6343640 1 -- 172.21.15.18:0/1084593156 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5af00cd260 msgr2=0x7f5af016b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:32.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.376+0000 7f5af6343640 1 --2- 172.21.15.18:0/1084593156 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5af00cd260 0x7f5af016b1a0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8009e50 tx=0x7f5ae801c8c0 comp rx=0 tx=0).stop 2024-04-17T19:54:32.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.376+0000 7f5af6343640 1 -- 172.21.15.18:0/1084593156 shutdown_connections 2024-04-17T19:54:32.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.376+0000 7f5af6343640 1 --2- 172.21.15.18:0/1084593156 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5af00cd260 0x7f5af016b1a0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:32.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.376+0000 7f5af6343640 1 -- 172.21.15.18:0/1084593156 >> 172.21.15.18:0/1084593156 conn(0x7f5af009aa70 msgr2=0x7f5af009ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:32.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.376+0000 7f5af6343640 1 -- 172.21.15.18:0/1084593156 shutdown_connections 2024-04-17T19:54:32.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.376+0000 7f5af6343640 1 -- 172.21.15.18:0/1084593156 wait complete. 2024-04-17T19:54:32.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.376+0000 7f5af6343640 1 Processor -- start 2024-04-17T19:54:32.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.376+0000 7f5af6343640 1 -- start start 2024-04-17T19:54:32.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.380+0000 7f5af6343640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5af00cd260 0x7f5af015de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:32.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.380+0000 7f5af6343640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5af00ced70 0x7f5af009dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:32.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.380+0000 7f5af6343640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5af009e190 0x7f5af009bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:32.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.380+0000 7f5af6343640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5af00b2ec0 con 0x7f5af009e190 2024-04-17T19:54:32.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.380+0000 7f5af6343640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5af00ce4d0 con 0x7f5af00cd260 2024-04-17T19:54:32.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.380+0000 7f5af6343640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f5af00d0c30 con 0x7f5af00ced70 2024-04-17T19:54:32.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.380+0000 7f5af48e0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5af009e190 0x7f5af009bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:32.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.380+0000 7f5af48e0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5af009e190 0x7f5af009bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34444/0 (socket says 172.21.15.18:34444) 2024-04-17T19:54:32.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.380+0000 7f5af48e0640 1 -- 172.21.15.18:0/1146444277 learned_addr learned my addr 172.21.15.18:0/1146444277 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:32.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.380+0000 7f5aeffff640 1 --2- 172.21.15.18:0/1146444277 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5af00cd260 0x7f5af015de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:32.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.380+0000 7f5aef7fe640 1 --2- 172.21.15.18:0/1146444277 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5af00ced70 0x7f5af009dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:32.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.380+0000 7f5af48e0640 1 -- 172.21.15.18:0/1146444277 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5af00ced70 msgr2=0x7f5af009dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:32.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.380+0000 7f5af48e0640 1 --2- 172.21.15.18:0/1146444277 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5af00ced70 0x7f5af009dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:32.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.380+0000 7f5af48e0640 1 -- 172.21.15.18:0/1146444277 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5af00cd260 msgr2=0x7f5af015de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:32.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.380+0000 7f5af48e0640 1 --2- 172.21.15.18:0/1146444277 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5af00cd260 0x7f5af015de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:32.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.380+0000 7f5af48e0640 1 -- 172.21.15.18:0/1146444277 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5af01f5cd0 con 0x7f5af009e190 2024-04-17T19:54:32.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.380+0000 7f5aef7fe640 1 --2- 172.21.15.18:0/1146444277 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5af00ced70 0x7f5af009dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:54:32.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.380+0000 7f5af48e0640 1 --2- 172.21.15.18:0/1146444277 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5af009e190 0x7f5af009bd90 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f5ae80af040 tx=0x7f5ae8019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:32.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.380+0000 7f5aecff9640 1 -- 172.21.15.18:0/1146444277 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae80a5720 con 0x7f5af009e190 2024-04-17T19:54:32.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.380+0000 7f5aecff9640 1 -- 172.21.15.18:0/1146444277 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ae80be070 con 0x7f5af009e190 2024-04-17T19:54:32.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.380+0000 7f5af6343640 1 -- 172.21.15.18:0/1146444277 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5af009e8a0 con 0x7f5af009e190 2024-04-17T19:54:32.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.380+0000 7f5aecff9640 1 -- 172.21.15.18:0/1146444277 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae8009510 con 0x7f5af009e190 2024-04-17T19:54:32.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.380+0000 7f5af6343640 1 -- 172.21.15.18:0/1146444277 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5af009ee60 con 0x7f5af009e190 2024-04-17T19:54:32.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.380+0000 7f5af6343640 1 -- 172.21.15.18:0/1146444277 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5af009e610 con 0x7f5af009e190 2024-04-17T19:54:32.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.384+0000 7f5aecff9640 1 -- 172.21.15.18:0/1146444277 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5ae80b8470 con 0x7f5af009e190 2024-04-17T19:54:32.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.384+0000 7f5aecff9640 1 --2- 172.21.15.18:0/1146444277 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f5adc068380 0x7f5adc06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:32.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.384+0000 7f5aecff9640 1 -- 172.21.15.18:0/1146444277 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7f5ae8122450 con 0x7f5af009e190 2024-04-17T19:54:32.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.384+0000 7f5aeffff640 1 --2- 172.21.15.18:0/1146444277 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f5adc068380 0x7f5adc06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:32.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.384+0000 7f5aeffff640 1 --2- 172.21.15.18:0/1146444277 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f5adc068380 0x7f5adc06a890 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0007fd0 tx=0x7f5ae0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:32.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.388+0000 7f5aecff9640 1 -- 172.21.15.18:0/1146444277 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5ae8016540 con 0x7f5af009e190 2024-04-17T19:54:32.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.552+0000 7f5af6343640 1 -- 172.21.15.18:0/1146444277 --> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f5af0069950 con 0x7f5adc068380 2024-04-17T19:54:32.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.552+0000 7f5aecff9640 1 -- 172.21.15.18:0/1146444277 <== mgr.4104 v2:172.21.15.18:6832/751466605 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5af0069950 con 0x7f5adc068380 2024-04-17T19:54:32.550 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 7 to deep-scrub 2024-04-17T19:54:32.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.552+0000 7f5af6343640 1 -- 172.21.15.18:0/1146444277 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f5adc068380 msgr2=0x7f5adc06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:32.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.552+0000 7f5af6343640 1 --2- 172.21.15.18:0/1146444277 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f5adc068380 0x7f5adc06a890 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0007fd0 tx=0x7f5ae0009040 comp rx=0 tx=0).stop 2024-04-17T19:54:32.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.552+0000 7f5af6343640 1 -- 172.21.15.18:0/1146444277 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5af009e190 msgr2=0x7f5af009bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:32.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.552+0000 7f5af6343640 1 --2- 172.21.15.18:0/1146444277 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5af009e190 0x7f5af009bd90 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f5ae80af040 tx=0x7f5ae8019660 comp rx=0 tx=0).stop 2024-04-17T19:54:32.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.552+0000 7f5af6343640 1 -- 172.21.15.18:0/1146444277 shutdown_connections 2024-04-17T19:54:32.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.552+0000 7f5af6343640 1 --2- 172.21.15.18:0/1146444277 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f5adc068380 0x7f5adc06a890 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:32.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.552+0000 7f5af6343640 1 --2- 172.21.15.18:0/1146444277 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5af009e190 0x7f5af009bd90 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:32.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.552+0000 7f5af6343640 1 --2- 172.21.15.18:0/1146444277 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5af00ced70 0x7f5af009dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:32.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.552+0000 7f5af6343640 1 --2- 172.21.15.18:0/1146444277 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5af00cd260 0x7f5af015de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:32.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.552+0000 7f5af6343640 1 -- 172.21.15.18:0/1146444277 >> 172.21.15.18:0/1146444277 conn(0x7f5af009aa70 msgr2=0x7f5af009ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:32.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.552+0000 7f5af6343640 1 -- 172.21.15.18:0/1146444277 shutdown_connections 2024-04-17T19:54:32.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.552+0000 7f5af6343640 1 -- 172.21.15.18:0/1146444277 wait complete. 2024-04-17T19:54:32.571 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T19:54:32.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.712+0000 7f1242758640 1 Processor -- start 2024-04-17T19:54:32.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.712+0000 7f1242758640 1 -- start start 2024-04-17T19:54:32.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.712+0000 7f1242758640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f123c0b6f60 0x7f123c0ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:32.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.712+0000 7f1242758640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f123c0cf180 con 0x7f123c0cd090 2024-04-17T19:54:32.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.712+0000 7f1242758640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f123c0b33e0 con 0x7f123c0ced70 2024-04-17T19:54:32.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.712+0000 7f1242758640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f123c0b2c70 con 0x7f123c0b6f60 2024-04-17T19:54:32.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.712+0000 7f1233fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f123c0b6f60 0x7f123c0ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:32.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.712+0000 7f1240cf5640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f123c0cd090 0x7f123c16a190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:44280/0 (socket says 172.21.15.18:44280) 2024-04-17T19:54:32.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.712+0000 7f1240cf5640 1 -- 172.21.15.18:0/3477138283 learned_addr learned my addr 172.21.15.18:0/3477138283 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:54:32.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.712+0000 7f1233fff640 1 -- 172.21.15.18:0/3477138283 >> v1:172.21.15.173:6789/0 conn(0x7f123c0ced70 legacy=0x7f123c0b6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:32.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.712+0000 7f1233fff640 1 -- 172.21.15.18:0/3477138283 >> v1:172.21.15.18:6789/0 conn(0x7f123c0cd090 legacy=0x7f123c16a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:32.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.712+0000 7f123b7fe640 1 -- 172.21.15.18:0/3477138283 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2676598374 0 0) 0x7f12340014a0 con 0x7f123c0cd090 2024-04-17T19:54:32.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.712+0000 7f1233fff640 1 -- 172.21.15.18:0/3477138283 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f123c0b0db0 con 0x7f123c0b6f60 2024-04-17T19:54:32.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.716+0000 7f1233fff640 1 --2- 172.21.15.18:0/3477138283 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f123c0b6f60 0x7f123c0ccb50 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f12240097c0 tx=0x7f122401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13633fb6644b23cb server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:32.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.716+0000 7f123b7fe640 1 -- 172.21.15.18:0/3477138283 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12240b0070 con 0x7f123c0b6f60 2024-04-17T19:54:32.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.716+0000 7f123b7fe640 1 -- 172.21.15.18:0/3477138283 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12240ab600 con 0x7f123c0b6f60 2024-04-17T19:54:32.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.716+0000 7f123b7fe640 1 -- 172.21.15.18:0/3477138283 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12240ab9d0 con 0x7f123c0b6f60 2024-04-17T19:54:32.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.716+0000 7f1242758640 1 -- 172.21.15.18:0/3477138283 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f123c0b6f60 msgr2=0x7f123c0ccb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:32.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.716+0000 7f1242758640 1 --2- 172.21.15.18:0/3477138283 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f123c0b6f60 0x7f123c0ccb50 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f12240097c0 tx=0x7f122401c4a0 comp rx=0 tx=0).stop 2024-04-17T19:54:32.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.716+0000 7f1242758640 1 -- 172.21.15.18:0/3477138283 shutdown_connections 2024-04-17T19:54:32.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.716+0000 7f1242758640 1 --2- 172.21.15.18:0/3477138283 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f123c0b6f60 0x7f123c0ccb50 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:32.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.716+0000 7f1242758640 1 -- 172.21.15.18:0/3477138283 >> 172.21.15.18:0/3477138283 conn(0x7f123c09aa70 msgr2=0x7f123c09ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:32.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.716+0000 7f1242758640 1 -- 172.21.15.18:0/3477138283 shutdown_connections 2024-04-17T19:54:32.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.716+0000 7f1242758640 1 -- 172.21.15.18:0/3477138283 wait complete. 2024-04-17T19:54:32.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.716+0000 7f1242758640 1 Processor -- start 2024-04-17T19:54:32.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.716+0000 7f1242758640 1 -- start start 2024-04-17T19:54:32.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.720+0000 7f1242758640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f123c0cd090 0x7f123c15a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:32.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.720+0000 7f1242758640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f123c0ced70 0x7f123c0af7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:32.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.720+0000 7f1242758640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f123c0afce0 0x7f123c15e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:32.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.720+0000 7f1242758640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f123c0d0c30 con 0x7f123c0ced70 2024-04-17T19:54:32.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.720+0000 7f1242758640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f123c0ce4d0 con 0x7f123c0afce0 2024-04-17T19:54:32.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.720+0000 7f1242758640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f123c0d0db0 con 0x7f123c0cd090 2024-04-17T19:54:32.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.720+0000 7f1233fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f123c0ced70 0x7f123c0af7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:32.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.720+0000 7f1233fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f123c0ced70 0x7f123c0af7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34452/0 (socket says 172.21.15.18:34452) 2024-04-17T19:54:32.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.720+0000 7f1233fff640 1 -- 172.21.15.18:0/3383652037 learned_addr learned my addr 172.21.15.18:0/3383652037 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:32.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.720+0000 7f1240cf5640 1 --2- 172.21.15.18:0/3383652037 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f123c0afce0 0x7f123c15e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:32.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.720+0000 7f123bfff640 1 --2- 172.21.15.18:0/3383652037 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f123c0cd090 0x7f123c15a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:32.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.720+0000 7f1233fff640 1 -- 172.21.15.18:0/3383652037 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f123c0cd090 msgr2=0x7f123c15a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:32.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.720+0000 7f1233fff640 1 --2- 172.21.15.18:0/3383652037 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f123c0cd090 0x7f123c15a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:32.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.720+0000 7f1233fff640 1 -- 172.21.15.18:0/3383652037 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f123c0afce0 msgr2=0x7f123c15e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:32.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.720+0000 7f1233fff640 1 --2- 172.21.15.18:0/3383652037 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f123c0afce0 0x7f123c15e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:32.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.720+0000 7f1233fff640 1 -- 172.21.15.18:0/3383652037 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f123c155650 con 0x7f123c0ced70 2024-04-17T19:54:32.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.720+0000 7f123bfff640 1 --2- 172.21.15.18:0/3383652037 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f123c0cd090 0x7f123c15a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:54:32.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.720+0000 7f1233fff640 1 --2- 172.21.15.18:0/3383652037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f123c0ced70 0x7f123c0af7a0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f12240097c0 tx=0x7f1224019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:32.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.720+0000 7f12397fa640 1 -- 172.21.15.18:0/3383652037 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12240b0040 con 0x7f123c0ced70 2024-04-17T19:54:32.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.720+0000 7f12397fa640 1 -- 172.21.15.18:0/3383652037 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12240b4410 con 0x7f123c0ced70 2024-04-17T19:54:32.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.720+0000 7f1242758640 1 -- 172.21.15.18:0/3383652037 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f123c15b3f0 con 0x7f123c0ced70 2024-04-17T19:54:32.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.720+0000 7f12397fa640 1 -- 172.21.15.18:0/3383652037 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12240b47e0 con 0x7f123c0ced70 2024-04-17T19:54:32.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.720+0000 7f1242758640 1 -- 172.21.15.18:0/3383652037 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f123c15b9b0 con 0x7f123c0ced70 2024-04-17T19:54:32.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.720+0000 7f1242758640 1 -- 172.21.15.18:0/3383652037 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f123c15b160 con 0x7f123c0ced70 2024-04-17T19:54:32.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.720+0000 7f12397fa640 1 -- 172.21.15.18:0/3383652037 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f12240bc020 con 0x7f123c0ced70 2024-04-17T19:54:32.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.720+0000 7f12397fa640 1 --2- 172.21.15.18:0/3383652037 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f121c068380 0x7f121c06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:32.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.724+0000 7f123bfff640 1 --2- 172.21.15.18:0/3383652037 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f121c068380 0x7f121c06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:32.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.724+0000 7f12397fa640 1 -- 172.21.15.18:0/3383652037 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7f1224120570 con 0x7f123c0ced70 2024-04-17T19:54:32.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.724+0000 7f123bfff640 1 --2- 172.21.15.18:0/3383652037 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f121c068380 0x7f121c06a890 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f122c000f70 tx=0x7f122c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:32.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.728+0000 7f12397fa640 1 -- 172.21.15.18:0/3383652037 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1224016090 con 0x7f123c0ced70 2024-04-17T19:54:32.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.880+0000 7f1242758640 1 -- 172.21.15.18:0/3383652037 --> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f123c069950 con 0x7f121c068380 2024-04-17T19:54:32.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.888+0000 7f12397fa640 1 -- 172.21.15.18:0/3383652037 <== mgr.4104 v2:172.21.15.18:6832/751466605 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+329128 (secure 0 0 0) 0x7f123c069950 con 0x7f121c068380 2024-04-17T19:54:32.891 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:54:32.893 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-17T19:54:32.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.896+0000 7f1242758640 1 -- 172.21.15.18:0/3383652037 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f121c068380 msgr2=0x7f121c06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:32.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.896+0000 7f1242758640 1 --2- 172.21.15.18:0/3383652037 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f121c068380 0x7f121c06a890 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f122c000f70 tx=0x7f122c009040 comp rx=0 tx=0).stop 2024-04-17T19:54:32.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.896+0000 7f1242758640 1 -- 172.21.15.18:0/3383652037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f123c0ced70 msgr2=0x7f123c0af7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:32.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.896+0000 7f1242758640 1 --2- 172.21.15.18:0/3383652037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f123c0ced70 0x7f123c0af7a0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f12240097c0 tx=0x7f1224019240 comp rx=0 tx=0).stop 2024-04-17T19:54:32.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.896+0000 7f1242758640 1 -- 172.21.15.18:0/3383652037 shutdown_connections 2024-04-17T19:54:32.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.896+0000 7f1242758640 1 --2- 172.21.15.18:0/3383652037 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f121c068380 0x7f121c06a890 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:32.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.896+0000 7f1242758640 1 --2- 172.21.15.18:0/3383652037 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f123c0afce0 0x7f123c15e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:32.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.896+0000 7f1242758640 1 --2- 172.21.15.18:0/3383652037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f123c0ced70 0x7f123c0af7a0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:32.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.896+0000 7f1242758640 1 --2- 172.21.15.18:0/3383652037 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f123c0cd090 0x7f123c15a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:32.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.896+0000 7f1242758640 1 -- 172.21.15.18:0/3383652037 >> 172.21.15.18:0/3383652037 conn(0x7f123c09aa70 msgr2=0x7f123c09ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:32.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.896+0000 7f1242758640 1 -- 172.21.15.18:0/3383652037 shutdown_connections 2024-04-17T19:54:32.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:32.896+0000 7f1242758640 1 -- 172.21.15.18:0/3383652037 wait complete. 2024-04-17T19:54:32.911 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2024-04-17T19:54:32.376216+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597336,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":219,"num_write_kb":2446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":175,"ondisk_log_size":175,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236416,"kb_used_data":3632,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738304,"statfs":{"total":773094113280,"available":772852023296,"internally_reserved":0,"allocated":3719168,"data_stored":2188528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":238276148},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004171"},"pg_stats":[{"pgid":"2.1f","version":"22'4","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.454872+0000","last_change":"2024-04-17T19:53:04.461184+0000","last_active":"2024-04-17T19:53:45.454872+0000","last_peered":"2024-04-17T19:53:45.454872+0000","last_clean":"2024-04-17T19:53:45.454872+0000","last_became_active":"2024-04-17T19:53:04.460006+0000","last_became_peered":"2024-04-17T19:53:04.460006+0000","last_unstale":"2024-04-17T19:53:45.454872+0000","last_undegraded":"2024-04-17T19:53:45.454872+0000","last_fullsized":"2024-04-17T19:53:45.454872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:31.604137+0000","last_change":"2024-04-17T19:54:31.604229+0000","last_active":"2024-04-17T19:54:31.604137+0000","last_peered":"2024-04-17T19:54:31.604137+0000","last_clean":"2024-04-17T19:54:31.604137+0000","last_became_active":"2024-04-17T19:53:05.467848+0000","last_became_peered":"2024-04-17T19:53:05.467848+0000","last_unstale":"2024-04-17T19:54:31.604137+0000","last_undegraded":"2024-04-17T19:54:31.604137+0000","last_fullsized":"2024-04-17T19:54:31.604137+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:31.603935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:31.603935+0000","last_clean_scrub_stamp":"2024-04-17T19:54:31.603935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:48:06.477508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.584776+0000","last_change":"2024-04-17T19:53:09.559397+0000","last_active":"2024-04-17T19:53:45.584776+0000","last_peered":"2024-04-17T19:53:45.584776+0000","last_clean":"2024-04-17T19:53:45.584776+0000","last_became_active":"2024-04-17T19:53:09.558504+0000","last_became_peered":"2024-04-17T19:53:09.558504+0000","last_unstale":"2024-04-17T19:53:45.584776+0000","last_undegraded":"2024-04-17T19:53:45.584776+0000","last_fullsized":"2024-04-17T19:53:45.584776+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:06:18.745394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.462060+0000","last_change":"2024-04-17T19:53:04.484961+0000","last_active":"2024-04-17T19:53:45.462060+0000","last_peered":"2024-04-17T19:53:45.462060+0000","last_clean":"2024-04-17T19:53:45.462060+0000","last_became_active":"2024-04-17T19:53:04.468291+0000","last_became_peered":"2024-04-17T19:53:04.468291+0000","last_unstale":"2024-04-17T19:53:45.462060+0000","last_undegraded":"2024-04-17T19:53:45.462060+0000","last_fullsized":"2024-04-17T19:53:45.462060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.460004+0000","last_change":"2024-04-17T19:53:05.475578+0000","last_active":"2024-04-17T19:53:45.460004+0000","last_peered":"2024-04-17T19:53:45.460004+0000","last_clean":"2024-04-17T19:53:45.460004+0000","last_became_active":"2024-04-17T19:53:05.473678+0000","last_became_peered":"2024-04-17T19:53:05.473678+0000","last_unstale":"2024-04-17T19:53:45.460004+0000","last_undegraded":"2024-04-17T19:53:45.460004+0000","last_fullsized":"2024-04-17T19:53:45.460004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.450003+0000","last_change":"2024-04-17T19:53:09.545180+0000","last_active":"2024-04-17T19:53:45.450003+0000","last_peered":"2024-04-17T19:53:45.450003+0000","last_clean":"2024-04-17T19:53:45.450003+0000","last_became_active":"2024-04-17T19:53:09.544580+0000","last_became_peered":"2024-04-17T19:53:09.544580+0000","last_unstale":"2024-04-17T19:53:45.450003+0000","last_undegraded":"2024-04-17T19:53:45.450003+0000","last_fullsized":"2024-04-17T19:53:45.450003+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.448839+0000","last_change":"2024-04-17T19:53:04.468009+0000","last_active":"2024-04-17T19:53:45.448839+0000","last_peered":"2024-04-17T19:53:45.448839+0000","last_clean":"2024-04-17T19:53:45.448839+0000","last_became_active":"2024-04-17T19:53:04.467568+0000","last_became_peered":"2024-04-17T19:53:04.467568+0000","last_unstale":"2024-04-17T19:53:45.448839+0000","last_undegraded":"2024-04-17T19:53:45.448839+0000","last_fullsized":"2024-04-17T19:53:45.448839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.580011+0000","last_change":"2024-04-17T19:53:05.464961+0000","last_active":"2024-04-17T19:53:45.580011+0000","last_peered":"2024-04-17T19:53:45.580011+0000","last_clean":"2024-04-17T19:53:45.580011+0000","last_became_active":"2024-04-17T19:53:05.464601+0000","last_became_peered":"2024-04-17T19:53:05.464601+0000","last_unstale":"2024-04-17T19:53:45.580011+0000","last_undegraded":"2024-04-17T19:53:45.580011+0000","last_fullsized":"2024-04-17T19:53:45.580011+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.450517+0000","last_change":"2024-04-17T19:53:09.529447+0000","last_active":"2024-04-17T19:53:45.450517+0000","last_peered":"2024-04-17T19:53:45.450517+0000","last_clean":"2024-04-17T19:53:45.450517+0000","last_became_active":"2024-04-17T19:53:09.528285+0000","last_became_peered":"2024-04-17T19:53:09.528285+0000","last_unstale":"2024-04-17T19:53:45.450517+0000","last_undegraded":"2024-04-17T19:53:45.450517+0000","last_fullsized":"2024-04-17T19:53:45.450517+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.448374+0000","last_change":"2024-04-17T19:53:04.467639+0000","last_active":"2024-04-17T19:53:45.448374+0000","last_peered":"2024-04-17T19:53:45.448374+0000","last_clean":"2024-04-17T19:53:45.448374+0000","last_became_active":"2024-04-17T19:53:04.467004+0000","last_became_peered":"2024-04-17T19:53:04.467004+0000","last_unstale":"2024-04-17T19:53:45.448374+0000","last_undegraded":"2024-04-17T19:53:45.448374+0000","last_fullsized":"2024-04-17T19:53:45.448374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:30.555341+0000","last_change":"2024-04-17T19:54:30.555364+0000","last_active":"2024-04-17T19:54:30.555341+0000","last_peered":"2024-04-17T19:54:30.555341+0000","last_clean":"2024-04-17T19:54:30.555341+0000","last_became_active":"2024-04-17T19:53:05.467217+0000","last_became_peered":"2024-04-17T19:53:05.467217+0000","last_unstale":"2024-04-17T19:54:30.555341+0000","last_undegraded":"2024-04-17T19:54:30.555341+0000","last_fullsized":"2024-04-17T19:54:30.555341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:30.555262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:30.555262+0000","last_clean_scrub_stamp":"2024-04-17T19:54:30.555262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:18:16.390951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.450166+0000","last_change":"2024-04-17T19:53:09.549722+0000","last_active":"2024-04-17T19:53:45.450166+0000","last_peered":"2024-04-17T19:53:45.450166+0000","last_clean":"2024-04-17T19:53:45.450166+0000","last_became_active":"2024-04-17T19:53:09.548876+0000","last_became_peered":"2024-04-17T19:53:09.548876+0000","last_unstale":"2024-04-17T19:53:45.450166+0000","last_undegraded":"2024-04-17T19:53:45.450166+0000","last_fullsized":"2024-04-17T19:53:45.450166+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.567169+0000","last_change":"2024-04-17T19:53:05.475996+0000","last_active":"2024-04-17T19:53:45.567169+0000","last_peered":"2024-04-17T19:53:45.567169+0000","last_clean":"2024-04-17T19:53:45.567169+0000","last_became_active":"2024-04-17T19:53:05.475517+0000","last_became_peered":"2024-04-17T19:53:05.475517+0000","last_unstale":"2024-04-17T19:53:45.567169+0000","last_undegraded":"2024-04-17T19:53:45.567169+0000","last_fullsized":"2024-04-17T19:53:45.567169+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.566584+0000","last_change":"2024-04-17T19:53:04.465884+0000","last_active":"2024-04-17T19:53:45.566584+0000","last_peered":"2024-04-17T19:53:45.566584+0000","last_clean":"2024-04-17T19:53:45.566584+0000","last_became_active":"2024-04-17T19:53:04.465108+0000","last_became_peered":"2024-04-17T19:53:04.465108+0000","last_unstale":"2024-04-17T19:53:45.566584+0000","last_undegraded":"2024-04-17T19:53:45.566584+0000","last_fullsized":"2024-04-17T19:53:45.566584+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.566693+0000","last_change":"2024-04-17T19:53:09.545287+0000","last_active":"2024-04-17T19:53:45.566693+0000","last_peered":"2024-04-17T19:53:45.566693+0000","last_clean":"2024-04-17T19:53:45.566693+0000","last_became_active":"2024-04-17T19:53:09.544328+0000","last_became_peered":"2024-04-17T19:53:09.544328+0000","last_unstale":"2024-04-17T19:53:45.566693+0000","last_undegraded":"2024-04-17T19:53:45.566693+0000","last_fullsized":"2024-04-17T19:53:45.566693+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.582177+0000","last_change":"2024-04-17T19:53:05.496585+0000","last_active":"2024-04-17T19:53:45.582177+0000","last_peered":"2024-04-17T19:53:45.582177+0000","last_clean":"2024-04-17T19:53:45.582177+0000","last_became_active":"2024-04-17T19:53:05.495800+0000","last_became_peered":"2024-04-17T19:53:05.495800+0000","last_unstale":"2024-04-17T19:53:45.582177+0000","last_undegraded":"2024-04-17T19:53:45.582177+0000","last_fullsized":"2024-04-17T19:53:45.582177+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:18:12.267644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452508+0000","last_change":"2024-04-17T19:53:04.479274+0000","last_active":"2024-04-17T19:53:45.452508+0000","last_peered":"2024-04-17T19:53:45.452508+0000","last_clean":"2024-04-17T19:53:45.452508+0000","last_became_active":"2024-04-17T19:53:04.478425+0000","last_became_peered":"2024-04-17T19:53:04.478425+0000","last_unstale":"2024-04-17T19:53:45.452508+0000","last_undegraded":"2024-04-17T19:53:45.452508+0000","last_fullsized":"2024-04-17T19:53:45.452508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:16:15.623557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.447932+0000","last_change":"2024-04-17T19:53:09.526995+0000","last_active":"2024-04-17T19:53:45.447932+0000","last_peered":"2024-04-17T19:53:45.447932+0000","last_clean":"2024-04-17T19:53:45.447932+0000","last_became_active":"2024-04-17T19:53:09.525577+0000","last_became_peered":"2024-04-17T19:53:09.525577+0000","last_unstale":"2024-04-17T19:53:45.447932+0000","last_undegraded":"2024-04-17T19:53:45.447932+0000","last_fullsized":"2024-04-17T19:53:45.447932+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452082+0000","last_change":"2024-04-17T19:53:05.463312+0000","last_active":"2024-04-17T19:53:45.452082+0000","last_peered":"2024-04-17T19:53:45.452082+0000","last_clean":"2024-04-17T19:53:45.452082+0000","last_became_active":"2024-04-17T19:53:05.462415+0000","last_became_peered":"2024-04-17T19:53:05.462415+0000","last_unstale":"2024-04-17T19:53:45.452082+0000","last_undegraded":"2024-04-17T19:53:45.452082+0000","last_fullsized":"2024-04-17T19:53:45.452082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.460180+0000","last_change":"2024-04-17T19:53:04.471150+0000","last_active":"2024-04-17T19:53:45.460180+0000","last_peered":"2024-04-17T19:53:45.460180+0000","last_clean":"2024-04-17T19:53:45.460180+0000","last_became_active":"2024-04-17T19:53:04.470258+0000","last_became_peered":"2024-04-17T19:53:04.470258+0000","last_unstale":"2024-04-17T19:53:45.460180+0000","last_undegraded":"2024-04-17T19:53:45.460180+0000","last_fullsized":"2024-04-17T19:53:45.460180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.587281+0000","last_change":"2024-04-17T19:53:09.565387+0000","last_active":"2024-04-17T19:53:45.587281+0000","last_peered":"2024-04-17T19:53:45.587281+0000","last_clean":"2024-04-17T19:53:45.587281+0000","last_became_active":"2024-04-17T19:53:09.564134+0000","last_became_peered":"2024-04-17T19:53:09.564134+0000","last_unstale":"2024-04-17T19:53:45.587281+0000","last_undegraded":"2024-04-17T19:53:45.587281+0000","last_fullsized":"2024-04-17T19:53:45.587281+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:21:01.809464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.565313+0000","last_change":"2024-04-17T19:53:05.468962+0000","last_active":"2024-04-17T19:53:45.565313+0000","last_peered":"2024-04-17T19:53:45.565313+0000","last_clean":"2024-04-17T19:53:45.565313+0000","last_became_active":"2024-04-17T19:53:05.466996+0000","last_became_peered":"2024-04-17T19:53:05.466996+0000","last_unstale":"2024-04-17T19:53:45.565313+0000","last_undegraded":"2024-04-17T19:53:45.565313+0000","last_fullsized":"2024-04-17T19:53:45.565313+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.446866+0000","last_change":"2024-04-17T19:53:04.472916+0000","last_active":"2024-04-17T19:53:45.446866+0000","last_peered":"2024-04-17T19:53:45.446866+0000","last_clean":"2024-04-17T19:53:45.446866+0000","last_became_active":"2024-04-17T19:53:04.468136+0000","last_became_peered":"2024-04-17T19:53:04.468136+0000","last_unstale":"2024-04-17T19:53:45.446866+0000","last_undegraded":"2024-04-17T19:53:45.446866+0000","last_fullsized":"2024-04-17T19:53:45.446866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.587927+0000","last_change":"2024-04-17T19:53:45.587217+0000","last_active":"2024-04-17T19:53:45.587927+0000","last_peered":"2024-04-17T19:53:45.587927+0000","last_clean":"2024-04-17T19:53:45.587927+0000","last_became_active":"2024-04-17T19:53:45.586731+0000","last_became_peered":"2024-04-17T19:53:45.586731+0000","last_unstale":"2024-04-17T19:53:45.587927+0000","last_undegraded":"2024-04-17T19:53:45.587927+0000","last_fullsized":"2024-04-17T19:53:45.587927+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,7],"acting":[2,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452895+0000","last_change":"2024-04-17T19:53:05.467799+0000","last_active":"2024-04-17T19:53:45.452895+0000","last_peered":"2024-04-17T19:53:45.452895+0000","last_clean":"2024-04-17T19:53:45.452895+0000","last_became_active":"2024-04-17T19:53:05.465048+0000","last_became_peered":"2024-04-17T19:53:05.465048+0000","last_unstale":"2024-04-17T19:53:45.452895+0000","last_undegraded":"2024-04-17T19:53:45.452895+0000","last_fullsized":"2024-04-17T19:53:45.452895+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.567187+0000","last_change":"2024-04-17T19:53:04.469594+0000","last_active":"2024-04-17T19:53:45.567187+0000","last_peered":"2024-04-17T19:53:45.567187+0000","last_clean":"2024-04-17T19:53:45.567187+0000","last_became_active":"2024-04-17T19:53:04.469119+0000","last_became_peered":"2024-04-17T19:53:04.469119+0000","last_unstale":"2024-04-17T19:53:45.567187+0000","last_undegraded":"2024-04-17T19:53:45.567187+0000","last_fullsized":"2024-04-17T19:53:45.567187+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.450497+0000","last_change":"2024-04-17T19:53:09.527277+0000","last_active":"2024-04-17T19:53:45.450497+0000","last_peered":"2024-04-17T19:53:45.450497+0000","last_clean":"2024-04-17T19:53:45.450497+0000","last_became_active":"2024-04-17T19:53:09.526436+0000","last_became_peered":"2024-04-17T19:53:09.526436+0000","last_unstale":"2024-04-17T19:53:45.450497+0000","last_undegraded":"2024-04-17T19:53:45.450497+0000","last_fullsized":"2024-04-17T19:53:45.450497+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.454276+0000","last_change":"2024-04-17T19:53:05.443712+0000","last_active":"2024-04-17T19:53:45.454276+0000","last_peered":"2024-04-17T19:53:45.454276+0000","last_clean":"2024-04-17T19:53:45.454276+0000","last_became_active":"2024-04-17T19:53:05.442881+0000","last_became_peered":"2024-04-17T19:53:05.442881+0000","last_unstale":"2024-04-17T19:53:45.454276+0000","last_undegraded":"2024-04-17T19:53:45.454276+0000","last_fullsized":"2024-04-17T19:53:45.454276+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.453531+0000","last_change":"2024-04-17T19:53:04.465717+0000","last_active":"2024-04-17T19:53:45.453531+0000","last_peered":"2024-04-17T19:53:45.453531+0000","last_clean":"2024-04-17T19:53:45.453531+0000","last_became_active":"2024-04-17T19:53:04.464701+0000","last_became_peered":"2024-04-17T19:53:04.464701+0000","last_unstale":"2024-04-17T19:53:45.453531+0000","last_undegraded":"2024-04-17T19:53:45.453531+0000","last_fullsized":"2024-04-17T19:53:45.453531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.456405+0000","last_change":"2024-04-17T19:53:09.530585+0000","last_active":"2024-04-17T19:53:45.456405+0000","last_peered":"2024-04-17T19:53:45.456405+0000","last_clean":"2024-04-17T19:53:45.456405+0000","last_became_active":"2024-04-17T19:53:09.529345+0000","last_became_peered":"2024-04-17T19:53:09.529345+0000","last_unstale":"2024-04-17T19:53:45.456405+0000","last_undegraded":"2024-04-17T19:53:45.456405+0000","last_fullsized":"2024-04-17T19:53:45.456405+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452698+0000","last_change":"2024-04-17T19:53:05.452177+0000","last_active":"2024-04-17T19:53:45.452698+0000","last_peered":"2024-04-17T19:53:45.452698+0000","last_clean":"2024-04-17T19:53:45.452698+0000","last_became_active":"2024-04-17T19:53:05.451272+0000","last_became_peered":"2024-04-17T19:53:05.451272+0000","last_unstale":"2024-04-17T19:53:45.452698+0000","last_undegraded":"2024-04-17T19:53:45.452698+0000","last_fullsized":"2024-04-17T19:53:45.452698+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:51:17.675125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.567122+0000","last_change":"2024-04-17T19:53:04.471944+0000","last_active":"2024-04-17T19:53:45.567122+0000","last_peered":"2024-04-17T19:53:45.567122+0000","last_clean":"2024-04-17T19:53:45.567122+0000","last_became_active":"2024-04-17T19:53:04.471458+0000","last_became_peered":"2024-04-17T19:53:04.471458+0000","last_unstale":"2024-04-17T19:53:45.567122+0000","last_undegraded":"2024-04-17T19:53:45.567122+0000","last_fullsized":"2024-04-17T19:53:45.567122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452001+0000","last_change":"2024-04-17T19:53:09.549998+0000","last_active":"2024-04-17T19:53:45.452001+0000","last_peered":"2024-04-17T19:53:45.452001+0000","last_clean":"2024-04-17T19:53:45.452001+0000","last_became_active":"2024-04-17T19:53:09.548136+0000","last_became_peered":"2024-04-17T19:53:09.548136+0000","last_unstale":"2024-04-17T19:53:45.452001+0000","last_undegraded":"2024-04-17T19:53:45.452001+0000","last_fullsized":"2024-04-17T19:53:45.452001+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:02:14.459968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.451757+0000","last_change":"2024-04-17T19:53:05.472884+0000","last_active":"2024-04-17T19:53:45.451757+0000","last_peered":"2024-04-17T19:53:45.451757+0000","last_clean":"2024-04-17T19:53:45.451757+0000","last_became_active":"2024-04-17T19:53:05.472513+0000","last_became_peered":"2024-04-17T19:53:05.472513+0000","last_unstale":"2024-04-17T19:53:45.451757+0000","last_undegraded":"2024-04-17T19:53:45.451757+0000","last_fullsized":"2024-04-17T19:53:45.451757+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.457788+0000","last_change":"2024-04-17T19:53:04.487713+0000","last_active":"2024-04-17T19:53:45.457788+0000","last_peered":"2024-04-17T19:53:45.457788+0000","last_clean":"2024-04-17T19:53:45.457788+0000","last_became_active":"2024-04-17T19:53:04.487005+0000","last_became_peered":"2024-04-17T19:53:04.487005+0000","last_unstale":"2024-04-17T19:53:45.457788+0000","last_undegraded":"2024-04-17T19:53:45.457788+0000","last_fullsized":"2024-04-17T19:53:45.457788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.451279+0000","last_change":"2024-04-17T19:53:09.547824+0000","last_active":"2024-04-17T19:53:45.451279+0000","last_peered":"2024-04-17T19:53:45.451279+0000","last_clean":"2024-04-17T19:53:45.451279+0000","last_became_active":"2024-04-17T19:53:09.545636+0000","last_became_peered":"2024-04-17T19:53:09.545636+0000","last_unstale":"2024-04-17T19:53:45.451279+0000","last_undegraded":"2024-04-17T19:53:45.451279+0000","last_fullsized":"2024-04-17T19:53:45.451279+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:06:17.885652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.447703+0000","last_change":"2024-04-17T19:53:05.465820+0000","last_active":"2024-04-17T19:53:45.447703+0000","last_peered":"2024-04-17T19:53:45.447703+0000","last_clean":"2024-04-17T19:53:45.447703+0000","last_became_active":"2024-04-17T19:53:05.464376+0000","last_became_peered":"2024-04-17T19:53:05.464376+0000","last_unstale":"2024-04-17T19:53:45.447703+0000","last_undegraded":"2024-04-17T19:53:45.447703+0000","last_fullsized":"2024-04-17T19:53:45.447703+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.567425+0000","last_change":"2024-04-17T19:53:04.464706+0000","last_active":"2024-04-17T19:53:45.567425+0000","last_peered":"2024-04-17T19:53:45.567425+0000","last_clean":"2024-04-17T19:53:45.567425+0000","last_became_active":"2024-04-17T19:53:04.464109+0000","last_became_peered":"2024-04-17T19:53:04.464109+0000","last_unstale":"2024-04-17T19:53:45.567425+0000","last_undegraded":"2024-04-17T19:53:45.567425+0000","last_fullsized":"2024-04-17T19:53:45.567425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452114+0000","last_change":"2024-04-17T19:53:09.553078+0000","last_active":"2024-04-17T19:53:45.452114+0000","last_peered":"2024-04-17T19:53:45.452114+0000","last_clean":"2024-04-17T19:53:45.452114+0000","last_became_active":"2024-04-17T19:53:09.548806+0000","last_became_peered":"2024-04-17T19:53:09.548806+0000","last_unstale":"2024-04-17T19:53:45.452114+0000","last_undegraded":"2024-04-17T19:53:45.452114+0000","last_fullsized":"2024-04-17T19:53:45.452114+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:33:37.250066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452646+0000","last_change":"2024-04-17T19:53:05.476631+0000","last_active":"2024-04-17T19:53:45.452646+0000","last_peered":"2024-04-17T19:53:45.452646+0000","last_clean":"2024-04-17T19:53:45.452646+0000","last_became_active":"2024-04-17T19:53:05.474164+0000","last_became_peered":"2024-04-17T19:53:05.474164+0000","last_unstale":"2024-04-17T19:53:45.452646+0000","last_undegraded":"2024-04-17T19:53:45.452646+0000","last_fullsized":"2024-04-17T19:53:45.452646+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.585125+0000","last_change":"2024-04-17T19:53:04.486117+0000","last_active":"2024-04-17T19:53:45.585125+0000","last_peered":"2024-04-17T19:53:45.585125+0000","last_clean":"2024-04-17T19:53:45.585125+0000","last_became_active":"2024-04-17T19:53:04.485424+0000","last_became_peered":"2024-04-17T19:53:04.485424+0000","last_unstale":"2024-04-17T19:53:45.585125+0000","last_undegraded":"2024-04-17T19:53:45.585125+0000","last_fullsized":"2024-04-17T19:53:45.585125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:21:45.875274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.457318+0000","last_change":"2024-04-17T19:53:09.549846+0000","last_active":"2024-04-17T19:53:45.457318+0000","last_peered":"2024-04-17T19:53:45.457318+0000","last_clean":"2024-04-17T19:53:45.457318+0000","last_became_active":"2024-04-17T19:53:09.548070+0000","last_became_peered":"2024-04-17T19:53:09.548070+0000","last_unstale":"2024-04-17T19:53:45.457318+0000","last_undegraded":"2024-04-17T19:53:45.457318+0000","last_fullsized":"2024-04-17T19:53:45.457318+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:57:05.469665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452883+0000","last_change":"2024-04-17T19:53:05.469993+0000","last_active":"2024-04-17T19:53:45.452883+0000","last_peered":"2024-04-17T19:53:45.452883+0000","last_clean":"2024-04-17T19:53:45.452883+0000","last_became_active":"2024-04-17T19:53:05.468241+0000","last_became_peered":"2024-04-17T19:53:05.468241+0000","last_unstale":"2024-04-17T19:53:45.452883+0000","last_undegraded":"2024-04-17T19:53:45.452883+0000","last_fullsized":"2024-04-17T19:53:45.452883+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:39:15.005822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.565143+0000","last_change":"2024-04-17T19:53:04.484259+0000","last_active":"2024-04-17T19:53:45.565143+0000","last_peered":"2024-04-17T19:53:45.565143+0000","last_clean":"2024-04-17T19:53:45.565143+0000","last_became_active":"2024-04-17T19:53:04.483882+0000","last_became_peered":"2024-04-17T19:53:04.483882+0000","last_unstale":"2024-04-17T19:53:45.565143+0000","last_undegraded":"2024-04-17T19:53:45.565143+0000","last_fullsized":"2024-04-17T19:53:45.565143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.460958+0000","last_change":"2024-04-17T19:53:09.559932+0000","last_active":"2024-04-17T19:53:45.460958+0000","last_peered":"2024-04-17T19:53:45.460958+0000","last_clean":"2024-04-17T19:53:45.460958+0000","last_became_active":"2024-04-17T19:53:09.558888+0000","last_became_peered":"2024-04-17T19:53:09.558888+0000","last_unstale":"2024-04-17T19:53:45.460958+0000","last_undegraded":"2024-04-17T19:53:45.460958+0000","last_fullsized":"2024-04-17T19:53:45.460958+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:31.105935+0000","last_change":"2024-04-17T19:54:31.106015+0000","last_active":"2024-04-17T19:54:31.105935+0000","last_peered":"2024-04-17T19:54:31.105935+0000","last_clean":"2024-04-17T19:54:31.105935+0000","last_became_active":"2024-04-17T19:53:05.462437+0000","last_became_peered":"2024-04-17T19:53:05.462437+0000","last_unstale":"2024-04-17T19:54:31.105935+0000","last_undegraded":"2024-04-17T19:54:31.105935+0000","last_fullsized":"2024-04-17T19:54:31.105935+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:31.105721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:31.105721+0000","last_clean_scrub_stamp":"2024-04-17T19:54:31.105721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:42:14.629660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.566647+0000","last_change":"2024-04-17T19:53:04.459172+0000","last_active":"2024-04-17T19:53:45.566647+0000","last_peered":"2024-04-17T19:53:45.566647+0000","last_clean":"2024-04-17T19:53:45.566647+0000","last_became_active":"2024-04-17T19:53:04.458798+0000","last_became_peered":"2024-04-17T19:53:04.458798+0000","last_unstale":"2024-04-17T19:53:45.566647+0000","last_undegraded":"2024-04-17T19:53:45.566647+0000","last_fullsized":"2024-04-17T19:53:45.566647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"29'119","reported_seq":192,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:29.935286+0000","last_change":"2024-04-17T19:54:29.935333+0000","last_active":"2024-04-17T19:54:29.935286+0000","last_peered":"2024-04-17T19:54:29.935286+0000","last_clean":"2024-04-17T19:54:29.935286+0000","last_became_active":"2024-04-17T19:52:54.649700+0000","last_became_peered":"2024-04-17T19:52:54.649700+0000","last_unstale":"2024-04-17T19:54:29.935286+0000","last_undegraded":"2024-04-17T19:54:29.935286+0000","last_fullsized":"2024-04-17T19:54:29.935286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'119","last_scrub_stamp":"2024-04-17T19:54:29.935174+0000","last_deep_scrub":"29'119","last_deep_scrub_stamp":"2024-04-17T19:54:29.935174+0000","last_clean_scrub_stamp":"2024-04-17T19:54:29.935174+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:43:19.897643+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:46.623394+0000","last_change":"2024-04-17T19:53:45.466468+0000","last_active":"2024-04-17T19:53:46.623394+0000","last_peered":"2024-04-17T19:53:46.623394+0000","last_clean":"2024-04-17T19:53:46.623394+0000","last_became_active":"2024-04-17T19:53:45.464724+0000","last_became_peered":"2024-04-17T19:53:45.464724+0000","last_unstale":"2024-04-17T19:53:46.623394+0000","last_undegraded":"2024-04-17T19:53:46.623394+0000","last_fullsized":"2024-04-17T19:53:46.623394+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,2,0],"acting":[4,5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.566965+0000","last_change":"2024-04-17T19:53:05.475968+0000","last_active":"2024-04-17T19:53:45.566965+0000","last_peered":"2024-04-17T19:53:45.566965+0000","last_clean":"2024-04-17T19:53:45.566965+0000","last_became_active":"2024-04-17T19:53:05.475600+0000","last_became_peered":"2024-04-17T19:53:05.475600+0000","last_unstale":"2024-04-17T19:53:45.566965+0000","last_undegraded":"2024-04-17T19:53:45.566965+0000","last_fullsized":"2024-04-17T19:53:45.566965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452962+0000","last_change":"2024-04-17T19:53:04.457214+0000","last_active":"2024-04-17T19:53:45.452962+0000","last_peered":"2024-04-17T19:53:45.452962+0000","last_clean":"2024-04-17T19:53:45.452962+0000","last_became_active":"2024-04-17T19:53:04.453473+0000","last_became_peered":"2024-04-17T19:53:04.453473+0000","last_unstale":"2024-04-17T19:53:45.452962+0000","last_undegraded":"2024-04-17T19:53:45.452962+0000","last_fullsized":"2024-04-17T19:53:45.452962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:14:03.008171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.450214+0000","last_change":"2024-04-17T19:53:09.548981+0000","last_active":"2024-04-17T19:53:45.450214+0000","last_peered":"2024-04-17T19:53:45.450214+0000","last_clean":"2024-04-17T19:53:45.450214+0000","last_became_active":"2024-04-17T19:53:09.548575+0000","last_became_peered":"2024-04-17T19:53:09.548575+0000","last_unstale":"2024-04-17T19:53:45.450214+0000","last_undegraded":"2024-04-17T19:53:45.450214+0000","last_fullsized":"2024-04-17T19:53:45.450214+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.448272+0000","last_change":"2024-04-17T19:53:05.464697+0000","last_active":"2024-04-17T19:53:45.448272+0000","last_peered":"2024-04-17T19:53:45.448272+0000","last_clean":"2024-04-17T19:53:45.448272+0000","last_became_active":"2024-04-17T19:53:05.463935+0000","last_became_peered":"2024-04-17T19:53:05.463935+0000","last_unstale":"2024-04-17T19:53:45.448272+0000","last_undegraded":"2024-04-17T19:53:45.448272+0000","last_fullsized":"2024-04-17T19:53:45.448272+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.461265+0000","last_change":"2024-04-17T19:53:04.475555+0000","last_active":"2024-04-17T19:53:45.461265+0000","last_peered":"2024-04-17T19:53:45.461265+0000","last_clean":"2024-04-17T19:53:45.461265+0000","last_became_active":"2024-04-17T19:53:04.467881+0000","last_became_peered":"2024-04-17T19:53:04.467881+0000","last_unstale":"2024-04-17T19:53:45.461265+0000","last_undegraded":"2024-04-17T19:53:45.461265+0000","last_fullsized":"2024-04-17T19:53:45.461265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.457373+0000","last_change":"2024-04-17T19:53:09.535560+0000","last_active":"2024-04-17T19:53:45.457373+0000","last_peered":"2024-04-17T19:53:45.457373+0000","last_clean":"2024-04-17T19:53:45.457373+0000","last_became_active":"2024-04-17T19:53:09.534631+0000","last_became_peered":"2024-04-17T19:53:09.534631+0000","last_unstale":"2024-04-17T19:53:45.457373+0000","last_undegraded":"2024-04-17T19:53:45.457373+0000","last_fullsized":"2024-04-17T19:53:45.457373+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:30.225908+0000","last_change":"2024-04-17T19:54:30.225930+0000","last_active":"2024-04-17T19:54:30.225908+0000","last_peered":"2024-04-17T19:54:30.225908+0000","last_clean":"2024-04-17T19:54:30.225908+0000","last_became_active":"2024-04-17T19:53:05.459941+0000","last_became_peered":"2024-04-17T19:53:05.459941+0000","last_unstale":"2024-04-17T19:54:30.225908+0000","last_undegraded":"2024-04-17T19:54:30.225908+0000","last_fullsized":"2024-04-17T19:54:30.225908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:30.225828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:30.225828+0000","last_clean_scrub_stamp":"2024-04-17T19:54:30.225828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:42:13.749766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.453193+0000","last_change":"2024-04-17T19:53:04.467765+0000","last_active":"2024-04-17T19:53:45.453193+0000","last_peered":"2024-04-17T19:53:45.453193+0000","last_clean":"2024-04-17T19:53:45.453193+0000","last_became_active":"2024-04-17T19:53:04.466753+0000","last_became_peered":"2024-04-17T19:53:04.466753+0000","last_unstale":"2024-04-17T19:53:45.453193+0000","last_undegraded":"2024-04-17T19:53:45.453193+0000","last_fullsized":"2024-04-17T19:53:45.453193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.564974+0000","last_change":"2024-04-17T19:53:09.519632+0000","last_active":"2024-04-17T19:53:45.564974+0000","last_peered":"2024-04-17T19:53:45.564974+0000","last_clean":"2024-04-17T19:53:45.564974+0000","last_became_active":"2024-04-17T19:53:09.518979+0000","last_became_peered":"2024-04-17T19:53:09.518979+0000","last_unstale":"2024-04-17T19:53:45.564974+0000","last_undegraded":"2024-04-17T19:53:45.564974+0000","last_fullsized":"2024-04-17T19:53:45.564974+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.451476+0000","last_change":"2024-04-17T19:53:05.464583+0000","last_active":"2024-04-17T19:53:45.451476+0000","last_peered":"2024-04-17T19:53:45.451476+0000","last_clean":"2024-04-17T19:53:45.451476+0000","last_became_active":"2024-04-17T19:53:05.464158+0000","last_became_peered":"2024-04-17T19:53:05.464158+0000","last_unstale":"2024-04-17T19:53:45.451476+0000","last_undegraded":"2024-04-17T19:53:45.451476+0000","last_fullsized":"2024-04-17T19:53:45.451476+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.449399+0000","last_change":"2024-04-17T19:53:04.477502+0000","last_active":"2024-04-17T19:53:45.449399+0000","last_peered":"2024-04-17T19:53:45.449399+0000","last_clean":"2024-04-17T19:53:45.449399+0000","last_became_active":"2024-04-17T19:53:04.477162+0000","last_became_peered":"2024-04-17T19:53:04.477162+0000","last_unstale":"2024-04-17T19:53:45.449399+0000","last_undegraded":"2024-04-17T19:53:45.449399+0000","last_fullsized":"2024-04-17T19:53:45.449399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.580377+0000","last_change":"2024-04-17T19:53:09.533476+0000","last_active":"2024-04-17T19:53:45.580377+0000","last_peered":"2024-04-17T19:53:45.580377+0000","last_clean":"2024-04-17T19:53:45.580377+0000","last_became_active":"2024-04-17T19:53:09.532715+0000","last_became_peered":"2024-04-17T19:53:09.532715+0000","last_unstale":"2024-04-17T19:53:45.580377+0000","last_undegraded":"2024-04-17T19:53:45.580377+0000","last_fullsized":"2024-04-17T19:53:45.580377+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.564923+0000","last_change":"2024-04-17T19:53:05.473330+0000","last_active":"2024-04-17T19:53:45.564923+0000","last_peered":"2024-04-17T19:53:45.564923+0000","last_clean":"2024-04-17T19:53:45.564923+0000","last_became_active":"2024-04-17T19:53:05.468223+0000","last_became_peered":"2024-04-17T19:53:05.468223+0000","last_unstale":"2024-04-17T19:53:45.564923+0000","last_undegraded":"2024-04-17T19:53:45.564923+0000","last_fullsized":"2024-04-17T19:53:45.564923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452438+0000","last_change":"2024-04-17T19:53:04.461896+0000","last_active":"2024-04-17T19:53:45.452438+0000","last_peered":"2024-04-17T19:53:45.452438+0000","last_clean":"2024-04-17T19:53:45.452438+0000","last_became_active":"2024-04-17T19:53:04.460919+0000","last_became_peered":"2024-04-17T19:53:04.460919+0000","last_unstale":"2024-04-17T19:53:45.452438+0000","last_undegraded":"2024-04-17T19:53:45.452438+0000","last_fullsized":"2024-04-17T19:53:45.452438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.461314+0000","last_change":"2024-04-17T19:53:09.547397+0000","last_active":"2024-04-17T19:53:45.461314+0000","last_peered":"2024-04-17T19:53:45.461314+0000","last_clean":"2024-04-17T19:53:45.461314+0000","last_became_active":"2024-04-17T19:53:09.546048+0000","last_became_peered":"2024-04-17T19:53:09.546048+0000","last_unstale":"2024-04-17T19:53:45.461314+0000","last_undegraded":"2024-04-17T19:53:45.461314+0000","last_fullsized":"2024-04-17T19:53:45.461314+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.579974+0000","last_change":"2024-04-17T19:53:05.474322+0000","last_active":"2024-04-17T19:53:45.579974+0000","last_peered":"2024-04-17T19:53:45.579974+0000","last_clean":"2024-04-17T19:53:45.579974+0000","last_became_active":"2024-04-17T19:53:05.473892+0000","last_became_peered":"2024-04-17T19:53:05.473892+0000","last_unstale":"2024-04-17T19:53:45.579974+0000","last_undegraded":"2024-04-17T19:53:45.579974+0000","last_fullsized":"2024-04-17T19:53:45.579974+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:31.249500+0000","last_change":"2024-04-17T19:54:31.249622+0000","last_active":"2024-04-17T19:54:31.249500+0000","last_peered":"2024-04-17T19:54:31.249500+0000","last_clean":"2024-04-17T19:54:31.249500+0000","last_became_active":"2024-04-17T19:53:04.459663+0000","last_became_peered":"2024-04-17T19:53:04.459663+0000","last_unstale":"2024-04-17T19:54:31.249500+0000","last_undegraded":"2024-04-17T19:54:31.249500+0000","last_fullsized":"2024-04-17T19:54:31.249500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:31.249225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:31.249225+0000","last_clean_scrub_stamp":"2024-04-17T19:54:31.249225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:48:06.122798+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.459754+0000","last_change":"2024-04-17T19:53:09.533802+0000","last_active":"2024-04-17T19:53:45.459754+0000","last_peered":"2024-04-17T19:53:45.459754+0000","last_clean":"2024-04-17T19:53:45.459754+0000","last_became_active":"2024-04-17T19:53:09.532504+0000","last_became_peered":"2024-04-17T19:53:09.532504+0000","last_unstale":"2024-04-17T19:53:45.459754+0000","last_undegraded":"2024-04-17T19:53:45.459754+0000","last_fullsized":"2024-04-17T19:53:45.459754+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.566396+0000","last_change":"2024-04-17T19:53:05.467855+0000","last_active":"2024-04-17T19:53:45.566396+0000","last_peered":"2024-04-17T19:53:45.566396+0000","last_clean":"2024-04-17T19:53:45.566396+0000","last_became_active":"2024-04-17T19:53:05.467349+0000","last_became_peered":"2024-04-17T19:53:05.467349+0000","last_unstale":"2024-04-17T19:53:45.566396+0000","last_undegraded":"2024-04-17T19:53:45.566396+0000","last_fullsized":"2024-04-17T19:53:45.566396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.567311+0000","last_change":"2024-04-17T19:53:04.465826+0000","last_active":"2024-04-17T19:53:45.567311+0000","last_peered":"2024-04-17T19:53:45.567311+0000","last_clean":"2024-04-17T19:53:45.567311+0000","last_became_active":"2024-04-17T19:53:04.465333+0000","last_became_peered":"2024-04-17T19:53:04.465333+0000","last_unstale":"2024-04-17T19:53:45.567311+0000","last_undegraded":"2024-04-17T19:53:45.567311+0000","last_fullsized":"2024-04-17T19:53:45.567311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.451925+0000","last_change":"2024-04-17T19:53:09.550127+0000","last_active":"2024-04-17T19:53:45.451925+0000","last_peered":"2024-04-17T19:53:45.451925+0000","last_clean":"2024-04-17T19:53:45.451925+0000","last_became_active":"2024-04-17T19:53:09.548109+0000","last_became_peered":"2024-04-17T19:53:09.548109+0000","last_unstale":"2024-04-17T19:53:45.451925+0000","last_undegraded":"2024-04-17T19:53:45.451925+0000","last_fullsized":"2024-04-17T19:53:45.451925+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:03:47.252621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452197+0000","last_change":"2024-04-17T19:53:05.455185+0000","last_active":"2024-04-17T19:53:45.452197+0000","last_peered":"2024-04-17T19:53:45.452197+0000","last_clean":"2024-04-17T19:53:45.452197+0000","last_became_active":"2024-04-17T19:53:05.454358+0000","last_became_peered":"2024-04-17T19:53:05.454358+0000","last_unstale":"2024-04-17T19:53:45.452197+0000","last_undegraded":"2024-04-17T19:53:45.452197+0000","last_fullsized":"2024-04-17T19:53:45.452197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:26:54.093651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.586332+0000","last_change":"2024-04-17T19:53:04.474288+0000","last_active":"2024-04-17T19:53:45.586332+0000","last_peered":"2024-04-17T19:53:45.586332+0000","last_clean":"2024-04-17T19:53:45.586332+0000","last_became_active":"2024-04-17T19:53:04.473389+0000","last_became_peered":"2024-04-17T19:53:04.473389+0000","last_unstale":"2024-04-17T19:53:45.586332+0000","last_undegraded":"2024-04-17T19:53:45.586332+0000","last_fullsized":"2024-04-17T19:53:45.586332+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:31:27.754909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.566826+0000","last_change":"2024-04-17T19:53:09.524630+0000","last_active":"2024-04-17T19:53:45.566826+0000","last_peered":"2024-04-17T19:53:45.566826+0000","last_clean":"2024-04-17T19:53:45.566826+0000","last_became_active":"2024-04-17T19:53:09.521522+0000","last_became_peered":"2024-04-17T19:53:09.521522+0000","last_unstale":"2024-04-17T19:53:45.566826+0000","last_undegraded":"2024-04-17T19:53:45.566826+0000","last_fullsized":"2024-04-17T19:53:45.566826+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.448666+0000","last_change":"2024-04-17T19:53:05.455865+0000","last_active":"2024-04-17T19:53:45.448666+0000","last_peered":"2024-04-17T19:53:45.448666+0000","last_clean":"2024-04-17T19:53:45.448666+0000","last_became_active":"2024-04-17T19:53:05.455429+0000","last_became_peered":"2024-04-17T19:53:05.455429+0000","last_unstale":"2024-04-17T19:53:45.448666+0000","last_undegraded":"2024-04-17T19:53:45.448666+0000","last_fullsized":"2024-04-17T19:53:45.448666+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"29'23","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:30.402619+0000","last_change":"2024-04-17T19:54:30.402768+0000","last_active":"2024-04-17T19:54:30.402619+0000","last_peered":"2024-04-17T19:54:30.402619+0000","last_clean":"2024-04-17T19:54:30.402619+0000","last_became_active":"2024-04-17T19:53:04.459855+0000","last_became_peered":"2024-04-17T19:53:04.459855+0000","last_unstale":"2024-04-17T19:54:30.402619+0000","last_undegraded":"2024-04-17T19:54:30.402619+0000","last_fullsized":"2024-04-17T19:54:30.402619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'23","last_scrub_stamp":"2024-04-17T19:54:30.402323+0000","last_deep_scrub":"29'23","last_deep_scrub_stamp":"2024-04-17T19:54:30.402323+0000","last_clean_scrub_stamp":"2024-04-17T19:54:30.402323+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:31:43.486454+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6170,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.451501+0000","last_change":"2024-04-17T19:53:09.530008+0000","last_active":"2024-04-17T19:53:45.451501+0000","last_peered":"2024-04-17T19:53:45.451501+0000","last_clean":"2024-04-17T19:53:45.451501+0000","last_became_active":"2024-04-17T19:53:09.528987+0000","last_became_peered":"2024-04-17T19:53:09.528987+0000","last_unstale":"2024-04-17T19:53:45.451501+0000","last_undegraded":"2024-04-17T19:53:45.451501+0000","last_fullsized":"2024-04-17T19:53:45.451501+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:31.530214+0000","last_change":"2024-04-17T19:54:31.530250+0000","last_active":"2024-04-17T19:54:31.530214+0000","last_peered":"2024-04-17T19:54:31.530214+0000","last_clean":"2024-04-17T19:54:31.530214+0000","last_became_active":"2024-04-17T19:53:05.468432+0000","last_became_peered":"2024-04-17T19:53:05.468432+0000","last_unstale":"2024-04-17T19:54:31.530214+0000","last_undegraded":"2024-04-17T19:54:31.530214+0000","last_fullsized":"2024-04-17T19:54:31.530214+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:31.530067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:31.530067+0000","last_clean_scrub_stamp":"2024-04-17T19:54:31.530067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:51:01.348417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.587107+0000","last_change":"2024-04-17T19:53:04.474378+0000","last_active":"2024-04-17T19:53:45.587107+0000","last_peered":"2024-04-17T19:53:45.587107+0000","last_clean":"2024-04-17T19:53:45.587107+0000","last_became_active":"2024-04-17T19:53:04.473458+0000","last_became_peered":"2024-04-17T19:53:04.473458+0000","last_unstale":"2024-04-17T19:53:45.587107+0000","last_undegraded":"2024-04-17T19:53:45.587107+0000","last_fullsized":"2024-04-17T19:53:45.587107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:16:30.888573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.450720+0000","last_change":"2024-04-17T19:53:09.558527+0000","last_active":"2024-04-17T19:53:45.450720+0000","last_peered":"2024-04-17T19:53:45.450720+0000","last_clean":"2024-04-17T19:53:45.450720+0000","last_became_active":"2024-04-17T19:53:09.557653+0000","last_became_peered":"2024-04-17T19:53:09.557653+0000","last_unstale":"2024-04-17T19:53:45.450720+0000","last_undegraded":"2024-04-17T19:53:45.450720+0000","last_fullsized":"2024-04-17T19:53:45.450720+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.462336+0000","last_change":"2024-04-17T19:53:05.467990+0000","last_active":"2024-04-17T19:53:45.462336+0000","last_peered":"2024-04-17T19:53:45.462336+0000","last_clean":"2024-04-17T19:53:45.462336+0000","last_became_active":"2024-04-17T19:53:05.461293+0000","last_became_peered":"2024-04-17T19:53:05.461293+0000","last_unstale":"2024-04-17T19:53:45.462336+0000","last_undegraded":"2024-04-17T19:53:45.462336+0000","last_fullsized":"2024-04-17T19:53:45.462336+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.449153+0000","last_change":"2024-04-17T19:53:04.472928+0000","last_active":"2024-04-17T19:53:45.449153+0000","last_peered":"2024-04-17T19:53:45.449153+0000","last_clean":"2024-04-17T19:53:45.449153+0000","last_became_active":"2024-04-17T19:53:04.467986+0000","last_became_peered":"2024-04-17T19:53:04.467986+0000","last_unstale":"2024-04-17T19:53:45.449153+0000","last_undegraded":"2024-04-17T19:53:45.449153+0000","last_fullsized":"2024-04-17T19:53:45.449153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.584286+0000","last_change":"2024-04-17T19:53:09.560792+0000","last_active":"2024-04-17T19:53:45.584286+0000","last_peered":"2024-04-17T19:53:45.584286+0000","last_clean":"2024-04-17T19:53:45.584286+0000","last_became_active":"2024-04-17T19:53:09.558779+0000","last_became_peered":"2024-04-17T19:53:09.558779+0000","last_unstale":"2024-04-17T19:53:45.584286+0000","last_undegraded":"2024-04-17T19:53:45.584286+0000","last_fullsized":"2024-04-17T19:53:45.584286+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:13:52.775623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.451318+0000","last_change":"2024-04-17T19:53:05.459934+0000","last_active":"2024-04-17T19:53:45.451318+0000","last_peered":"2024-04-17T19:53:45.451318+0000","last_clean":"2024-04-17T19:53:45.451318+0000","last_became_active":"2024-04-17T19:53:05.459538+0000","last_became_peered":"2024-04-17T19:53:05.459538+0000","last_unstale":"2024-04-17T19:53:45.451318+0000","last_undegraded":"2024-04-17T19:53:45.451318+0000","last_fullsized":"2024-04-17T19:53:45.451318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:30.962371+0000","last_change":"2024-04-17T19:54:30.962395+0000","last_active":"2024-04-17T19:54:30.962371+0000","last_peered":"2024-04-17T19:54:30.962371+0000","last_clean":"2024-04-17T19:54:30.962371+0000","last_became_active":"2024-04-17T19:53:04.459787+0000","last_became_peered":"2024-04-17T19:53:04.459787+0000","last_unstale":"2024-04-17T19:54:30.962371+0000","last_undegraded":"2024-04-17T19:54:30.962371+0000","last_fullsized":"2024-04-17T19:54:30.962371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:30.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:30.962289+0000","last_clean_scrub_stamp":"2024-04-17T19:54:30.962289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:35:39.104616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.590843+0000","last_change":"2024-04-17T19:53:45.589100+0000","last_active":"2024-04-17T19:53:45.590843+0000","last_peered":"2024-04-17T19:53:45.590843+0000","last_clean":"2024-04-17T19:53:45.590843+0000","last_became_active":"2024-04-17T19:53:45.587729+0000","last_became_peered":"2024-04-17T19:53:45.587729+0000","last_unstale":"2024-04-17T19:53:45.590843+0000","last_undegraded":"2024-04-17T19:53:45.590843+0000","last_fullsized":"2024-04-17T19:53:45.590843+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,7],"acting":[4,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452618+0000","last_change":"2024-04-17T19:53:09.536930+0000","last_active":"2024-04-17T19:53:45.452618+0000","last_peered":"2024-04-17T19:53:45.452618+0000","last_clean":"2024-04-17T19:53:45.452618+0000","last_became_active":"2024-04-17T19:53:09.535559+0000","last_became_peered":"2024-04-17T19:53:09.535559+0000","last_unstale":"2024-04-17T19:53:45.452618+0000","last_undegraded":"2024-04-17T19:53:45.452618+0000","last_fullsized":"2024-04-17T19:53:45.452618+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.460086+0000","last_change":"2024-04-17T19:53:05.440653+0000","last_active":"2024-04-17T19:53:45.460086+0000","last_peered":"2024-04-17T19:53:45.460086+0000","last_clean":"2024-04-17T19:53:45.460086+0000","last_became_active":"2024-04-17T19:53:05.439793+0000","last_became_peered":"2024-04-17T19:53:05.439793+0000","last_unstale":"2024-04-17T19:53:45.460086+0000","last_undegraded":"2024-04-17T19:53:45.460086+0000","last_fullsized":"2024-04-17T19:53:45.460086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.565132+0000","last_change":"2024-04-17T19:53:04.461705+0000","last_active":"2024-04-17T19:53:45.565132+0000","last_peered":"2024-04-17T19:53:45.565132+0000","last_clean":"2024-04-17T19:53:45.565132+0000","last_became_active":"2024-04-17T19:53:04.461020+0000","last_became_peered":"2024-04-17T19:53:04.461020+0000","last_unstale":"2024-04-17T19:53:45.565132+0000","last_undegraded":"2024-04-17T19:53:45.565132+0000","last_fullsized":"2024-04-17T19:53:45.565132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.566800+0000","last_change":"2024-04-17T19:53:09.535147+0000","last_active":"2024-04-17T19:53:45.566800+0000","last_peered":"2024-04-17T19:53:45.566800+0000","last_clean":"2024-04-17T19:53:45.566800+0000","last_became_active":"2024-04-17T19:53:09.534655+0000","last_became_peered":"2024-04-17T19:53:09.534655+0000","last_unstale":"2024-04-17T19:53:45.566800+0000","last_undegraded":"2024-04-17T19:53:45.566800+0000","last_fullsized":"2024-04-17T19:53:45.566800+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.453088+0000","last_change":"2024-04-17T19:53:05.455848+0000","last_active":"2024-04-17T19:53:45.453088+0000","last_peered":"2024-04-17T19:53:45.453088+0000","last_clean":"2024-04-17T19:53:45.453088+0000","last_became_active":"2024-04-17T19:53:05.452844+0000","last_became_peered":"2024-04-17T19:53:05.452844+0000","last_unstale":"2024-04-17T19:53:45.453088+0000","last_undegraded":"2024-04-17T19:53:45.453088+0000","last_fullsized":"2024-04-17T19:53:45.453088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.453145+0000","last_change":"2024-04-17T19:53:04.470824+0000","last_active":"2024-04-17T19:53:45.453145+0000","last_peered":"2024-04-17T19:53:45.453145+0000","last_clean":"2024-04-17T19:53:45.453145+0000","last_became_active":"2024-04-17T19:53:04.469777+0000","last_became_peered":"2024-04-17T19:53:04.469777+0000","last_unstale":"2024-04-17T19:53:45.453145+0000","last_undegraded":"2024-04-17T19:53:45.453145+0000","last_fullsized":"2024-04-17T19:53:45.453145+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:30:04.861958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.567283+0000","last_change":"2024-04-17T19:53:04.469785+0000","last_active":"2024-04-17T19:53:45.567283+0000","last_peered":"2024-04-17T19:53:45.567283+0000","last_clean":"2024-04-17T19:53:45.567283+0000","last_became_active":"2024-04-17T19:53:04.469297+0000","last_became_peered":"2024-04-17T19:53:04.469297+0000","last_unstale":"2024-04-17T19:53:45.567283+0000","last_undegraded":"2024-04-17T19:53:45.567283+0000","last_fullsized":"2024-04-17T19:53:45.567283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452959+0000","last_change":"2024-04-17T19:53:05.460191+0000","last_active":"2024-04-17T19:53:45.452959+0000","last_peered":"2024-04-17T19:53:45.452959+0000","last_clean":"2024-04-17T19:53:45.452959+0000","last_became_active":"2024-04-17T19:53:05.459616+0000","last_became_peered":"2024-04-17T19:53:05.459616+0000","last_unstale":"2024-04-17T19:53:45.452959+0000","last_undegraded":"2024-04-17T19:53:45.452959+0000","last_fullsized":"2024-04-17T19:53:45.452959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.467434+0000","last_change":"2024-04-17T19:53:45.464499+0000","last_active":"2024-04-17T19:53:45.467434+0000","last_peered":"2024-04-17T19:53:45.467434+0000","last_clean":"2024-04-17T19:53:45.467434+0000","last_became_active":"2024-04-17T19:53:45.462598+0000","last_became_peered":"2024-04-17T19:53:45.462598+0000","last_unstale":"2024-04-17T19:53:45.467434+0000","last_undegraded":"2024-04-17T19:53:45.467434+0000","last_fullsized":"2024-04-17T19:53:45.467434+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,2],"acting":[4,6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.458378+0000","last_change":"2024-04-17T19:53:04.487292+0000","last_active":"2024-04-17T19:53:45.458378+0000","last_peered":"2024-04-17T19:53:45.458378+0000","last_clean":"2024-04-17T19:53:45.458378+0000","last_became_active":"2024-04-17T19:53:04.486707+0000","last_became_peered":"2024-04-17T19:53:04.486707+0000","last_unstale":"2024-04-17T19:53:45.458378+0000","last_undegraded":"2024-04-17T19:53:45.458378+0000","last_fullsized":"2024-04-17T19:53:45.458378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:03.403876+0000","last_clean_scrub_stamp":"2024-04-17T19:53:03.403876+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.580359+0000","last_change":"2024-04-17T19:53:05.449319+0000","last_active":"2024-04-17T19:53:45.580359+0000","last_peered":"2024-04-17T19:53:45.580359+0000","last_clean":"2024-04-17T19:53:45.580359+0000","last_became_active":"2024-04-17T19:53:05.448374+0000","last_became_peered":"2024-04-17T19:53:05.448374+0000","last_unstale":"2024-04-17T19:53:45.580359+0000","last_undegraded":"2024-04-17T19:53:45.580359+0000","last_fullsized":"2024-04-17T19:53:45.580359+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.586836+0000","last_change":"2024-04-17T19:53:09.561127+0000","last_active":"2024-04-17T19:53:45.586836+0000","last_peered":"2024-04-17T19:53:45.586836+0000","last_clean":"2024-04-17T19:53:45.586836+0000","last_became_active":"2024-04-17T19:53:09.560076+0000","last_became_peered":"2024-04-17T19:53:09.560076+0000","last_unstale":"2024-04-17T19:53:45.586836+0000","last_undegraded":"2024-04-17T19:53:45.586836+0000","last_fullsized":"2024-04-17T19:53:45.586836+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:25:20.343613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.450237+0000","last_change":"2024-04-17T19:53:05.472665+0000","last_active":"2024-04-17T19:53:45.450237+0000","last_peered":"2024-04-17T19:53:45.450237+0000","last_clean":"2024-04-17T19:53:45.450237+0000","last_became_active":"2024-04-17T19:53:05.472324+0000","last_became_peered":"2024-04-17T19:53:05.472324+0000","last_unstale":"2024-04-17T19:53:45.450237+0000","last_undegraded":"2024-04-17T19:53:45.450237+0000","last_fullsized":"2024-04-17T19:53:45.450237+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.584932+0000","last_change":"2024-04-17T19:53:05.477190+0000","last_active":"2024-04-17T19:53:45.584932+0000","last_peered":"2024-04-17T19:53:45.584932+0000","last_clean":"2024-04-17T19:53:45.584932+0000","last_became_active":"2024-04-17T19:53:05.475823+0000","last_became_peered":"2024-04-17T19:53:05.475823+0000","last_unstale":"2024-04-17T19:53:45.584932+0000","last_undegraded":"2024-04-17T19:53:45.584932+0000","last_fullsized":"2024-04-17T19:53:45.584932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:53:37.141518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.564814+0000","last_change":"2024-04-17T19:53:05.453565+0000","last_active":"2024-04-17T19:53:45.564814+0000","last_peered":"2024-04-17T19:53:45.564814+0000","last_clean":"2024-04-17T19:53:45.564814+0000","last_became_active":"2024-04-17T19:53:05.453142+0000","last_became_peered":"2024-04-17T19:53:05.453142+0000","last_unstale":"2024-04-17T19:53:45.564814+0000","last_undegraded":"2024-04-17T19:53:45.564814+0000","last_fullsized":"2024-04-17T19:53:45.564814+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.458074+0000","last_change":"2024-04-17T19:53:05.476450+0000","last_active":"2024-04-17T19:53:45.458074+0000","last_peered":"2024-04-17T19:53:45.458074+0000","last_clean":"2024-04-17T19:53:45.458074+0000","last_became_active":"2024-04-17T19:53:05.473931+0000","last_became_peered":"2024-04-17T19:53:05.473931+0000","last_unstale":"2024-04-17T19:53:45.458074+0000","last_undegraded":"2024-04-17T19:53:45.458074+0000","last_fullsized":"2024-04-17T19:53:45.458074+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452420+0000","last_change":"2024-04-17T19:53:05.469653+0000","last_active":"2024-04-17T19:53:45.452420+0000","last_peered":"2024-04-17T19:53:45.452420+0000","last_clean":"2024-04-17T19:53:45.452420+0000","last_became_active":"2024-04-17T19:53:05.467838+0000","last_became_peered":"2024-04-17T19:53:05.467838+0000","last_unstale":"2024-04-17T19:53:45.452420+0000","last_undegraded":"2024-04-17T19:53:45.452420+0000","last_fullsized":"2024-04-17T19:53:45.452420+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:38:51.699072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.454087+0000","last_change":"2024-04-17T19:53:05.462678+0000","last_active":"2024-04-17T19:53:45.454087+0000","last_peered":"2024-04-17T19:53:45.454087+0000","last_clean":"2024-04-17T19:53:45.454087+0000","last_became_active":"2024-04-17T19:53:05.461829+0000","last_became_peered":"2024-04-17T19:53:05.461829+0000","last_unstale":"2024-04-17T19:53:45.454087+0000","last_undegraded":"2024-04-17T19:53:45.454087+0000","last_fullsized":"2024-04-17T19:53:45.454087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:03:53.876774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.451159+0000","last_change":"2024-04-17T19:53:05.465993+0000","last_active":"2024-04-17T19:53:45.451159+0000","last_peered":"2024-04-17T19:53:45.451159+0000","last_clean":"2024-04-17T19:53:45.451159+0000","last_became_active":"2024-04-17T19:53:05.465547+0000","last_became_peered":"2024-04-17T19:53:05.465547+0000","last_unstale":"2024-04-17T19:53:45.451159+0000","last_undegraded":"2024-04-17T19:53:45.451159+0000","last_fullsized":"2024-04-17T19:53:45.451159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.459421+0000","last_change":"2024-04-17T19:53:05.477188+0000","last_active":"2024-04-17T19:53:45.459421+0000","last_peered":"2024-04-17T19:53:45.459421+0000","last_clean":"2024-04-17T19:53:45.459421+0000","last_became_active":"2024-04-17T19:53:05.474798+0000","last_became_peered":"2024-04-17T19:53:05.474798+0000","last_unstale":"2024-04-17T19:53:45.459421+0000","last_undegraded":"2024-04-17T19:53:45.459421+0000","last_fullsized":"2024-04-17T19:53:45.459421+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.564797+0000","last_change":"2024-04-17T19:53:05.484009+0000","last_active":"2024-04-17T19:53:45.564797+0000","last_peered":"2024-04-17T19:53:45.564797+0000","last_clean":"2024-04-17T19:53:45.564797+0000","last_became_active":"2024-04-17T19:53:05.483664+0000","last_became_peered":"2024-04-17T19:53:05.483664+0000","last_unstale":"2024-04-17T19:53:45.564797+0000","last_undegraded":"2024-04-17T19:53:45.564797+0000","last_fullsized":"2024-04-17T19:53:45.564797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.456519+0000","last_change":"2024-04-17T19:53:05.466532+0000","last_active":"2024-04-17T19:53:45.456519+0000","last_peered":"2024-04-17T19:53:45.456519+0000","last_clean":"2024-04-17T19:53:45.456519+0000","last_became_active":"2024-04-17T19:53:05.465302+0000","last_became_peered":"2024-04-17T19:53:05.465302+0000","last_unstale":"2024-04-17T19:53:45.456519+0000","last_undegraded":"2024-04-17T19:53:45.456519+0000","last_fullsized":"2024-04-17T19:53:45.456519+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.580003+0000","last_change":"2024-04-17T19:53:05.456313+0000","last_active":"2024-04-17T19:53:45.580003+0000","last_peered":"2024-04-17T19:53:45.580003+0000","last_clean":"2024-04-17T19:53:45.580003+0000","last_became_active":"2024-04-17T19:53:05.455862+0000","last_became_peered":"2024-04-17T19:53:05.455862+0000","last_unstale":"2024-04-17T19:53:45.580003+0000","last_undegraded":"2024-04-17T19:53:45.580003+0000","last_fullsized":"2024-04-17T19:53:45.580003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.452676+0000","last_change":"2024-04-17T19:53:05.465083+0000","last_active":"2024-04-17T19:53:45.452676+0000","last_peered":"2024-04-17T19:53:45.452676+0000","last_clean":"2024-04-17T19:53:45.452676+0000","last_became_active":"2024-04-17T19:53:05.463806+0000","last_became_peered":"2024-04-17T19:53:05.463806+0000","last_unstale":"2024-04-17T19:53:45.452676+0000","last_undegraded":"2024-04-17T19:53:45.452676+0000","last_fullsized":"2024-04-17T19:53:45.452676+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.448110+0000","last_change":"2024-04-17T19:53:05.464340+0000","last_active":"2024-04-17T19:53:45.448110+0000","last_peered":"2024-04-17T19:53:45.448110+0000","last_clean":"2024-04-17T19:53:45.448110+0000","last_became_active":"2024-04-17T19:53:05.463286+0000","last_became_peered":"2024-04-17T19:53:05.463286+0000","last_unstale":"2024-04-17T19:53:45.448110+0000","last_undegraded":"2024-04-17T19:53:45.448110+0000","last_fullsized":"2024-04-17T19:53:45.448110+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.565216+0000","last_change":"2024-04-17T19:53:05.475791+0000","last_active":"2024-04-17T19:53:45.565216+0000","last_peered":"2024-04-17T19:53:45.565216+0000","last_clean":"2024-04-17T19:53:45.565216+0000","last_became_active":"2024-04-17T19:53:05.475372+0000","last_became_peered":"2024-04-17T19:53:05.475372+0000","last_unstale":"2024-04-17T19:53:45.565216+0000","last_undegraded":"2024-04-17T19:53:45.565216+0000","last_fullsized":"2024-04-17T19:53:45.565216+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.582332+0000","last_change":"2024-04-17T19:53:05.496650+0000","last_active":"2024-04-17T19:53:45.582332+0000","last_peered":"2024-04-17T19:53:45.582332+0000","last_clean":"2024-04-17T19:53:45.582332+0000","last_became_active":"2024-04-17T19:53:05.495881+0000","last_became_peered":"2024-04-17T19:53:05.495881+0000","last_unstale":"2024-04-17T19:53:45.582332+0000","last_undegraded":"2024-04-17T19:53:45.582332+0000","last_fullsized":"2024-04-17T19:53:45.582332+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:23:03.879786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.565886+0000","last_change":"2024-04-17T19:53:05.461335+0000","last_active":"2024-04-17T19:53:45.565886+0000","last_peered":"2024-04-17T19:53:45.565886+0000","last_clean":"2024-04-17T19:53:45.565886+0000","last_became_active":"2024-04-17T19:53:05.460831+0000","last_became_peered":"2024-04-17T19:53:05.460831+0000","last_unstale":"2024-04-17T19:53:45.565886+0000","last_undegraded":"2024-04-17T19:53:45.565886+0000","last_fullsized":"2024-04-17T19:53:45.565886+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.564810+0000","last_change":"2024-04-17T19:53:05.473875+0000","last_active":"2024-04-17T19:53:45.564810+0000","last_peered":"2024-04-17T19:53:45.564810+0000","last_clean":"2024-04-17T19:53:45.564810+0000","last_became_active":"2024-04-17T19:53:05.467366+0000","last_became_peered":"2024-04-17T19:53:05.467366+0000","last_unstale":"2024-04-17T19:53:45.564810+0000","last_undegraded":"2024-04-17T19:53:45.564810+0000","last_fullsized":"2024-04-17T19:53:45.564810+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.590712+0000","last_change":"2024-04-17T19:53:45.588365+0000","last_active":"2024-04-17T19:53:45.590712+0000","last_peered":"2024-04-17T19:53:45.590712+0000","last_clean":"2024-04-17T19:53:45.590712+0000","last_became_active":"2024-04-17T19:53:45.587213+0000","last_became_peered":"2024-04-17T19:53:45.587213+0000","last_unstale":"2024-04-17T19:53:45.590712+0000","last_undegraded":"2024-04-17T19:53:45.590712+0000","last_fullsized":"2024-04-17T19:53:45.590712+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.451842+0000","last_change":"2024-04-17T19:53:05.465968+0000","last_active":"2024-04-17T19:53:45.451842+0000","last_peered":"2024-04-17T19:53:45.451842+0000","last_clean":"2024-04-17T19:53:45.451842+0000","last_became_active":"2024-04-17T19:53:05.465145+0000","last_became_peered":"2024-04-17T19:53:05.465145+0000","last_unstale":"2024-04-17T19:53:45.451842+0000","last_undegraded":"2024-04-17T19:53:45.451842+0000","last_fullsized":"2024-04-17T19:53:45.451842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:47:46.099722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.453510+0000","last_change":"2024-04-17T19:53:05.463993+0000","last_active":"2024-04-17T19:53:45.453510+0000","last_peered":"2024-04-17T19:53:45.453510+0000","last_clean":"2024-04-17T19:53:45.453510+0000","last_became_active":"2024-04-17T19:53:05.463172+0000","last_became_peered":"2024-04-17T19:53:05.463172+0000","last_unstale":"2024-04-17T19:53:45.453510+0000","last_undegraded":"2024-04-17T19:53:45.453510+0000","last_fullsized":"2024-04-17T19:53:45.453510+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:29:50.457953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.448059+0000","last_change":"2024-04-17T19:53:05.471782+0000","last_active":"2024-04-17T19:53:45.448059+0000","last_peered":"2024-04-17T19:53:45.448059+0000","last_clean":"2024-04-17T19:53:45.448059+0000","last_became_active":"2024-04-17T19:53:05.471347+0000","last_became_peered":"2024-04-17T19:53:05.471347+0000","last_unstale":"2024-04-17T19:53:45.448059+0000","last_undegraded":"2024-04-17T19:53:45.448059+0000","last_fullsized":"2024-04-17T19:53:45.448059+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.448626+0000","last_change":"2024-04-17T19:53:05.460256+0000","last_active":"2024-04-17T19:53:45.448626+0000","last_peered":"2024-04-17T19:53:45.448626+0000","last_clean":"2024-04-17T19:53:45.448626+0000","last_became_active":"2024-04-17T19:53:05.459869+0000","last_became_peered":"2024-04-17T19:53:05.459869+0000","last_unstale":"2024-04-17T19:53:45.448626+0000","last_undegraded":"2024-04-17T19:53:45.448626+0000","last_fullsized":"2024-04-17T19:53:45.448626+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.448884+0000","last_change":"2024-04-17T19:53:05.467331+0000","last_active":"2024-04-17T19:53:45.448884+0000","last_peered":"2024-04-17T19:53:45.448884+0000","last_clean":"2024-04-17T19:53:45.448884+0000","last_became_active":"2024-04-17T19:53:05.467015+0000","last_became_peered":"2024-04-17T19:53:05.467015+0000","last_unstale":"2024-04-17T19:53:45.448884+0000","last_undegraded":"2024-04-17T19:53:45.448884+0000","last_fullsized":"2024-04-17T19:53:45.448884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.581413+0000","last_change":"2024-04-17T19:53:05.462631+0000","last_active":"2024-04-17T19:53:45.581413+0000","last_peered":"2024-04-17T19:53:45.581413+0000","last_clean":"2024-04-17T19:53:45.581413+0000","last_became_active":"2024-04-17T19:53:05.462217+0000","last_became_peered":"2024-04-17T19:53:05.462217+0000","last_unstale":"2024-04-17T19:53:45.581413+0000","last_undegraded":"2024-04-17T19:53:45.581413+0000","last_fullsized":"2024-04-17T19:53:45.581413+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.455914+0000","last_change":"2024-04-17T19:53:05.467941+0000","last_active":"2024-04-17T19:53:45.455914+0000","last_peered":"2024-04-17T19:53:45.455914+0000","last_clean":"2024-04-17T19:53:45.455914+0000","last_became_active":"2024-04-17T19:53:05.467093+0000","last_became_peered":"2024-04-17T19:53:05.467093+0000","last_unstale":"2024-04-17T19:53:45.455914+0000","last_undegraded":"2024-04-17T19:53:45.455914+0000","last_fullsized":"2024-04-17T19:53:45.455914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.447282+0000","last_change":"2024-04-17T19:53:05.465748+0000","last_active":"2024-04-17T19:53:45.447282+0000","last_peered":"2024-04-17T19:53:45.447282+0000","last_clean":"2024-04-17T19:53:45.447282+0000","last_became_active":"2024-04-17T19:53:05.465436+0000","last_became_peered":"2024-04-17T19:53:05.465436+0000","last_unstale":"2024-04-17T19:53:45.447282+0000","last_undegraded":"2024-04-17T19:53:45.447282+0000","last_fullsized":"2024-04-17T19:53:45.447282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:31.348038+0000","last_change":"2024-04-17T19:54:31.348071+0000","last_active":"2024-04-17T19:54:31.348038+0000","last_peered":"2024-04-17T19:54:31.348038+0000","last_clean":"2024-04-17T19:54:31.348038+0000","last_became_active":"2024-04-17T19:53:05.457656+0000","last_became_peered":"2024-04-17T19:53:05.457656+0000","last_unstale":"2024-04-17T19:54:31.348038+0000","last_undegraded":"2024-04-17T19:54:31.348038+0000","last_fullsized":"2024-04-17T19:54:31.348038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:31.347957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:31.347957+0000","last_clean_scrub_stamp":"2024-04-17T19:54:31.347957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:40:17.344401+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.447553+0000","last_change":"2024-04-17T19:53:05.477086+0000","last_active":"2024-04-17T19:53:45.447553+0000","last_peered":"2024-04-17T19:53:45.447553+0000","last_clean":"2024-04-17T19:53:45.447553+0000","last_became_active":"2024-04-17T19:53:05.476734+0000","last_became_peered":"2024-04-17T19:53:05.476734+0000","last_unstale":"2024-04-17T19:53:45.447553+0000","last_undegraded":"2024-04-17T19:53:45.447553+0000","last_fullsized":"2024-04-17T19:53:45.447553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.450687+0000","last_change":"2024-04-17T19:53:05.458378+0000","last_active":"2024-04-17T19:53:45.450687+0000","last_peered":"2024-04-17T19:53:45.450687+0000","last_clean":"2024-04-17T19:53:45.450687+0000","last_became_active":"2024-04-17T19:53:05.457210+0000","last_became_peered":"2024-04-17T19:53:05.457210+0000","last_unstale":"2024-04-17T19:53:45.450687+0000","last_undegraded":"2024-04-17T19:53:45.450687+0000","last_fullsized":"2024-04-17T19:53:45.450687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.455431+0000","last_change":"2024-04-17T19:53:05.455054+0000","last_active":"2024-04-17T19:53:45.455431+0000","last_peered":"2024-04-17T19:53:45.455431+0000","last_clean":"2024-04-17T19:53:45.455431+0000","last_became_active":"2024-04-17T19:53:05.454065+0000","last_became_peered":"2024-04-17T19:53:05.454065+0000","last_unstale":"2024-04-17T19:53:45.455431+0000","last_undegraded":"2024-04-17T19:53:45.455431+0000","last_fullsized":"2024-04-17T19:53:45.455431+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.457855+0000","last_change":"2024-04-17T19:53:05.456675+0000","last_active":"2024-04-17T19:53:45.457855+0000","last_peered":"2024-04-17T19:53:45.457855+0000","last_clean":"2024-04-17T19:53:45.457855+0000","last_became_active":"2024-04-17T19:53:05.455779+0000","last_became_peered":"2024-04-17T19:53:05.455779+0000","last_unstale":"2024-04-17T19:53:45.457855+0000","last_undegraded":"2024-04-17T19:53:45.457855+0000","last_fullsized":"2024-04-17T19:53:45.457855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:04.415194+0000","last_clean_scrub_stamp":"2024-04-17T19:53:04.415194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:29.205949+0000","last_change":"2024-04-17T19:54:29.205992+0000","last_active":"2024-04-17T19:54:29.205949+0000","last_peered":"2024-04-17T19:54:29.205949+0000","last_clean":"2024-04-17T19:54:29.205949+0000","last_became_active":"2024-04-17T19:53:05.461324+0000","last_became_peered":"2024-04-17T19:53:05.461324+0000","last_unstale":"2024-04-17T19:54:29.205949+0000","last_undegraded":"2024-04-17T19:54:29.205949+0000","last_fullsized":"2024-04-17T19:54:29.205949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:29.205807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:29.205807+0000","last_clean_scrub_stamp":"2024-04-17T19:54:29.205807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:26:58.059998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6968,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":13936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":56,"ondisk_log_size":56,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509464,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":315392,"data_stored":124356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509463,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":909312,"data_stored":714692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509463,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":331776,"data_stored":131074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509463,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31480,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":311296,"data_stored":124814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509463,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31492,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340348,"statfs":{"total":96636764160,"available":96604516352,"internally_reserved":0,"allocated":323584,"data_stored":130402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509462,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32060,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339780,"statfs":{"total":96636764160,"available":96603934720,"internally_reserved":0,"allocated":905216,"data_stored":714670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509463,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31484,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340356,"statfs":{"total":96636764160,"available":96604524544,"internally_reserved":0,"allocated":315392,"data_stored":124288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542167,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":307200,"data_stored":124232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":6170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":6842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T19:54:32.919 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-04-17T19:53:03.403876+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.919 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-17T19:53:08.460800+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=8, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.919 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-04-17T19:53:03.403876+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.919 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-17T19:53:04.415194+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=4, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.919 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-17T19:53:08.460800+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=8, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.919 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-04-17T19:53:03.403876+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.920 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-17T19:53:04.415194+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=4, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.920 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-17T19:53:08.460800+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=8, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.920 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-04-17T19:53:03.403876+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.920 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-17T19:53:08.460800+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=8, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.920 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-17T19:53:04.415194+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=4, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.920 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-04-17T19:53:03.403876+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.920 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-17T19:53:08.460800+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=8, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.920 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-17T19:53:04.415194+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=4, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.920 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-04-17T19:53:03.403876+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.920 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-17T19:53:08.460800+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=8, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.920 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-17T19:53:04.415194+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=4, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.921 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-04-17T19:53:03.403876+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.921 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-17T19:53:08.460800+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=8, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.921 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-17T19:53:04.415194+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=4, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.921 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-04-17T19:53:03.403876+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.921 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-17T19:53:08.460800+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=8, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.921 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-17T19:53:04.415194+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=4, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.921 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-17T19:53:03.403876+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.921 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-17T19:53:08.460800+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=8, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.921 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-17T19:53:04.415194+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=4, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.921 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-17T19:53:03.403876+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.922 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-17T19:53:08.460800+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=8, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.922 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-17T19:53:04.415194+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=4, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.922 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-17T19:53:03.403876+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.922 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-17T19:53:08.460800+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=8, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.922 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-17T19:53:04.415194+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=4, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.922 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-17T19:53:03.403876+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.922 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-17T19:53:08.460800+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=8, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.922 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-17T19:53:04.415194+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=4, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.922 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-17T19:53:03.403876+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.923 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-17T19:53:08.460800+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=8, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.923 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-17T19:53:04.415194+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=4, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.923 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-17T19:53:03.403876+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.923 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-17T19:53:08.460800+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=8, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.923 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-17T19:53:04.415194+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=4, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.923 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-17T19:53:03.403876+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.923 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-17T19:53:08.460800+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=8, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.923 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-17T19:53:03.403876+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.923 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-17T19:53:08.460800+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=8, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.923 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-17T19:53:04.415194+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=4, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.924 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-04-17T19:53:03.403876+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.924 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-17T19:53:08.460800+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=8, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.924 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-17T19:53:04.415194+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=4, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.924 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-04-17T19:53:03.403876+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.924 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-17T19:53:08.460800+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=8, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.924 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-04-17T19:53:03.403876+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.924 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-17T19:53:08.460800+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=8, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.924 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-17T19:53:04.415194+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=4, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.924 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-04-17T19:53:03.403876+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.924 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-17T19:53:08.460800+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=8, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.924 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-17T19:53:04.415194+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=4, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.925 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-04-17T19:53:03.403876+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.925 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-17T19:53:08.460800+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=8, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.925 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-17T19:53:04.415194+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=4, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.925 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-17T19:53:08.460800+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=8, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.925 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-17T19:53:04.415194+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=4, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.925 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-04-17T19:53:03.403876+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.925 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-17T19:53:08.460800+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=8, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.925 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-17T19:53:04.415194+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=4, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.925 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-04-17T19:53:03.403876+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.925 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-17T19:53:08.460800+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=8, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.926 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-17T19:53:04.415194+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=4, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.926 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-17T19:53:08.460800+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=8, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.926 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-04-17T19:53:03.403876+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.926 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-17T19:53:08.460800+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=8, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.926 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-17T19:53:04.415194+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=4, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.926 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-04-17T19:53:03.403876+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.926 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-17T19:53:08.460800+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=8, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.926 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-17T19:53:04.415194+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=4, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.927 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-17T19:53:08.460800+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=8, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.927 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-17T19:53:08.460800+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=8, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.927 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-17T19:53:04.415194+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=4, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.927 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-04-17T19:53:03.403876+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.927 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-17T19:53:08.460800+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=8, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.927 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-17T19:53:04.415194+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=4, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.927 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-04-17T19:53:03.403876+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.927 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-04-17T19:53:03.403876+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.927 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-17T19:53:04.415194+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=4, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.928 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-17T19:53:08.460800+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=8, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.928 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-04-17T19:53:03.403876+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=3, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.928 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-17T19:53:04.415194+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=4, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.928 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-17T19:53:08.460800+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=8, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.928 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-17T19:53:04.415194+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=4, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.928 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-17T19:53:04.415194+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=4, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.928 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-17T19:53:04.415194+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=4, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.928 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-17T19:53:04.415194+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=4, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.928 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-17T19:53:04.415194+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=4, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.929 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-17T19:53:04.415194+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=4, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.929 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-17T19:53:04.415194+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=4, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.929 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-17T19:53:04.415194+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=4, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.929 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-17T19:53:04.415194+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=4, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.929 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-17T19:53:04.415194+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=4, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.929 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-17T19:53:04.415194+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=4, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.929 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-17T19:53:04.415194+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=4, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.929 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-17T19:53:04.415194+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=4, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.929 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-17T19:53:04.415194+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=4, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.930 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-17T19:53:04.415194+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=4, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.930 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-17T19:53:04.415194+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=4, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.930 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-17T19:53:04.415194+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=4, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.930 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-17T19:53:04.415194+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=4, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.930 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-17T19:53:04.415194+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=4, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.930 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-17T19:53:04.415194+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=4, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.930 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-17T19:53:04.415194+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=4, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.930 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-17T19:53:04.415194+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=4, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.930 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-17T19:53:04.415194+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=4, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.931 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-17T19:53:04.415194+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=4, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.931 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-17T19:53:04.415194+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=4, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.931 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-17T19:53:04.415194+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=4, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.931 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-17T19:53:04.415194+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=4, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.931 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-17T19:53:04.415194+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=4, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.931 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-17T19:53:04.415194+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=4, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.931 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-17T19:53:04.415194+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=4, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:32.931 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-17T19:54:52.932 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T19:54:53.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.100+0000 7f6e51e83640 1 Processor -- start 2024-04-17T19:54:53.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.100+0000 7f6e51e83640 1 -- start start 2024-04-17T19:54:53.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.100+0000 7f6e51e83640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6e4c0b82a0 0x7f6e4c06cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:53.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.100+0000 7f6e51e83640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6e4c0b86b0 0x7f6e4c06d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:53.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.100+0000 7f6e51e83640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e4c06be80 con 0x7f6e4c162fa0 2024-04-17T19:54:53.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.100+0000 7f6e51e83640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f6e4c0cfd90 con 0x7f6e4c0b86b0 2024-04-17T19:54:53.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.100+0000 7f6e51e83640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f6e4c06c160 con 0x7f6e4c0b82a0 2024-04-17T19:54:53.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.100+0000 7f6e4bfff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f6e4c162fa0 0x7f6e4c1633b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:59646/0 (socket says 172.21.15.18:59646) 2024-04-17T19:54:53.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.100+0000 7f6e42ffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6e4c0b86b0 0x7f6e4c06d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:53.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.100+0000 7f6e4bfff640 1 -- 172.21.15.18:0/715902972 learned_addr learned my addr 172.21.15.18:0/715902972 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:54:53.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.100+0000 7f6e4b7fe640 1 --2- 172.21.15.18:0/715902972 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6e4c0b82a0 0x7f6e4c06cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:53.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.100+0000 7f6e4affd640 1 -- 172.21.15.18:0/715902972 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1987114688 0 0) 0x7f6e4c06be80 con 0x7f6e4c162fa0 2024-04-17T19:54:53.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.100+0000 7f6e4affd640 1 -- 172.21.15.18:0/715902972 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e38003530 con 0x7f6e4c162fa0 2024-04-17T19:54:53.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.100+0000 7f6e42ffd640 1 -- 172.21.15.18:0/715902972 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6e4c0b82a0 msgr2=0x7f6e4c06cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:54:53.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.100+0000 7f6e42ffd640 1 --2- 172.21.15.18:0/715902972 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6e4c0b82a0 0x7f6e4c06cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:53.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.100+0000 7f6e42ffd640 1 -- 172.21.15.18:0/715902972 >> v1:172.21.15.18:6789/0 conn(0x7f6e4c162fa0 legacy=0x7f6e4c1633b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:53.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.100+0000 7f6e42ffd640 1 -- 172.21.15.18:0/715902972 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e4c06c440 con 0x7f6e4c0b86b0 2024-04-17T19:54:53.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.104+0000 7f6e42ffd640 1 --2- 172.21.15.18:0/715902972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e4c0b86b0 0x7f6e4c06d180 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f6e340097c0 tx=0x7f6e3401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70c811e4faff1720 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:53.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.104+0000 7f6e4affd640 1 -- 172.21.15.18:0/715902972 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e340ab600 con 0x7f6e4c0b86b0 2024-04-17T19:54:53.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.104+0000 7f6e4affd640 1 -- 172.21.15.18:0/715902972 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e340b0070 con 0x7f6e4c0b86b0 2024-04-17T19:54:53.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.104+0000 7f6e4affd640 1 -- 172.21.15.18:0/715902972 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e340ab9c0 con 0x7f6e4c0b86b0 2024-04-17T19:54:53.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.104+0000 7f6e51e83640 1 -- 172.21.15.18:0/715902972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e4c0b86b0 msgr2=0x7f6e4c06d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:53.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.104+0000 7f6e51e83640 1 --2- 172.21.15.18:0/715902972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e4c0b86b0 0x7f6e4c06d180 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f6e340097c0 tx=0x7f6e3401c3e0 comp rx=0 tx=0).stop 2024-04-17T19:54:53.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.104+0000 7f6e51e83640 1 -- 172.21.15.18:0/715902972 shutdown_connections 2024-04-17T19:54:53.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.104+0000 7f6e51e83640 1 --2- 172.21.15.18:0/715902972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e4c0b86b0 0x7f6e4c06d180 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:53.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.104+0000 7f6e51e83640 1 --2- 172.21.15.18:0/715902972 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6e4c0b82a0 0x7f6e4c06cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:53.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.104+0000 7f6e51e83640 1 -- 172.21.15.18:0/715902972 >> 172.21.15.18:0/715902972 conn(0x7f6e4c0b6cf0 msgr2=0x7f6e4c0b7100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:53.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.104+0000 7f6e51e83640 1 -- 172.21.15.18:0/715902972 shutdown_connections 2024-04-17T19:54:53.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.104+0000 7f6e51e83640 1 -- 172.21.15.18:0/715902972 wait complete. 2024-04-17T19:54:53.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.108+0000 7f6e51e83640 1 Processor -- start 2024-04-17T19:54:53.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.108+0000 7f6e51e83640 1 -- start start 2024-04-17T19:54:53.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.108+0000 7f6e51e83640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e4c0b82a0 0x7f6e4c0cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:53.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.108+0000 7f6e51e83640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6e4c0b86b0 0x7f6e4c150c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:53.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.108+0000 7f6e51e83640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e4c162fa0 0x7f6e4c151140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:53.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.108+0000 7f6e51e83640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6e4c16ccb0 con 0x7f6e4c0b82a0 2024-04-17T19:54:53.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.108+0000 7f6e51e83640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6e4c16cb30 con 0x7f6e4c162fa0 2024-04-17T19:54:53.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.108+0000 7f6e51e83640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f6e4c16ce30 con 0x7f6e4c0b86b0 2024-04-17T19:54:53.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.108+0000 7f6e4b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e4c0b82a0 0x7f6e4c0cdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:53.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.108+0000 7f6e4b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e4c0b82a0 0x7f6e4c0cdaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60868/0 (socket says 172.21.15.18:60868) 2024-04-17T19:54:53.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.108+0000 7f6e4b7fe640 1 -- 172.21.15.18:0/2234274716 learned_addr learned my addr 172.21.15.18:0/2234274716 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:54:53.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.108+0000 7f6e4bfff640 1 --2- 172.21.15.18:0/2234274716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e4c162fa0 0x7f6e4c151140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:53.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.108+0000 7f6e4b7fe640 1 -- 172.21.15.18:0/2234274716 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6e4c0b86b0 msgr2=0x7f6e4c150c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:53.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.108+0000 7f6e42ffd640 1 --2- 172.21.15.18:0/2234274716 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6e4c0b86b0 0x7f6e4c150c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:53.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.108+0000 7f6e4b7fe640 1 --2- 172.21.15.18:0/2234274716 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6e4c0b86b0 0x7f6e4c150c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:53.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.108+0000 7f6e4b7fe640 1 -- 172.21.15.18:0/2234274716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e4c162fa0 msgr2=0x7f6e4c151140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:53.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.108+0000 7f6e4b7fe640 1 --2- 172.21.15.18:0/2234274716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e4c162fa0 0x7f6e4c151140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:53.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.108+0000 7f6e4b7fe640 1 -- 172.21.15.18:0/2234274716 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e4c152e40 con 0x7f6e4c0b82a0 2024-04-17T19:54:53.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.108+0000 7f6e4bfff640 1 --2- 172.21.15.18:0/2234274716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e4c162fa0 0x7f6e4c151140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:54:53.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.108+0000 7f6e4b7fe640 1 --2- 172.21.15.18:0/2234274716 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e4c0b82a0 0x7f6e4c0cdaa0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c00e8a0 tx=0x7f6e3c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:53.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.108+0000 7f6e48ff9640 1 -- 172.21.15.18:0/2234274716 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c017070 con 0x7f6e4c0b82a0 2024-04-17T19:54:53.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.108+0000 7f6e48ff9640 1 -- 172.21.15.18:0/2234274716 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e3c00c940 con 0x7f6e4c0b82a0 2024-04-17T19:54:53.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.108+0000 7f6e51e83640 1 -- 172.21.15.18:0/2234274716 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e4c1530e0 con 0x7f6e4c0b82a0 2024-04-17T19:54:53.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.108+0000 7f6e48ff9640 1 -- 172.21.15.18:0/2234274716 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c00cd10 con 0x7f6e4c0b82a0 2024-04-17T19:54:53.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.108+0000 7f6e51e83640 1 -- 172.21.15.18:0/2234274716 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e4c1536a0 con 0x7f6e4c0b82a0 2024-04-17T19:54:53.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.108+0000 7f6e51e83640 1 -- 172.21.15.18:0/2234274716 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e4c069950 con 0x7f6e4c0b82a0 2024-04-17T19:54:53.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.112+0000 7f6e48ff9640 1 -- 172.21.15.18:0/2234274716 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6e3c01a070 con 0x7f6e4c0b82a0 2024-04-17T19:54:53.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.112+0000 7f6e48ff9640 1 --2- 172.21.15.18:0/2234274716 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f6e2c0683b0 0x7f6e2c06a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:54:53.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.112+0000 7f6e48ff9640 1 -- 172.21.15.18:0/2234274716 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7f6e3c086f10 con 0x7f6e4c0b82a0 2024-04-17T19:54:53.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.112+0000 7f6e42ffd640 1 --2- 172.21.15.18:0/2234274716 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f6e2c0683b0 0x7f6e2c06a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:54:53.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.112+0000 7f6e42ffd640 1 --2- 172.21.15.18:0/2234274716 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f6e2c0683b0 0x7f6e2c06a8c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6e340af000 tx=0x7f6e34008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:54:53.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.116+0000 7f6e48ff9640 1 -- 172.21.15.18:0/2234274716 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6e3c057100 con 0x7f6e4c0b82a0 2024-04-17T19:54:53.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.280+0000 7f6e51e83640 1 -- 172.21.15.18:0/2234274716 --> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6e4c068ae0 con 0x7f6e2c0683b0 2024-04-17T19:54:53.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.304+0000 7f6e48ff9640 1 -- 172.21.15.18:0/2234274716 <== mgr.4104 v2:172.21.15.18:6832/751466605 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332480 (secure 0 0 0) 0x7f6e340b0040 con 0x7f6e2c0683b0 2024-04-17T19:54:53.304 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:54:53.307 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-17T19:54:53.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.308+0000 7f6e51e83640 1 -- 172.21.15.18:0/2234274716 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f6e2c0683b0 msgr2=0x7f6e2c06a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:53.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.308+0000 7f6e51e83640 1 --2- 172.21.15.18:0/2234274716 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f6e2c0683b0 0x7f6e2c06a8c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6e340af000 tx=0x7f6e34008040 comp rx=0 tx=0).stop 2024-04-17T19:54:53.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.308+0000 7f6e51e83640 1 -- 172.21.15.18:0/2234274716 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e4c0b82a0 msgr2=0x7f6e4c0cdaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:54:53.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.308+0000 7f6e51e83640 1 --2- 172.21.15.18:0/2234274716 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e4c0b82a0 0x7f6e4c0cdaa0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c00e8a0 tx=0x7f6e3c00eca0 comp rx=0 tx=0).stop 2024-04-17T19:54:53.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.308+0000 7f6e51e83640 1 -- 172.21.15.18:0/2234274716 shutdown_connections 2024-04-17T19:54:53.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.308+0000 7f6e51e83640 1 --2- 172.21.15.18:0/2234274716 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f6e2c0683b0 0x7f6e2c06a8c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:53.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.308+0000 7f6e51e83640 1 --2- 172.21.15.18:0/2234274716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e4c162fa0 0x7f6e4c151140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:53.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.308+0000 7f6e51e83640 1 --2- 172.21.15.18:0/2234274716 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6e4c0b86b0 0x7f6e4c150c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:53.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.308+0000 7f6e51e83640 1 --2- 172.21.15.18:0/2234274716 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e4c0b82a0 0x7f6e4c0cdaa0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:54:53.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.308+0000 7f6e51e83640 1 -- 172.21.15.18:0/2234274716 >> 172.21.15.18:0/2234274716 conn(0x7f6e4c0b6cf0 msgr2=0x7f6e4c0d3420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:54:53.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.308+0000 7f6e51e83640 1 -- 172.21.15.18:0/2234274716 shutdown_connections 2024-04-17T19:54:53.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:54:53.308+0000 7f6e51e83640 1 -- 172.21.15.18:0/2234274716 wait complete. 2024-04-17T19:54:53.329 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":83,"stamp":"2024-04-17T19:54:52.385512+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597336,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":219,"num_write_kb":2446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":193,"ondisk_log_size":193,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240560,"kb_used_data":3632,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754734160,"statfs":{"total":773094113280,"available":772847779840,"internally_reserved":0,"allocated":3719168,"data_stored":2188528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":242535988},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005458"},"pg_stats":[{"pgid":"2.1f","version":"29'6","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:33.068855+0000","last_change":"2024-04-17T19:54:33.068936+0000","last_active":"2024-04-17T19:54:33.068855+0000","last_peered":"2024-04-17T19:54:33.068855+0000","last_clean":"2024-04-17T19:54:33.068855+0000","last_became_active":"2024-04-17T19:53:04.460006+0000","last_became_peered":"2024-04-17T19:53:04.460006+0000","last_unstale":"2024-04-17T19:54:33.068855+0000","last_undegraded":"2024-04-17T19:54:33.068855+0000","last_fullsized":"2024-04-17T19:54:33.068855+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-04-17T19:54:33.068649+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-04-17T19:54:33.068649+0000","last_clean_scrub_stamp":"2024-04-17T19:54:33.068649+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:47:42.637103+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:31.604137+0000","last_change":"2024-04-17T19:54:31.604229+0000","last_active":"2024-04-17T19:54:31.604137+0000","last_peered":"2024-04-17T19:54:31.604137+0000","last_clean":"2024-04-17T19:54:31.604137+0000","last_became_active":"2024-04-17T19:53:05.467848+0000","last_became_peered":"2024-04-17T19:53:05.467848+0000","last_unstale":"2024-04-17T19:54:31.604137+0000","last_undegraded":"2024-04-17T19:54:31.604137+0000","last_fullsized":"2024-04-17T19:54:31.604137+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:31.603935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:31.603935+0000","last_clean_scrub_stamp":"2024-04-17T19:54:31.603935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:48:06.477508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:38.859572+0000","last_change":"2024-04-17T19:54:38.859643+0000","last_active":"2024-04-17T19:54:38.859572+0000","last_peered":"2024-04-17T19:54:38.859572+0000","last_clean":"2024-04-17T19:54:38.859572+0000","last_became_active":"2024-04-17T19:53:09.558504+0000","last_became_peered":"2024-04-17T19:53:09.558504+0000","last_unstale":"2024-04-17T19:54:38.859572+0000","last_undegraded":"2024-04-17T19:54:38.859572+0000","last_fullsized":"2024-04-17T19:54:38.859572+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:38.859352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:38.859352+0000","last_clean_scrub_stamp":"2024-04-17T19:54:38.859352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:31:51.943483+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:36.761341+0000","last_change":"2024-04-17T19:54:36.761409+0000","last_active":"2024-04-17T19:54:36.761341+0000","last_peered":"2024-04-17T19:54:36.761341+0000","last_clean":"2024-04-17T19:54:36.761341+0000","last_became_active":"2024-04-17T19:53:04.468291+0000","last_became_peered":"2024-04-17T19:53:04.468291+0000","last_unstale":"2024-04-17T19:54:36.761341+0000","last_undegraded":"2024-04-17T19:54:36.761341+0000","last_fullsized":"2024-04-17T19:54:36.761341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2024-04-17T19:54:36.761123+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2024-04-17T19:54:36.761123+0000","last_clean_scrub_stamp":"2024-04-17T19:54:36.761123+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:51:06.579473+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:33.695941+0000","last_change":"2024-04-17T19:54:33.696002+0000","last_active":"2024-04-17T19:54:33.695941+0000","last_peered":"2024-04-17T19:54:33.695941+0000","last_clean":"2024-04-17T19:54:33.695941+0000","last_became_active":"2024-04-17T19:53:05.473678+0000","last_became_peered":"2024-04-17T19:53:05.473678+0000","last_unstale":"2024-04-17T19:54:33.695941+0000","last_undegraded":"2024-04-17T19:54:33.695941+0000","last_fullsized":"2024-04-17T19:54:33.695941+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:33.695727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:33.695727+0000","last_clean_scrub_stamp":"2024-04-17T19:54:33.695727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:28:51.406487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:40.348490+0000","last_change":"2024-04-17T19:54:40.348586+0000","last_active":"2024-04-17T19:54:40.348490+0000","last_peered":"2024-04-17T19:54:40.348490+0000","last_clean":"2024-04-17T19:54:40.348490+0000","last_became_active":"2024-04-17T19:53:09.544580+0000","last_became_peered":"2024-04-17T19:53:09.544580+0000","last_unstale":"2024-04-17T19:54:40.348490+0000","last_undegraded":"2024-04-17T19:54:40.348490+0000","last_fullsized":"2024-04-17T19:54:40.348490+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:40.348275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:40.348275+0000","last_clean_scrub_stamp":"2024-04-17T19:54:40.348275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:54:15.941094+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"29'3","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:33.262766+0000","last_change":"2024-04-17T19:54:33.262926+0000","last_active":"2024-04-17T19:54:33.262766+0000","last_peered":"2024-04-17T19:54:33.262766+0000","last_clean":"2024-04-17T19:54:33.262766+0000","last_became_active":"2024-04-17T19:53:04.467568+0000","last_became_peered":"2024-04-17T19:53:04.467568+0000","last_unstale":"2024-04-17T19:54:33.262766+0000","last_undegraded":"2024-04-17T19:54:33.262766+0000","last_fullsized":"2024-04-17T19:54:33.262766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-04-17T19:54:33.262526+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-04-17T19:54:33.262526+0000","last_clean_scrub_stamp":"2024-04-17T19:54:33.262526+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:28:50.973286+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:34.944510+0000","last_change":"2024-04-17T19:54:34.944577+0000","last_active":"2024-04-17T19:54:34.944510+0000","last_peered":"2024-04-17T19:54:34.944510+0000","last_clean":"2024-04-17T19:54:34.944510+0000","last_became_active":"2024-04-17T19:53:05.464601+0000","last_became_peered":"2024-04-17T19:53:05.464601+0000","last_unstale":"2024-04-17T19:54:34.944510+0000","last_undegraded":"2024-04-17T19:54:34.944510+0000","last_fullsized":"2024-04-17T19:54:34.944510+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:34.944317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:34.944317+0000","last_clean_scrub_stamp":"2024-04-17T19:54:34.944317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:25:21.620850+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:39.341762+0000","last_change":"2024-04-17T19:54:39.341846+0000","last_active":"2024-04-17T19:54:39.341762+0000","last_peered":"2024-04-17T19:54:39.341762+0000","last_clean":"2024-04-17T19:54:39.341762+0000","last_became_active":"2024-04-17T19:53:09.528285+0000","last_became_peered":"2024-04-17T19:53:09.528285+0000","last_unstale":"2024-04-17T19:54:39.341762+0000","last_undegraded":"2024-04-17T19:54:39.341762+0000","last_fullsized":"2024-04-17T19:54:39.341762+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:39.341546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:39.341546+0000","last_clean_scrub_stamp":"2024-04-17T19:54:39.341546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:36:44.798061+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"29'3","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:32.277293+0000","last_change":"2024-04-17T19:54:32.277319+0000","last_active":"2024-04-17T19:54:32.277293+0000","last_peered":"2024-04-17T19:54:32.277293+0000","last_clean":"2024-04-17T19:54:32.277293+0000","last_became_active":"2024-04-17T19:53:04.467004+0000","last_became_peered":"2024-04-17T19:53:04.467004+0000","last_unstale":"2024-04-17T19:54:32.277293+0000","last_undegraded":"2024-04-17T19:54:32.277293+0000","last_fullsized":"2024-04-17T19:54:32.277293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-04-17T19:54:32.277221+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-04-17T19:54:32.277221+0000","last_clean_scrub_stamp":"2024-04-17T19:54:32.277221+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:37:12.113197+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:30.555341+0000","last_change":"2024-04-17T19:54:30.555364+0000","last_active":"2024-04-17T19:54:30.555341+0000","last_peered":"2024-04-17T19:54:30.555341+0000","last_clean":"2024-04-17T19:54:30.555341+0000","last_became_active":"2024-04-17T19:53:05.467217+0000","last_became_peered":"2024-04-17T19:53:05.467217+0000","last_unstale":"2024-04-17T19:54:30.555341+0000","last_undegraded":"2024-04-17T19:54:30.555341+0000","last_fullsized":"2024-04-17T19:54:30.555341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:30.555262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:30.555262+0000","last_clean_scrub_stamp":"2024-04-17T19:54:30.555262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:18:16.390951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:42.362464+0000","last_change":"2024-04-17T19:54:42.362529+0000","last_active":"2024-04-17T19:54:42.362464+0000","last_peered":"2024-04-17T19:54:42.362464+0000","last_clean":"2024-04-17T19:54:42.362464+0000","last_became_active":"2024-04-17T19:53:09.548876+0000","last_became_peered":"2024-04-17T19:53:09.548876+0000","last_unstale":"2024-04-17T19:54:42.362464+0000","last_undegraded":"2024-04-17T19:54:42.362464+0000","last_fullsized":"2024-04-17T19:54:42.362464+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:42.362234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:42.362234+0000","last_clean_scrub_stamp":"2024-04-17T19:54:42.362234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:47:57.555966+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:49.620849+0000","last_change":"2024-04-17T19:54:49.620973+0000","last_active":"2024-04-17T19:54:49.620849+0000","last_peered":"2024-04-17T19:54:49.620849+0000","last_clean":"2024-04-17T19:54:49.620849+0000","last_became_active":"2024-04-17T19:53:05.475517+0000","last_became_peered":"2024-04-17T19:53:05.475517+0000","last_unstale":"2024-04-17T19:54:49.620849+0000","last_undegraded":"2024-04-17T19:54:49.620849+0000","last_fullsized":"2024-04-17T19:54:49.620849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:49.620506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:49.620506+0000","last_clean_scrub_stamp":"2024-04-17T19:54:49.620506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:13:22.608497+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"29'3","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:43.580594+0000","last_change":"2024-04-17T19:54:43.580670+0000","last_active":"2024-04-17T19:54:43.580594+0000","last_peered":"2024-04-17T19:54:43.580594+0000","last_clean":"2024-04-17T19:54:43.580594+0000","last_became_active":"2024-04-17T19:53:04.465108+0000","last_became_peered":"2024-04-17T19:53:04.465108+0000","last_unstale":"2024-04-17T19:54:43.580594+0000","last_undegraded":"2024-04-17T19:54:43.580594+0000","last_fullsized":"2024-04-17T19:54:43.580594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-04-17T19:54:43.580358+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-04-17T19:54:43.580358+0000","last_clean_scrub_stamp":"2024-04-17T19:54:43.580358+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:53:50.501802+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.566693+0000","last_change":"2024-04-17T19:53:09.545287+0000","last_active":"2024-04-17T19:53:45.566693+0000","last_peered":"2024-04-17T19:53:45.566693+0000","last_clean":"2024-04-17T19:53:45.566693+0000","last_became_active":"2024-04-17T19:53:09.544328+0000","last_became_peered":"2024-04-17T19:53:09.544328+0000","last_unstale":"2024-04-17T19:53:45.566693+0000","last_undegraded":"2024-04-17T19:53:45.566693+0000","last_fullsized":"2024-04-17T19:53:45.566693+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:36.825651+0000","last_change":"2024-04-17T19:54:36.825763+0000","last_active":"2024-04-17T19:54:36.825651+0000","last_peered":"2024-04-17T19:54:36.825651+0000","last_clean":"2024-04-17T19:54:36.825651+0000","last_became_active":"2024-04-17T19:53:05.495800+0000","last_became_peered":"2024-04-17T19:53:05.495800+0000","last_unstale":"2024-04-17T19:54:36.825651+0000","last_undegraded":"2024-04-17T19:54:36.825651+0000","last_fullsized":"2024-04-17T19:54:36.825651+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:36.825315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:36.825315+0000","last_clean_scrub_stamp":"2024-04-17T19:54:36.825315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:34:59.885998+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:34.772365+0000","last_change":"2024-04-17T19:54:34.772430+0000","last_active":"2024-04-17T19:54:34.772365+0000","last_peered":"2024-04-17T19:54:34.772365+0000","last_clean":"2024-04-17T19:54:34.772365+0000","last_became_active":"2024-04-17T19:53:04.478425+0000","last_became_peered":"2024-04-17T19:53:04.478425+0000","last_unstale":"2024-04-17T19:54:34.772365+0000","last_undegraded":"2024-04-17T19:54:34.772365+0000","last_fullsized":"2024-04-17T19:54:34.772365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:34.772131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:34.772131+0000","last_clean_scrub_stamp":"2024-04-17T19:54:34.772131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:00:04.394614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:46.241668+0000","last_change":"2024-04-17T19:54:46.241734+0000","last_active":"2024-04-17T19:54:46.241668+0000","last_peered":"2024-04-17T19:54:46.241668+0000","last_clean":"2024-04-17T19:54:46.241668+0000","last_became_active":"2024-04-17T19:53:09.525577+0000","last_became_peered":"2024-04-17T19:53:09.525577+0000","last_unstale":"2024-04-17T19:54:46.241668+0000","last_undegraded":"2024-04-17T19:54:46.241668+0000","last_fullsized":"2024-04-17T19:54:46.241668+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:46.241459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:46.241459+0000","last_clean_scrub_stamp":"2024-04-17T19:54:46.241459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:22:27.771568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:32.107135+0000","last_change":"2024-04-17T19:54:32.107195+0000","last_active":"2024-04-17T19:54:32.107135+0000","last_peered":"2024-04-17T19:54:32.107135+0000","last_clean":"2024-04-17T19:54:32.107135+0000","last_became_active":"2024-04-17T19:53:05.462415+0000","last_became_peered":"2024-04-17T19:53:05.462415+0000","last_unstale":"2024-04-17T19:54:32.107135+0000","last_undegraded":"2024-04-17T19:54:32.107135+0000","last_fullsized":"2024-04-17T19:54:32.107135+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:32.106927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:32.106927+0000","last_clean_scrub_stamp":"2024-04-17T19:54:32.106927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:48:21.980434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:37.165495+0000","last_change":"2024-04-17T19:54:37.165563+0000","last_active":"2024-04-17T19:54:37.165495+0000","last_peered":"2024-04-17T19:54:37.165495+0000","last_clean":"2024-04-17T19:54:37.165495+0000","last_became_active":"2024-04-17T19:53:04.470258+0000","last_became_peered":"2024-04-17T19:53:04.470258+0000","last_unstale":"2024-04-17T19:54:37.165495+0000","last_undegraded":"2024-04-17T19:54:37.165495+0000","last_fullsized":"2024-04-17T19:54:37.165495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:37.165295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:37.165295+0000","last_clean_scrub_stamp":"2024-04-17T19:54:37.165295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:36:42.621810+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:41.872665+0000","last_change":"2024-04-17T19:54:41.872796+0000","last_active":"2024-04-17T19:54:41.872665+0000","last_peered":"2024-04-17T19:54:41.872665+0000","last_clean":"2024-04-17T19:54:41.872665+0000","last_became_active":"2024-04-17T19:53:09.564134+0000","last_became_peered":"2024-04-17T19:53:09.564134+0000","last_unstale":"2024-04-17T19:54:41.872665+0000","last_undegraded":"2024-04-17T19:54:41.872665+0000","last_fullsized":"2024-04-17T19:54:41.872665+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:41.872298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:41.872298+0000","last_clean_scrub_stamp":"2024-04-17T19:54:41.872298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:42:25.396236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:33.570448+0000","last_change":"2024-04-17T19:54:33.570513+0000","last_active":"2024-04-17T19:54:33.570448+0000","last_peered":"2024-04-17T19:54:33.570448+0000","last_clean":"2024-04-17T19:54:33.570448+0000","last_became_active":"2024-04-17T19:53:05.466996+0000","last_became_peered":"2024-04-17T19:53:05.466996+0000","last_unstale":"2024-04-17T19:54:33.570448+0000","last_undegraded":"2024-04-17T19:54:33.570448+0000","last_fullsized":"2024-04-17T19:54:33.570448+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:33.570236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:33.570236+0000","last_clean_scrub_stamp":"2024-04-17T19:54:33.570236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:00:10.888202+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:34.215318+0000","last_change":"2024-04-17T19:54:34.215390+0000","last_active":"2024-04-17T19:54:34.215318+0000","last_peered":"2024-04-17T19:54:34.215318+0000","last_clean":"2024-04-17T19:54:34.215318+0000","last_became_active":"2024-04-17T19:53:04.468136+0000","last_became_peered":"2024-04-17T19:53:04.468136+0000","last_unstale":"2024-04-17T19:54:34.215318+0000","last_undegraded":"2024-04-17T19:54:34.215318+0000","last_fullsized":"2024-04-17T19:54:34.215318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:34.215104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:34.215104+0000","last_clean_scrub_stamp":"2024-04-17T19:54:34.215104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:55:30.389643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:44.324900+0000","last_change":"2024-04-17T19:54:44.324964+0000","last_active":"2024-04-17T19:54:44.324900+0000","last_peered":"2024-04-17T19:54:44.324900+0000","last_clean":"2024-04-17T19:54:44.324900+0000","last_became_active":"2024-04-17T19:53:45.586731+0000","last_became_peered":"2024-04-17T19:53:45.586731+0000","last_unstale":"2024-04-17T19:54:44.324900+0000","last_undegraded":"2024-04-17T19:54:44.324900+0000","last_fullsized":"2024-04-17T19:54:44.324900+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:44.324697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:44.324697+0000","last_clean_scrub_stamp":"2024-04-17T19:54:44.324697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:14:18.384761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,7],"acting":[2,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:42.194714+0000","last_change":"2024-04-17T19:54:42.194776+0000","last_active":"2024-04-17T19:54:42.194714+0000","last_peered":"2024-04-17T19:54:42.194714+0000","last_clean":"2024-04-17T19:54:42.194714+0000","last_became_active":"2024-04-17T19:53:05.465048+0000","last_became_peered":"2024-04-17T19:53:05.465048+0000","last_unstale":"2024-04-17T19:54:42.194714+0000","last_undegraded":"2024-04-17T19:54:42.194714+0000","last_fullsized":"2024-04-17T19:54:42.194714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:42.194491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:42.194491+0000","last_clean_scrub_stamp":"2024-04-17T19:54:42.194491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:14:16.254555+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"29'3","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:44.622882+0000","last_change":"2024-04-17T19:54:44.622963+0000","last_active":"2024-04-17T19:54:44.622882+0000","last_peered":"2024-04-17T19:54:44.622882+0000","last_clean":"2024-04-17T19:54:44.622882+0000","last_became_active":"2024-04-17T19:53:04.469119+0000","last_became_peered":"2024-04-17T19:53:04.469119+0000","last_unstale":"2024-04-17T19:54:44.622882+0000","last_undegraded":"2024-04-17T19:54:44.622882+0000","last_fullsized":"2024-04-17T19:54:44.622882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-04-17T19:54:44.622670+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-04-17T19:54:44.622670+0000","last_clean_scrub_stamp":"2024-04-17T19:54:44.622670+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:11:46.929005+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:38.334524+0000","last_change":"2024-04-17T19:54:38.334663+0000","last_active":"2024-04-17T19:54:38.334524+0000","last_peered":"2024-04-17T19:54:38.334524+0000","last_clean":"2024-04-17T19:54:38.334524+0000","last_became_active":"2024-04-17T19:53:09.526436+0000","last_became_peered":"2024-04-17T19:53:09.526436+0000","last_unstale":"2024-04-17T19:54:38.334524+0000","last_undegraded":"2024-04-17T19:54:38.334524+0000","last_fullsized":"2024-04-17T19:54:38.334524+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:38.334262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:38.334262+0000","last_clean_scrub_stamp":"2024-04-17T19:54:38.334262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:18:24.169951+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:39.174455+0000","last_change":"2024-04-17T19:54:39.174576+0000","last_active":"2024-04-17T19:54:39.174455+0000","last_peered":"2024-04-17T19:54:39.174455+0000","last_clean":"2024-04-17T19:54:39.174455+0000","last_became_active":"2024-04-17T19:53:05.442881+0000","last_became_peered":"2024-04-17T19:53:05.442881+0000","last_unstale":"2024-04-17T19:54:39.174455+0000","last_undegraded":"2024-04-17T19:54:39.174455+0000","last_fullsized":"2024-04-17T19:54:39.174455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:39.174135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:39.174135+0000","last_clean_scrub_stamp":"2024-04-17T19:54:39.174135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:00:16.492101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"29'2","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:35.117453+0000","last_change":"2024-04-17T19:54:35.117588+0000","last_active":"2024-04-17T19:54:35.117453+0000","last_peered":"2024-04-17T19:54:35.117453+0000","last_clean":"2024-04-17T19:54:35.117453+0000","last_became_active":"2024-04-17T19:53:04.464701+0000","last_became_peered":"2024-04-17T19:53:04.464701+0000","last_unstale":"2024-04-17T19:54:35.117453+0000","last_undegraded":"2024-04-17T19:54:35.117453+0000","last_fullsized":"2024-04-17T19:54:35.117453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-17T19:54:35.117211+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-17T19:54:35.117211+0000","last_clean_scrub_stamp":"2024-04-17T19:54:35.117211+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:11:42.011626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:44.174652+0000","last_change":"2024-04-17T19:54:44.174722+0000","last_active":"2024-04-17T19:54:44.174652+0000","last_peered":"2024-04-17T19:54:44.174652+0000","last_clean":"2024-04-17T19:54:44.174652+0000","last_became_active":"2024-04-17T19:53:09.529345+0000","last_became_peered":"2024-04-17T19:53:09.529345+0000","last_unstale":"2024-04-17T19:54:44.174652+0000","last_undegraded":"2024-04-17T19:54:44.174652+0000","last_fullsized":"2024-04-17T19:54:44.174652+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:44.174442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:44.174442+0000","last_clean_scrub_stamp":"2024-04-17T19:54:44.174442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:44:56.571729+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:35.736147+0000","last_change":"2024-04-17T19:54:35.736232+0000","last_active":"2024-04-17T19:54:35.736147+0000","last_peered":"2024-04-17T19:54:35.736147+0000","last_clean":"2024-04-17T19:54:35.736147+0000","last_became_active":"2024-04-17T19:53:05.451272+0000","last_became_peered":"2024-04-17T19:53:05.451272+0000","last_unstale":"2024-04-17T19:54:35.736147+0000","last_undegraded":"2024-04-17T19:54:35.736147+0000","last_fullsized":"2024-04-17T19:54:35.736147+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:35.735939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:35.735939+0000","last_clean_scrub_stamp":"2024-04-17T19:54:35.735939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:37:20.814690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:46.595342+0000","last_change":"2024-04-17T19:54:46.595409+0000","last_active":"2024-04-17T19:54:46.595342+0000","last_peered":"2024-04-17T19:54:46.595342+0000","last_clean":"2024-04-17T19:54:46.595342+0000","last_became_active":"2024-04-17T19:53:04.471458+0000","last_became_peered":"2024-04-17T19:53:04.471458+0000","last_unstale":"2024-04-17T19:54:46.595342+0000","last_undegraded":"2024-04-17T19:54:46.595342+0000","last_fullsized":"2024-04-17T19:54:46.595342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:46.595127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:46.595127+0000","last_clean_scrub_stamp":"2024-04-17T19:54:46.595127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:37:42.061867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:44.680723+0000","last_change":"2024-04-17T19:54:44.680801+0000","last_active":"2024-04-17T19:54:44.680723+0000","last_peered":"2024-04-17T19:54:44.680723+0000","last_clean":"2024-04-17T19:54:44.680723+0000","last_became_active":"2024-04-17T19:53:09.548136+0000","last_became_peered":"2024-04-17T19:53:09.548136+0000","last_unstale":"2024-04-17T19:54:44.680723+0000","last_undegraded":"2024-04-17T19:54:44.680723+0000","last_fullsized":"2024-04-17T19:54:44.680723+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:44.680497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:44.680497+0000","last_clean_scrub_stamp":"2024-04-17T19:54:44.680497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:07.219745+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:37.338104+0000","last_change":"2024-04-17T19:54:37.338166+0000","last_active":"2024-04-17T19:54:37.338104+0000","last_peered":"2024-04-17T19:54:37.338104+0000","last_clean":"2024-04-17T19:54:37.338104+0000","last_became_active":"2024-04-17T19:53:05.472513+0000","last_became_peered":"2024-04-17T19:53:05.472513+0000","last_unstale":"2024-04-17T19:54:37.338104+0000","last_undegraded":"2024-04-17T19:54:37.338104+0000","last_fullsized":"2024-04-17T19:54:37.338104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:37.337872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:37.337872+0000","last_clean_scrub_stamp":"2024-04-17T19:54:37.337872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:55:33.512412+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:38.793086+0000","last_change":"2024-04-17T19:54:38.793146+0000","last_active":"2024-04-17T19:54:38.793086+0000","last_peered":"2024-04-17T19:54:38.793086+0000","last_clean":"2024-04-17T19:54:38.793086+0000","last_became_active":"2024-04-17T19:53:04.487005+0000","last_became_peered":"2024-04-17T19:53:04.487005+0000","last_unstale":"2024-04-17T19:54:38.793086+0000","last_undegraded":"2024-04-17T19:54:38.793086+0000","last_fullsized":"2024-04-17T19:54:38.793086+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:38.792894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:38.792894+0000","last_clean_scrub_stamp":"2024-04-17T19:54:38.792894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:00:16.110859+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:42.710833+0000","last_change":"2024-04-17T19:54:42.710977+0000","last_active":"2024-04-17T19:54:42.710833+0000","last_peered":"2024-04-17T19:54:42.710833+0000","last_clean":"2024-04-17T19:54:42.710833+0000","last_became_active":"2024-04-17T19:53:09.545636+0000","last_became_peered":"2024-04-17T19:53:09.545636+0000","last_unstale":"2024-04-17T19:54:42.710833+0000","last_undegraded":"2024-04-17T19:54:42.710833+0000","last_fullsized":"2024-04-17T19:54:42.710833+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:42.710550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:42.710550+0000","last_clean_scrub_stamp":"2024-04-17T19:54:42.710550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:52:09.014718+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:42.196655+0000","last_change":"2024-04-17T19:54:42.196729+0000","last_active":"2024-04-17T19:54:42.196655+0000","last_peered":"2024-04-17T19:54:42.196655+0000","last_clean":"2024-04-17T19:54:42.196655+0000","last_became_active":"2024-04-17T19:53:05.464376+0000","last_became_peered":"2024-04-17T19:53:05.464376+0000","last_unstale":"2024-04-17T19:54:42.196655+0000","last_undegraded":"2024-04-17T19:54:42.196655+0000","last_fullsized":"2024-04-17T19:54:42.196655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:42.196437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:42.196437+0000","last_clean_scrub_stamp":"2024-04-17T19:54:42.196437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:30:23.117850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:41.638501+0000","last_change":"2024-04-17T19:54:41.638579+0000","last_active":"2024-04-17T19:54:41.638501+0000","last_peered":"2024-04-17T19:54:41.638501+0000","last_clean":"2024-04-17T19:54:41.638501+0000","last_became_active":"2024-04-17T19:53:04.464109+0000","last_became_peered":"2024-04-17T19:53:04.464109+0000","last_unstale":"2024-04-17T19:54:41.638501+0000","last_undegraded":"2024-04-17T19:54:41.638501+0000","last_fullsized":"2024-04-17T19:54:41.638501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:41.638283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:41.638283+0000","last_clean_scrub_stamp":"2024-04-17T19:54:41.638283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:30:51.214513+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:46.670954+0000","last_change":"2024-04-17T19:54:46.671018+0000","last_active":"2024-04-17T19:54:46.670954+0000","last_peered":"2024-04-17T19:54:46.670954+0000","last_clean":"2024-04-17T19:54:46.670954+0000","last_became_active":"2024-04-17T19:53:09.548806+0000","last_became_peered":"2024-04-17T19:53:09.548806+0000","last_unstale":"2024-04-17T19:54:46.670954+0000","last_undegraded":"2024-04-17T19:54:46.670954+0000","last_fullsized":"2024-04-17T19:54:46.670954+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:46.670742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:46.670742+0000","last_clean_scrub_stamp":"2024-04-17T19:54:46.670742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:06:22.772782+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:44.806266+0000","last_change":"2024-04-17T19:54:44.806332+0000","last_active":"2024-04-17T19:54:44.806266+0000","last_peered":"2024-04-17T19:54:44.806266+0000","last_clean":"2024-04-17T19:54:44.806266+0000","last_became_active":"2024-04-17T19:53:05.474164+0000","last_became_peered":"2024-04-17T19:53:05.474164+0000","last_unstale":"2024-04-17T19:54:44.806266+0000","last_undegraded":"2024-04-17T19:54:44.806266+0000","last_fullsized":"2024-04-17T19:54:44.806266+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:44.806022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:44.806022+0000","last_clean_scrub_stamp":"2024-04-17T19:54:44.806022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:29:16.767697+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:34.829114+0000","last_change":"2024-04-17T19:54:34.829180+0000","last_active":"2024-04-17T19:54:34.829114+0000","last_peered":"2024-04-17T19:54:34.829114+0000","last_clean":"2024-04-17T19:54:34.829114+0000","last_became_active":"2024-04-17T19:53:04.485424+0000","last_became_peered":"2024-04-17T19:53:04.485424+0000","last_unstale":"2024-04-17T19:54:34.829114+0000","last_undegraded":"2024-04-17T19:54:34.829114+0000","last_fullsized":"2024-04-17T19:54:34.829114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:34.828902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:34.828902+0000","last_clean_scrub_stamp":"2024-04-17T19:54:34.828902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:27:18.811583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:43.698021+0000","last_change":"2024-04-17T19:54:43.698100+0000","last_active":"2024-04-17T19:54:43.698021+0000","last_peered":"2024-04-17T19:54:43.698021+0000","last_clean":"2024-04-17T19:54:43.698021+0000","last_became_active":"2024-04-17T19:53:09.548070+0000","last_became_peered":"2024-04-17T19:53:09.548070+0000","last_unstale":"2024-04-17T19:54:43.698021+0000","last_undegraded":"2024-04-17T19:54:43.698021+0000","last_fullsized":"2024-04-17T19:54:43.698021+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:43.697813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:43.697813+0000","last_clean_scrub_stamp":"2024-04-17T19:54:43.697813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:31:34.403430+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:41.720807+0000","last_change":"2024-04-17T19:54:41.720877+0000","last_active":"2024-04-17T19:54:41.720807+0000","last_peered":"2024-04-17T19:54:41.720807+0000","last_clean":"2024-04-17T19:54:41.720807+0000","last_became_active":"2024-04-17T19:53:05.468241+0000","last_became_peered":"2024-04-17T19:53:05.468241+0000","last_unstale":"2024-04-17T19:54:41.720807+0000","last_undegraded":"2024-04-17T19:54:41.720807+0000","last_fullsized":"2024-04-17T19:54:41.720807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:41.720597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:41.720597+0000","last_clean_scrub_stamp":"2024-04-17T19:54:41.720597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:18:30.659233+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:38.617749+0000","last_change":"2024-04-17T19:54:38.617833+0000","last_active":"2024-04-17T19:54:38.617749+0000","last_peered":"2024-04-17T19:54:38.617749+0000","last_clean":"2024-04-17T19:54:38.617749+0000","last_became_active":"2024-04-17T19:53:04.483882+0000","last_became_peered":"2024-04-17T19:53:04.483882+0000","last_unstale":"2024-04-17T19:54:38.617749+0000","last_undegraded":"2024-04-17T19:54:38.617749+0000","last_fullsized":"2024-04-17T19:54:38.617749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:38.617547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:38.617547+0000","last_clean_scrub_stamp":"2024-04-17T19:54:38.617547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:44:51.014835+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:49.837388+0000","last_change":"2024-04-17T19:54:49.837457+0000","last_active":"2024-04-17T19:54:49.837388+0000","last_peered":"2024-04-17T19:54:49.837388+0000","last_clean":"2024-04-17T19:54:49.837388+0000","last_became_active":"2024-04-17T19:53:09.558888+0000","last_became_peered":"2024-04-17T19:53:09.558888+0000","last_unstale":"2024-04-17T19:54:49.837388+0000","last_undegraded":"2024-04-17T19:54:49.837388+0000","last_fullsized":"2024-04-17T19:54:49.837388+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:49.837159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:49.837159+0000","last_clean_scrub_stamp":"2024-04-17T19:54:49.837159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:11:52.143493+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:31.105935+0000","last_change":"2024-04-17T19:54:31.106015+0000","last_active":"2024-04-17T19:54:31.105935+0000","last_peered":"2024-04-17T19:54:31.105935+0000","last_clean":"2024-04-17T19:54:31.105935+0000","last_became_active":"2024-04-17T19:53:05.462437+0000","last_became_peered":"2024-04-17T19:53:05.462437+0000","last_unstale":"2024-04-17T19:54:31.105935+0000","last_undegraded":"2024-04-17T19:54:31.105935+0000","last_fullsized":"2024-04-17T19:54:31.105935+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:31.105721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:31.105721+0000","last_clean_scrub_stamp":"2024-04-17T19:54:31.105721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:42:14.629660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:39.639298+0000","last_change":"2024-04-17T19:54:39.639424+0000","last_active":"2024-04-17T19:54:39.639298+0000","last_peered":"2024-04-17T19:54:39.639298+0000","last_clean":"2024-04-17T19:54:39.639298+0000","last_became_active":"2024-04-17T19:53:04.458798+0000","last_became_peered":"2024-04-17T19:53:04.458798+0000","last_unstale":"2024-04-17T19:54:39.639298+0000","last_undegraded":"2024-04-17T19:54:39.639298+0000","last_fullsized":"2024-04-17T19:54:39.639298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:39.639029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:39.639029+0000","last_clean_scrub_stamp":"2024-04-17T19:54:39.639029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:12:22.145725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"29'119","reported_seq":192,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:29.935286+0000","last_change":"2024-04-17T19:54:29.935333+0000","last_active":"2024-04-17T19:54:29.935286+0000","last_peered":"2024-04-17T19:54:29.935286+0000","last_clean":"2024-04-17T19:54:29.935286+0000","last_became_active":"2024-04-17T19:52:54.649700+0000","last_became_peered":"2024-04-17T19:52:54.649700+0000","last_unstale":"2024-04-17T19:54:29.935286+0000","last_undegraded":"2024-04-17T19:54:29.935286+0000","last_fullsized":"2024-04-17T19:54:29.935286+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'119","last_scrub_stamp":"2024-04-17T19:54:29.935174+0000","last_deep_scrub":"29'119","last_deep_scrub_stamp":"2024-04-17T19:54:29.935174+0000","last_clean_scrub_stamp":"2024-04-17T19:54:29.935174+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:43:19.897643+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:47.283652+0000","last_change":"2024-04-17T19:54:47.283722+0000","last_active":"2024-04-17T19:54:47.283652+0000","last_peered":"2024-04-17T19:54:47.283652+0000","last_clean":"2024-04-17T19:54:47.283652+0000","last_became_active":"2024-04-17T19:53:45.464724+0000","last_became_peered":"2024-04-17T19:53:45.464724+0000","last_unstale":"2024-04-17T19:54:47.283652+0000","last_undegraded":"2024-04-17T19:54:47.283652+0000","last_fullsized":"2024-04-17T19:54:47.283652+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:47.283401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:47.283401+0000","last_clean_scrub_stamp":"2024-04-17T19:54:47.283401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:30:56.859631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,2,0],"acting":[4,5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:48.614550+0000","last_change":"2024-04-17T19:54:48.614614+0000","last_active":"2024-04-17T19:54:48.614550+0000","last_peered":"2024-04-17T19:54:48.614550+0000","last_clean":"2024-04-17T19:54:48.614550+0000","last_became_active":"2024-04-17T19:53:05.475600+0000","last_became_peered":"2024-04-17T19:53:05.475600+0000","last_unstale":"2024-04-17T19:54:48.614550+0000","last_undegraded":"2024-04-17T19:54:48.614550+0000","last_fullsized":"2024-04-17T19:54:48.614550+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:48.614310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:48.614310+0000","last_clean_scrub_stamp":"2024-04-17T19:54:48.614310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:16:21.133094+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:32.851034+0000","last_change":"2024-04-17T19:54:32.851104+0000","last_active":"2024-04-17T19:54:32.851034+0000","last_peered":"2024-04-17T19:54:32.851034+0000","last_clean":"2024-04-17T19:54:32.851034+0000","last_became_active":"2024-04-17T19:53:04.453473+0000","last_became_peered":"2024-04-17T19:53:04.453473+0000","last_unstale":"2024-04-17T19:54:32.851034+0000","last_undegraded":"2024-04-17T19:54:32.851034+0000","last_fullsized":"2024-04-17T19:54:32.851034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:32.850810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:32.850810+0000","last_clean_scrub_stamp":"2024-04-17T19:54:32.850810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:40:17.682304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:41.362462+0000","last_change":"2024-04-17T19:54:41.362538+0000","last_active":"2024-04-17T19:54:41.362462+0000","last_peered":"2024-04-17T19:54:41.362462+0000","last_clean":"2024-04-17T19:54:41.362462+0000","last_became_active":"2024-04-17T19:53:09.548575+0000","last_became_peered":"2024-04-17T19:53:09.548575+0000","last_unstale":"2024-04-17T19:54:41.362462+0000","last_undegraded":"2024-04-17T19:54:41.362462+0000","last_fullsized":"2024-04-17T19:54:41.362462+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:41.362248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:41.362248+0000","last_clean_scrub_stamp":"2024-04-17T19:54:41.362248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:24:04.704304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:40.107815+0000","last_change":"2024-04-17T19:54:40.107882+0000","last_active":"2024-04-17T19:54:40.107815+0000","last_peered":"2024-04-17T19:54:40.107815+0000","last_clean":"2024-04-17T19:54:40.107815+0000","last_became_active":"2024-04-17T19:53:05.463935+0000","last_became_peered":"2024-04-17T19:53:05.463935+0000","last_unstale":"2024-04-17T19:54:40.107815+0000","last_undegraded":"2024-04-17T19:54:40.107815+0000","last_fullsized":"2024-04-17T19:54:40.107815+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:40.107587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:40.107587+0000","last_clean_scrub_stamp":"2024-04-17T19:54:40.107587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:40:35.119877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"29'2","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:35.747222+0000","last_change":"2024-04-17T19:54:35.747302+0000","last_active":"2024-04-17T19:54:35.747222+0000","last_peered":"2024-04-17T19:54:35.747222+0000","last_clean":"2024-04-17T19:54:35.747222+0000","last_became_active":"2024-04-17T19:53:04.467881+0000","last_became_peered":"2024-04-17T19:53:04.467881+0000","last_unstale":"2024-04-17T19:54:35.747222+0000","last_undegraded":"2024-04-17T19:54:35.747222+0000","last_fullsized":"2024-04-17T19:54:35.747222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-17T19:54:35.747013+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-17T19:54:35.747013+0000","last_clean_scrub_stamp":"2024-04-17T19:54:35.747013+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:18:21.582701+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:47.799915+0000","last_change":"2024-04-17T19:54:47.799982+0000","last_active":"2024-04-17T19:54:47.799915+0000","last_peered":"2024-04-17T19:54:47.799915+0000","last_clean":"2024-04-17T19:54:47.799915+0000","last_became_active":"2024-04-17T19:53:09.534631+0000","last_became_peered":"2024-04-17T19:53:09.534631+0000","last_unstale":"2024-04-17T19:54:47.799915+0000","last_undegraded":"2024-04-17T19:54:47.799915+0000","last_fullsized":"2024-04-17T19:54:47.799915+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:47.799709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:47.799709+0000","last_clean_scrub_stamp":"2024-04-17T19:54:47.799709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:56:47.040578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:30.225908+0000","last_change":"2024-04-17T19:54:30.225930+0000","last_active":"2024-04-17T19:54:30.225908+0000","last_peered":"2024-04-17T19:54:30.225908+0000","last_clean":"2024-04-17T19:54:30.225908+0000","last_became_active":"2024-04-17T19:53:05.459941+0000","last_became_peered":"2024-04-17T19:53:05.459941+0000","last_unstale":"2024-04-17T19:54:30.225908+0000","last_undegraded":"2024-04-17T19:54:30.225908+0000","last_fullsized":"2024-04-17T19:54:30.225908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:30.225828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:30.225828+0000","last_clean_scrub_stamp":"2024-04-17T19:54:30.225828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:42:13.749766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"29'3","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:36.124197+0000","last_change":"2024-04-17T19:54:36.124296+0000","last_active":"2024-04-17T19:54:36.124197+0000","last_peered":"2024-04-17T19:54:36.124197+0000","last_clean":"2024-04-17T19:54:36.124197+0000","last_became_active":"2024-04-17T19:53:04.466753+0000","last_became_peered":"2024-04-17T19:53:04.466753+0000","last_unstale":"2024-04-17T19:54:36.124197+0000","last_undegraded":"2024-04-17T19:54:36.124197+0000","last_fullsized":"2024-04-17T19:54:36.124197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-04-17T19:54:36.123994+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-04-17T19:54:36.123994+0000","last_clean_scrub_stamp":"2024-04-17T19:54:36.123994+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:18:21.959683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:51.630305+0000","last_change":"2024-04-17T19:54:51.630375+0000","last_active":"2024-04-17T19:54:51.630305+0000","last_peered":"2024-04-17T19:54:51.630305+0000","last_clean":"2024-04-17T19:54:51.630305+0000","last_became_active":"2024-04-17T19:53:09.518979+0000","last_became_peered":"2024-04-17T19:53:09.518979+0000","last_unstale":"2024-04-17T19:54:51.630305+0000","last_undegraded":"2024-04-17T19:54:51.630305+0000","last_fullsized":"2024-04-17T19:54:51.630305+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:51.630030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:51.630030+0000","last_clean_scrub_stamp":"2024-04-17T19:54:51.630030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:49:07.846948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:34.380941+0000","last_change":"2024-04-17T19:54:34.381006+0000","last_active":"2024-04-17T19:54:34.380941+0000","last_peered":"2024-04-17T19:54:34.380941+0000","last_clean":"2024-04-17T19:54:34.380941+0000","last_became_active":"2024-04-17T19:53:05.464158+0000","last_became_peered":"2024-04-17T19:53:05.464158+0000","last_unstale":"2024-04-17T19:54:34.380941+0000","last_undegraded":"2024-04-17T19:54:34.380941+0000","last_fullsized":"2024-04-17T19:54:34.380941+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:34.380741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:34.380741+0000","last_clean_scrub_stamp":"2024-04-17T19:54:34.380741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:48:24.254248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"29'2","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:36.185598+0000","last_change":"2024-04-17T19:54:36.185673+0000","last_active":"2024-04-17T19:54:36.185598+0000","last_peered":"2024-04-17T19:54:36.185598+0000","last_clean":"2024-04-17T19:54:36.185598+0000","last_became_active":"2024-04-17T19:53:04.477162+0000","last_became_peered":"2024-04-17T19:53:04.477162+0000","last_unstale":"2024-04-17T19:54:36.185598+0000","last_undegraded":"2024-04-17T19:54:36.185598+0000","last_fullsized":"2024-04-17T19:54:36.185598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-17T19:54:36.185367+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-17T19:54:36.185367+0000","last_clean_scrub_stamp":"2024-04-17T19:54:36.185367+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:36:41.641883+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:37.014138+0000","last_change":"2024-04-17T19:54:37.014214+0000","last_active":"2024-04-17T19:54:37.014138+0000","last_peered":"2024-04-17T19:54:37.014138+0000","last_clean":"2024-04-17T19:54:37.014138+0000","last_became_active":"2024-04-17T19:53:09.532715+0000","last_became_peered":"2024-04-17T19:53:09.532715+0000","last_unstale":"2024-04-17T19:54:37.014138+0000","last_undegraded":"2024-04-17T19:54:37.014138+0000","last_fullsized":"2024-04-17T19:54:37.014138+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:37.013907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:37.013907+0000","last_clean_scrub_stamp":"2024-04-17T19:54:37.013907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:23:20.051411+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:35.625158+0000","last_change":"2024-04-17T19:54:35.625229+0000","last_active":"2024-04-17T19:54:35.625158+0000","last_peered":"2024-04-17T19:54:35.625158+0000","last_clean":"2024-04-17T19:54:35.625158+0000","last_became_active":"2024-04-17T19:53:05.468223+0000","last_became_peered":"2024-04-17T19:53:05.468223+0000","last_unstale":"2024-04-17T19:54:35.625158+0000","last_undegraded":"2024-04-17T19:54:35.625158+0000","last_fullsized":"2024-04-17T19:54:35.625158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:35.624895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:35.624895+0000","last_clean_scrub_stamp":"2024-04-17T19:54:35.624895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:26:33.171568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"29'12","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:34.105744+0000","last_change":"2024-04-17T19:54:34.105831+0000","last_active":"2024-04-17T19:54:34.105744+0000","last_peered":"2024-04-17T19:54:34.105744+0000","last_clean":"2024-04-17T19:54:34.105744+0000","last_became_active":"2024-04-17T19:53:04.460919+0000","last_became_peered":"2024-04-17T19:53:04.460919+0000","last_unstale":"2024-04-17T19:54:34.105744+0000","last_undegraded":"2024-04-17T19:54:34.105744+0000","last_fullsized":"2024-04-17T19:54:34.105744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-04-17T19:54:34.105533+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-04-17T19:54:34.105533+0000","last_clean_scrub_stamp":"2024-04-17T19:54:34.105533+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:41:27.472188+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:48.827409+0000","last_change":"2024-04-17T19:54:48.827482+0000","last_active":"2024-04-17T19:54:48.827409+0000","last_peered":"2024-04-17T19:54:48.827409+0000","last_clean":"2024-04-17T19:54:48.827409+0000","last_became_active":"2024-04-17T19:53:09.546048+0000","last_became_peered":"2024-04-17T19:53:09.546048+0000","last_unstale":"2024-04-17T19:54:48.827409+0000","last_undegraded":"2024-04-17T19:54:48.827409+0000","last_fullsized":"2024-04-17T19:54:48.827409+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:48.827197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:48.827197+0000","last_clean_scrub_stamp":"2024-04-17T19:54:48.827197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:53:55.748641+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:35.994982+0000","last_change":"2024-04-17T19:54:35.995049+0000","last_active":"2024-04-17T19:54:35.994982+0000","last_peered":"2024-04-17T19:54:35.994982+0000","last_clean":"2024-04-17T19:54:35.994982+0000","last_became_active":"2024-04-17T19:53:05.473892+0000","last_became_peered":"2024-04-17T19:53:05.473892+0000","last_unstale":"2024-04-17T19:54:35.994982+0000","last_undegraded":"2024-04-17T19:54:35.994982+0000","last_fullsized":"2024-04-17T19:54:35.994982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:35.994766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:35.994766+0000","last_clean_scrub_stamp":"2024-04-17T19:54:35.994766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:00:37.719934+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:31.249500+0000","last_change":"2024-04-17T19:54:31.249622+0000","last_active":"2024-04-17T19:54:31.249500+0000","last_peered":"2024-04-17T19:54:31.249500+0000","last_clean":"2024-04-17T19:54:31.249500+0000","last_became_active":"2024-04-17T19:53:04.459663+0000","last_became_peered":"2024-04-17T19:53:04.459663+0000","last_unstale":"2024-04-17T19:54:31.249500+0000","last_undegraded":"2024-04-17T19:54:31.249500+0000","last_fullsized":"2024-04-17T19:54:31.249500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:31.249225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:31.249225+0000","last_clean_scrub_stamp":"2024-04-17T19:54:31.249225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:48:06.122798+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:46.803924+0000","last_change":"2024-04-17T19:54:46.804002+0000","last_active":"2024-04-17T19:54:46.803924+0000","last_peered":"2024-04-17T19:54:46.803924+0000","last_clean":"2024-04-17T19:54:46.803924+0000","last_became_active":"2024-04-17T19:53:09.532504+0000","last_became_peered":"2024-04-17T19:53:09.532504+0000","last_unstale":"2024-04-17T19:54:46.803924+0000","last_undegraded":"2024-04-17T19:54:46.803924+0000","last_fullsized":"2024-04-17T19:54:46.803924+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:46.803660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:46.803660+0000","last_clean_scrub_stamp":"2024-04-17T19:54:46.803660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:30:56.379890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:32.567508+0000","last_change":"2024-04-17T19:54:32.567561+0000","last_active":"2024-04-17T19:54:32.567508+0000","last_peered":"2024-04-17T19:54:32.567508+0000","last_clean":"2024-04-17T19:54:32.567508+0000","last_became_active":"2024-04-17T19:53:05.467349+0000","last_became_peered":"2024-04-17T19:53:05.467349+0000","last_unstale":"2024-04-17T19:54:32.567508+0000","last_undegraded":"2024-04-17T19:54:32.567508+0000","last_fullsized":"2024-04-17T19:54:32.567508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:32.567363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:32.567363+0000","last_clean_scrub_stamp":"2024-04-17T19:54:32.567363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:07:24.700412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:42.625850+0000","last_change":"2024-04-17T19:54:42.625916+0000","last_active":"2024-04-17T19:54:42.625850+0000","last_peered":"2024-04-17T19:54:42.625850+0000","last_clean":"2024-04-17T19:54:42.625850+0000","last_became_active":"2024-04-17T19:53:04.465333+0000","last_became_peered":"2024-04-17T19:53:04.465333+0000","last_unstale":"2024-04-17T19:54:42.625850+0000","last_undegraded":"2024-04-17T19:54:42.625850+0000","last_fullsized":"2024-04-17T19:54:42.625850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:42.625620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:42.625620+0000","last_clean_scrub_stamp":"2024-04-17T19:54:42.625620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:56:41.866489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:45.712057+0000","last_change":"2024-04-17T19:54:45.712125+0000","last_active":"2024-04-17T19:54:45.712057+0000","last_peered":"2024-04-17T19:54:45.712057+0000","last_clean":"2024-04-17T19:54:45.712057+0000","last_became_active":"2024-04-17T19:53:09.548109+0000","last_became_peered":"2024-04-17T19:53:09.548109+0000","last_unstale":"2024-04-17T19:54:45.712057+0000","last_undegraded":"2024-04-17T19:54:45.712057+0000","last_fullsized":"2024-04-17T19:54:45.712057+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:45.711826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:45.711826+0000","last_clean_scrub_stamp":"2024-04-17T19:54:45.711826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:13:53.082548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:36.702835+0000","last_change":"2024-04-17T19:54:36.702955+0000","last_active":"2024-04-17T19:54:36.702835+0000","last_peered":"2024-04-17T19:54:36.702835+0000","last_clean":"2024-04-17T19:54:36.702835+0000","last_became_active":"2024-04-17T19:53:05.454358+0000","last_became_peered":"2024-04-17T19:53:05.454358+0000","last_unstale":"2024-04-17T19:54:36.702835+0000","last_undegraded":"2024-04-17T19:54:36.702835+0000","last_fullsized":"2024-04-17T19:54:36.702835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:36.702572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:36.702572+0000","last_clean_scrub_stamp":"2024-04-17T19:54:36.702572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:46:25.853340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"29'4","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:32.800512+0000","last_change":"2024-04-17T19:54:32.800613+0000","last_active":"2024-04-17T19:54:32.800512+0000","last_peered":"2024-04-17T19:54:32.800512+0000","last_clean":"2024-04-17T19:54:32.800512+0000","last_became_active":"2024-04-17T19:53:04.473389+0000","last_became_peered":"2024-04-17T19:53:04.473389+0000","last_unstale":"2024-04-17T19:54:32.800512+0000","last_undegraded":"2024-04-17T19:54:32.800512+0000","last_fullsized":"2024-04-17T19:54:32.800512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-04-17T19:54:32.800306+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-04-17T19:54:32.800306+0000","last_clean_scrub_stamp":"2024-04-17T19:54:32.800306+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:08:35.608211+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.566826+0000","last_change":"2024-04-17T19:53:09.524630+0000","last_active":"2024-04-17T19:53:45.566826+0000","last_peered":"2024-04-17T19:53:45.566826+0000","last_clean":"2024-04-17T19:53:45.566826+0000","last_became_active":"2024-04-17T19:53:09.521522+0000","last_became_peered":"2024-04-17T19:53:09.521522+0000","last_unstale":"2024-04-17T19:53:45.566826+0000","last_undegraded":"2024-04-17T19:53:45.566826+0000","last_fullsized":"2024-04-17T19:53:45.566826+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:37.142222+0000","last_change":"2024-04-17T19:54:37.142309+0000","last_active":"2024-04-17T19:54:37.142222+0000","last_peered":"2024-04-17T19:54:37.142222+0000","last_clean":"2024-04-17T19:54:37.142222+0000","last_became_active":"2024-04-17T19:53:05.455429+0000","last_became_peered":"2024-04-17T19:53:05.455429+0000","last_unstale":"2024-04-17T19:54:37.142222+0000","last_undegraded":"2024-04-17T19:54:37.142222+0000","last_fullsized":"2024-04-17T19:54:37.142222+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:37.142003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:37.142003+0000","last_clean_scrub_stamp":"2024-04-17T19:54:37.142003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:07:29.275051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"29'23","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:30.402619+0000","last_change":"2024-04-17T19:54:30.402768+0000","last_active":"2024-04-17T19:54:30.402619+0000","last_peered":"2024-04-17T19:54:30.402619+0000","last_clean":"2024-04-17T19:54:30.402619+0000","last_became_active":"2024-04-17T19:53:04.459855+0000","last_became_peered":"2024-04-17T19:53:04.459855+0000","last_unstale":"2024-04-17T19:54:30.402619+0000","last_undegraded":"2024-04-17T19:54:30.402619+0000","last_fullsized":"2024-04-17T19:54:30.402619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'23","last_scrub_stamp":"2024-04-17T19:54:30.402323+0000","last_deep_scrub":"29'23","last_deep_scrub_stamp":"2024-04-17T19:54:30.402323+0000","last_clean_scrub_stamp":"2024-04-17T19:54:30.402323+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:31:43.486454+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6170,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:43.176422+0000","last_change":"2024-04-17T19:54:43.176499+0000","last_active":"2024-04-17T19:54:43.176422+0000","last_peered":"2024-04-17T19:54:43.176422+0000","last_clean":"2024-04-17T19:54:43.176422+0000","last_became_active":"2024-04-17T19:53:09.528987+0000","last_became_peered":"2024-04-17T19:53:09.528987+0000","last_unstale":"2024-04-17T19:54:43.176422+0000","last_undegraded":"2024-04-17T19:54:43.176422+0000","last_fullsized":"2024-04-17T19:54:43.176422+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:43.176154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:43.176154+0000","last_clean_scrub_stamp":"2024-04-17T19:54:43.176154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:30:24.097567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:31.530214+0000","last_change":"2024-04-17T19:54:31.530250+0000","last_active":"2024-04-17T19:54:31.530214+0000","last_peered":"2024-04-17T19:54:31.530214+0000","last_clean":"2024-04-17T19:54:31.530214+0000","last_became_active":"2024-04-17T19:53:05.468432+0000","last_became_peered":"2024-04-17T19:53:05.468432+0000","last_unstale":"2024-04-17T19:54:31.530214+0000","last_undegraded":"2024-04-17T19:54:31.530214+0000","last_fullsized":"2024-04-17T19:54:31.530214+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:31.530067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:31.530067+0000","last_clean_scrub_stamp":"2024-04-17T19:54:31.530067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:51:01.348417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"29'5","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:33.807091+0000","last_change":"2024-04-17T19:54:33.807182+0000","last_active":"2024-04-17T19:54:33.807091+0000","last_peered":"2024-04-17T19:54:33.807091+0000","last_clean":"2024-04-17T19:54:33.807091+0000","last_became_active":"2024-04-17T19:53:04.473458+0000","last_became_peered":"2024-04-17T19:53:04.473458+0000","last_unstale":"2024-04-17T19:54:33.807091+0000","last_undegraded":"2024-04-17T19:54:33.807091+0000","last_fullsized":"2024-04-17T19:54:33.807091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-04-17T19:54:33.806888+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-04-17T19:54:33.806888+0000","last_clean_scrub_stamp":"2024-04-17T19:54:33.806888+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:01:12.748161+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:43.325683+0000","last_change":"2024-04-17T19:54:43.325750+0000","last_active":"2024-04-17T19:54:43.325683+0000","last_peered":"2024-04-17T19:54:43.325683+0000","last_clean":"2024-04-17T19:54:43.325683+0000","last_became_active":"2024-04-17T19:53:09.557653+0000","last_became_peered":"2024-04-17T19:53:09.557653+0000","last_unstale":"2024-04-17T19:54:43.325683+0000","last_undegraded":"2024-04-17T19:54:43.325683+0000","last_fullsized":"2024-04-17T19:54:43.325683+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:43.325458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:43.325458+0000","last_clean_scrub_stamp":"2024-04-17T19:54:43.325458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:40:38.337749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:32.650874+0000","last_change":"2024-04-17T19:54:32.650937+0000","last_active":"2024-04-17T19:54:32.650874+0000","last_peered":"2024-04-17T19:54:32.650874+0000","last_clean":"2024-04-17T19:54:32.650874+0000","last_became_active":"2024-04-17T19:53:05.461293+0000","last_became_peered":"2024-04-17T19:53:05.461293+0000","last_unstale":"2024-04-17T19:54:32.650874+0000","last_undegraded":"2024-04-17T19:54:32.650874+0000","last_fullsized":"2024-04-17T19:54:32.650874+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:32.650671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:32.650671+0000","last_clean_scrub_stamp":"2024-04-17T19:54:32.650671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:37:12.486647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:35.197287+0000","last_change":"2024-04-17T19:54:35.197431+0000","last_active":"2024-04-17T19:54:35.197287+0000","last_peered":"2024-04-17T19:54:35.197287+0000","last_clean":"2024-04-17T19:54:35.197287+0000","last_became_active":"2024-04-17T19:53:04.467986+0000","last_became_peered":"2024-04-17T19:53:04.467986+0000","last_unstale":"2024-04-17T19:54:35.197287+0000","last_undegraded":"2024-04-17T19:54:35.197287+0000","last_fullsized":"2024-04-17T19:54:35.197287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:35.196978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:35.196978+0000","last_clean_scrub_stamp":"2024-04-17T19:54:35.196978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:18:21.032667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:39.884766+0000","last_change":"2024-04-17T19:54:39.884839+0000","last_active":"2024-04-17T19:54:39.884766+0000","last_peered":"2024-04-17T19:54:39.884766+0000","last_clean":"2024-04-17T19:54:39.884766+0000","last_became_active":"2024-04-17T19:53:09.558779+0000","last_became_peered":"2024-04-17T19:53:09.558779+0000","last_unstale":"2024-04-17T19:54:39.884766+0000","last_undegraded":"2024-04-17T19:54:39.884766+0000","last_fullsized":"2024-04-17T19:54:39.884766+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:39.884545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:39.884545+0000","last_clean_scrub_stamp":"2024-04-17T19:54:39.884545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:40:25.880990+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:33.358830+0000","last_change":"2024-04-17T19:54:33.358901+0000","last_active":"2024-04-17T19:54:33.358830+0000","last_peered":"2024-04-17T19:54:33.358830+0000","last_clean":"2024-04-17T19:54:33.358830+0000","last_became_active":"2024-04-17T19:53:05.459538+0000","last_became_peered":"2024-04-17T19:53:05.459538+0000","last_unstale":"2024-04-17T19:54:33.358830+0000","last_undegraded":"2024-04-17T19:54:33.358830+0000","last_fullsized":"2024-04-17T19:54:33.358830+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:33.358574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:33.358574+0000","last_clean_scrub_stamp":"2024-04-17T19:54:33.358574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:42:16.882512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:30.962371+0000","last_change":"2024-04-17T19:54:30.962395+0000","last_active":"2024-04-17T19:54:30.962371+0000","last_peered":"2024-04-17T19:54:30.962371+0000","last_clean":"2024-04-17T19:54:30.962371+0000","last_became_active":"2024-04-17T19:53:04.459787+0000","last_became_peered":"2024-04-17T19:53:04.459787+0000","last_unstale":"2024-04-17T19:54:30.962371+0000","last_undegraded":"2024-04-17T19:54:30.962371+0000","last_fullsized":"2024-04-17T19:54:30.962371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:30.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:30.962289+0000","last_clean_scrub_stamp":"2024-04-17T19:54:30.962289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:35:39.104616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:48.263266+0000","last_change":"2024-04-17T19:54:48.263335+0000","last_active":"2024-04-17T19:54:48.263266+0000","last_peered":"2024-04-17T19:54:48.263266+0000","last_clean":"2024-04-17T19:54:48.263266+0000","last_became_active":"2024-04-17T19:53:45.587729+0000","last_became_peered":"2024-04-17T19:53:45.587729+0000","last_unstale":"2024-04-17T19:54:48.263266+0000","last_undegraded":"2024-04-17T19:54:48.263266+0000","last_fullsized":"2024-04-17T19:54:48.263266+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:48.263063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:48.263063+0000","last_clean_scrub_stamp":"2024-04-17T19:54:48.263063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:56:47.503932+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,7],"acting":[4,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:45.200125+0000","last_change":"2024-04-17T19:54:45.200195+0000","last_active":"2024-04-17T19:54:45.200125+0000","last_peered":"2024-04-17T19:54:45.200125+0000","last_clean":"2024-04-17T19:54:45.200125+0000","last_became_active":"2024-04-17T19:53:09.535559+0000","last_became_peered":"2024-04-17T19:53:09.535559+0000","last_unstale":"2024-04-17T19:54:45.200125+0000","last_undegraded":"2024-04-17T19:54:45.200125+0000","last_fullsized":"2024-04-17T19:54:45.200125+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:45.199920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:45.199920+0000","last_clean_scrub_stamp":"2024-04-17T19:54:45.199920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:29:17.161595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:38.168657+0000","last_change":"2024-04-17T19:54:38.168721+0000","last_active":"2024-04-17T19:54:38.168657+0000","last_peered":"2024-04-17T19:54:38.168657+0000","last_clean":"2024-04-17T19:54:38.168657+0000","last_became_active":"2024-04-17T19:53:05.439793+0000","last_became_peered":"2024-04-17T19:53:05.439793+0000","last_unstale":"2024-04-17T19:54:38.168657+0000","last_undegraded":"2024-04-17T19:54:38.168657+0000","last_fullsized":"2024-04-17T19:54:38.168657+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:38.168444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:38.168444+0000","last_clean_scrub_stamp":"2024-04-17T19:54:38.168444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:54:13.761262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:40.631714+0000","last_change":"2024-04-17T19:54:40.631780+0000","last_active":"2024-04-17T19:54:40.631714+0000","last_peered":"2024-04-17T19:54:40.631714+0000","last_clean":"2024-04-17T19:54:40.631714+0000","last_became_active":"2024-04-17T19:53:04.461020+0000","last_became_peered":"2024-04-17T19:53:04.461020+0000","last_unstale":"2024-04-17T19:54:40.631714+0000","last_undegraded":"2024-04-17T19:54:40.631714+0000","last_fullsized":"2024-04-17T19:54:40.631714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:40.631459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:40.631459+0000","last_clean_scrub_stamp":"2024-04-17T19:54:40.631459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:05:58.011709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:53:45.566800+0000","last_change":"2024-04-17T19:53:09.535147+0000","last_active":"2024-04-17T19:53:45.566800+0000","last_peered":"2024-04-17T19:53:45.566800+0000","last_clean":"2024-04-17T19:53:45.566800+0000","last_became_active":"2024-04-17T19:53:09.534655+0000","last_became_peered":"2024-04-17T19:53:09.534655+0000","last_unstale":"2024-04-17T19:53:45.566800+0000","last_undegraded":"2024-04-17T19:53:45.566800+0000","last_fullsized":"2024-04-17T19:53:45.566800+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:53:08.460800+0000","last_clean_scrub_stamp":"2024-04-17T19:53:08.460800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:40.822010+0000","last_change":"2024-04-17T19:54:40.822080+0000","last_active":"2024-04-17T19:54:40.822010+0000","last_peered":"2024-04-17T19:54:40.822010+0000","last_clean":"2024-04-17T19:54:40.822010+0000","last_became_active":"2024-04-17T19:53:05.452844+0000","last_became_peered":"2024-04-17T19:53:05.452844+0000","last_unstale":"2024-04-17T19:54:40.822010+0000","last_undegraded":"2024-04-17T19:54:40.822010+0000","last_fullsized":"2024-04-17T19:54:40.822010+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:40.821803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:40.821803+0000","last_clean_scrub_stamp":"2024-04-17T19:54:40.821803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:40:35.834094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:33.803131+0000","last_change":"2024-04-17T19:54:33.803191+0000","last_active":"2024-04-17T19:54:33.803131+0000","last_peered":"2024-04-17T19:54:33.803131+0000","last_clean":"2024-04-17T19:54:33.803131+0000","last_became_active":"2024-04-17T19:53:04.469777+0000","last_became_peered":"2024-04-17T19:53:04.469777+0000","last_unstale":"2024-04-17T19:54:33.803131+0000","last_undegraded":"2024-04-17T19:54:33.803131+0000","last_fullsized":"2024-04-17T19:54:33.803131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:33.802935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:33.802935+0000","last_clean_scrub_stamp":"2024-04-17T19:54:33.802935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:49:24.633597+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:45.628007+0000","last_change":"2024-04-17T19:54:45.628082+0000","last_active":"2024-04-17T19:54:45.628007+0000","last_peered":"2024-04-17T19:54:45.628007+0000","last_clean":"2024-04-17T19:54:45.628007+0000","last_became_active":"2024-04-17T19:53:04.469297+0000","last_became_peered":"2024-04-17T19:53:04.469297+0000","last_unstale":"2024-04-17T19:54:45.628007+0000","last_undegraded":"2024-04-17T19:54:45.628007+0000","last_fullsized":"2024-04-17T19:54:45.628007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2024-04-17T19:54:45.627789+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2024-04-17T19:54:45.627789+0000","last_clean_scrub_stamp":"2024-04-17T19:54:45.627789+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:36:20.473140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:40.216055+0000","last_change":"2024-04-17T19:54:40.216114+0000","last_active":"2024-04-17T19:54:40.216055+0000","last_peered":"2024-04-17T19:54:40.216055+0000","last_clean":"2024-04-17T19:54:40.216055+0000","last_became_active":"2024-04-17T19:53:05.459616+0000","last_became_peered":"2024-04-17T19:53:05.459616+0000","last_unstale":"2024-04-17T19:54:40.216055+0000","last_undegraded":"2024-04-17T19:54:40.216055+0000","last_fullsized":"2024-04-17T19:54:40.216055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:40.215853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:40.215853+0000","last_clean_scrub_stamp":"2024-04-17T19:54:40.215853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:58:20.190432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:46.247645+0000","last_change":"2024-04-17T19:54:46.247724+0000","last_active":"2024-04-17T19:54:46.247645+0000","last_peered":"2024-04-17T19:54:46.247645+0000","last_clean":"2024-04-17T19:54:46.247645+0000","last_became_active":"2024-04-17T19:53:45.462598+0000","last_became_peered":"2024-04-17T19:53:45.462598+0000","last_unstale":"2024-04-17T19:54:46.247645+0000","last_undegraded":"2024-04-17T19:54:46.247645+0000","last_fullsized":"2024-04-17T19:54:46.247645+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:46.247423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:46.247423+0000","last_clean_scrub_stamp":"2024-04-17T19:54:46.247423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:06:03.627673+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,2],"acting":[4,6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:37.769059+0000","last_change":"2024-04-17T19:54:37.769169+0000","last_active":"2024-04-17T19:54:37.769059+0000","last_peered":"2024-04-17T19:54:37.769059+0000","last_clean":"2024-04-17T19:54:37.769059+0000","last_became_active":"2024-04-17T19:53:04.486707+0000","last_became_peered":"2024-04-17T19:53:04.486707+0000","last_unstale":"2024-04-17T19:54:37.769059+0000","last_undegraded":"2024-04-17T19:54:37.769059+0000","last_fullsized":"2024-04-17T19:54:37.769059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2024-04-17T19:54:37.768846+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2024-04-17T19:54:37.768846+0000","last_clean_scrub_stamp":"2024-04-17T19:54:37.768846+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:07:29.901894+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:31.937365+0000","last_change":"2024-04-17T19:54:31.937416+0000","last_active":"2024-04-17T19:54:31.937365+0000","last_peered":"2024-04-17T19:54:31.937365+0000","last_clean":"2024-04-17T19:54:31.937365+0000","last_became_active":"2024-04-17T19:53:05.448374+0000","last_became_peered":"2024-04-17T19:53:05.448374+0000","last_unstale":"2024-04-17T19:54:31.937365+0000","last_undegraded":"2024-04-17T19:54:31.937365+0000","last_fullsized":"2024-04-17T19:54:31.937365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:31.937235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:31.937235+0000","last_clean_scrub_stamp":"2024-04-17T19:54:31.937235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:08:34.745140+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:40.885115+0000","last_change":"2024-04-17T19:54:40.885183+0000","last_active":"2024-04-17T19:54:40.885115+0000","last_peered":"2024-04-17T19:54:40.885115+0000","last_clean":"2024-04-17T19:54:40.885115+0000","last_became_active":"2024-04-17T19:53:09.560076+0000","last_became_peered":"2024-04-17T19:53:09.560076+0000","last_unstale":"2024-04-17T19:54:40.885115+0000","last_undegraded":"2024-04-17T19:54:40.885115+0000","last_fullsized":"2024-04-17T19:54:40.885115+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:40.884901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:40.884901+0000","last_clean_scrub_stamp":"2024-04-17T19:54:40.884901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:05:05.807615+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:36.343716+0000","last_change":"2024-04-17T19:54:36.343788+0000","last_active":"2024-04-17T19:54:36.343716+0000","last_peered":"2024-04-17T19:54:36.343716+0000","last_clean":"2024-04-17T19:54:36.343716+0000","last_became_active":"2024-04-17T19:53:05.472324+0000","last_became_peered":"2024-04-17T19:53:05.472324+0000","last_unstale":"2024-04-17T19:54:36.343716+0000","last_undegraded":"2024-04-17T19:54:36.343716+0000","last_fullsized":"2024-04-17T19:54:36.343716+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:36.343487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:36.343487+0000","last_clean_scrub_stamp":"2024-04-17T19:54:36.343487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:41:29.710142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:35.836096+0000","last_change":"2024-04-17T19:54:35.836179+0000","last_active":"2024-04-17T19:54:35.836096+0000","last_peered":"2024-04-17T19:54:35.836096+0000","last_clean":"2024-04-17T19:54:35.836096+0000","last_became_active":"2024-04-17T19:53:05.475823+0000","last_became_peered":"2024-04-17T19:53:05.475823+0000","last_unstale":"2024-04-17T19:54:35.836096+0000","last_undegraded":"2024-04-17T19:54:35.836096+0000","last_fullsized":"2024-04-17T19:54:35.836096+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:35.835849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:35.835849+0000","last_clean_scrub_stamp":"2024-04-17T19:54:35.835849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:27:29.359575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:36.625107+0000","last_change":"2024-04-17T19:54:36.625174+0000","last_active":"2024-04-17T19:54:36.625107+0000","last_peered":"2024-04-17T19:54:36.625107+0000","last_clean":"2024-04-17T19:54:36.625107+0000","last_became_active":"2024-04-17T19:53:05.453142+0000","last_became_peered":"2024-04-17T19:53:05.453142+0000","last_unstale":"2024-04-17T19:54:36.625107+0000","last_undegraded":"2024-04-17T19:54:36.625107+0000","last_fullsized":"2024-04-17T19:54:36.625107+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:36.624896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:36.624896+0000","last_clean_scrub_stamp":"2024-04-17T19:54:36.624896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:14:10.684960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:43.811762+0000","last_change":"2024-04-17T19:54:43.811830+0000","last_active":"2024-04-17T19:54:43.811762+0000","last_peered":"2024-04-17T19:54:43.811762+0000","last_clean":"2024-04-17T19:54:43.811762+0000","last_became_active":"2024-04-17T19:53:05.473931+0000","last_became_peered":"2024-04-17T19:53:05.473931+0000","last_unstale":"2024-04-17T19:54:43.811762+0000","last_undegraded":"2024-04-17T19:54:43.811762+0000","last_fullsized":"2024-04-17T19:54:43.811762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:43.811533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:43.811533+0000","last_clean_scrub_stamp":"2024-04-17T19:54:43.811533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:44:56.208821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:40.683168+0000","last_change":"2024-04-17T19:54:40.683233+0000","last_active":"2024-04-17T19:54:40.683168+0000","last_peered":"2024-04-17T19:54:40.683168+0000","last_clean":"2024-04-17T19:54:40.683168+0000","last_became_active":"2024-04-17T19:53:05.467838+0000","last_became_peered":"2024-04-17T19:53:05.467838+0000","last_unstale":"2024-04-17T19:54:40.683168+0000","last_undegraded":"2024-04-17T19:54:40.683168+0000","last_fullsized":"2024-04-17T19:54:40.683168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:40.682913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:40.682913+0000","last_clean_scrub_stamp":"2024-04-17T19:54:40.682913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:16:49.578443+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:37.660853+0000","last_change":"2024-04-17T19:54:37.660937+0000","last_active":"2024-04-17T19:54:37.660853+0000","last_peered":"2024-04-17T19:54:37.660853+0000","last_clean":"2024-04-17T19:54:37.660853+0000","last_became_active":"2024-04-17T19:53:05.461829+0000","last_became_peered":"2024-04-17T19:53:05.461829+0000","last_unstale":"2024-04-17T19:54:37.660853+0000","last_undegraded":"2024-04-17T19:54:37.660853+0000","last_fullsized":"2024-04-17T19:54:37.660853+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:37.660560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:37.660560+0000","last_clean_scrub_stamp":"2024-04-17T19:54:37.660560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:03:08.537572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:35.380013+0000","last_change":"2024-04-17T19:54:35.380076+0000","last_active":"2024-04-17T19:54:35.380013+0000","last_peered":"2024-04-17T19:54:35.380013+0000","last_clean":"2024-04-17T19:54:35.380013+0000","last_became_active":"2024-04-17T19:53:05.465547+0000","last_became_peered":"2024-04-17T19:53:05.465547+0000","last_unstale":"2024-04-17T19:54:35.380013+0000","last_undegraded":"2024-04-17T19:54:35.380013+0000","last_fullsized":"2024-04-17T19:54:35.380013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:35.379805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:35.379805+0000","last_clean_scrub_stamp":"2024-04-17T19:54:35.379805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:47:44.948259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:45.804744+0000","last_change":"2024-04-17T19:54:45.804809+0000","last_active":"2024-04-17T19:54:45.804744+0000","last_peered":"2024-04-17T19:54:45.804744+0000","last_clean":"2024-04-17T19:54:45.804744+0000","last_became_active":"2024-04-17T19:53:05.474798+0000","last_became_peered":"2024-04-17T19:53:05.474798+0000","last_unstale":"2024-04-17T19:54:45.804744+0000","last_undegraded":"2024-04-17T19:54:45.804744+0000","last_fullsized":"2024-04-17T19:54:45.804744+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:45.804534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:45.804534+0000","last_clean_scrub_stamp":"2024-04-17T19:54:45.804534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:06:03.184784+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:50.617592+0000","last_change":"2024-04-17T19:54:50.617654+0000","last_active":"2024-04-17T19:54:50.617592+0000","last_peered":"2024-04-17T19:54:50.617592+0000","last_clean":"2024-04-17T19:54:50.617592+0000","last_became_active":"2024-04-17T19:53:05.483664+0000","last_became_peered":"2024-04-17T19:53:05.483664+0000","last_unstale":"2024-04-17T19:54:50.617592+0000","last_undegraded":"2024-04-17T19:54:50.617592+0000","last_fullsized":"2024-04-17T19:54:50.617592+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:50.617383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:50.617383+0000","last_clean_scrub_stamp":"2024-04-17T19:54:50.617383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:31:07.148471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:42.771094+0000","last_change":"2024-04-17T19:54:42.771231+0000","last_active":"2024-04-17T19:54:42.771094+0000","last_peered":"2024-04-17T19:54:42.771094+0000","last_clean":"2024-04-17T19:54:42.771094+0000","last_became_active":"2024-04-17T19:53:05.465302+0000","last_became_peered":"2024-04-17T19:53:05.465302+0000","last_unstale":"2024-04-17T19:54:42.771094+0000","last_undegraded":"2024-04-17T19:54:42.771094+0000","last_fullsized":"2024-04-17T19:54:42.771094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:42.770847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:42.770847+0000","last_clean_scrub_stamp":"2024-04-17T19:54:42.770847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:30:23.692260+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:32.947983+0000","last_change":"2024-04-17T19:54:32.948009+0000","last_active":"2024-04-17T19:54:32.947983+0000","last_peered":"2024-04-17T19:54:32.947983+0000","last_clean":"2024-04-17T19:54:32.947983+0000","last_became_active":"2024-04-17T19:53:05.455862+0000","last_became_peered":"2024-04-17T19:53:05.455862+0000","last_unstale":"2024-04-17T19:54:32.947983+0000","last_undegraded":"2024-04-17T19:54:32.947983+0000","last_fullsized":"2024-04-17T19:54:32.947983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:32.947903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:32.947903+0000","last_clean_scrub_stamp":"2024-04-17T19:54:32.947903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:36:29.104472+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:41.170040+0000","last_change":"2024-04-17T19:54:41.170100+0000","last_active":"2024-04-17T19:54:41.170040+0000","last_peered":"2024-04-17T19:54:41.170040+0000","last_clean":"2024-04-17T19:54:41.170040+0000","last_became_active":"2024-04-17T19:53:05.463806+0000","last_became_peered":"2024-04-17T19:53:05.463806+0000","last_unstale":"2024-04-17T19:54:41.170040+0000","last_undegraded":"2024-04-17T19:54:41.170040+0000","last_fullsized":"2024-04-17T19:54:41.170040+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:41.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:41.169839+0000","last_clean_scrub_stamp":"2024-04-17T19:54:41.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:26:38.716511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:39.126408+0000","last_change":"2024-04-17T19:54:39.126485+0000","last_active":"2024-04-17T19:54:39.126408+0000","last_peered":"2024-04-17T19:54:39.126408+0000","last_clean":"2024-04-17T19:54:39.126408+0000","last_became_active":"2024-04-17T19:53:05.463286+0000","last_became_peered":"2024-04-17T19:53:05.463286+0000","last_unstale":"2024-04-17T19:54:39.126408+0000","last_undegraded":"2024-04-17T19:54:39.126408+0000","last_fullsized":"2024-04-17T19:54:39.126408+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:39.126199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:39.126199+0000","last_clean_scrub_stamp":"2024-04-17T19:54:39.126199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:58:19.100777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:47.579395+0000","last_change":"2024-04-17T19:54:47.579517+0000","last_active":"2024-04-17T19:54:47.579395+0000","last_peered":"2024-04-17T19:54:47.579395+0000","last_clean":"2024-04-17T19:54:47.579395+0000","last_became_active":"2024-04-17T19:53:05.475372+0000","last_became_peered":"2024-04-17T19:53:05.475372+0000","last_unstale":"2024-04-17T19:54:47.579395+0000","last_undegraded":"2024-04-17T19:54:47.579395+0000","last_fullsized":"2024-04-17T19:54:47.579395+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:47.579006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:47.579006+0000","last_clean_scrub_stamp":"2024-04-17T19:54:47.579006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:13:35.740851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:37.815491+0000","last_change":"2024-04-17T19:54:37.815557+0000","last_active":"2024-04-17T19:54:37.815491+0000","last_peered":"2024-04-17T19:54:37.815491+0000","last_clean":"2024-04-17T19:54:37.815491+0000","last_became_active":"2024-04-17T19:53:05.495881+0000","last_became_peered":"2024-04-17T19:53:05.495881+0000","last_unstale":"2024-04-17T19:54:37.815491+0000","last_undegraded":"2024-04-17T19:54:37.815491+0000","last_fullsized":"2024-04-17T19:54:37.815491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:37.815282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:37.815282+0000","last_clean_scrub_stamp":"2024-04-17T19:54:37.815282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:23:20.852786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:34.605830+0000","last_change":"2024-04-17T19:54:34.605904+0000","last_active":"2024-04-17T19:54:34.605830+0000","last_peered":"2024-04-17T19:54:34.605830+0000","last_clean":"2024-04-17T19:54:34.605830+0000","last_became_active":"2024-04-17T19:53:05.460831+0000","last_became_peered":"2024-04-17T19:53:05.460831+0000","last_unstale":"2024-04-17T19:54:34.605830+0000","last_undegraded":"2024-04-17T19:54:34.605830+0000","last_fullsized":"2024-04-17T19:54:34.605830+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:34.605621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:34.605621+0000","last_clean_scrub_stamp":"2024-04-17T19:54:34.605621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:58:14.580199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:37.604965+0000","last_change":"2024-04-17T19:54:37.605029+0000","last_active":"2024-04-17T19:54:37.604965+0000","last_peered":"2024-04-17T19:54:37.604965+0000","last_clean":"2024-04-17T19:54:37.604965+0000","last_became_active":"2024-04-17T19:53:05.467366+0000","last_became_peered":"2024-04-17T19:53:05.467366+0000","last_unstale":"2024-04-17T19:54:37.604965+0000","last_undegraded":"2024-04-17T19:54:37.604965+0000","last_fullsized":"2024-04-17T19:54:37.604965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:37.604735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:37.604735+0000","last_clean_scrub_stamp":"2024-04-17T19:54:37.604735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:30:18.526149+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:50.853545+0000","last_change":"2024-04-17T19:54:50.853685+0000","last_active":"2024-04-17T19:54:50.853545+0000","last_peered":"2024-04-17T19:54:50.853545+0000","last_clean":"2024-04-17T19:54:50.853545+0000","last_became_active":"2024-04-17T19:53:45.587213+0000","last_became_peered":"2024-04-17T19:53:45.587213+0000","last_unstale":"2024-04-17T19:54:50.853545+0000","last_undegraded":"2024-04-17T19:54:50.853545+0000","last_fullsized":"2024-04-17T19:54:50.853545+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:50.853298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:50.853298+0000","last_clean_scrub_stamp":"2024-04-17T19:54:50.853298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:36:25.698649+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:39.722701+0000","last_change":"2024-04-17T19:54:39.722773+0000","last_active":"2024-04-17T19:54:39.722701+0000","last_peered":"2024-04-17T19:54:39.722701+0000","last_clean":"2024-04-17T19:54:39.722701+0000","last_became_active":"2024-04-17T19:53:05.465145+0000","last_became_peered":"2024-04-17T19:53:05.465145+0000","last_unstale":"2024-04-17T19:54:39.722701+0000","last_undegraded":"2024-04-17T19:54:39.722701+0000","last_fullsized":"2024-04-17T19:54:39.722701+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:39.722458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:39.722458+0000","last_clean_scrub_stamp":"2024-04-17T19:54:39.722458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:55:29.920734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:38.682326+0000","last_change":"2024-04-17T19:54:38.682392+0000","last_active":"2024-04-17T19:54:38.682326+0000","last_peered":"2024-04-17T19:54:38.682326+0000","last_clean":"2024-04-17T19:54:38.682326+0000","last_became_active":"2024-04-17T19:53:05.463172+0000","last_became_peered":"2024-04-17T19:53:05.463172+0000","last_unstale":"2024-04-17T19:54:38.682326+0000","last_undegraded":"2024-04-17T19:54:38.682326+0000","last_fullsized":"2024-04-17T19:54:38.682326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:38.682110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:38.682110+0000","last_clean_scrub_stamp":"2024-04-17T19:54:38.682110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:14:46.153927+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:44.213116+0000","last_change":"2024-04-17T19:54:44.213183+0000","last_active":"2024-04-17T19:54:44.213116+0000","last_peered":"2024-04-17T19:54:44.213116+0000","last_clean":"2024-04-17T19:54:44.213116+0000","last_became_active":"2024-04-17T19:53:05.471347+0000","last_became_peered":"2024-04-17T19:53:05.471347+0000","last_unstale":"2024-04-17T19:54:44.213116+0000","last_undegraded":"2024-04-17T19:54:44.213116+0000","last_fullsized":"2024-04-17T19:54:44.213116+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:44.212912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:44.212912+0000","last_clean_scrub_stamp":"2024-04-17T19:54:44.212912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:12:26.719608+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:38.143171+0000","last_change":"2024-04-17T19:54:38.143320+0000","last_active":"2024-04-17T19:54:38.143171+0000","last_peered":"2024-04-17T19:54:38.143171+0000","last_clean":"2024-04-17T19:54:38.143171+0000","last_became_active":"2024-04-17T19:53:05.459869+0000","last_became_peered":"2024-04-17T19:53:05.459869+0000","last_unstale":"2024-04-17T19:54:38.143171+0000","last_undegraded":"2024-04-17T19:54:38.143171+0000","last_fullsized":"2024-04-17T19:54:38.143171+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:38.142885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:38.142885+0000","last_clean_scrub_stamp":"2024-04-17T19:54:38.142885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:00:15.460850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:43.210472+0000","last_change":"2024-04-17T19:54:43.210541+0000","last_active":"2024-04-17T19:54:43.210472+0000","last_peered":"2024-04-17T19:54:43.210472+0000","last_clean":"2024-04-17T19:54:43.210472+0000","last_became_active":"2024-04-17T19:53:05.467015+0000","last_became_peered":"2024-04-17T19:53:05.467015+0000","last_unstale":"2024-04-17T19:54:43.210472+0000","last_undegraded":"2024-04-17T19:54:43.210472+0000","last_fullsized":"2024-04-17T19:54:43.210472+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:43.210270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:43.210270+0000","last_clean_scrub_stamp":"2024-04-17T19:54:43.210270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:44:55.607557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:33.924503+0000","last_change":"2024-04-17T19:54:33.924566+0000","last_active":"2024-04-17T19:54:33.924503+0000","last_peered":"2024-04-17T19:54:33.924503+0000","last_clean":"2024-04-17T19:54:33.924503+0000","last_became_active":"2024-04-17T19:53:05.462217+0000","last_became_peered":"2024-04-17T19:53:05.462217+0000","last_unstale":"2024-04-17T19:54:33.924503+0000","last_undegraded":"2024-04-17T19:54:33.924503+0000","last_fullsized":"2024-04-17T19:54:33.924503+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:33.924295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:33.924295+0000","last_clean_scrub_stamp":"2024-04-17T19:54:33.924295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:27:17.906976+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:34.715805+0000","last_change":"2024-04-17T19:54:34.715870+0000","last_active":"2024-04-17T19:54:34.715805+0000","last_peered":"2024-04-17T19:54:34.715805+0000","last_clean":"2024-04-17T19:54:34.715805+0000","last_became_active":"2024-04-17T19:53:05.467093+0000","last_became_peered":"2024-04-17T19:53:05.467093+0000","last_unstale":"2024-04-17T19:54:34.715805+0000","last_undegraded":"2024-04-17T19:54:34.715805+0000","last_fullsized":"2024-04-17T19:54:34.715805+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:34.715596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:34.715596+0000","last_clean_scrub_stamp":"2024-04-17T19:54:34.715596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:55:30.890135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:41.150915+0000","last_change":"2024-04-17T19:54:41.151067+0000","last_active":"2024-04-17T19:54:41.150915+0000","last_peered":"2024-04-17T19:54:41.150915+0000","last_clean":"2024-04-17T19:54:41.150915+0000","last_became_active":"2024-04-17T19:53:05.465436+0000","last_became_peered":"2024-04-17T19:53:05.465436+0000","last_unstale":"2024-04-17T19:54:41.150915+0000","last_undegraded":"2024-04-17T19:54:41.150915+0000","last_fullsized":"2024-04-17T19:54:41.150915+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:41.150643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:41.150643+0000","last_clean_scrub_stamp":"2024-04-17T19:54:41.150643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:06:14.590244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:31.348038+0000","last_change":"2024-04-17T19:54:31.348071+0000","last_active":"2024-04-17T19:54:31.348038+0000","last_peered":"2024-04-17T19:54:31.348038+0000","last_clean":"2024-04-17T19:54:31.348038+0000","last_became_active":"2024-04-17T19:53:05.457656+0000","last_became_peered":"2024-04-17T19:53:05.457656+0000","last_unstale":"2024-04-17T19:54:31.348038+0000","last_undegraded":"2024-04-17T19:54:31.348038+0000","last_fullsized":"2024-04-17T19:54:31.348038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:31.347957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:31.347957+0000","last_clean_scrub_stamp":"2024-04-17T19:54:31.347957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:40:17.344401+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:45.251024+0000","last_change":"2024-04-17T19:54:45.251100+0000","last_active":"2024-04-17T19:54:45.251024+0000","last_peered":"2024-04-17T19:54:45.251024+0000","last_clean":"2024-04-17T19:54:45.251024+0000","last_became_active":"2024-04-17T19:53:05.476734+0000","last_became_peered":"2024-04-17T19:53:05.476734+0000","last_unstale":"2024-04-17T19:54:45.251024+0000","last_undegraded":"2024-04-17T19:54:45.251024+0000","last_fullsized":"2024-04-17T19:54:45.251024+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:45.250813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:45.250813+0000","last_clean_scrub_stamp":"2024-04-17T19:54:45.250813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:48:14.991068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:32.385488+0000","last_change":"2024-04-17T19:54:32.385513+0000","last_active":"2024-04-17T19:54:32.385488+0000","last_peered":"2024-04-17T19:54:32.385488+0000","last_clean":"2024-04-17T19:54:32.385488+0000","last_became_active":"2024-04-17T19:53:05.457210+0000","last_became_peered":"2024-04-17T19:53:05.457210+0000","last_unstale":"2024-04-17T19:54:32.385488+0000","last_undegraded":"2024-04-17T19:54:32.385488+0000","last_fullsized":"2024-04-17T19:54:32.385488+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:32.385390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:32.385390+0000","last_clean_scrub_stamp":"2024-04-17T19:54:32.385390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:27:01.239581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:39.789836+0000","last_change":"2024-04-17T19:54:39.789903+0000","last_active":"2024-04-17T19:54:39.789836+0000","last_peered":"2024-04-17T19:54:39.789836+0000","last_clean":"2024-04-17T19:54:39.789836+0000","last_became_active":"2024-04-17T19:53:05.454065+0000","last_became_peered":"2024-04-17T19:53:05.454065+0000","last_unstale":"2024-04-17T19:54:39.789836+0000","last_undegraded":"2024-04-17T19:54:39.789836+0000","last_fullsized":"2024-04-17T19:54:39.789836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:39.789575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:39.789575+0000","last_clean_scrub_stamp":"2024-04-17T19:54:39.789575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:58:19.764153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:41.796134+0000","last_change":"2024-04-17T19:54:41.796220+0000","last_active":"2024-04-17T19:54:41.796134+0000","last_peered":"2024-04-17T19:54:41.796134+0000","last_clean":"2024-04-17T19:54:41.796134+0000","last_became_active":"2024-04-17T19:53:05.455779+0000","last_became_peered":"2024-04-17T19:53:05.455779+0000","last_unstale":"2024-04-17T19:54:41.796134+0000","last_undegraded":"2024-04-17T19:54:41.796134+0000","last_fullsized":"2024-04-17T19:54:41.796134+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:41.795918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:41.795918+0000","last_clean_scrub_stamp":"2024-04-17T19:54:41.795918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:14:15.855982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:29.205949+0000","last_change":"2024-04-17T19:54:29.205992+0000","last_active":"2024-04-17T19:54:29.205949+0000","last_peered":"2024-04-17T19:54:29.205949+0000","last_clean":"2024-04-17T19:54:29.205949+0000","last_became_active":"2024-04-17T19:53:05.461324+0000","last_became_peered":"2024-04-17T19:53:05.461324+0000","last_unstale":"2024-04-17T19:54:29.205949+0000","last_undegraded":"2024-04-17T19:54:29.205949+0000","last_fullsized":"2024-04-17T19:54:29.205949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:29.205807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:29.205807+0000","last_clean_scrub_stamp":"2024-04-17T19:54:29.205807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:26:58.059998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6968,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":13936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509468,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":124356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509467,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":909312,"data_stored":714692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509467,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":331776,"data_stored":131074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509467,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31480,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":311296,"data_stored":124814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509467,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31492,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340348,"statfs":{"total":96636764160,"available":96604516352,"internally_reserved":0,"allocated":323584,"data_stored":130402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509466,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32060,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339780,"statfs":{"total":96636764160,"available":96603934720,"internally_reserved":0,"allocated":905216,"data_stored":714670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509467,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35644,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336196,"statfs":{"total":96636764160,"available":96600264704,"internally_reserved":0,"allocated":315392,"data_stored":124288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542171,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":124232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":6170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":6842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T19:54:53.334 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-17T19:53:08.460800+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=8, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:53.335 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-17T19:53:08.460800+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=8, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:53.335 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-17T19:53:08.460800+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=53, tm_sec=8, tm_wday=2, tm_yday=108, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=17, tm_hour=19, tm_min=54, tm_sec=27, tm_wday=2, tm_yday=108, tm_isdst=0) 2024-04-17T19:54:53.336 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-17T19:55:00.047 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T19:55:00.050 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T19:55:13.337 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-17T19:55:13.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.508+0000 7f137d32b640 1 Processor -- start 2024-04-17T19:55:13.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.508+0000 7f137d32b640 1 -- start start 2024-04-17T19:55:13.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.508+0000 7f137d32b640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f137815e1a0 0x7f13780ce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:13.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.508+0000 7f137d32b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f13780cef10 0x7f137815e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:13.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.508+0000 7f137d32b640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13780d0020 con 0x7f137815ee50 2024-04-17T19:55:13.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.508+0000 7f137d32b640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f13780cd930 con 0x7f13780cef10 2024-04-17T19:55:13.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.508+0000 7f137d32b640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f13780cdc10 con 0x7f137815e1a0 2024-04-17T19:55:13.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.508+0000 7f136e7fc640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f13780cef10 0x7f137815e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:13.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.508+0000 7f136e7fc640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f13780cef10 0x7f137815e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34246/0 (socket says 172.21.15.18:34246) 2024-04-17T19:55:13.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.508+0000 7f136e7fc640 1 -- 172.21.15.18:0/96168739 learned_addr learned my addr 172.21.15.18:0/96168739 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:55:13.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.508+0000 7f13777fe640 1 --1- 172.21.15.18:0/96168739 >> v1:172.21.15.18:6789/0 conn(0x7f137815ee50 0x7f137806cd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:54306/0 (socket says 172.21.15.18:54306) 2024-04-17T19:55:13.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.508+0000 7f1376ffd640 1 --2- 172.21.15.18:0/96168739 >> v2:172.21.15.173:3300/0 conn(0x7f137815e1a0 0x7f13780ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:13.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.508+0000 7f136e7fc640 1 -- 172.21.15.18:0/96168739 >> v2:172.21.15.173:3300/0 conn(0x7f137815e1a0 msgr2=0x7f13780ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:55:13.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.508+0000 7f136e7fc640 1 --2- 172.21.15.18:0/96168739 >> v2:172.21.15.173:3300/0 conn(0x7f137815e1a0 0x7f13780ce9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:13.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.508+0000 7f136e7fc640 1 -- 172.21.15.18:0/96168739 >> v1:172.21.15.18:6789/0 conn(0x7f137815ee50 legacy=0x7f137806cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:13.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.508+0000 7f136e7fc640 1 -- 172.21.15.18:0/96168739 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13780cdef0 con 0x7f13780cef10 2024-04-17T19:55:13.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.512+0000 7f136e7fc640 1 --2- 172.21.15.18:0/96168739 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13780cef10 0x7f137815e910 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f137806fdc0 tx=0x7f136001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=588c4d74e432a43f server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:55:13.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.512+0000 7f13767fc640 1 -- 172.21.15.18:0/96168739 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13600b2070 con 0x7f13780cef10 2024-04-17T19:55:13.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.512+0000 7f13767fc640 1 -- 172.21.15.18:0/96168739 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13600ad680 con 0x7f13780cef10 2024-04-17T19:55:13.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.512+0000 7f13767fc640 1 -- 172.21.15.18:0/96168739 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13600ada50 con 0x7f13780cef10 2024-04-17T19:55:13.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.512+0000 7f137d32b640 1 -- 172.21.15.18:0/96168739 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13780cef10 msgr2=0x7f137815e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:13.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.512+0000 7f137d32b640 1 --2- 172.21.15.18:0/96168739 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13780cef10 0x7f137815e910 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f137806fdc0 tx=0x7f136001c490 comp rx=0 tx=0).stop 2024-04-17T19:55:13.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.512+0000 7f137d32b640 1 -- 172.21.15.18:0/96168739 shutdown_connections 2024-04-17T19:55:13.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.512+0000 7f137d32b640 1 --2- 172.21.15.18:0/96168739 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13780cef10 0x7f137815e910 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:13.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.512+0000 7f137d32b640 1 --2- 172.21.15.18:0/96168739 >> v2:172.21.15.173:3300/0 conn(0x7f137815e1a0 0x7f13780ce9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:13.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.512+0000 7f137d32b640 1 -- 172.21.15.18:0/96168739 >> 172.21.15.18:0/96168739 conn(0x7f1378072bb0 msgr2=0x7f1378072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:55:13.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.512+0000 7f137d32b640 1 -- 172.21.15.18:0/96168739 shutdown_connections 2024-04-17T19:55:13.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.512+0000 7f137d32b640 1 -- 172.21.15.18:0/96168739 wait complete. 2024-04-17T19:55:13.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.512+0000 7f137d32b640 1 Processor -- start 2024-04-17T19:55:13.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.512+0000 7f137d32b640 1 -- start start 2024-04-17T19:55:13.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.516+0000 7f137d32b640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f13780cef10 0x7f1378154070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:13.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.516+0000 7f137d32b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f137815e1a0 0x7f1378155f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:13.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.516+0000 7f137d32b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f137815ee50 0x7f13780b4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:13.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.516+0000 7f137d32b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1378157b90 con 0x7f137815e1a0 2024-04-17T19:55:13.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.516+0000 7f137d32b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1378157a10 con 0x7f137815ee50 2024-04-17T19:55:13.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.516+0000 7f137d32b640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f137806d470 con 0x7f13780cef10 2024-04-17T19:55:13.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.516+0000 7f136e7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f137815e1a0 0x7f1378155f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:13.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.516+0000 7f136e7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f137815e1a0 0x7f1378155f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34248/0 (socket says 172.21.15.18:34248) 2024-04-17T19:55:13.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.516+0000 7f136e7fc640 1 -- 172.21.15.18:0/2308050076 learned_addr learned my addr 172.21.15.18:0/2308050076 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:55:13.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.516+0000 7f13777fe640 1 --2- 172.21.15.18:0/2308050076 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f137815ee50 0x7f13780b4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:13.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.516+0000 7f1376ffd640 1 --2- 172.21.15.18:0/2308050076 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f13780cef10 0x7f1378154070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:13.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.516+0000 7f136e7fc640 1 -- 172.21.15.18:0/2308050076 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f13780cef10 msgr2=0x7f1378154070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:13.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.516+0000 7f136e7fc640 1 --2- 172.21.15.18:0/2308050076 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f13780cef10 0x7f1378154070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:13.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.516+0000 7f136e7fc640 1 -- 172.21.15.18:0/2308050076 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f137815ee50 msgr2=0x7f13780b4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:13.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.516+0000 7f136e7fc640 1 --2- 172.21.15.18:0/2308050076 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f137815ee50 0x7f13780b4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:13.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.516+0000 7f136e7fc640 1 -- 172.21.15.18:0/2308050076 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13780b3bc0 con 0x7f137815e1a0 2024-04-17T19:55:13.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.516+0000 7f136e7fc640 1 --2- 172.21.15.18:0/2308050076 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f137815e1a0 0x7f1378155f30 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f136001a0c0 tx=0x7f136001acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:55:13.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.516+0000 7f136ffff640 1 -- 172.21.15.18:0/2308050076 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13600b2040 con 0x7f137815e1a0 2024-04-17T19:55:13.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.516+0000 7f136ffff640 1 -- 172.21.15.18:0/2308050076 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13600bd070 con 0x7f137815e1a0 2024-04-17T19:55:13.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.516+0000 7f137d32b640 1 -- 172.21.15.18:0/2308050076 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13780b3ea0 con 0x7f137815e1a0 2024-04-17T19:55:13.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.516+0000 7f136ffff640 1 -- 172.21.15.18:0/2308050076 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13600b8450 con 0x7f137815e1a0 2024-04-17T19:55:13.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.516+0000 7f137d32b640 1 -- 172.21.15.18:0/2308050076 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13780b4460 con 0x7f137815e1a0 2024-04-17T19:55:13.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.516+0000 7f137d32b640 1 -- 172.21.15.18:0/2308050076 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13780b3930 con 0x7f137815e1a0 2024-04-17T19:55:13.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.516+0000 7f136ffff640 1 -- 172.21.15.18:0/2308050076 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f13600b85f0 con 0x7f137815e1a0 2024-04-17T19:55:13.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.520+0000 7f136ffff640 1 --2- 172.21.15.18:0/2308050076 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f1358068380 0x7f135806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:13.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.520+0000 7f136ffff640 1 -- 172.21.15.18:0/2308050076 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7f1360121ca0 con 0x7f137815e1a0 2024-04-17T19:55:13.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.520+0000 7f1376ffd640 1 --2- 172.21.15.18:0/2308050076 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f1358068380 0x7f135806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:13.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.520+0000 7f1376ffd640 1 --2- 172.21.15.18:0/2308050076 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f1358068380 0x7f135806a890 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f13780b5f30 tx=0x7f1368008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:55:13.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.524+0000 7f136ffff640 1 -- 172.21.15.18:0/2308050076 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f13600c7020 con 0x7f137815e1a0 2024-04-17T19:55:13.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.684+0000 7f137d32b640 1 -- 172.21.15.18:0/2308050076 --> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1378069950 con 0x7f1358068380 2024-04-17T19:55:13.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.692+0000 7f136ffff640 1 -- 172.21.15.18:0/2308050076 <== mgr.4104 v2:172.21.15.18:6832/751466605 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332591 (secure 0 0 0) 0x7f1378069950 con 0x7f1358068380 2024-04-17T19:55:13.694 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:55:13.696 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-17T19:55:13.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.696+0000 7f137d32b640 1 -- 172.21.15.18:0/2308050076 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f1358068380 msgr2=0x7f135806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:13.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.696+0000 7f137d32b640 1 --2- 172.21.15.18:0/2308050076 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f1358068380 0x7f135806a890 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f13780b5f30 tx=0x7f1368008040 comp rx=0 tx=0).stop 2024-04-17T19:55:13.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.696+0000 7f137d32b640 1 -- 172.21.15.18:0/2308050076 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f137815e1a0 msgr2=0x7f1378155f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:13.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.696+0000 7f137d32b640 1 --2- 172.21.15.18:0/2308050076 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f137815e1a0 0x7f1378155f30 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f136001a0c0 tx=0x7f136001acd0 comp rx=0 tx=0).stop 2024-04-17T19:55:13.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.696+0000 7f137d32b640 1 -- 172.21.15.18:0/2308050076 shutdown_connections 2024-04-17T19:55:13.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.696+0000 7f137d32b640 1 --2- 172.21.15.18:0/2308050076 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f1358068380 0x7f135806a890 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:13.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.696+0000 7f137d32b640 1 --2- 172.21.15.18:0/2308050076 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f137815ee50 0x7f13780b4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:13.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.696+0000 7f137d32b640 1 --2- 172.21.15.18:0/2308050076 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f137815e1a0 0x7f1378155f30 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:13.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.696+0000 7f137d32b640 1 --2- 172.21.15.18:0/2308050076 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f13780cef10 0x7f1378154070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:13.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.696+0000 7f137d32b640 1 -- 172.21.15.18:0/2308050076 >> 172.21.15.18:0/2308050076 conn(0x7f1378072bb0 msgr2=0x7f137806bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:55:13.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.696+0000 7f137d32b640 1 -- 172.21.15.18:0/2308050076 shutdown_connections 2024-04-17T19:55:13.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.696+0000 7f137d32b640 1 -- 172.21.15.18:0/2308050076 wait complete. 2024-04-17T19:55:13.714 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":93,"stamp":"2024-04-17T19:55:12.394802+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597336,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":219,"num_write_kb":2446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":193,"ondisk_log_size":193,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240560,"kb_used_data":3632,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754734160,"statfs":{"total":773094113280,"available":772847779840,"internally_reserved":0,"allocated":3719168,"data_stored":2188528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":242535988},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005310"},"pg_stats":[{"pgid":"2.1f","version":"29'6","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:33.068936+0000","last_change":"2024-04-17T19:54:33.068936+0000","last_active":"2024-04-17T19:54:33.068936+0000","last_peered":"2024-04-17T19:54:33.068936+0000","last_clean":"2024-04-17T19:54:33.068936+0000","last_became_active":"2024-04-17T19:53:04.460006+0000","last_became_peered":"2024-04-17T19:53:04.460006+0000","last_unstale":"2024-04-17T19:54:33.068936+0000","last_undegraded":"2024-04-17T19:54:33.068936+0000","last_fullsized":"2024-04-17T19:54:33.068936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-04-17T19:54:33.068649+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-04-17T19:54:33.068649+0000","last_clean_scrub_stamp":"2024-04-17T19:54:33.068649+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:47:42.637103+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:31.604229+0000","last_change":"2024-04-17T19:54:31.604229+0000","last_active":"2024-04-17T19:54:31.604229+0000","last_peered":"2024-04-17T19:54:31.604229+0000","last_clean":"2024-04-17T19:54:31.604229+0000","last_became_active":"2024-04-17T19:53:05.467848+0000","last_became_peered":"2024-04-17T19:53:05.467848+0000","last_unstale":"2024-04-17T19:54:31.604229+0000","last_undegraded":"2024-04-17T19:54:31.604229+0000","last_fullsized":"2024-04-17T19:54:31.604229+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:31.603935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:31.603935+0000","last_clean_scrub_stamp":"2024-04-17T19:54:31.603935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:48:06.477508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:38.859572+0000","last_change":"2024-04-17T19:54:38.859643+0000","last_active":"2024-04-17T19:54:38.859572+0000","last_peered":"2024-04-17T19:54:38.859572+0000","last_clean":"2024-04-17T19:54:38.859572+0000","last_became_active":"2024-04-17T19:53:09.558504+0000","last_became_peered":"2024-04-17T19:53:09.558504+0000","last_unstale":"2024-04-17T19:54:38.859572+0000","last_undegraded":"2024-04-17T19:54:38.859572+0000","last_fullsized":"2024-04-17T19:54:38.859572+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:38.859352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:38.859352+0000","last_clean_scrub_stamp":"2024-04-17T19:54:38.859352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:31:51.943483+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:36.761409+0000","last_change":"2024-04-17T19:54:36.761409+0000","last_active":"2024-04-17T19:54:36.761409+0000","last_peered":"2024-04-17T19:54:36.761409+0000","last_clean":"2024-04-17T19:54:36.761409+0000","last_became_active":"2024-04-17T19:53:04.468291+0000","last_became_peered":"2024-04-17T19:53:04.468291+0000","last_unstale":"2024-04-17T19:54:36.761409+0000","last_undegraded":"2024-04-17T19:54:36.761409+0000","last_fullsized":"2024-04-17T19:54:36.761409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2024-04-17T19:54:36.761123+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2024-04-17T19:54:36.761123+0000","last_clean_scrub_stamp":"2024-04-17T19:54:36.761123+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:51:06.579473+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:33.696002+0000","last_change":"2024-04-17T19:54:33.696002+0000","last_active":"2024-04-17T19:54:33.696002+0000","last_peered":"2024-04-17T19:54:33.696002+0000","last_clean":"2024-04-17T19:54:33.696002+0000","last_became_active":"2024-04-17T19:53:05.473678+0000","last_became_peered":"2024-04-17T19:53:05.473678+0000","last_unstale":"2024-04-17T19:54:33.696002+0000","last_undegraded":"2024-04-17T19:54:33.696002+0000","last_fullsized":"2024-04-17T19:54:33.696002+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:33.695727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:33.695727+0000","last_clean_scrub_stamp":"2024-04-17T19:54:33.695727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:28:51.406487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:40.348490+0000","last_change":"2024-04-17T19:54:40.348586+0000","last_active":"2024-04-17T19:54:40.348490+0000","last_peered":"2024-04-17T19:54:40.348490+0000","last_clean":"2024-04-17T19:54:40.348490+0000","last_became_active":"2024-04-17T19:53:09.544580+0000","last_became_peered":"2024-04-17T19:53:09.544580+0000","last_unstale":"2024-04-17T19:54:40.348490+0000","last_undegraded":"2024-04-17T19:54:40.348490+0000","last_fullsized":"2024-04-17T19:54:40.348490+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:40.348275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:40.348275+0000","last_clean_scrub_stamp":"2024-04-17T19:54:40.348275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:54:15.941094+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"29'3","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:33.262766+0000","last_change":"2024-04-17T19:54:33.262926+0000","last_active":"2024-04-17T19:54:33.262766+0000","last_peered":"2024-04-17T19:54:33.262766+0000","last_clean":"2024-04-17T19:54:33.262766+0000","last_became_active":"2024-04-17T19:53:04.467568+0000","last_became_peered":"2024-04-17T19:53:04.467568+0000","last_unstale":"2024-04-17T19:54:33.262766+0000","last_undegraded":"2024-04-17T19:54:33.262766+0000","last_fullsized":"2024-04-17T19:54:33.262766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-04-17T19:54:33.262526+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-04-17T19:54:33.262526+0000","last_clean_scrub_stamp":"2024-04-17T19:54:33.262526+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:28:50.973286+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:34.944510+0000","last_change":"2024-04-17T19:54:34.944577+0000","last_active":"2024-04-17T19:54:34.944510+0000","last_peered":"2024-04-17T19:54:34.944510+0000","last_clean":"2024-04-17T19:54:34.944510+0000","last_became_active":"2024-04-17T19:53:05.464601+0000","last_became_peered":"2024-04-17T19:53:05.464601+0000","last_unstale":"2024-04-17T19:54:34.944510+0000","last_undegraded":"2024-04-17T19:54:34.944510+0000","last_fullsized":"2024-04-17T19:54:34.944510+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:34.944317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:34.944317+0000","last_clean_scrub_stamp":"2024-04-17T19:54:34.944317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:25:21.620850+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:39.341762+0000","last_change":"2024-04-17T19:54:39.341846+0000","last_active":"2024-04-17T19:54:39.341762+0000","last_peered":"2024-04-17T19:54:39.341762+0000","last_clean":"2024-04-17T19:54:39.341762+0000","last_became_active":"2024-04-17T19:53:09.528285+0000","last_became_peered":"2024-04-17T19:53:09.528285+0000","last_unstale":"2024-04-17T19:54:39.341762+0000","last_undegraded":"2024-04-17T19:54:39.341762+0000","last_fullsized":"2024-04-17T19:54:39.341762+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:39.341546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:39.341546+0000","last_clean_scrub_stamp":"2024-04-17T19:54:39.341546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:36:44.798061+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"29'3","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:32.277293+0000","last_change":"2024-04-17T19:54:32.277319+0000","last_active":"2024-04-17T19:54:32.277293+0000","last_peered":"2024-04-17T19:54:32.277293+0000","last_clean":"2024-04-17T19:54:32.277293+0000","last_became_active":"2024-04-17T19:53:04.467004+0000","last_became_peered":"2024-04-17T19:53:04.467004+0000","last_unstale":"2024-04-17T19:54:32.277293+0000","last_undegraded":"2024-04-17T19:54:32.277293+0000","last_fullsized":"2024-04-17T19:54:32.277293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-04-17T19:54:32.277221+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-04-17T19:54:32.277221+0000","last_clean_scrub_stamp":"2024-04-17T19:54:32.277221+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:37:12.113197+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:30.555341+0000","last_change":"2024-04-17T19:54:30.555364+0000","last_active":"2024-04-17T19:54:30.555341+0000","last_peered":"2024-04-17T19:54:30.555341+0000","last_clean":"2024-04-17T19:54:30.555341+0000","last_became_active":"2024-04-17T19:53:05.467217+0000","last_became_peered":"2024-04-17T19:53:05.467217+0000","last_unstale":"2024-04-17T19:54:30.555341+0000","last_undegraded":"2024-04-17T19:54:30.555341+0000","last_fullsized":"2024-04-17T19:54:30.555341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:30.555262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:30.555262+0000","last_clean_scrub_stamp":"2024-04-17T19:54:30.555262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:18:16.390951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:42.362464+0000","last_change":"2024-04-17T19:54:42.362529+0000","last_active":"2024-04-17T19:54:42.362464+0000","last_peered":"2024-04-17T19:54:42.362464+0000","last_clean":"2024-04-17T19:54:42.362464+0000","last_became_active":"2024-04-17T19:53:09.548876+0000","last_became_peered":"2024-04-17T19:53:09.548876+0000","last_unstale":"2024-04-17T19:54:42.362464+0000","last_undegraded":"2024-04-17T19:54:42.362464+0000","last_fullsized":"2024-04-17T19:54:42.362464+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:42.362234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:42.362234+0000","last_clean_scrub_stamp":"2024-04-17T19:54:42.362234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:47:57.555966+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:49.620849+0000","last_change":"2024-04-17T19:54:49.620973+0000","last_active":"2024-04-17T19:54:49.620849+0000","last_peered":"2024-04-17T19:54:49.620849+0000","last_clean":"2024-04-17T19:54:49.620849+0000","last_became_active":"2024-04-17T19:53:05.475517+0000","last_became_peered":"2024-04-17T19:53:05.475517+0000","last_unstale":"2024-04-17T19:54:49.620849+0000","last_undegraded":"2024-04-17T19:54:49.620849+0000","last_fullsized":"2024-04-17T19:54:49.620849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:49.620506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:49.620506+0000","last_clean_scrub_stamp":"2024-04-17T19:54:49.620506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:13:22.608497+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"29'3","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:43.580594+0000","last_change":"2024-04-17T19:54:43.580670+0000","last_active":"2024-04-17T19:54:43.580594+0000","last_peered":"2024-04-17T19:54:43.580594+0000","last_clean":"2024-04-17T19:54:43.580594+0000","last_became_active":"2024-04-17T19:53:04.465108+0000","last_became_peered":"2024-04-17T19:53:04.465108+0000","last_unstale":"2024-04-17T19:54:43.580594+0000","last_undegraded":"2024-04-17T19:54:43.580594+0000","last_fullsized":"2024-04-17T19:54:43.580594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-04-17T19:54:43.580358+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-04-17T19:54:43.580358+0000","last_clean_scrub_stamp":"2024-04-17T19:54:43.580358+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:53:50.501802+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:54.621423+0000","last_change":"2024-04-17T19:54:54.621552+0000","last_active":"2024-04-17T19:54:54.621423+0000","last_peered":"2024-04-17T19:54:54.621423+0000","last_clean":"2024-04-17T19:54:54.621423+0000","last_became_active":"2024-04-17T19:53:09.544328+0000","last_became_peered":"2024-04-17T19:53:09.544328+0000","last_unstale":"2024-04-17T19:54:54.621423+0000","last_undegraded":"2024-04-17T19:54:54.621423+0000","last_fullsized":"2024-04-17T19:54:54.621423+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:54.621065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:54.621065+0000","last_clean_scrub_stamp":"2024-04-17T19:54:54.621065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:33:00.684115+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:36.825651+0000","last_change":"2024-04-17T19:54:36.825763+0000","last_active":"2024-04-17T19:54:36.825651+0000","last_peered":"2024-04-17T19:54:36.825651+0000","last_clean":"2024-04-17T19:54:36.825651+0000","last_became_active":"2024-04-17T19:53:05.495800+0000","last_became_peered":"2024-04-17T19:53:05.495800+0000","last_unstale":"2024-04-17T19:54:36.825651+0000","last_undegraded":"2024-04-17T19:54:36.825651+0000","last_fullsized":"2024-04-17T19:54:36.825651+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:36.825315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:36.825315+0000","last_clean_scrub_stamp":"2024-04-17T19:54:36.825315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:34:59.885998+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:34.772365+0000","last_change":"2024-04-17T19:54:34.772430+0000","last_active":"2024-04-17T19:54:34.772365+0000","last_peered":"2024-04-17T19:54:34.772365+0000","last_clean":"2024-04-17T19:54:34.772365+0000","last_became_active":"2024-04-17T19:53:04.478425+0000","last_became_peered":"2024-04-17T19:53:04.478425+0000","last_unstale":"2024-04-17T19:54:34.772365+0000","last_undegraded":"2024-04-17T19:54:34.772365+0000","last_fullsized":"2024-04-17T19:54:34.772365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:34.772131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:34.772131+0000","last_clean_scrub_stamp":"2024-04-17T19:54:34.772131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:00:04.394614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:46.241668+0000","last_change":"2024-04-17T19:54:46.241734+0000","last_active":"2024-04-17T19:54:46.241668+0000","last_peered":"2024-04-17T19:54:46.241668+0000","last_clean":"2024-04-17T19:54:46.241668+0000","last_became_active":"2024-04-17T19:53:09.525577+0000","last_became_peered":"2024-04-17T19:53:09.525577+0000","last_unstale":"2024-04-17T19:54:46.241668+0000","last_undegraded":"2024-04-17T19:54:46.241668+0000","last_fullsized":"2024-04-17T19:54:46.241668+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:46.241459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:46.241459+0000","last_clean_scrub_stamp":"2024-04-17T19:54:46.241459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:22:27.771568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:32.107135+0000","last_change":"2024-04-17T19:54:32.107195+0000","last_active":"2024-04-17T19:54:32.107135+0000","last_peered":"2024-04-17T19:54:32.107135+0000","last_clean":"2024-04-17T19:54:32.107135+0000","last_became_active":"2024-04-17T19:53:05.462415+0000","last_became_peered":"2024-04-17T19:53:05.462415+0000","last_unstale":"2024-04-17T19:54:32.107135+0000","last_undegraded":"2024-04-17T19:54:32.107135+0000","last_fullsized":"2024-04-17T19:54:32.107135+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:32.106927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:32.106927+0000","last_clean_scrub_stamp":"2024-04-17T19:54:32.106927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:48:21.980434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:37.165495+0000","last_change":"2024-04-17T19:54:37.165563+0000","last_active":"2024-04-17T19:54:37.165495+0000","last_peered":"2024-04-17T19:54:37.165495+0000","last_clean":"2024-04-17T19:54:37.165495+0000","last_became_active":"2024-04-17T19:53:04.470258+0000","last_became_peered":"2024-04-17T19:53:04.470258+0000","last_unstale":"2024-04-17T19:54:37.165495+0000","last_undegraded":"2024-04-17T19:54:37.165495+0000","last_fullsized":"2024-04-17T19:54:37.165495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:37.165295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:37.165295+0000","last_clean_scrub_stamp":"2024-04-17T19:54:37.165295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:36:42.621810+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:41.872665+0000","last_change":"2024-04-17T19:54:41.872796+0000","last_active":"2024-04-17T19:54:41.872665+0000","last_peered":"2024-04-17T19:54:41.872665+0000","last_clean":"2024-04-17T19:54:41.872665+0000","last_became_active":"2024-04-17T19:53:09.564134+0000","last_became_peered":"2024-04-17T19:53:09.564134+0000","last_unstale":"2024-04-17T19:54:41.872665+0000","last_undegraded":"2024-04-17T19:54:41.872665+0000","last_fullsized":"2024-04-17T19:54:41.872665+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:41.872298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:41.872298+0000","last_clean_scrub_stamp":"2024-04-17T19:54:41.872298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:42:25.396236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:33.570448+0000","last_change":"2024-04-17T19:54:33.570513+0000","last_active":"2024-04-17T19:54:33.570448+0000","last_peered":"2024-04-17T19:54:33.570448+0000","last_clean":"2024-04-17T19:54:33.570448+0000","last_became_active":"2024-04-17T19:53:05.466996+0000","last_became_peered":"2024-04-17T19:53:05.466996+0000","last_unstale":"2024-04-17T19:54:33.570448+0000","last_undegraded":"2024-04-17T19:54:33.570448+0000","last_fullsized":"2024-04-17T19:54:33.570448+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:33.570236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:33.570236+0000","last_clean_scrub_stamp":"2024-04-17T19:54:33.570236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:00:10.888202+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:34.215318+0000","last_change":"2024-04-17T19:54:34.215390+0000","last_active":"2024-04-17T19:54:34.215318+0000","last_peered":"2024-04-17T19:54:34.215318+0000","last_clean":"2024-04-17T19:54:34.215318+0000","last_became_active":"2024-04-17T19:53:04.468136+0000","last_became_peered":"2024-04-17T19:53:04.468136+0000","last_unstale":"2024-04-17T19:54:34.215318+0000","last_undegraded":"2024-04-17T19:54:34.215318+0000","last_fullsized":"2024-04-17T19:54:34.215318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:34.215104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:34.215104+0000","last_clean_scrub_stamp":"2024-04-17T19:54:34.215104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:55:30.389643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:44.324900+0000","last_change":"2024-04-17T19:54:44.324964+0000","last_active":"2024-04-17T19:54:44.324900+0000","last_peered":"2024-04-17T19:54:44.324900+0000","last_clean":"2024-04-17T19:54:44.324900+0000","last_became_active":"2024-04-17T19:53:45.586731+0000","last_became_peered":"2024-04-17T19:53:45.586731+0000","last_unstale":"2024-04-17T19:54:44.324900+0000","last_undegraded":"2024-04-17T19:54:44.324900+0000","last_fullsized":"2024-04-17T19:54:44.324900+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:44.324697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:44.324697+0000","last_clean_scrub_stamp":"2024-04-17T19:54:44.324697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:14:18.384761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,7],"acting":[2,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:42.194714+0000","last_change":"2024-04-17T19:54:42.194776+0000","last_active":"2024-04-17T19:54:42.194714+0000","last_peered":"2024-04-17T19:54:42.194714+0000","last_clean":"2024-04-17T19:54:42.194714+0000","last_became_active":"2024-04-17T19:53:05.465048+0000","last_became_peered":"2024-04-17T19:53:05.465048+0000","last_unstale":"2024-04-17T19:54:42.194714+0000","last_undegraded":"2024-04-17T19:54:42.194714+0000","last_fullsized":"2024-04-17T19:54:42.194714+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:42.194491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:42.194491+0000","last_clean_scrub_stamp":"2024-04-17T19:54:42.194491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:14:16.254555+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"29'3","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:44.622882+0000","last_change":"2024-04-17T19:54:44.622963+0000","last_active":"2024-04-17T19:54:44.622882+0000","last_peered":"2024-04-17T19:54:44.622882+0000","last_clean":"2024-04-17T19:54:44.622882+0000","last_became_active":"2024-04-17T19:53:04.469119+0000","last_became_peered":"2024-04-17T19:53:04.469119+0000","last_unstale":"2024-04-17T19:54:44.622882+0000","last_undegraded":"2024-04-17T19:54:44.622882+0000","last_fullsized":"2024-04-17T19:54:44.622882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-04-17T19:54:44.622670+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-04-17T19:54:44.622670+0000","last_clean_scrub_stamp":"2024-04-17T19:54:44.622670+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:11:46.929005+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:38.334524+0000","last_change":"2024-04-17T19:54:38.334663+0000","last_active":"2024-04-17T19:54:38.334524+0000","last_peered":"2024-04-17T19:54:38.334524+0000","last_clean":"2024-04-17T19:54:38.334524+0000","last_became_active":"2024-04-17T19:53:09.526436+0000","last_became_peered":"2024-04-17T19:53:09.526436+0000","last_unstale":"2024-04-17T19:54:38.334524+0000","last_undegraded":"2024-04-17T19:54:38.334524+0000","last_fullsized":"2024-04-17T19:54:38.334524+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:38.334262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:38.334262+0000","last_clean_scrub_stamp":"2024-04-17T19:54:38.334262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:18:24.169951+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:39.174455+0000","last_change":"2024-04-17T19:54:39.174576+0000","last_active":"2024-04-17T19:54:39.174455+0000","last_peered":"2024-04-17T19:54:39.174455+0000","last_clean":"2024-04-17T19:54:39.174455+0000","last_became_active":"2024-04-17T19:53:05.442881+0000","last_became_peered":"2024-04-17T19:53:05.442881+0000","last_unstale":"2024-04-17T19:54:39.174455+0000","last_undegraded":"2024-04-17T19:54:39.174455+0000","last_fullsized":"2024-04-17T19:54:39.174455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:39.174135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:39.174135+0000","last_clean_scrub_stamp":"2024-04-17T19:54:39.174135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:00:16.492101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"29'2","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:35.117453+0000","last_change":"2024-04-17T19:54:35.117588+0000","last_active":"2024-04-17T19:54:35.117453+0000","last_peered":"2024-04-17T19:54:35.117453+0000","last_clean":"2024-04-17T19:54:35.117453+0000","last_became_active":"2024-04-17T19:53:04.464701+0000","last_became_peered":"2024-04-17T19:53:04.464701+0000","last_unstale":"2024-04-17T19:54:35.117453+0000","last_undegraded":"2024-04-17T19:54:35.117453+0000","last_fullsized":"2024-04-17T19:54:35.117453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-17T19:54:35.117211+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-17T19:54:35.117211+0000","last_clean_scrub_stamp":"2024-04-17T19:54:35.117211+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:11:42.011626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:44.174722+0000","last_change":"2024-04-17T19:54:44.174722+0000","last_active":"2024-04-17T19:54:44.174722+0000","last_peered":"2024-04-17T19:54:44.174722+0000","last_clean":"2024-04-17T19:54:44.174722+0000","last_became_active":"2024-04-17T19:53:09.529345+0000","last_became_peered":"2024-04-17T19:53:09.529345+0000","last_unstale":"2024-04-17T19:54:44.174722+0000","last_undegraded":"2024-04-17T19:54:44.174722+0000","last_fullsized":"2024-04-17T19:54:44.174722+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:44.174442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:44.174442+0000","last_clean_scrub_stamp":"2024-04-17T19:54:44.174442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:44:56.571729+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:35.736232+0000","last_change":"2024-04-17T19:54:35.736232+0000","last_active":"2024-04-17T19:54:35.736232+0000","last_peered":"2024-04-17T19:54:35.736232+0000","last_clean":"2024-04-17T19:54:35.736232+0000","last_became_active":"2024-04-17T19:53:05.451272+0000","last_became_peered":"2024-04-17T19:53:05.451272+0000","last_unstale":"2024-04-17T19:54:35.736232+0000","last_undegraded":"2024-04-17T19:54:35.736232+0000","last_fullsized":"2024-04-17T19:54:35.736232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:35.735939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:35.735939+0000","last_clean_scrub_stamp":"2024-04-17T19:54:35.735939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:37:20.814690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:46.595409+0000","last_change":"2024-04-17T19:54:46.595409+0000","last_active":"2024-04-17T19:54:46.595409+0000","last_peered":"2024-04-17T19:54:46.595409+0000","last_clean":"2024-04-17T19:54:46.595409+0000","last_became_active":"2024-04-17T19:53:04.471458+0000","last_became_peered":"2024-04-17T19:53:04.471458+0000","last_unstale":"2024-04-17T19:54:46.595409+0000","last_undegraded":"2024-04-17T19:54:46.595409+0000","last_fullsized":"2024-04-17T19:54:46.595409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:46.595127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:46.595127+0000","last_clean_scrub_stamp":"2024-04-17T19:54:46.595127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:37:42.061867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:44.680723+0000","last_change":"2024-04-17T19:54:44.680801+0000","last_active":"2024-04-17T19:54:44.680723+0000","last_peered":"2024-04-17T19:54:44.680723+0000","last_clean":"2024-04-17T19:54:44.680723+0000","last_became_active":"2024-04-17T19:53:09.548136+0000","last_became_peered":"2024-04-17T19:53:09.548136+0000","last_unstale":"2024-04-17T19:54:44.680723+0000","last_undegraded":"2024-04-17T19:54:44.680723+0000","last_fullsized":"2024-04-17T19:54:44.680723+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:44.680497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:44.680497+0000","last_clean_scrub_stamp":"2024-04-17T19:54:44.680497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:28:07.219745+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:37.338166+0000","last_change":"2024-04-17T19:54:37.338166+0000","last_active":"2024-04-17T19:54:37.338166+0000","last_peered":"2024-04-17T19:54:37.338166+0000","last_clean":"2024-04-17T19:54:37.338166+0000","last_became_active":"2024-04-17T19:53:05.472513+0000","last_became_peered":"2024-04-17T19:53:05.472513+0000","last_unstale":"2024-04-17T19:54:37.338166+0000","last_undegraded":"2024-04-17T19:54:37.338166+0000","last_fullsized":"2024-04-17T19:54:37.338166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:37.337872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:37.337872+0000","last_clean_scrub_stamp":"2024-04-17T19:54:37.337872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:55:33.512412+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:38.793146+0000","last_change":"2024-04-17T19:54:38.793146+0000","last_active":"2024-04-17T19:54:38.793146+0000","last_peered":"2024-04-17T19:54:38.793146+0000","last_clean":"2024-04-17T19:54:38.793146+0000","last_became_active":"2024-04-17T19:53:04.487005+0000","last_became_peered":"2024-04-17T19:53:04.487005+0000","last_unstale":"2024-04-17T19:54:38.793146+0000","last_undegraded":"2024-04-17T19:54:38.793146+0000","last_fullsized":"2024-04-17T19:54:38.793146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:38.792894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:38.792894+0000","last_clean_scrub_stamp":"2024-04-17T19:54:38.792894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:00:16.110859+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:42.710833+0000","last_change":"2024-04-17T19:54:42.710977+0000","last_active":"2024-04-17T19:54:42.710833+0000","last_peered":"2024-04-17T19:54:42.710833+0000","last_clean":"2024-04-17T19:54:42.710833+0000","last_became_active":"2024-04-17T19:53:09.545636+0000","last_became_peered":"2024-04-17T19:53:09.545636+0000","last_unstale":"2024-04-17T19:54:42.710833+0000","last_undegraded":"2024-04-17T19:54:42.710833+0000","last_fullsized":"2024-04-17T19:54:42.710833+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:42.710550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:42.710550+0000","last_clean_scrub_stamp":"2024-04-17T19:54:42.710550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:52:09.014718+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:42.196729+0000","last_change":"2024-04-17T19:54:42.196729+0000","last_active":"2024-04-17T19:54:42.196729+0000","last_peered":"2024-04-17T19:54:42.196729+0000","last_clean":"2024-04-17T19:54:42.196729+0000","last_became_active":"2024-04-17T19:53:05.464376+0000","last_became_peered":"2024-04-17T19:53:05.464376+0000","last_unstale":"2024-04-17T19:54:42.196729+0000","last_undegraded":"2024-04-17T19:54:42.196729+0000","last_fullsized":"2024-04-17T19:54:42.196729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:42.196437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:42.196437+0000","last_clean_scrub_stamp":"2024-04-17T19:54:42.196437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:30:23.117850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:41.638579+0000","last_change":"2024-04-17T19:54:41.638579+0000","last_active":"2024-04-17T19:54:41.638579+0000","last_peered":"2024-04-17T19:54:41.638579+0000","last_clean":"2024-04-17T19:54:41.638579+0000","last_became_active":"2024-04-17T19:53:04.464109+0000","last_became_peered":"2024-04-17T19:53:04.464109+0000","last_unstale":"2024-04-17T19:54:41.638579+0000","last_undegraded":"2024-04-17T19:54:41.638579+0000","last_fullsized":"2024-04-17T19:54:41.638579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:41.638283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:41.638283+0000","last_clean_scrub_stamp":"2024-04-17T19:54:41.638283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:30:51.214513+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:46.670954+0000","last_change":"2024-04-17T19:54:46.671018+0000","last_active":"2024-04-17T19:54:46.670954+0000","last_peered":"2024-04-17T19:54:46.670954+0000","last_clean":"2024-04-17T19:54:46.670954+0000","last_became_active":"2024-04-17T19:53:09.548806+0000","last_became_peered":"2024-04-17T19:53:09.548806+0000","last_unstale":"2024-04-17T19:54:46.670954+0000","last_undegraded":"2024-04-17T19:54:46.670954+0000","last_fullsized":"2024-04-17T19:54:46.670954+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:46.670742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:46.670742+0000","last_clean_scrub_stamp":"2024-04-17T19:54:46.670742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:06:22.772782+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:44.806332+0000","last_change":"2024-04-17T19:54:44.806332+0000","last_active":"2024-04-17T19:54:44.806332+0000","last_peered":"2024-04-17T19:54:44.806332+0000","last_clean":"2024-04-17T19:54:44.806332+0000","last_became_active":"2024-04-17T19:53:05.474164+0000","last_became_peered":"2024-04-17T19:53:05.474164+0000","last_unstale":"2024-04-17T19:54:44.806332+0000","last_undegraded":"2024-04-17T19:54:44.806332+0000","last_fullsized":"2024-04-17T19:54:44.806332+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:44.806022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:44.806022+0000","last_clean_scrub_stamp":"2024-04-17T19:54:44.806022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:29:16.767697+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:34.829180+0000","last_change":"2024-04-17T19:54:34.829180+0000","last_active":"2024-04-17T19:54:34.829180+0000","last_peered":"2024-04-17T19:54:34.829180+0000","last_clean":"2024-04-17T19:54:34.829180+0000","last_became_active":"2024-04-17T19:53:04.485424+0000","last_became_peered":"2024-04-17T19:53:04.485424+0000","last_unstale":"2024-04-17T19:54:34.829180+0000","last_undegraded":"2024-04-17T19:54:34.829180+0000","last_fullsized":"2024-04-17T19:54:34.829180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:34.828902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:34.828902+0000","last_clean_scrub_stamp":"2024-04-17T19:54:34.828902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:27:18.811583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:43.698021+0000","last_change":"2024-04-17T19:54:43.698100+0000","last_active":"2024-04-17T19:54:43.698021+0000","last_peered":"2024-04-17T19:54:43.698021+0000","last_clean":"2024-04-17T19:54:43.698021+0000","last_became_active":"2024-04-17T19:53:09.548070+0000","last_became_peered":"2024-04-17T19:53:09.548070+0000","last_unstale":"2024-04-17T19:54:43.698021+0000","last_undegraded":"2024-04-17T19:54:43.698021+0000","last_fullsized":"2024-04-17T19:54:43.698021+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:43.697813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:43.697813+0000","last_clean_scrub_stamp":"2024-04-17T19:54:43.697813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:31:34.403430+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:41.720877+0000","last_change":"2024-04-17T19:54:41.720877+0000","last_active":"2024-04-17T19:54:41.720877+0000","last_peered":"2024-04-17T19:54:41.720877+0000","last_clean":"2024-04-17T19:54:41.720877+0000","last_became_active":"2024-04-17T19:53:05.468241+0000","last_became_peered":"2024-04-17T19:53:05.468241+0000","last_unstale":"2024-04-17T19:54:41.720877+0000","last_undegraded":"2024-04-17T19:54:41.720877+0000","last_fullsized":"2024-04-17T19:54:41.720877+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:41.720597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:41.720597+0000","last_clean_scrub_stamp":"2024-04-17T19:54:41.720597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:18:30.659233+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:38.617833+0000","last_change":"2024-04-17T19:54:38.617833+0000","last_active":"2024-04-17T19:54:38.617833+0000","last_peered":"2024-04-17T19:54:38.617833+0000","last_clean":"2024-04-17T19:54:38.617833+0000","last_became_active":"2024-04-17T19:53:04.483882+0000","last_became_peered":"2024-04-17T19:53:04.483882+0000","last_unstale":"2024-04-17T19:54:38.617833+0000","last_undegraded":"2024-04-17T19:54:38.617833+0000","last_fullsized":"2024-04-17T19:54:38.617833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:38.617547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:38.617547+0000","last_clean_scrub_stamp":"2024-04-17T19:54:38.617547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:44:51.014835+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:49.837388+0000","last_change":"2024-04-17T19:54:49.837457+0000","last_active":"2024-04-17T19:54:49.837388+0000","last_peered":"2024-04-17T19:54:49.837388+0000","last_clean":"2024-04-17T19:54:49.837388+0000","last_became_active":"2024-04-17T19:53:09.558888+0000","last_became_peered":"2024-04-17T19:53:09.558888+0000","last_unstale":"2024-04-17T19:54:49.837388+0000","last_undegraded":"2024-04-17T19:54:49.837388+0000","last_fullsized":"2024-04-17T19:54:49.837388+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:49.837159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:49.837159+0000","last_clean_scrub_stamp":"2024-04-17T19:54:49.837159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:11:52.143493+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:31.106015+0000","last_change":"2024-04-17T19:54:31.106015+0000","last_active":"2024-04-17T19:54:31.106015+0000","last_peered":"2024-04-17T19:54:31.106015+0000","last_clean":"2024-04-17T19:54:31.106015+0000","last_became_active":"2024-04-17T19:53:05.462437+0000","last_became_peered":"2024-04-17T19:53:05.462437+0000","last_unstale":"2024-04-17T19:54:31.106015+0000","last_undegraded":"2024-04-17T19:54:31.106015+0000","last_fullsized":"2024-04-17T19:54:31.106015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:31.105721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:31.105721+0000","last_clean_scrub_stamp":"2024-04-17T19:54:31.105721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:42:14.629660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:39.639424+0000","last_change":"2024-04-17T19:54:39.639424+0000","last_active":"2024-04-17T19:54:39.639424+0000","last_peered":"2024-04-17T19:54:39.639424+0000","last_clean":"2024-04-17T19:54:39.639424+0000","last_became_active":"2024-04-17T19:53:04.458798+0000","last_became_peered":"2024-04-17T19:53:04.458798+0000","last_unstale":"2024-04-17T19:54:39.639424+0000","last_undegraded":"2024-04-17T19:54:39.639424+0000","last_fullsized":"2024-04-17T19:54:39.639424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:39.639029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:39.639029+0000","last_clean_scrub_stamp":"2024-04-17T19:54:39.639029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:12:22.145725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"29'119","reported_seq":193,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:29.935333+0000","last_change":"2024-04-17T19:54:29.935333+0000","last_active":"2024-04-17T19:54:29.935333+0000","last_peered":"2024-04-17T19:54:29.935333+0000","last_clean":"2024-04-17T19:54:29.935333+0000","last_became_active":"2024-04-17T19:52:54.649700+0000","last_became_peered":"2024-04-17T19:52:54.649700+0000","last_unstale":"2024-04-17T19:54:29.935333+0000","last_undegraded":"2024-04-17T19:54:29.935333+0000","last_fullsized":"2024-04-17T19:54:29.935333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'119","last_scrub_stamp":"2024-04-17T19:54:29.935174+0000","last_deep_scrub":"29'119","last_deep_scrub_stamp":"2024-04-17T19:54:29.935174+0000","last_clean_scrub_stamp":"2024-04-17T19:54:29.935174+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:43:19.897643+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:47.283652+0000","last_change":"2024-04-17T19:54:47.283722+0000","last_active":"2024-04-17T19:54:47.283652+0000","last_peered":"2024-04-17T19:54:47.283652+0000","last_clean":"2024-04-17T19:54:47.283652+0000","last_became_active":"2024-04-17T19:53:45.464724+0000","last_became_peered":"2024-04-17T19:53:45.464724+0000","last_unstale":"2024-04-17T19:54:47.283652+0000","last_undegraded":"2024-04-17T19:54:47.283652+0000","last_fullsized":"2024-04-17T19:54:47.283652+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:47.283401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:47.283401+0000","last_clean_scrub_stamp":"2024-04-17T19:54:47.283401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:30:56.859631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,2,0],"acting":[4,5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:48.614550+0000","last_change":"2024-04-17T19:54:48.614614+0000","last_active":"2024-04-17T19:54:48.614550+0000","last_peered":"2024-04-17T19:54:48.614550+0000","last_clean":"2024-04-17T19:54:48.614550+0000","last_became_active":"2024-04-17T19:53:05.475600+0000","last_became_peered":"2024-04-17T19:53:05.475600+0000","last_unstale":"2024-04-17T19:54:48.614550+0000","last_undegraded":"2024-04-17T19:54:48.614550+0000","last_fullsized":"2024-04-17T19:54:48.614550+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:48.614310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:48.614310+0000","last_clean_scrub_stamp":"2024-04-17T19:54:48.614310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:16:21.133094+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:32.851034+0000","last_change":"2024-04-17T19:54:32.851104+0000","last_active":"2024-04-17T19:54:32.851034+0000","last_peered":"2024-04-17T19:54:32.851034+0000","last_clean":"2024-04-17T19:54:32.851034+0000","last_became_active":"2024-04-17T19:53:04.453473+0000","last_became_peered":"2024-04-17T19:53:04.453473+0000","last_unstale":"2024-04-17T19:54:32.851034+0000","last_undegraded":"2024-04-17T19:54:32.851034+0000","last_fullsized":"2024-04-17T19:54:32.851034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:32.850810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:32.850810+0000","last_clean_scrub_stamp":"2024-04-17T19:54:32.850810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:40:17.682304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:41.362462+0000","last_change":"2024-04-17T19:54:41.362538+0000","last_active":"2024-04-17T19:54:41.362462+0000","last_peered":"2024-04-17T19:54:41.362462+0000","last_clean":"2024-04-17T19:54:41.362462+0000","last_became_active":"2024-04-17T19:53:09.548575+0000","last_became_peered":"2024-04-17T19:53:09.548575+0000","last_unstale":"2024-04-17T19:54:41.362462+0000","last_undegraded":"2024-04-17T19:54:41.362462+0000","last_fullsized":"2024-04-17T19:54:41.362462+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:41.362248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:41.362248+0000","last_clean_scrub_stamp":"2024-04-17T19:54:41.362248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:24:04.704304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:40.107815+0000","last_change":"2024-04-17T19:54:40.107882+0000","last_active":"2024-04-17T19:54:40.107815+0000","last_peered":"2024-04-17T19:54:40.107815+0000","last_clean":"2024-04-17T19:54:40.107815+0000","last_became_active":"2024-04-17T19:53:05.463935+0000","last_became_peered":"2024-04-17T19:53:05.463935+0000","last_unstale":"2024-04-17T19:54:40.107815+0000","last_undegraded":"2024-04-17T19:54:40.107815+0000","last_fullsized":"2024-04-17T19:54:40.107815+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:40.107587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:40.107587+0000","last_clean_scrub_stamp":"2024-04-17T19:54:40.107587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:40:35.119877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"29'2","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:35.747222+0000","last_change":"2024-04-17T19:54:35.747302+0000","last_active":"2024-04-17T19:54:35.747222+0000","last_peered":"2024-04-17T19:54:35.747222+0000","last_clean":"2024-04-17T19:54:35.747222+0000","last_became_active":"2024-04-17T19:53:04.467881+0000","last_became_peered":"2024-04-17T19:53:04.467881+0000","last_unstale":"2024-04-17T19:54:35.747222+0000","last_undegraded":"2024-04-17T19:54:35.747222+0000","last_fullsized":"2024-04-17T19:54:35.747222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-17T19:54:35.747013+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-17T19:54:35.747013+0000","last_clean_scrub_stamp":"2024-04-17T19:54:35.747013+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:18:21.582701+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:47.799915+0000","last_change":"2024-04-17T19:54:47.799982+0000","last_active":"2024-04-17T19:54:47.799915+0000","last_peered":"2024-04-17T19:54:47.799915+0000","last_clean":"2024-04-17T19:54:47.799915+0000","last_became_active":"2024-04-17T19:53:09.534631+0000","last_became_peered":"2024-04-17T19:53:09.534631+0000","last_unstale":"2024-04-17T19:54:47.799915+0000","last_undegraded":"2024-04-17T19:54:47.799915+0000","last_fullsized":"2024-04-17T19:54:47.799915+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:47.799709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:47.799709+0000","last_clean_scrub_stamp":"2024-04-17T19:54:47.799709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:56:47.040578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:30.225908+0000","last_change":"2024-04-17T19:54:30.225930+0000","last_active":"2024-04-17T19:54:30.225908+0000","last_peered":"2024-04-17T19:54:30.225908+0000","last_clean":"2024-04-17T19:54:30.225908+0000","last_became_active":"2024-04-17T19:53:05.459941+0000","last_became_peered":"2024-04-17T19:53:05.459941+0000","last_unstale":"2024-04-17T19:54:30.225908+0000","last_undegraded":"2024-04-17T19:54:30.225908+0000","last_fullsized":"2024-04-17T19:54:30.225908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:30.225828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:30.225828+0000","last_clean_scrub_stamp":"2024-04-17T19:54:30.225828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:42:13.749766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"29'3","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:36.124197+0000","last_change":"2024-04-17T19:54:36.124296+0000","last_active":"2024-04-17T19:54:36.124197+0000","last_peered":"2024-04-17T19:54:36.124197+0000","last_clean":"2024-04-17T19:54:36.124197+0000","last_became_active":"2024-04-17T19:53:04.466753+0000","last_became_peered":"2024-04-17T19:53:04.466753+0000","last_unstale":"2024-04-17T19:54:36.124197+0000","last_undegraded":"2024-04-17T19:54:36.124197+0000","last_fullsized":"2024-04-17T19:54:36.124197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-04-17T19:54:36.123994+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-04-17T19:54:36.123994+0000","last_clean_scrub_stamp":"2024-04-17T19:54:36.123994+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:18:21.959683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:51.630305+0000","last_change":"2024-04-17T19:54:51.630375+0000","last_active":"2024-04-17T19:54:51.630305+0000","last_peered":"2024-04-17T19:54:51.630305+0000","last_clean":"2024-04-17T19:54:51.630305+0000","last_became_active":"2024-04-17T19:53:09.518979+0000","last_became_peered":"2024-04-17T19:53:09.518979+0000","last_unstale":"2024-04-17T19:54:51.630305+0000","last_undegraded":"2024-04-17T19:54:51.630305+0000","last_fullsized":"2024-04-17T19:54:51.630305+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:51.630030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:51.630030+0000","last_clean_scrub_stamp":"2024-04-17T19:54:51.630030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:49:07.846948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:34.380941+0000","last_change":"2024-04-17T19:54:34.381006+0000","last_active":"2024-04-17T19:54:34.380941+0000","last_peered":"2024-04-17T19:54:34.380941+0000","last_clean":"2024-04-17T19:54:34.380941+0000","last_became_active":"2024-04-17T19:53:05.464158+0000","last_became_peered":"2024-04-17T19:53:05.464158+0000","last_unstale":"2024-04-17T19:54:34.380941+0000","last_undegraded":"2024-04-17T19:54:34.380941+0000","last_fullsized":"2024-04-17T19:54:34.380941+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:34.380741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:34.380741+0000","last_clean_scrub_stamp":"2024-04-17T19:54:34.380741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:48:24.254248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"29'2","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:36.185598+0000","last_change":"2024-04-17T19:54:36.185673+0000","last_active":"2024-04-17T19:54:36.185598+0000","last_peered":"2024-04-17T19:54:36.185598+0000","last_clean":"2024-04-17T19:54:36.185598+0000","last_became_active":"2024-04-17T19:53:04.477162+0000","last_became_peered":"2024-04-17T19:53:04.477162+0000","last_unstale":"2024-04-17T19:54:36.185598+0000","last_undegraded":"2024-04-17T19:54:36.185598+0000","last_fullsized":"2024-04-17T19:54:36.185598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-04-17T19:54:36.185367+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-04-17T19:54:36.185367+0000","last_clean_scrub_stamp":"2024-04-17T19:54:36.185367+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:36:41.641883+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:37.014138+0000","last_change":"2024-04-17T19:54:37.014214+0000","last_active":"2024-04-17T19:54:37.014138+0000","last_peered":"2024-04-17T19:54:37.014138+0000","last_clean":"2024-04-17T19:54:37.014138+0000","last_became_active":"2024-04-17T19:53:09.532715+0000","last_became_peered":"2024-04-17T19:53:09.532715+0000","last_unstale":"2024-04-17T19:54:37.014138+0000","last_undegraded":"2024-04-17T19:54:37.014138+0000","last_fullsized":"2024-04-17T19:54:37.014138+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:37.013907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:37.013907+0000","last_clean_scrub_stamp":"2024-04-17T19:54:37.013907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:23:20.051411+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:35.625158+0000","last_change":"2024-04-17T19:54:35.625229+0000","last_active":"2024-04-17T19:54:35.625158+0000","last_peered":"2024-04-17T19:54:35.625158+0000","last_clean":"2024-04-17T19:54:35.625158+0000","last_became_active":"2024-04-17T19:53:05.468223+0000","last_became_peered":"2024-04-17T19:53:05.468223+0000","last_unstale":"2024-04-17T19:54:35.625158+0000","last_undegraded":"2024-04-17T19:54:35.625158+0000","last_fullsized":"2024-04-17T19:54:35.625158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:35.624895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:35.624895+0000","last_clean_scrub_stamp":"2024-04-17T19:54:35.624895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:26:33.171568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"29'12","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:34.105744+0000","last_change":"2024-04-17T19:54:34.105831+0000","last_active":"2024-04-17T19:54:34.105744+0000","last_peered":"2024-04-17T19:54:34.105744+0000","last_clean":"2024-04-17T19:54:34.105744+0000","last_became_active":"2024-04-17T19:53:04.460919+0000","last_became_peered":"2024-04-17T19:53:04.460919+0000","last_unstale":"2024-04-17T19:54:34.105744+0000","last_undegraded":"2024-04-17T19:54:34.105744+0000","last_fullsized":"2024-04-17T19:54:34.105744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-04-17T19:54:34.105533+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-04-17T19:54:34.105533+0000","last_clean_scrub_stamp":"2024-04-17T19:54:34.105533+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:41:27.472188+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:48.827409+0000","last_change":"2024-04-17T19:54:48.827482+0000","last_active":"2024-04-17T19:54:48.827409+0000","last_peered":"2024-04-17T19:54:48.827409+0000","last_clean":"2024-04-17T19:54:48.827409+0000","last_became_active":"2024-04-17T19:53:09.546048+0000","last_became_peered":"2024-04-17T19:53:09.546048+0000","last_unstale":"2024-04-17T19:54:48.827409+0000","last_undegraded":"2024-04-17T19:54:48.827409+0000","last_fullsized":"2024-04-17T19:54:48.827409+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:48.827197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:48.827197+0000","last_clean_scrub_stamp":"2024-04-17T19:54:48.827197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:53:55.748641+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:35.994982+0000","last_change":"2024-04-17T19:54:35.995049+0000","last_active":"2024-04-17T19:54:35.994982+0000","last_peered":"2024-04-17T19:54:35.994982+0000","last_clean":"2024-04-17T19:54:35.994982+0000","last_became_active":"2024-04-17T19:53:05.473892+0000","last_became_peered":"2024-04-17T19:53:05.473892+0000","last_unstale":"2024-04-17T19:54:35.994982+0000","last_undegraded":"2024-04-17T19:54:35.994982+0000","last_fullsized":"2024-04-17T19:54:35.994982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:35.994766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:35.994766+0000","last_clean_scrub_stamp":"2024-04-17T19:54:35.994766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:00:37.719934+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:31.249500+0000","last_change":"2024-04-17T19:54:31.249622+0000","last_active":"2024-04-17T19:54:31.249500+0000","last_peered":"2024-04-17T19:54:31.249500+0000","last_clean":"2024-04-17T19:54:31.249500+0000","last_became_active":"2024-04-17T19:53:04.459663+0000","last_became_peered":"2024-04-17T19:53:04.459663+0000","last_unstale":"2024-04-17T19:54:31.249500+0000","last_undegraded":"2024-04-17T19:54:31.249500+0000","last_fullsized":"2024-04-17T19:54:31.249500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:31.249225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:31.249225+0000","last_clean_scrub_stamp":"2024-04-17T19:54:31.249225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:48:06.122798+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:46.803924+0000","last_change":"2024-04-17T19:54:46.804002+0000","last_active":"2024-04-17T19:54:46.803924+0000","last_peered":"2024-04-17T19:54:46.803924+0000","last_clean":"2024-04-17T19:54:46.803924+0000","last_became_active":"2024-04-17T19:53:09.532504+0000","last_became_peered":"2024-04-17T19:53:09.532504+0000","last_unstale":"2024-04-17T19:54:46.803924+0000","last_undegraded":"2024-04-17T19:54:46.803924+0000","last_fullsized":"2024-04-17T19:54:46.803924+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:46.803660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:46.803660+0000","last_clean_scrub_stamp":"2024-04-17T19:54:46.803660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:30:56.379890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:32.567508+0000","last_change":"2024-04-17T19:54:32.567561+0000","last_active":"2024-04-17T19:54:32.567508+0000","last_peered":"2024-04-17T19:54:32.567508+0000","last_clean":"2024-04-17T19:54:32.567508+0000","last_became_active":"2024-04-17T19:53:05.467349+0000","last_became_peered":"2024-04-17T19:53:05.467349+0000","last_unstale":"2024-04-17T19:54:32.567508+0000","last_undegraded":"2024-04-17T19:54:32.567508+0000","last_fullsized":"2024-04-17T19:54:32.567508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:32.567363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:32.567363+0000","last_clean_scrub_stamp":"2024-04-17T19:54:32.567363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:07:24.700412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:42.625850+0000","last_change":"2024-04-17T19:54:42.625916+0000","last_active":"2024-04-17T19:54:42.625850+0000","last_peered":"2024-04-17T19:54:42.625850+0000","last_clean":"2024-04-17T19:54:42.625850+0000","last_became_active":"2024-04-17T19:53:04.465333+0000","last_became_peered":"2024-04-17T19:53:04.465333+0000","last_unstale":"2024-04-17T19:54:42.625850+0000","last_undegraded":"2024-04-17T19:54:42.625850+0000","last_fullsized":"2024-04-17T19:54:42.625850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:42.625620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:42.625620+0000","last_clean_scrub_stamp":"2024-04-17T19:54:42.625620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:56:41.866489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:45.712057+0000","last_change":"2024-04-17T19:54:45.712125+0000","last_active":"2024-04-17T19:54:45.712057+0000","last_peered":"2024-04-17T19:54:45.712057+0000","last_clean":"2024-04-17T19:54:45.712057+0000","last_became_active":"2024-04-17T19:53:09.548109+0000","last_became_peered":"2024-04-17T19:53:09.548109+0000","last_unstale":"2024-04-17T19:54:45.712057+0000","last_undegraded":"2024-04-17T19:54:45.712057+0000","last_fullsized":"2024-04-17T19:54:45.712057+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:45.711826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:45.711826+0000","last_clean_scrub_stamp":"2024-04-17T19:54:45.711826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:13:53.082548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:36.702835+0000","last_change":"2024-04-17T19:54:36.702955+0000","last_active":"2024-04-17T19:54:36.702835+0000","last_peered":"2024-04-17T19:54:36.702835+0000","last_clean":"2024-04-17T19:54:36.702835+0000","last_became_active":"2024-04-17T19:53:05.454358+0000","last_became_peered":"2024-04-17T19:53:05.454358+0000","last_unstale":"2024-04-17T19:54:36.702835+0000","last_undegraded":"2024-04-17T19:54:36.702835+0000","last_fullsized":"2024-04-17T19:54:36.702835+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:36.702572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:36.702572+0000","last_clean_scrub_stamp":"2024-04-17T19:54:36.702572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:46:25.853340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"29'4","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:32.800512+0000","last_change":"2024-04-17T19:54:32.800613+0000","last_active":"2024-04-17T19:54:32.800512+0000","last_peered":"2024-04-17T19:54:32.800512+0000","last_clean":"2024-04-17T19:54:32.800512+0000","last_became_active":"2024-04-17T19:53:04.473389+0000","last_became_peered":"2024-04-17T19:53:04.473389+0000","last_unstale":"2024-04-17T19:54:32.800512+0000","last_undegraded":"2024-04-17T19:54:32.800512+0000","last_fullsized":"2024-04-17T19:54:32.800512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-04-17T19:54:32.800306+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-04-17T19:54:32.800306+0000","last_clean_scrub_stamp":"2024-04-17T19:54:32.800306+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:08:35.608211+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:52.642351+0000","last_change":"2024-04-17T19:54:52.642427+0000","last_active":"2024-04-17T19:54:52.642351+0000","last_peered":"2024-04-17T19:54:52.642351+0000","last_clean":"2024-04-17T19:54:52.642351+0000","last_became_active":"2024-04-17T19:53:09.521522+0000","last_became_peered":"2024-04-17T19:53:09.521522+0000","last_unstale":"2024-04-17T19:54:52.642351+0000","last_undegraded":"2024-04-17T19:54:52.642351+0000","last_fullsized":"2024-04-17T19:54:52.642351+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:52.642111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:52.642111+0000","last_clean_scrub_stamp":"2024-04-17T19:54:52.642111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:06:51.365706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:37.142222+0000","last_change":"2024-04-17T19:54:37.142309+0000","last_active":"2024-04-17T19:54:37.142222+0000","last_peered":"2024-04-17T19:54:37.142222+0000","last_clean":"2024-04-17T19:54:37.142222+0000","last_became_active":"2024-04-17T19:53:05.455429+0000","last_became_peered":"2024-04-17T19:53:05.455429+0000","last_unstale":"2024-04-17T19:54:37.142222+0000","last_undegraded":"2024-04-17T19:54:37.142222+0000","last_fullsized":"2024-04-17T19:54:37.142222+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:37.142003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:37.142003+0000","last_clean_scrub_stamp":"2024-04-17T19:54:37.142003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:07:29.275051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"29'23","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:30.402619+0000","last_change":"2024-04-17T19:54:30.402768+0000","last_active":"2024-04-17T19:54:30.402619+0000","last_peered":"2024-04-17T19:54:30.402619+0000","last_clean":"2024-04-17T19:54:30.402619+0000","last_became_active":"2024-04-17T19:53:04.459855+0000","last_became_peered":"2024-04-17T19:53:04.459855+0000","last_unstale":"2024-04-17T19:54:30.402619+0000","last_undegraded":"2024-04-17T19:54:30.402619+0000","last_fullsized":"2024-04-17T19:54:30.402619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'23","last_scrub_stamp":"2024-04-17T19:54:30.402323+0000","last_deep_scrub":"29'23","last_deep_scrub_stamp":"2024-04-17T19:54:30.402323+0000","last_clean_scrub_stamp":"2024-04-17T19:54:30.402323+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:31:43.486454+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6170,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:43.176422+0000","last_change":"2024-04-17T19:54:43.176499+0000","last_active":"2024-04-17T19:54:43.176422+0000","last_peered":"2024-04-17T19:54:43.176422+0000","last_clean":"2024-04-17T19:54:43.176422+0000","last_became_active":"2024-04-17T19:53:09.528987+0000","last_became_peered":"2024-04-17T19:53:09.528987+0000","last_unstale":"2024-04-17T19:54:43.176422+0000","last_undegraded":"2024-04-17T19:54:43.176422+0000","last_fullsized":"2024-04-17T19:54:43.176422+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:43.176154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:43.176154+0000","last_clean_scrub_stamp":"2024-04-17T19:54:43.176154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:30:24.097567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:31.530214+0000","last_change":"2024-04-17T19:54:31.530250+0000","last_active":"2024-04-17T19:54:31.530214+0000","last_peered":"2024-04-17T19:54:31.530214+0000","last_clean":"2024-04-17T19:54:31.530214+0000","last_became_active":"2024-04-17T19:53:05.468432+0000","last_became_peered":"2024-04-17T19:53:05.468432+0000","last_unstale":"2024-04-17T19:54:31.530214+0000","last_undegraded":"2024-04-17T19:54:31.530214+0000","last_fullsized":"2024-04-17T19:54:31.530214+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:31.530067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:31.530067+0000","last_clean_scrub_stamp":"2024-04-17T19:54:31.530067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:51:01.348417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"29'5","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:33.807091+0000","last_change":"2024-04-17T19:54:33.807182+0000","last_active":"2024-04-17T19:54:33.807091+0000","last_peered":"2024-04-17T19:54:33.807091+0000","last_clean":"2024-04-17T19:54:33.807091+0000","last_became_active":"2024-04-17T19:53:04.473458+0000","last_became_peered":"2024-04-17T19:53:04.473458+0000","last_unstale":"2024-04-17T19:54:33.807091+0000","last_undegraded":"2024-04-17T19:54:33.807091+0000","last_fullsized":"2024-04-17T19:54:33.807091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-04-17T19:54:33.806888+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-04-17T19:54:33.806888+0000","last_clean_scrub_stamp":"2024-04-17T19:54:33.806888+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:01:12.748161+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:43.325683+0000","last_change":"2024-04-17T19:54:43.325750+0000","last_active":"2024-04-17T19:54:43.325683+0000","last_peered":"2024-04-17T19:54:43.325683+0000","last_clean":"2024-04-17T19:54:43.325683+0000","last_became_active":"2024-04-17T19:53:09.557653+0000","last_became_peered":"2024-04-17T19:53:09.557653+0000","last_unstale":"2024-04-17T19:54:43.325683+0000","last_undegraded":"2024-04-17T19:54:43.325683+0000","last_fullsized":"2024-04-17T19:54:43.325683+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:43.325458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:43.325458+0000","last_clean_scrub_stamp":"2024-04-17T19:54:43.325458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:40:38.337749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:32.650874+0000","last_change":"2024-04-17T19:54:32.650937+0000","last_active":"2024-04-17T19:54:32.650874+0000","last_peered":"2024-04-17T19:54:32.650874+0000","last_clean":"2024-04-17T19:54:32.650874+0000","last_became_active":"2024-04-17T19:53:05.461293+0000","last_became_peered":"2024-04-17T19:53:05.461293+0000","last_unstale":"2024-04-17T19:54:32.650874+0000","last_undegraded":"2024-04-17T19:54:32.650874+0000","last_fullsized":"2024-04-17T19:54:32.650874+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:32.650671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:32.650671+0000","last_clean_scrub_stamp":"2024-04-17T19:54:32.650671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:37:12.486647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:35.197287+0000","last_change":"2024-04-17T19:54:35.197431+0000","last_active":"2024-04-17T19:54:35.197287+0000","last_peered":"2024-04-17T19:54:35.197287+0000","last_clean":"2024-04-17T19:54:35.197287+0000","last_became_active":"2024-04-17T19:53:04.467986+0000","last_became_peered":"2024-04-17T19:53:04.467986+0000","last_unstale":"2024-04-17T19:54:35.197287+0000","last_undegraded":"2024-04-17T19:54:35.197287+0000","last_fullsized":"2024-04-17T19:54:35.197287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:35.196978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:35.196978+0000","last_clean_scrub_stamp":"2024-04-17T19:54:35.196978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:18:21.032667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:39.884766+0000","last_change":"2024-04-17T19:54:39.884839+0000","last_active":"2024-04-17T19:54:39.884766+0000","last_peered":"2024-04-17T19:54:39.884766+0000","last_clean":"2024-04-17T19:54:39.884766+0000","last_became_active":"2024-04-17T19:53:09.558779+0000","last_became_peered":"2024-04-17T19:53:09.558779+0000","last_unstale":"2024-04-17T19:54:39.884766+0000","last_undegraded":"2024-04-17T19:54:39.884766+0000","last_fullsized":"2024-04-17T19:54:39.884766+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:39.884545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:39.884545+0000","last_clean_scrub_stamp":"2024-04-17T19:54:39.884545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:40:25.880990+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:33.358830+0000","last_change":"2024-04-17T19:54:33.358901+0000","last_active":"2024-04-17T19:54:33.358830+0000","last_peered":"2024-04-17T19:54:33.358830+0000","last_clean":"2024-04-17T19:54:33.358830+0000","last_became_active":"2024-04-17T19:53:05.459538+0000","last_became_peered":"2024-04-17T19:53:05.459538+0000","last_unstale":"2024-04-17T19:54:33.358830+0000","last_undegraded":"2024-04-17T19:54:33.358830+0000","last_fullsized":"2024-04-17T19:54:33.358830+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:33.358574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:33.358574+0000","last_clean_scrub_stamp":"2024-04-17T19:54:33.358574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:42:16.882512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:30.962371+0000","last_change":"2024-04-17T19:54:30.962395+0000","last_active":"2024-04-17T19:54:30.962371+0000","last_peered":"2024-04-17T19:54:30.962371+0000","last_clean":"2024-04-17T19:54:30.962371+0000","last_became_active":"2024-04-17T19:53:04.459787+0000","last_became_peered":"2024-04-17T19:53:04.459787+0000","last_unstale":"2024-04-17T19:54:30.962371+0000","last_undegraded":"2024-04-17T19:54:30.962371+0000","last_fullsized":"2024-04-17T19:54:30.962371+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:30.962289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:30.962289+0000","last_clean_scrub_stamp":"2024-04-17T19:54:30.962289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:35:39.104616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:48.263266+0000","last_change":"2024-04-17T19:54:48.263335+0000","last_active":"2024-04-17T19:54:48.263266+0000","last_peered":"2024-04-17T19:54:48.263266+0000","last_clean":"2024-04-17T19:54:48.263266+0000","last_became_active":"2024-04-17T19:53:45.587729+0000","last_became_peered":"2024-04-17T19:53:45.587729+0000","last_unstale":"2024-04-17T19:54:48.263266+0000","last_undegraded":"2024-04-17T19:54:48.263266+0000","last_fullsized":"2024-04-17T19:54:48.263266+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:48.263063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:48.263063+0000","last_clean_scrub_stamp":"2024-04-17T19:54:48.263063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:56:47.503932+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,7],"acting":[4,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:45.200195+0000","last_change":"2024-04-17T19:54:45.200195+0000","last_active":"2024-04-17T19:54:45.200195+0000","last_peered":"2024-04-17T19:54:45.200195+0000","last_clean":"2024-04-17T19:54:45.200195+0000","last_became_active":"2024-04-17T19:53:09.535559+0000","last_became_peered":"2024-04-17T19:53:09.535559+0000","last_unstale":"2024-04-17T19:54:45.200195+0000","last_undegraded":"2024-04-17T19:54:45.200195+0000","last_fullsized":"2024-04-17T19:54:45.200195+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:45.199920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:45.199920+0000","last_clean_scrub_stamp":"2024-04-17T19:54:45.199920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:29:17.161595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:38.168657+0000","last_change":"2024-04-17T19:54:38.168721+0000","last_active":"2024-04-17T19:54:38.168657+0000","last_peered":"2024-04-17T19:54:38.168657+0000","last_clean":"2024-04-17T19:54:38.168657+0000","last_became_active":"2024-04-17T19:53:05.439793+0000","last_became_peered":"2024-04-17T19:53:05.439793+0000","last_unstale":"2024-04-17T19:54:38.168657+0000","last_undegraded":"2024-04-17T19:54:38.168657+0000","last_fullsized":"2024-04-17T19:54:38.168657+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:38.168444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:38.168444+0000","last_clean_scrub_stamp":"2024-04-17T19:54:38.168444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:54:13.761262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:40.631714+0000","last_change":"2024-04-17T19:54:40.631780+0000","last_active":"2024-04-17T19:54:40.631714+0000","last_peered":"2024-04-17T19:54:40.631714+0000","last_clean":"2024-04-17T19:54:40.631714+0000","last_became_active":"2024-04-17T19:53:04.461020+0000","last_became_peered":"2024-04-17T19:53:04.461020+0000","last_unstale":"2024-04-17T19:54:40.631714+0000","last_undegraded":"2024-04-17T19:54:40.631714+0000","last_fullsized":"2024-04-17T19:54:40.631714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:40.631459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:40.631459+0000","last_clean_scrub_stamp":"2024-04-17T19:54:40.631459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:05:58.011709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:53.610791+0000","last_change":"2024-04-17T19:54:53.610866+0000","last_active":"2024-04-17T19:54:53.610791+0000","last_peered":"2024-04-17T19:54:53.610791+0000","last_clean":"2024-04-17T19:54:53.610791+0000","last_became_active":"2024-04-17T19:53:09.534655+0000","last_became_peered":"2024-04-17T19:53:09.534655+0000","last_unstale":"2024-04-17T19:54:53.610791+0000","last_undegraded":"2024-04-17T19:54:53.610791+0000","last_fullsized":"2024-04-17T19:54:53.610791+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:53.610564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:53.610564+0000","last_clean_scrub_stamp":"2024-04-17T19:54:53.610564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:56:50.097384+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:40.822010+0000","last_change":"2024-04-17T19:54:40.822080+0000","last_active":"2024-04-17T19:54:40.822010+0000","last_peered":"2024-04-17T19:54:40.822010+0000","last_clean":"2024-04-17T19:54:40.822010+0000","last_became_active":"2024-04-17T19:53:05.452844+0000","last_became_peered":"2024-04-17T19:53:05.452844+0000","last_unstale":"2024-04-17T19:54:40.822010+0000","last_undegraded":"2024-04-17T19:54:40.822010+0000","last_fullsized":"2024-04-17T19:54:40.822010+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:40.821803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:40.821803+0000","last_clean_scrub_stamp":"2024-04-17T19:54:40.821803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:40:35.834094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:33.803131+0000","last_change":"2024-04-17T19:54:33.803191+0000","last_active":"2024-04-17T19:54:33.803131+0000","last_peered":"2024-04-17T19:54:33.803131+0000","last_clean":"2024-04-17T19:54:33.803131+0000","last_became_active":"2024-04-17T19:53:04.469777+0000","last_became_peered":"2024-04-17T19:53:04.469777+0000","last_unstale":"2024-04-17T19:54:33.803131+0000","last_undegraded":"2024-04-17T19:54:33.803131+0000","last_fullsized":"2024-04-17T19:54:33.803131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:33.802935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:33.802935+0000","last_clean_scrub_stamp":"2024-04-17T19:54:33.802935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:49:24.633597+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:45.628007+0000","last_change":"2024-04-17T19:54:45.628082+0000","last_active":"2024-04-17T19:54:45.628007+0000","last_peered":"2024-04-17T19:54:45.628007+0000","last_clean":"2024-04-17T19:54:45.628007+0000","last_became_active":"2024-04-17T19:53:04.469297+0000","last_became_peered":"2024-04-17T19:53:04.469297+0000","last_unstale":"2024-04-17T19:54:45.628007+0000","last_undegraded":"2024-04-17T19:54:45.628007+0000","last_fullsized":"2024-04-17T19:54:45.628007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2024-04-17T19:54:45.627789+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2024-04-17T19:54:45.627789+0000","last_clean_scrub_stamp":"2024-04-17T19:54:45.627789+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:36:20.473140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:40.216055+0000","last_change":"2024-04-17T19:54:40.216114+0000","last_active":"2024-04-17T19:54:40.216055+0000","last_peered":"2024-04-17T19:54:40.216055+0000","last_clean":"2024-04-17T19:54:40.216055+0000","last_became_active":"2024-04-17T19:53:05.459616+0000","last_became_peered":"2024-04-17T19:53:05.459616+0000","last_unstale":"2024-04-17T19:54:40.216055+0000","last_undegraded":"2024-04-17T19:54:40.216055+0000","last_fullsized":"2024-04-17T19:54:40.216055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:40.215853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:40.215853+0000","last_clean_scrub_stamp":"2024-04-17T19:54:40.215853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:58:20.190432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:46.247645+0000","last_change":"2024-04-17T19:54:46.247724+0000","last_active":"2024-04-17T19:54:46.247645+0000","last_peered":"2024-04-17T19:54:46.247645+0000","last_clean":"2024-04-17T19:54:46.247645+0000","last_became_active":"2024-04-17T19:53:45.462598+0000","last_became_peered":"2024-04-17T19:53:45.462598+0000","last_unstale":"2024-04-17T19:54:46.247645+0000","last_undegraded":"2024-04-17T19:54:46.247645+0000","last_fullsized":"2024-04-17T19:54:46.247645+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:46.247423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:46.247423+0000","last_clean_scrub_stamp":"2024-04-17T19:54:46.247423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:06:03.627673+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,2],"acting":[4,6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:37.769059+0000","last_change":"2024-04-17T19:54:37.769169+0000","last_active":"2024-04-17T19:54:37.769059+0000","last_peered":"2024-04-17T19:54:37.769059+0000","last_clean":"2024-04-17T19:54:37.769059+0000","last_became_active":"2024-04-17T19:53:04.486707+0000","last_became_peered":"2024-04-17T19:53:04.486707+0000","last_unstale":"2024-04-17T19:54:37.769059+0000","last_undegraded":"2024-04-17T19:54:37.769059+0000","last_fullsized":"2024-04-17T19:54:37.769059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2024-04-17T19:54:37.768846+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2024-04-17T19:54:37.768846+0000","last_clean_scrub_stamp":"2024-04-17T19:54:37.768846+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:07:29.901894+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:31.937365+0000","last_change":"2024-04-17T19:54:31.937416+0000","last_active":"2024-04-17T19:54:31.937365+0000","last_peered":"2024-04-17T19:54:31.937365+0000","last_clean":"2024-04-17T19:54:31.937365+0000","last_became_active":"2024-04-17T19:53:05.448374+0000","last_became_peered":"2024-04-17T19:53:05.448374+0000","last_unstale":"2024-04-17T19:54:31.937365+0000","last_undegraded":"2024-04-17T19:54:31.937365+0000","last_fullsized":"2024-04-17T19:54:31.937365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:31.937235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:31.937235+0000","last_clean_scrub_stamp":"2024-04-17T19:54:31.937235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:08:34.745140+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:40.885115+0000","last_change":"2024-04-17T19:54:40.885183+0000","last_active":"2024-04-17T19:54:40.885115+0000","last_peered":"2024-04-17T19:54:40.885115+0000","last_clean":"2024-04-17T19:54:40.885115+0000","last_became_active":"2024-04-17T19:53:09.560076+0000","last_became_peered":"2024-04-17T19:53:09.560076+0000","last_unstale":"2024-04-17T19:54:40.885115+0000","last_undegraded":"2024-04-17T19:54:40.885115+0000","last_fullsized":"2024-04-17T19:54:40.885115+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:40.884901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:40.884901+0000","last_clean_scrub_stamp":"2024-04-17T19:54:40.884901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:05:05.807615+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:36.343788+0000","last_change":"2024-04-17T19:54:36.343788+0000","last_active":"2024-04-17T19:54:36.343788+0000","last_peered":"2024-04-17T19:54:36.343788+0000","last_clean":"2024-04-17T19:54:36.343788+0000","last_became_active":"2024-04-17T19:53:05.472324+0000","last_became_peered":"2024-04-17T19:53:05.472324+0000","last_unstale":"2024-04-17T19:54:36.343788+0000","last_undegraded":"2024-04-17T19:54:36.343788+0000","last_fullsized":"2024-04-17T19:54:36.343788+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:36.343487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:36.343487+0000","last_clean_scrub_stamp":"2024-04-17T19:54:36.343487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T03:41:29.710142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:35.836179+0000","last_change":"2024-04-17T19:54:35.836179+0000","last_active":"2024-04-17T19:54:35.836179+0000","last_peered":"2024-04-17T19:54:35.836179+0000","last_clean":"2024-04-17T19:54:35.836179+0000","last_became_active":"2024-04-17T19:53:05.475823+0000","last_became_peered":"2024-04-17T19:53:05.475823+0000","last_unstale":"2024-04-17T19:54:35.836179+0000","last_undegraded":"2024-04-17T19:54:35.836179+0000","last_fullsized":"2024-04-17T19:54:35.836179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:35.835849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:35.835849+0000","last_clean_scrub_stamp":"2024-04-17T19:54:35.835849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:27:29.359575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:36.625174+0000","last_change":"2024-04-17T19:54:36.625174+0000","last_active":"2024-04-17T19:54:36.625174+0000","last_peered":"2024-04-17T19:54:36.625174+0000","last_clean":"2024-04-17T19:54:36.625174+0000","last_became_active":"2024-04-17T19:53:05.453142+0000","last_became_peered":"2024-04-17T19:53:05.453142+0000","last_unstale":"2024-04-17T19:54:36.625174+0000","last_undegraded":"2024-04-17T19:54:36.625174+0000","last_fullsized":"2024-04-17T19:54:36.625174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:36.624896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:36.624896+0000","last_clean_scrub_stamp":"2024-04-17T19:54:36.624896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:14:10.684960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:43.811830+0000","last_change":"2024-04-17T19:54:43.811830+0000","last_active":"2024-04-17T19:54:43.811830+0000","last_peered":"2024-04-17T19:54:43.811830+0000","last_clean":"2024-04-17T19:54:43.811830+0000","last_became_active":"2024-04-17T19:53:05.473931+0000","last_became_peered":"2024-04-17T19:53:05.473931+0000","last_unstale":"2024-04-17T19:54:43.811830+0000","last_undegraded":"2024-04-17T19:54:43.811830+0000","last_fullsized":"2024-04-17T19:54:43.811830+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:43.811533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:43.811533+0000","last_clean_scrub_stamp":"2024-04-17T19:54:43.811533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:44:56.208821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:40.683168+0000","last_change":"2024-04-17T19:54:40.683233+0000","last_active":"2024-04-17T19:54:40.683168+0000","last_peered":"2024-04-17T19:54:40.683168+0000","last_clean":"2024-04-17T19:54:40.683168+0000","last_became_active":"2024-04-17T19:53:05.467838+0000","last_became_peered":"2024-04-17T19:53:05.467838+0000","last_unstale":"2024-04-17T19:54:40.683168+0000","last_undegraded":"2024-04-17T19:54:40.683168+0000","last_fullsized":"2024-04-17T19:54:40.683168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:40.682913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:40.682913+0000","last_clean_scrub_stamp":"2024-04-17T19:54:40.682913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:16:49.578443+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:37.660853+0000","last_change":"2024-04-17T19:54:37.660937+0000","last_active":"2024-04-17T19:54:37.660853+0000","last_peered":"2024-04-17T19:54:37.660853+0000","last_clean":"2024-04-17T19:54:37.660853+0000","last_became_active":"2024-04-17T19:53:05.461829+0000","last_became_peered":"2024-04-17T19:53:05.461829+0000","last_unstale":"2024-04-17T19:54:37.660853+0000","last_undegraded":"2024-04-17T19:54:37.660853+0000","last_fullsized":"2024-04-17T19:54:37.660853+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:37.660560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:37.660560+0000","last_clean_scrub_stamp":"2024-04-17T19:54:37.660560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:03:08.537572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:35.380013+0000","last_change":"2024-04-17T19:54:35.380076+0000","last_active":"2024-04-17T19:54:35.380013+0000","last_peered":"2024-04-17T19:54:35.380013+0000","last_clean":"2024-04-17T19:54:35.380013+0000","last_became_active":"2024-04-17T19:53:05.465547+0000","last_became_peered":"2024-04-17T19:53:05.465547+0000","last_unstale":"2024-04-17T19:54:35.380013+0000","last_undegraded":"2024-04-17T19:54:35.380013+0000","last_fullsized":"2024-04-17T19:54:35.380013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:35.379805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:35.379805+0000","last_clean_scrub_stamp":"2024-04-17T19:54:35.379805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T05:47:44.948259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:45.804744+0000","last_change":"2024-04-17T19:54:45.804809+0000","last_active":"2024-04-17T19:54:45.804744+0000","last_peered":"2024-04-17T19:54:45.804744+0000","last_clean":"2024-04-17T19:54:45.804744+0000","last_became_active":"2024-04-17T19:53:05.474798+0000","last_became_peered":"2024-04-17T19:53:05.474798+0000","last_unstale":"2024-04-17T19:54:45.804744+0000","last_undegraded":"2024-04-17T19:54:45.804744+0000","last_fullsized":"2024-04-17T19:54:45.804744+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:45.804534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:45.804534+0000","last_clean_scrub_stamp":"2024-04-17T19:54:45.804534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:06:03.184784+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:50.617592+0000","last_change":"2024-04-17T19:54:50.617654+0000","last_active":"2024-04-17T19:54:50.617592+0000","last_peered":"2024-04-17T19:54:50.617592+0000","last_clean":"2024-04-17T19:54:50.617592+0000","last_became_active":"2024-04-17T19:53:05.483664+0000","last_became_peered":"2024-04-17T19:53:05.483664+0000","last_unstale":"2024-04-17T19:54:50.617592+0000","last_undegraded":"2024-04-17T19:54:50.617592+0000","last_fullsized":"2024-04-17T19:54:50.617592+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:50.617383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:50.617383+0000","last_clean_scrub_stamp":"2024-04-17T19:54:50.617383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:31:07.148471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:42.771094+0000","last_change":"2024-04-17T19:54:42.771231+0000","last_active":"2024-04-17T19:54:42.771094+0000","last_peered":"2024-04-17T19:54:42.771094+0000","last_clean":"2024-04-17T19:54:42.771094+0000","last_became_active":"2024-04-17T19:53:05.465302+0000","last_became_peered":"2024-04-17T19:53:05.465302+0000","last_unstale":"2024-04-17T19:54:42.771094+0000","last_undegraded":"2024-04-17T19:54:42.771094+0000","last_fullsized":"2024-04-17T19:54:42.771094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:42.770847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:42.770847+0000","last_clean_scrub_stamp":"2024-04-17T19:54:42.770847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:30:23.692260+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:32.947983+0000","last_change":"2024-04-17T19:54:32.948009+0000","last_active":"2024-04-17T19:54:32.947983+0000","last_peered":"2024-04-17T19:54:32.947983+0000","last_clean":"2024-04-17T19:54:32.947983+0000","last_became_active":"2024-04-17T19:53:05.455862+0000","last_became_peered":"2024-04-17T19:53:05.455862+0000","last_unstale":"2024-04-17T19:54:32.947983+0000","last_undegraded":"2024-04-17T19:54:32.947983+0000","last_fullsized":"2024-04-17T19:54:32.947983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:32.947903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:32.947903+0000","last_clean_scrub_stamp":"2024-04-17T19:54:32.947903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:36:29.104472+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:41.170040+0000","last_change":"2024-04-17T19:54:41.170100+0000","last_active":"2024-04-17T19:54:41.170040+0000","last_peered":"2024-04-17T19:54:41.170040+0000","last_clean":"2024-04-17T19:54:41.170040+0000","last_became_active":"2024-04-17T19:53:05.463806+0000","last_became_peered":"2024-04-17T19:53:05.463806+0000","last_unstale":"2024-04-17T19:54:41.170040+0000","last_undegraded":"2024-04-17T19:54:41.170040+0000","last_fullsized":"2024-04-17T19:54:41.170040+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:41.169839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:41.169839+0000","last_clean_scrub_stamp":"2024-04-17T19:54:41.169839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:26:38.716511+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:39.126408+0000","last_change":"2024-04-17T19:54:39.126485+0000","last_active":"2024-04-17T19:54:39.126408+0000","last_peered":"2024-04-17T19:54:39.126408+0000","last_clean":"2024-04-17T19:54:39.126408+0000","last_became_active":"2024-04-17T19:53:05.463286+0000","last_became_peered":"2024-04-17T19:53:05.463286+0000","last_unstale":"2024-04-17T19:54:39.126408+0000","last_undegraded":"2024-04-17T19:54:39.126408+0000","last_fullsized":"2024-04-17T19:54:39.126408+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:39.126199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:39.126199+0000","last_clean_scrub_stamp":"2024-04-17T19:54:39.126199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:58:19.100777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:47.579395+0000","last_change":"2024-04-17T19:54:47.579517+0000","last_active":"2024-04-17T19:54:47.579395+0000","last_peered":"2024-04-17T19:54:47.579395+0000","last_clean":"2024-04-17T19:54:47.579395+0000","last_became_active":"2024-04-17T19:53:05.475372+0000","last_became_peered":"2024-04-17T19:53:05.475372+0000","last_unstale":"2024-04-17T19:54:47.579395+0000","last_undegraded":"2024-04-17T19:54:47.579395+0000","last_fullsized":"2024-04-17T19:54:47.579395+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:47.579006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:47.579006+0000","last_clean_scrub_stamp":"2024-04-17T19:54:47.579006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:13:35.740851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:37.815491+0000","last_change":"2024-04-17T19:54:37.815557+0000","last_active":"2024-04-17T19:54:37.815491+0000","last_peered":"2024-04-17T19:54:37.815491+0000","last_clean":"2024-04-17T19:54:37.815491+0000","last_became_active":"2024-04-17T19:53:05.495881+0000","last_became_peered":"2024-04-17T19:53:05.495881+0000","last_unstale":"2024-04-17T19:54:37.815491+0000","last_undegraded":"2024-04-17T19:54:37.815491+0000","last_fullsized":"2024-04-17T19:54:37.815491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:37.815282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:37.815282+0000","last_clean_scrub_stamp":"2024-04-17T19:54:37.815282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T22:23:20.852786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:34.605830+0000","last_change":"2024-04-17T19:54:34.605904+0000","last_active":"2024-04-17T19:54:34.605830+0000","last_peered":"2024-04-17T19:54:34.605830+0000","last_clean":"2024-04-17T19:54:34.605830+0000","last_became_active":"2024-04-17T19:53:05.460831+0000","last_became_peered":"2024-04-17T19:53:05.460831+0000","last_unstale":"2024-04-17T19:54:34.605830+0000","last_undegraded":"2024-04-17T19:54:34.605830+0000","last_fullsized":"2024-04-17T19:54:34.605830+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:34.605621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:34.605621+0000","last_clean_scrub_stamp":"2024-04-17T19:54:34.605621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:58:14.580199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:37.604965+0000","last_change":"2024-04-17T19:54:37.605029+0000","last_active":"2024-04-17T19:54:37.604965+0000","last_peered":"2024-04-17T19:54:37.604965+0000","last_clean":"2024-04-17T19:54:37.604965+0000","last_became_active":"2024-04-17T19:53:05.467366+0000","last_became_peered":"2024-04-17T19:53:05.467366+0000","last_unstale":"2024-04-17T19:54:37.604965+0000","last_undegraded":"2024-04-17T19:54:37.604965+0000","last_fullsized":"2024-04-17T19:54:37.604965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:37.604735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:37.604735+0000","last_clean_scrub_stamp":"2024-04-17T19:54:37.604735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T00:30:18.526149+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:50.853545+0000","last_change":"2024-04-17T19:54:50.853685+0000","last_active":"2024-04-17T19:54:50.853545+0000","last_peered":"2024-04-17T19:54:50.853545+0000","last_clean":"2024-04-17T19:54:50.853545+0000","last_became_active":"2024-04-17T19:53:45.587213+0000","last_became_peered":"2024-04-17T19:53:45.587213+0000","last_unstale":"2024-04-17T19:54:50.853545+0000","last_undegraded":"2024-04-17T19:54:50.853545+0000","last_fullsized":"2024-04-17T19:54:50.853545+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:50.853298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:50.853298+0000","last_clean_scrub_stamp":"2024-04-17T19:54:50.853298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:36:25.698649+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:39.722701+0000","last_change":"2024-04-17T19:54:39.722773+0000","last_active":"2024-04-17T19:54:39.722701+0000","last_peered":"2024-04-17T19:54:39.722701+0000","last_clean":"2024-04-17T19:54:39.722701+0000","last_became_active":"2024-04-17T19:53:05.465145+0000","last_became_peered":"2024-04-17T19:53:05.465145+0000","last_unstale":"2024-04-17T19:54:39.722701+0000","last_undegraded":"2024-04-17T19:54:39.722701+0000","last_fullsized":"2024-04-17T19:54:39.722701+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:39.722458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:39.722458+0000","last_clean_scrub_stamp":"2024-04-17T19:54:39.722458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:55:29.920734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:38.682326+0000","last_change":"2024-04-17T19:54:38.682392+0000","last_active":"2024-04-17T19:54:38.682326+0000","last_peered":"2024-04-17T19:54:38.682326+0000","last_clean":"2024-04-17T19:54:38.682326+0000","last_became_active":"2024-04-17T19:53:05.463172+0000","last_became_peered":"2024-04-17T19:53:05.463172+0000","last_unstale":"2024-04-17T19:54:38.682326+0000","last_undegraded":"2024-04-17T19:54:38.682326+0000","last_fullsized":"2024-04-17T19:54:38.682326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:38.682110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:38.682110+0000","last_clean_scrub_stamp":"2024-04-17T19:54:38.682110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:14:46.153927+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:44.213116+0000","last_change":"2024-04-17T19:54:44.213183+0000","last_active":"2024-04-17T19:54:44.213116+0000","last_peered":"2024-04-17T19:54:44.213116+0000","last_clean":"2024-04-17T19:54:44.213116+0000","last_became_active":"2024-04-17T19:53:05.471347+0000","last_became_peered":"2024-04-17T19:53:05.471347+0000","last_unstale":"2024-04-17T19:54:44.213116+0000","last_undegraded":"2024-04-17T19:54:44.213116+0000","last_fullsized":"2024-04-17T19:54:44.213116+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:44.212912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:44.212912+0000","last_clean_scrub_stamp":"2024-04-17T19:54:44.212912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:12:26.719608+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:38.143171+0000","last_change":"2024-04-17T19:54:38.143320+0000","last_active":"2024-04-17T19:54:38.143171+0000","last_peered":"2024-04-17T19:54:38.143171+0000","last_clean":"2024-04-17T19:54:38.143171+0000","last_became_active":"2024-04-17T19:53:05.459869+0000","last_became_peered":"2024-04-17T19:53:05.459869+0000","last_unstale":"2024-04-17T19:54:38.143171+0000","last_undegraded":"2024-04-17T19:54:38.143171+0000","last_fullsized":"2024-04-17T19:54:38.143171+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:38.142885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:38.142885+0000","last_clean_scrub_stamp":"2024-04-17T19:54:38.142885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T20:00:15.460850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:43.210472+0000","last_change":"2024-04-17T19:54:43.210541+0000","last_active":"2024-04-17T19:54:43.210472+0000","last_peered":"2024-04-17T19:54:43.210472+0000","last_clean":"2024-04-17T19:54:43.210472+0000","last_became_active":"2024-04-17T19:53:05.467015+0000","last_became_peered":"2024-04-17T19:53:05.467015+0000","last_unstale":"2024-04-17T19:54:43.210472+0000","last_undegraded":"2024-04-17T19:54:43.210472+0000","last_fullsized":"2024-04-17T19:54:43.210472+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:43.210270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:43.210270+0000","last_clean_scrub_stamp":"2024-04-17T19:54:43.210270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:44:55.607557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:33.924503+0000","last_change":"2024-04-17T19:54:33.924566+0000","last_active":"2024-04-17T19:54:33.924503+0000","last_peered":"2024-04-17T19:54:33.924503+0000","last_clean":"2024-04-17T19:54:33.924503+0000","last_became_active":"2024-04-17T19:53:05.462217+0000","last_became_peered":"2024-04-17T19:53:05.462217+0000","last_unstale":"2024-04-17T19:54:33.924503+0000","last_undegraded":"2024-04-17T19:54:33.924503+0000","last_fullsized":"2024-04-17T19:54:33.924503+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:33.924295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:33.924295+0000","last_clean_scrub_stamp":"2024-04-17T19:54:33.924295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:27:17.906976+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:34.715805+0000","last_change":"2024-04-17T19:54:34.715870+0000","last_active":"2024-04-17T19:54:34.715805+0000","last_peered":"2024-04-17T19:54:34.715805+0000","last_clean":"2024-04-17T19:54:34.715805+0000","last_became_active":"2024-04-17T19:53:05.467093+0000","last_became_peered":"2024-04-17T19:53:05.467093+0000","last_unstale":"2024-04-17T19:54:34.715805+0000","last_undegraded":"2024-04-17T19:54:34.715805+0000","last_fullsized":"2024-04-17T19:54:34.715805+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:34.715596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:34.715596+0000","last_clean_scrub_stamp":"2024-04-17T19:54:34.715596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T01:55:30.890135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:41.150915+0000","last_change":"2024-04-17T19:54:41.151067+0000","last_active":"2024-04-17T19:54:41.150915+0000","last_peered":"2024-04-17T19:54:41.150915+0000","last_clean":"2024-04-17T19:54:41.150915+0000","last_became_active":"2024-04-17T19:53:05.465436+0000","last_became_peered":"2024-04-17T19:53:05.465436+0000","last_unstale":"2024-04-17T19:54:41.150915+0000","last_undegraded":"2024-04-17T19:54:41.150915+0000","last_fullsized":"2024-04-17T19:54:41.150915+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:41.150643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:41.150643+0000","last_clean_scrub_stamp":"2024-04-17T19:54:41.150643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T02:06:14.590244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:31.348038+0000","last_change":"2024-04-17T19:54:31.348071+0000","last_active":"2024-04-17T19:54:31.348038+0000","last_peered":"2024-04-17T19:54:31.348038+0000","last_clean":"2024-04-17T19:54:31.348038+0000","last_became_active":"2024-04-17T19:53:05.457656+0000","last_became_peered":"2024-04-17T19:53:05.457656+0000","last_unstale":"2024-04-17T19:54:31.348038+0000","last_undegraded":"2024-04-17T19:54:31.348038+0000","last_fullsized":"2024-04-17T19:54:31.348038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:31.347957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:31.347957+0000","last_clean_scrub_stamp":"2024-04-17T19:54:31.347957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T07:40:17.344401+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:45.251024+0000","last_change":"2024-04-17T19:54:45.251100+0000","last_active":"2024-04-17T19:54:45.251024+0000","last_peered":"2024-04-17T19:54:45.251024+0000","last_clean":"2024-04-17T19:54:45.251024+0000","last_became_active":"2024-04-17T19:53:05.476734+0000","last_became_peered":"2024-04-17T19:53:05.476734+0000","last_unstale":"2024-04-17T19:54:45.251024+0000","last_undegraded":"2024-04-17T19:54:45.251024+0000","last_fullsized":"2024-04-17T19:54:45.251024+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:45.250813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:45.250813+0000","last_clean_scrub_stamp":"2024-04-17T19:54:45.250813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T21:48:14.991068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:32.385513+0000","last_change":"2024-04-17T19:54:32.385513+0000","last_active":"2024-04-17T19:54:32.385513+0000","last_peered":"2024-04-17T19:54:32.385513+0000","last_clean":"2024-04-17T19:54:32.385513+0000","last_became_active":"2024-04-17T19:53:05.457210+0000","last_became_peered":"2024-04-17T19:53:05.457210+0000","last_unstale":"2024-04-17T19:54:32.385513+0000","last_undegraded":"2024-04-17T19:54:32.385513+0000","last_fullsized":"2024-04-17T19:54:32.385513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:32.385390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:32.385390+0000","last_clean_scrub_stamp":"2024-04-17T19:54:32.385390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:27:01.239581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:39.789903+0000","last_change":"2024-04-17T19:54:39.789903+0000","last_active":"2024-04-17T19:54:39.789903+0000","last_peered":"2024-04-17T19:54:39.789903+0000","last_clean":"2024-04-17T19:54:39.789903+0000","last_became_active":"2024-04-17T19:53:05.454065+0000","last_became_peered":"2024-04-17T19:53:05.454065+0000","last_unstale":"2024-04-17T19:54:39.789903+0000","last_undegraded":"2024-04-17T19:54:39.789903+0000","last_fullsized":"2024-04-17T19:54:39.789903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:39.789575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:39.789575+0000","last_clean_scrub_stamp":"2024-04-17T19:54:39.789575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T06:58:19.764153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:41.796220+0000","last_change":"2024-04-17T19:54:41.796220+0000","last_active":"2024-04-17T19:54:41.796220+0000","last_peered":"2024-04-17T19:54:41.796220+0000","last_clean":"2024-04-17T19:54:41.796220+0000","last_became_active":"2024-04-17T19:53:05.455779+0000","last_became_peered":"2024-04-17T19:53:05.455779+0000","last_unstale":"2024-04-17T19:54:41.796220+0000","last_undegraded":"2024-04-17T19:54:41.796220+0000","last_fullsized":"2024-04-17T19:54:41.796220+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:41.795918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:41.795918+0000","last_clean_scrub_stamp":"2024-04-17T19:54:41.795918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-19T04:14:15.855982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-17T19:54:29.205992+0000","last_change":"2024-04-17T19:54:29.205992+0000","last_active":"2024-04-17T19:54:29.205992+0000","last_peered":"2024-04-17T19:54:29.205992+0000","last_clean":"2024-04-17T19:54:29.205992+0000","last_became_active":"2024-04-17T19:53:05.461324+0000","last_became_peered":"2024-04-17T19:53:05.461324+0000","last_unstale":"2024-04-17T19:54:29.205992+0000","last_undegraded":"2024-04-17T19:54:29.205992+0000","last_fullsized":"2024-04-17T19:54:29.205992+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-17T19:54:29.205807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-17T19:54:29.205807+0000","last_clean_scrub_stamp":"2024-04-17T19:54:29.205807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T23:26:58.059998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":6968,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":13936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509472,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":124356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509471,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":909312,"data_stored":714692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509471,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":331776,"data_stored":131074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509471,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31480,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":311296,"data_stored":124814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509471,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31492,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340348,"statfs":{"total":96636764160,"available":96604516352,"internally_reserved":0,"allocated":323584,"data_stored":130402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509470,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32060,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339780,"statfs":{"total":96636764160,"available":96603934720,"internally_reserved":0,"allocated":905216,"data_stored":714670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509471,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35644,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336196,"statfs":{"total":96636764160,"available":96600264704,"internally_reserved":0,"allocated":315392,"data_stored":124288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542175,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":124232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":6170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":6842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-17T19:55:13.721 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-17T19:55:13.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.900+0000 7f3eaaa64640 1 Processor -- start 2024-04-17T19:55:13.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.900+0000 7f3eaaa64640 1 -- start start 2024-04-17T19:55:13.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.900+0000 7f3eaaa64640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3ea40ced70 0x7f3ea40b6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:13.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.900+0000 7f3eaaa64640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ea40cf180 con 0x7f3ea40cd260 2024-04-17T19:55:13.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.900+0000 7f3eaaa64640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ea40b71a0 con 0x7f3ea40b6d90 2024-04-17T19:55:13.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.900+0000 7f3eaaa64640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f3ea40b2c70 con 0x7f3ea40ced70 2024-04-17T19:55:13.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.900+0000 7f3ea9001640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f3ea40cd260 0x7f3ea416a190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:54320/0 (socket says 172.21.15.18:54320) 2024-04-17T19:55:13.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.900+0000 7f3ea9001640 1 -- 172.21.15.18:0/566571293 learned_addr learned my addr 172.21.15.18:0/566571293 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:55:13.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.900+0000 7f3ea8800640 1 --2- 172.21.15.18:0/566571293 >> v2:172.21.15.173:3300/0 conn(0x7f3ea40ced70 0x7f3ea40b6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:13.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.900+0000 7f3ea37fe640 1 -- 172.21.15.18:0/566571293 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1161804412 0 0) 0x7f3e9c0014a0 con 0x7f3ea40cd260 2024-04-17T19:55:13.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.900+0000 7f3ea37fe640 1 -- 172.21.15.18:0/566571293 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e8c003530 con 0x7f3ea40cd260 2024-04-17T19:55:13.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.900+0000 7f3ea37fe640 1 -- 172.21.15.18:0/566571293 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2280044414 0 0) 0x7f3e8c003530 con 0x7f3ea40cd260 2024-04-17T19:55:13.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.900+0000 7f3ea37fe640 1 -- 172.21.15.18:0/566571293 >> v2:172.21.15.173:3300/0 conn(0x7f3ea40ced70 msgr2=0x7f3ea40b6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:55:13.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.900+0000 7f3ea37fe640 1 --2- 172.21.15.18:0/566571293 >> v2:172.21.15.173:3300/0 conn(0x7f3ea40ced70 0x7f3ea40b6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:13.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.904+0000 7f3ea37fe640 1 -- 172.21.15.18:0/566571293 >> v1:172.21.15.173:6789/0 conn(0x7f3ea40b6d90 legacy=0x7f3ea40ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:13.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.904+0000 7f3ea37fe640 1 -- 172.21.15.18:0/566571293 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ea40b33e0 con 0x7f3ea40cd260 2024-04-17T19:55:13.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.904+0000 7f3ea37fe640 1 -- 172.21.15.18:0/566571293 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3208559991 0 0) 0x7f3e9c001bd0 con 0x7f3ea40cd260 2024-04-17T19:55:13.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.904+0000 7f3ea37fe640 1 -- 172.21.15.18:0/566571293 >> v1:172.21.15.18:6789/0 conn(0x7f3ea40cd260 legacy=0x7f3ea416a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:13.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.904+0000 7f3ea37fe640 1 --2- 172.21.15.18:0/566571293 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3e8c0039c0 0x7f3e8c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:13.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.904+0000 7f3ea37fe640 1 --2- 172.21.15.18:0/566571293 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3e8c004810 0x7f3e8c004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:13.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.904+0000 7f3ea37fe640 1 --2- 172.21.15.18:0/566571293 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e8c0051d0 0x7f3e8c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:13.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.904+0000 7f3ea37fe640 1 -- 172.21.15.18:0/566571293 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea40b2c70 con 0x7f3e8c0051d0 2024-04-17T19:55:13.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.904+0000 7f3ea37fe640 1 -- 172.21.15.18:0/566571293 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3e8c00c170 con 0x7f3e8c0039c0 2024-04-17T19:55:13.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.904+0000 7f3ea37fe640 1 -- 172.21.15.18:0/566571293 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f3e8c00c370 con 0x7f3e8c004810 2024-04-17T19:55:13.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.904+0000 7f3ea9001640 1 --2- 172.21.15.18:0/566571293 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e8c0051d0 0x7f3e8c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:13.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.904+0000 7f3ea9001640 1 -- 172.21.15.18:0/566571293 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3e8c004810 msgr2=0x7f3e8c004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:55:13.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.904+0000 7f3ea9001640 1 --2- 172.21.15.18:0/566571293 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3e8c004810 0x7f3e8c004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:13.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.904+0000 7f3ea9001640 1 -- 172.21.15.18:0/566571293 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3e8c0039c0 msgr2=0x7f3e8c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:55:13.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.904+0000 7f3ea9001640 1 --2- 172.21.15.18:0/566571293 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3e8c0039c0 0x7f3e8c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:13.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.904+0000 7f3ea9001640 1 -- 172.21.15.18:0/566571293 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e8c003530 con 0x7f3e8c0051d0 2024-04-17T19:55:13.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.904+0000 7f3ea9001640 1 -- 172.21.15.18:0/566571293 reap_dead start 2024-04-17T19:55:13.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.904+0000 7f3ea9001640 1 --2- 172.21.15.18:0/566571293 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e8c0051d0 0x7f3e8c00b9d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c00aa50 tx=0x7f3e9c01d2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a234f881fea409c server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:55:13.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.904+0000 7f3ea37fe640 1 -- 172.21.15.18:0/566571293 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c00a670 con 0x7f3e8c0051d0 2024-04-17T19:55:13.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.904+0000 7f3ea37fe640 1 -- 172.21.15.18:0/566571293 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e9c0ac640 con 0x7f3e8c0051d0 2024-04-17T19:55:13.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.904+0000 7f3ea37fe640 1 -- 172.21.15.18:0/566571293 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c0aca30 con 0x7f3e8c0051d0 2024-04-17T19:55:13.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.904+0000 7f3eaaa64640 1 -- 172.21.15.18:0/566571293 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e8c0051d0 msgr2=0x7f3e8c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:13.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.904+0000 7f3eaaa64640 1 --2- 172.21.15.18:0/566571293 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e8c0051d0 0x7f3e8c00b9d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c00aa50 tx=0x7f3e9c01d2e0 comp rx=0 tx=0).stop 2024-04-17T19:55:13.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.904+0000 7f3eaaa64640 1 -- 172.21.15.18:0/566571293 shutdown_connections 2024-04-17T19:55:13.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.904+0000 7f3eaaa64640 1 --2- 172.21.15.18:0/566571293 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e8c0051d0 0x7f3e8c00b9d0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:13.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.904+0000 7f3eaaa64640 1 -- 172.21.15.18:0/566571293 >> 172.21.15.18:0/566571293 conn(0x7f3ea409aa70 msgr2=0x7f3ea409ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:55:13.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.904+0000 7f3eaaa64640 1 -- 172.21.15.18:0/566571293 shutdown_connections 2024-04-17T19:55:13.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.904+0000 7f3eaaa64640 1 -- 172.21.15.18:0/566571293 wait complete. 2024-04-17T19:55:13.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.908+0000 7f3eaaa64640 1 Processor -- start 2024-04-17T19:55:13.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.908+0000 7f3eaaa64640 1 -- start start 2024-04-17T19:55:13.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.908+0000 7f3eaaa64640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3e8c0051d0 0x7f3ea4159b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:13.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.908+0000 7f3eaaa64640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ea41ea440 0x7f3ea41e8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:13.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.908+0000 7f3eaaa64640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ea41e9420 0x7f3ea41e9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:13.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.908+0000 7f3eaaa64640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea40cf360 con 0x7f3ea41ea440 2024-04-17T19:55:13.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.908+0000 7f3eaaa64640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea40ce4d0 con 0x7f3ea41e9420 2024-04-17T19:55:13.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.908+0000 7f3eaaa64640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f3ea40b1090 con 0x7f3e8c0051d0 2024-04-17T19:55:13.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.908+0000 7f3ea3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ea41ea440 0x7f3ea41e8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:13.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.908+0000 7f3ea3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ea41ea440 0x7f3ea41e8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34268/0 (socket says 172.21.15.18:34268) 2024-04-17T19:55:13.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.908+0000 7f3ea3fff640 1 -- 172.21.15.18:0/3364857786 learned_addr learned my addr 172.21.15.18:0/3364857786 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:55:13.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.908+0000 7f3ea8800640 1 --2- 172.21.15.18:0/3364857786 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3e8c0051d0 0x7f3ea4159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:13.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.908+0000 7f3ea9001640 1 --2- 172.21.15.18:0/3364857786 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ea41e9420 0x7f3ea41e9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:13.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.908+0000 7f3ea3fff640 1 -- 172.21.15.18:0/3364857786 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3e8c0051d0 msgr2=0x7f3ea4159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:13.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.908+0000 7f3ea3fff640 1 --2- 172.21.15.18:0/3364857786 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3e8c0051d0 0x7f3ea4159b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:13.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.908+0000 7f3ea3fff640 1 -- 172.21.15.18:0/3364857786 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ea41e9420 msgr2=0x7f3ea41e9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:13.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.908+0000 7f3ea3fff640 1 --2- 172.21.15.18:0/3364857786 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ea41e9420 0x7f3ea41e9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:13.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.908+0000 7f3ea3fff640 1 -- 172.21.15.18:0/3364857786 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ea415a490 con 0x7f3ea41ea440 2024-04-17T19:55:13.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.908+0000 7f3ea9001640 1 --2- 172.21.15.18:0/3364857786 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ea41e9420 0x7f3ea41e9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:55:13.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.908+0000 7f3ea3fff640 1 --2- 172.21.15.18:0/3364857786 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ea41ea440 0x7f3ea41e8ee0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f3e9800c3a0 tx=0x7f3e9800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:55:13.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.908+0000 7f3ea17fa640 1 -- 172.21.15.18:0/3364857786 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e98017070 con 0x7f3ea41ea440 2024-04-17T19:55:13.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.908+0000 7f3ea17fa640 1 -- 172.21.15.18:0/3364857786 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e980052d0 con 0x7f3ea41ea440 2024-04-17T19:55:13.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.908+0000 7f3eaaa64640 1 -- 172.21.15.18:0/3364857786 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ea415a770 con 0x7f3ea41ea440 2024-04-17T19:55:13.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.908+0000 7f3ea17fa640 1 -- 172.21.15.18:0/3364857786 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e98003840 con 0x7f3ea41ea440 2024-04-17T19:55:13.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.908+0000 7f3eaaa64640 1 -- 172.21.15.18:0/3364857786 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ea415c980 con 0x7f3ea41ea440 2024-04-17T19:55:13.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.912+0000 7f3eaaa64640 1 -- 172.21.15.18:0/3364857786 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ea415ac90 con 0x7f3ea41ea440 2024-04-17T19:55:13.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.912+0000 7f3ea17fa640 1 -- 172.21.15.18:0/3364857786 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3e980039e0 con 0x7f3ea41ea440 2024-04-17T19:55:13.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.912+0000 7f3ea17fa640 1 --2- 172.21.15.18:0/3364857786 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f3e90068380 0x7f3e9006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:13.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.912+0000 7f3ea17fa640 1 -- 172.21.15.18:0/3364857786 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7f3e98086070 con 0x7f3ea41ea440 2024-04-17T19:55:13.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.912+0000 7f3ea8800640 1 --2- 172.21.15.18:0/3364857786 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f3e90068380 0x7f3e9006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:13.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.912+0000 7f3ea8800640 1 --2- 172.21.15.18:0/3364857786 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f3e90068380 0x7f3e9006a890 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3e940047c0 tx=0x7f3e94008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:55:13.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:13.916+0000 7f3ea17fa640 1 -- 172.21.15.18:0/3364857786 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3ea40b71a0 con 0x7f3ea41ea440 2024-04-17T19:55:14.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.076+0000 7f3eaaa64640 1 -- 172.21.15.18:0/3364857786 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f3ea415a220 con 0x7f3ea41ea440 2024-04-17T19:55:14.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.080+0000 7f3ea17fa640 1 -- 172.21.15.18:0/3364857786 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7f3e98005480 con 0x7f3ea41ea440 2024-04-17T19:55:14.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.080+0000 7f3ea17fa640 1 -- 172.21.15.18:0/3364857786 <== mon.0 v2:172.21.15.18:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f3e980010b0 con 0x7f3ea41ea440 2024-04-17T19:55:14.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.084+0000 7f3eaaa64640 1 -- 172.21.15.18:0/3364857786 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f3e90068380 msgr2=0x7f3e9006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:14.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.084+0000 7f3eaaa64640 1 --2- 172.21.15.18:0/3364857786 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f3e90068380 0x7f3e9006a890 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3e940047c0 tx=0x7f3e94008040 comp rx=0 tx=0).stop 2024-04-17T19:55:14.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.084+0000 7f3eaaa64640 1 -- 172.21.15.18:0/3364857786 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ea41ea440 msgr2=0x7f3ea41e8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:14.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.084+0000 7f3eaaa64640 1 --2- 172.21.15.18:0/3364857786 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ea41ea440 0x7f3ea41e8ee0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f3e9800c3a0 tx=0x7f3e9800c860 comp rx=0 tx=0).stop 2024-04-17T19:55:14.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.084+0000 7f3eaaa64640 1 -- 172.21.15.18:0/3364857786 shutdown_connections 2024-04-17T19:55:14.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.084+0000 7f3eaaa64640 1 --2- 172.21.15.18:0/3364857786 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f3e90068380 0x7f3e9006a890 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:14.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.084+0000 7f3eaaa64640 1 --2- 172.21.15.18:0/3364857786 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3ea41e9420 0x7f3ea41e9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:14.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.084+0000 7f3eaaa64640 1 --2- 172.21.15.18:0/3364857786 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ea41ea440 0x7f3ea41e8ee0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:14.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.084+0000 7f3eaaa64640 1 --2- 172.21.15.18:0/3364857786 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3e8c0051d0 0x7f3ea4159b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:14.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.084+0000 7f3eaaa64640 1 -- 172.21.15.18:0/3364857786 >> 172.21.15.18:0/3364857786 conn(0x7f3ea409aa70 msgr2=0x7f3ea409ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:55:14.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.084+0000 7f3eaaa64640 1 -- 172.21.15.18:0/3364857786 shutdown_connections 2024-04-17T19:55:14.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.084+0000 7f3eaaa64640 1 -- 172.21.15.18:0/3364857786 wait complete. 2024-04-17T19:55:14.102 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-17T19:55:14.102 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T19:55:14.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.240+0000 7f04665e5640 1 Processor -- start 2024-04-17T19:55:14.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.240+0000 7f04665e5640 1 -- start start 2024-04-17T19:55:14.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.240+0000 7f04665e5640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f046015e910 0x7f046015ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:14.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.240+0000 7f04665e5640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f046006cd60 0x7f046006d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:14.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.240+0000 7f04665e5640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f046006d6b0 con 0x7f046015e1a0 2024-04-17T19:55:14.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.240+0000 7f04665e5640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f04600d0020 con 0x7f046006cd60 2024-04-17T19:55:14.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.240+0000 7f04665e5640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f04600cd930 con 0x7f046015e910 2024-04-17T19:55:14.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.240+0000 7f0464b82640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f046006cd60 0x7f046006d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:14.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.240+0000 7f045ffff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f046015e1a0 0x7f04600ce9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:54330/0 (socket says 172.21.15.18:54330) 2024-04-17T19:55:14.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.240+0000 7f045ffff640 1 -- 172.21.15.18:0/1235753309 learned_addr learned my addr 172.21.15.18:0/1235753309 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:55:14.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.240+0000 7f0457fff640 1 --2- 172.21.15.18:0/1235753309 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f046015e910 0x7f046015ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:14.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.240+0000 7f0464b82640 1 -- 172.21.15.18:0/1235753309 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f046015e910 msgr2=0x7f046015ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:55:14.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.240+0000 7f0464b82640 1 --2- 172.21.15.18:0/1235753309 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f046015e910 0x7f046015ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:14.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.240+0000 7f0464b82640 1 -- 172.21.15.18:0/1235753309 >> v1:172.21.15.18:6789/0 conn(0x7f046015e1a0 legacy=0x7f04600ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:14.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.240+0000 7f045f7fe640 1 -- 172.21.15.18:0/1235753309 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1516400305 0 0) 0x7f0450001120 con 0x7f046015e1a0 2024-04-17T19:55:14.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.240+0000 7f0464b82640 1 -- 172.21.15.18:0/1235753309 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04600cdc10 con 0x7f046006cd60 2024-04-17T19:55:14.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.244+0000 7f0464b82640 1 --2- 172.21.15.18:0/1235753309 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f046006cd60 0x7f046006d170 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f0458009d90 tx=0x7f045801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b460a673994633c server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:55:14.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.244+0000 7f045f7fe640 1 -- 172.21.15.18:0/1235753309 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04580b2070 con 0x7f046006cd60 2024-04-17T19:55:14.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.244+0000 7f045f7fe640 1 -- 172.21.15.18:0/1235753309 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f04580a5890 con 0x7f046006cd60 2024-04-17T19:55:14.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.244+0000 7f045f7fe640 1 -- 172.21.15.18:0/1235753309 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04580a5c80 con 0x7f046006cd60 2024-04-17T19:55:14.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.244+0000 7f04665e5640 1 -- 172.21.15.18:0/1235753309 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f046006cd60 msgr2=0x7f046006d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:14.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.244+0000 7f04665e5640 1 --2- 172.21.15.18:0/1235753309 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f046006cd60 0x7f046006d170 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f0458009d90 tx=0x7f045801c8e0 comp rx=0 tx=0).stop 2024-04-17T19:55:14.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.244+0000 7f04665e5640 1 -- 172.21.15.18:0/1235753309 shutdown_connections 2024-04-17T19:55:14.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.244+0000 7f04665e5640 1 --2- 172.21.15.18:0/1235753309 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f046006cd60 0x7f046006d170 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:14.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.244+0000 7f04665e5640 1 --2- 172.21.15.18:0/1235753309 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f046015e910 0x7f046015ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:14.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.244+0000 7f04665e5640 1 -- 172.21.15.18:0/1235753309 >> 172.21.15.18:0/1235753309 conn(0x7f0460072bb0 msgr2=0x7f0460072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:55:14.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.244+0000 7f04665e5640 1 -- 172.21.15.18:0/1235753309 shutdown_connections 2024-04-17T19:55:14.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.244+0000 7f04665e5640 1 -- 172.21.15.18:0/1235753309 wait complete. 2024-04-17T19:55:14.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.244+0000 7f04665e5640 1 Processor -- start 2024-04-17T19:55:14.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.244+0000 7f04665e5640 1 -- start start 2024-04-17T19:55:14.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.248+0000 7f04665e5640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f046006cd60 0x7f046014d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:14.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.248+0000 7f04665e5640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f046015e1a0 0x7f046015aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:14.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.248+0000 7f04665e5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f046015e910 0x7f046015b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:14.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.248+0000 7f04665e5640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f046015e730 con 0x7f046015e910 2024-04-17T19:55:14.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.248+0000 7f04665e5640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f046015e5b0 con 0x7f046006cd60 2024-04-17T19:55:14.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.248+0000 7f04665e5640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f04600cf0e0 con 0x7f046015e1a0 2024-04-17T19:55:14.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.248+0000 7f0464b82640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f046015e910 0x7f046015b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:14.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.248+0000 7f0464b82640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f046015e910 0x7f046015b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34294/0 (socket says 172.21.15.18:34294) 2024-04-17T19:55:14.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.248+0000 7f0464b82640 1 -- 172.21.15.18:0/3102938070 learned_addr learned my addr 172.21.15.18:0/3102938070 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:55:14.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.248+0000 7f045ffff640 1 --2- 172.21.15.18:0/3102938070 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f046006cd60 0x7f046014d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:14.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.248+0000 7f0464b82640 1 -- 172.21.15.18:0/3102938070 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f046015e1a0 msgr2=0x7f046015aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:14.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.248+0000 7f0464b82640 1 --2- 172.21.15.18:0/3102938070 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f046015e1a0 0x7f046015aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:14.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.248+0000 7f0464b82640 1 -- 172.21.15.18:0/3102938070 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f046006cd60 msgr2=0x7f046014d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:14.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.248+0000 7f0464b82640 1 --2- 172.21.15.18:0/3102938070 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f046006cd60 0x7f046014d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:14.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.248+0000 7f0464b82640 1 -- 172.21.15.18:0/3102938070 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f046014dc60 con 0x7f046015e910 2024-04-17T19:55:14.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.248+0000 7f0464b82640 1 --2- 172.21.15.18:0/3102938070 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f046015e910 0x7f046015b0e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f0458009d90 tx=0x7f0458019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:55:14.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.248+0000 7f045d7fa640 1 -- 172.21.15.18:0/3102938070 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04580b2050 con 0x7f046015e910 2024-04-17T19:55:14.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.248+0000 7f045d7fa640 1 -- 172.21.15.18:0/3102938070 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f04580be070 con 0x7f046015e910 2024-04-17T19:55:14.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.248+0000 7f04665e5640 1 -- 172.21.15.18:0/3102938070 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f046015a760 con 0x7f046015e910 2024-04-17T19:55:14.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.248+0000 7f045d7fa640 1 -- 172.21.15.18:0/3102938070 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04580ada50 con 0x7f046015e910 2024-04-17T19:55:14.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.248+0000 7f04665e5640 1 -- 172.21.15.18:0/3102938070 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04601549f0 con 0x7f046015e910 2024-04-17T19:55:14.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.248+0000 7f04665e5640 1 -- 172.21.15.18:0/3102938070 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0460069950 con 0x7f046015e910 2024-04-17T19:55:14.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.248+0000 7f045d7fa640 1 -- 172.21.15.18:0/3102938070 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f04580adbf0 con 0x7f046015e910 2024-04-17T19:55:14.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.252+0000 7f045d7fa640 1 --2- 172.21.15.18:0/3102938070 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0440068380 0x7f044006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:14.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.252+0000 7f045ffff640 1 --2- 172.21.15.18:0/3102938070 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0440068380 0x7f044006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:14.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.252+0000 7f045d7fa640 1 -- 172.21.15.18:0/3102938070 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7f0458122400 con 0x7f046015e910 2024-04-17T19:55:14.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.252+0000 7f045ffff640 1 --2- 172.21.15.18:0/3102938070 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0440068380 0x7f044006a890 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0450000f70 tx=0x7f0450009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:55:14.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.256+0000 7f045d7fa640 1 -- 172.21.15.18:0/3102938070 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0458016560 con 0x7f046015e910 2024-04-17T19:55:14.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.444+0000 7f04665e5640 1 -- 172.21.15.18:0/3102938070 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f046015d4d0 con 0x7f046015e910 2024-04-17T19:55:14.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.444+0000 7f045d7fa640 1 -- 172.21.15.18:0/3102938070 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5177 (secure 0 0 0) 0x7f04580f2600 con 0x7f046015e910 2024-04-17T19:55:14.444 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:55:14.444 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/729504609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":729504609},{"type":"v1","addr":"172.21.15.173:6833","nonce":729504609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4261,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/3797017174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3797017174},{"type":"v1","addr":"172.21.15.173:6835","nonce":3797017174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/995848920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":995848920},{"type":"v1","addr":"172.21.15.18:6835","nonce":995848920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-17T19:53:04.851226+0000","modified":"2024-04-17T19:53:22.952315+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6837/1926349198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1926349198},{"type":"v1","addr":"172.21.15.18:6837","nonce":1926349198}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1}]} 2024-04-17T19:55:14.444 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 9 2024-04-17T19:55:14.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.448+0000 7f04665e5640 1 -- 172.21.15.18:0/3102938070 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0440068380 msgr2=0x7f044006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:14.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.448+0000 7f04665e5640 1 --2- 172.21.15.18:0/3102938070 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0440068380 0x7f044006a890 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0450000f70 tx=0x7f0450009040 comp rx=0 tx=0).stop 2024-04-17T19:55:14.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.448+0000 7f04665e5640 1 -- 172.21.15.18:0/3102938070 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f046015e910 msgr2=0x7f046015b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:14.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.448+0000 7f04665e5640 1 --2- 172.21.15.18:0/3102938070 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f046015e910 0x7f046015b0e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f0458009d90 tx=0x7f0458019680 comp rx=0 tx=0).stop 2024-04-17T19:55:14.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.448+0000 7f04665e5640 1 -- 172.21.15.18:0/3102938070 shutdown_connections 2024-04-17T19:55:14.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.448+0000 7f04665e5640 1 --2- 172.21.15.18:0/3102938070 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f0440068380 0x7f044006a890 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:14.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.448+0000 7f04665e5640 1 --2- 172.21.15.18:0/3102938070 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f046015e910 0x7f046015b0e0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:14.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.448+0000 7f04665e5640 1 --2- 172.21.15.18:0/3102938070 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f046015e1a0 0x7f046015aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:14.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.448+0000 7f04665e5640 1 --2- 172.21.15.18:0/3102938070 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f046006cd60 0x7f046014d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:14.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.448+0000 7f04665e5640 1 -- 172.21.15.18:0/3102938070 >> 172.21.15.18:0/3102938070 conn(0x7f0460072bb0 msgr2=0x7f04601502a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:55:14.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.448+0000 7f04665e5640 1 -- 172.21.15.18:0/3102938070 shutdown_connections 2024-04-17T19:55:14.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.448+0000 7f04665e5640 1 -- 172.21.15.18:0/3102938070 wait complete. 2024-04-17T19:55:14.464 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-17T19:55:14.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.616+0000 7f67890d6640 1 Processor -- start 2024-04-17T19:55:14.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.616+0000 7f67890d6640 1 -- start start 2024-04-17T19:55:14.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.616+0000 7f67890d6640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f67840d16b0 0x7f678415d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:14.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.616+0000 7f67890d6640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6784070cd0 0x7f67840710e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:14.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.616+0000 7f67890d6640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6784071620 con 0x7f67840cd570 2024-04-17T19:55:14.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.616+0000 7f67890d6640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f67840b61a0 con 0x7f6784070cd0 2024-04-17T19:55:14.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.616+0000 7f67890d6640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f67840d1cc0 con 0x7f67840d16b0 2024-04-17T19:55:14.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.616+0000 7f678259c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6784070cd0 0x7f67840710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:14.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.616+0000 7f678259c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6784070cd0 0x7f67840710e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46738/0 (socket says 172.21.15.18:46738) 2024-04-17T19:55:14.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.616+0000 7f678259c640 1 -- 172.21.15.18:0/3379996374 learned_addr learned my addr 172.21.15.18:0/3379996374 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:55:14.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.616+0000 7f678359e640 1 --1- 172.21.15.18:0/3379996374 >> v1:172.21.15.18:6789/0 conn(0x7f67840cd570 0x7f67840cd980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:42426/0 (socket says 172.21.15.18:42426) 2024-04-17T19:55:14.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.616+0000 7f6782d9d640 1 --2- 172.21.15.18:0/3379996374 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f67840d16b0 0x7f678415d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:14.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.616+0000 7f678259c640 1 -- 172.21.15.18:0/3379996374 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f67840d16b0 msgr2=0x7f678415d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:55:14.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.616+0000 7f678259c640 1 --2- 172.21.15.18:0/3379996374 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f67840d16b0 0x7f678415d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:14.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.616+0000 7f678259c640 1 -- 172.21.15.18:0/3379996374 >> v1:172.21.15.18:6789/0 conn(0x7f67840cd570 legacy=0x7f67840cd980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:14.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.616+0000 7f678259c640 1 -- 172.21.15.18:0/3379996374 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67840d1fa0 con 0x7f6784070cd0 2024-04-17T19:55:14.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.616+0000 7f6781d9b640 1 -- 172.21.15.18:0/3379996374 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1379563580 0 0) 0x7f677c0014a0 con 0x7f67840cd570 2024-04-17T19:55:14.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.620+0000 7f678259c640 1 --2- 172.21.15.18:0/3379996374 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6784070cd0 0x7f67840710e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f676c009870 tx=0x7f676c01ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90e6931b5feff8a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:55:14.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.620+0000 7f6781d9b640 1 -- 172.21.15.18:0/3379996374 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f676c0b5070 con 0x7f6784070cd0 2024-04-17T19:55:14.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.620+0000 7f6781d9b640 1 -- 172.21.15.18:0/3379996374 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f676c0a8a50 con 0x7f6784070cd0 2024-04-17T19:55:14.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.620+0000 7f6781d9b640 1 -- 172.21.15.18:0/3379996374 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f676c0a8e40 con 0x7f6784070cd0 2024-04-17T19:55:14.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.620+0000 7f67890d6640 1 -- 172.21.15.18:0/3379996374 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6784070cd0 msgr2=0x7f67840710e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:14.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.620+0000 7f67890d6640 1 --2- 172.21.15.18:0/3379996374 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6784070cd0 0x7f67840710e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f676c009870 tx=0x7f676c01ed50 comp rx=0 tx=0).stop 2024-04-17T19:55:14.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.620+0000 7f67890d6640 1 -- 172.21.15.18:0/3379996374 shutdown_connections 2024-04-17T19:55:14.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.620+0000 7f67890d6640 1 --2- 172.21.15.18:0/3379996374 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6784070cd0 0x7f67840710e0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:14.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.620+0000 7f67890d6640 1 --2- 172.21.15.18:0/3379996374 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f67840d16b0 0x7f678415d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:14.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.620+0000 7f67890d6640 1 -- 172.21.15.18:0/3379996374 >> 172.21.15.18:0/3379996374 conn(0x7f67840d2bf0 msgr2=0x7f67840d3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:55:14.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.620+0000 7f67890d6640 1 -- 172.21.15.18:0/3379996374 shutdown_connections 2024-04-17T19:55:14.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.620+0000 7f67890d6640 1 -- 172.21.15.18:0/3379996374 wait complete. 2024-04-17T19:55:14.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.624+0000 7f67890d6640 1 Processor -- start 2024-04-17T19:55:14.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.624+0000 7f67890d6640 1 -- start start 2024-04-17T19:55:14.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.624+0000 7f67890d6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6784070cd0 0x7f67840cc200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:14.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.624+0000 7f67890d6640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67840cd570 0x7f6784156cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:14.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.624+0000 7f67890d6640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f67840d16b0 0x7f6784157210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:14.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.624+0000 7f67890d6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f67840d2560 con 0x7f6784070cd0 2024-04-17T19:55:14.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.624+0000 7f67890d6640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f67840d3a80 con 0x7f67840cd570 2024-04-17T19:55:14.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.624+0000 7f67890d6640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f67840b7690 con 0x7f67840d16b0 2024-04-17T19:55:14.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.624+0000 7f6782d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6784070cd0 0x7f67840cc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:14.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.624+0000 7f6782d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6784070cd0 0x7f67840cc200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46752/0 (socket says 172.21.15.18:46752) 2024-04-17T19:55:14.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.624+0000 7f6782d9d640 1 -- 172.21.15.18:0/1847338874 learned_addr learned my addr 172.21.15.18:0/1847338874 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:55:14.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.624+0000 7f678259c640 1 --2- 172.21.15.18:0/1847338874 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67840cd570 0x7f6784156cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:14.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.624+0000 7f6782d9d640 1 -- 172.21.15.18:0/1847338874 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f67840d16b0 msgr2=0x7f6784157210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:14.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.624+0000 7f678359e640 1 --2- 172.21.15.18:0/1847338874 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f67840d16b0 0x7f6784157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:14.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.624+0000 7f6782d9d640 1 --2- 172.21.15.18:0/1847338874 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f67840d16b0 0x7f6784157210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:14.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.624+0000 7f6782d9d640 1 -- 172.21.15.18:0/1847338874 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67840cd570 msgr2=0x7f6784156cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:14.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.624+0000 7f6782d9d640 1 --2- 172.21.15.18:0/1847338874 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67840cd570 0x7f6784156cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:14.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.624+0000 7f6782d9d640 1 -- 172.21.15.18:0/1847338874 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67840cc740 con 0x7f6784070cd0 2024-04-17T19:55:14.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.624+0000 7f678259c640 1 --2- 172.21.15.18:0/1847338874 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67840cd570 0x7f6784156cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:55:14.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.624+0000 7f6782d9d640 1 --2- 172.21.15.18:0/1847338874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6784070cd0 0x7f67840cc200 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f677400d620 tx=0x7f677400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:55:14.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.624+0000 7f677b7fe640 1 -- 172.21.15.18:0/1847338874 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f677400b620 con 0x7f6784070cd0 2024-04-17T19:55:14.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.624+0000 7f677b7fe640 1 -- 172.21.15.18:0/1847338874 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f6774019070 con 0x7f6784070cd0 2024-04-17T19:55:14.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.624+0000 7f67890d6640 1 -- 172.21.15.18:0/1847338874 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6784157ae0 con 0x7f6784070cd0 2024-04-17T19:55:14.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.624+0000 7f677b7fe640 1 -- 172.21.15.18:0/1847338874 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f677400ba00 con 0x7f6784070cd0 2024-04-17T19:55:14.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.624+0000 7f67890d6640 1 -- 172.21.15.18:0/1847338874 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67841e2ef0 con 0x7f6784070cd0 2024-04-17T19:55:14.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.624+0000 7f67890d6640 1 -- 172.21.15.18:0/1847338874 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6784069950 con 0x7f6784070cd0 2024-04-17T19:55:14.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.628+0000 7f677b7fe640 1 -- 172.21.15.18:0/1847338874 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f677400bba0 con 0x7f6784070cd0 2024-04-17T19:55:14.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.628+0000 7f677b7fe640 1 --2- 172.21.15.18:0/1847338874 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f6764068380 0x7f676406a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:14.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.628+0000 7f677b7fe640 1 -- 172.21.15.18:0/1847338874 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7f67740872a0 con 0x7f6784070cd0 2024-04-17T19:55:14.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.628+0000 7f678259c640 1 --2- 172.21.15.18:0/1847338874 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f6764068380 0x7f676406a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:14.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.628+0000 7f678259c640 1 --2- 172.21.15.18:0/1847338874 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f6764068380 0x7f676406a890 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f676c0b2000 tx=0x7f676c0aa070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:55:14.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.632+0000 7f677b7fe640 1 -- 172.21.15.18:0/1847338874 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f67840cc740 con 0x7f6784070cd0 2024-04-17T19:55:14.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.828+0000 7f67890d6640 1 -- 172.21.15.18:0/1847338874 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f67841587a0 con 0x7f6784070cd0 2024-04-17T19:55:14.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.832+0000 7f677b7fe640 1 -- 172.21.15.18:0/1847338874 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5177 (secure 0 0 0) 0x7f6774057400 con 0x7f6784070cd0 2024-04-17T19:55:14.830 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:55:14.830 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/729504609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":729504609},{"type":"v1","addr":"172.21.15.173:6833","nonce":729504609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4261,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/3797017174","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":3797017174},{"type":"v1","addr":"172.21.15.173:6835","nonce":3797017174}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/995848920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":995848920},{"type":"v1","addr":"172.21.15.18:6835","nonce":995848920}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-17T19:53:04.851226+0000","modified":"2024-04-17T19:53:22.952315+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6837/1926349198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1926349198},{"type":"v1","addr":"172.21.15.18:6837","nonce":1926349198}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1}]} 2024-04-17T19:55:14.830 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 9 2024-04-17T19:55:14.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.832+0000 7f67890d6640 1 -- 172.21.15.18:0/1847338874 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f6764068380 msgr2=0x7f676406a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:14.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.832+0000 7f67890d6640 1 --2- 172.21.15.18:0/1847338874 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f6764068380 0x7f676406a890 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f676c0b2000 tx=0x7f676c0aa070 comp rx=0 tx=0).stop 2024-04-17T19:55:14.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.832+0000 7f67890d6640 1 -- 172.21.15.18:0/1847338874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6784070cd0 msgr2=0x7f67840cc200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:14.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.832+0000 7f67890d6640 1 --2- 172.21.15.18:0/1847338874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6784070cd0 0x7f67840cc200 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f677400d620 tx=0x7f677400dae0 comp rx=0 tx=0).stop 2024-04-17T19:55:14.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.832+0000 7f67890d6640 1 -- 172.21.15.18:0/1847338874 shutdown_connections 2024-04-17T19:55:14.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.832+0000 7f67890d6640 1 --2- 172.21.15.18:0/1847338874 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f6764068380 0x7f676406a890 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:14.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.832+0000 7f67890d6640 1 --2- 172.21.15.18:0/1847338874 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f67840d16b0 0x7f6784157210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:14.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.832+0000 7f67890d6640 1 --2- 172.21.15.18:0/1847338874 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f67840cd570 0x7f6784156cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:14.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.832+0000 7f67890d6640 1 --2- 172.21.15.18:0/1847338874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6784070cd0 0x7f67840cc200 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:14.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.832+0000 7f67890d6640 1 -- 172.21.15.18:0/1847338874 >> 172.21.15.18:0/1847338874 conn(0x7f67840d2bf0 msgr2=0x7f678415c510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:55:14.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.832+0000 7f67890d6640 1 -- 172.21.15.18:0/1847338874 shutdown_connections 2024-04-17T19:55:14.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:14.832+0000 7f67890d6640 1 -- 172.21.15.18:0/1847338874 wait complete. 2024-04-17T19:55:14.852 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-17T19:55:15.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.008+0000 7f97361f2640 1 Processor -- start 2024-04-17T19:55:15.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.008+0000 7f97361f2640 1 -- start start 2024-04-17T19:55:15.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.012+0000 7f97361f2640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f973015e910 0x7f973015ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:15.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.012+0000 7f97361f2640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f973006cd60 0x7f973006d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:15.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.012+0000 7f97361f2640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f973006d6b0 con 0x7f973015e1a0 2024-04-17T19:55:15.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.012+0000 7f97361f2640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f97300d0020 con 0x7f973006cd60 2024-04-17T19:55:15.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.012+0000 7f97361f2640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f97300cd930 con 0x7f973015e910 2024-04-17T19:55:15.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.012+0000 7f972ffff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f973006cd60 0x7f973006d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:15.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.012+0000 7f972ffff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f973006cd60 0x7f973006d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46768/0 (socket says 172.21.15.18:46768) 2024-04-17T19:55:15.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.012+0000 7f972ffff640 1 -- 172.21.15.18:0/3637058256 learned_addr learned my addr 172.21.15.18:0/3637058256 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:55:15.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.012+0000 7f9727fff640 1 --2- 172.21.15.18:0/3637058256 >> v2:172.21.15.173:3300/0 conn(0x7f973015e910 0x7f973015ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:15.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.012+0000 7f972ffff640 1 -- 172.21.15.18:0/3637058256 >> v2:172.21.15.173:3300/0 conn(0x7f973015e910 msgr2=0x7f973015ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:55:15.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.012+0000 7f972ffff640 1 --2- 172.21.15.18:0/3637058256 >> v2:172.21.15.173:3300/0 conn(0x7f973015e910 0x7f973015ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:15.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.012+0000 7f972ffff640 1 -- 172.21.15.18:0/3637058256 >> v1:172.21.15.173:6789/0 conn(0x7f973015e1a0 legacy=0x7f97300ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:55:15.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.012+0000 7f972ffff640 1 -- 172.21.15.18:0/3637058256 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97300cdc10 con 0x7f973006cd60 2024-04-17T19:55:15.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.012+0000 7f9727fff640 1 --2- 172.21.15.18:0/3637058256 >> v2:172.21.15.173:3300/0 conn(0x7f973015e910 0x7f973015ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:55:15.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.012+0000 7f972ffff640 1 --2- 172.21.15.18:0/3637058256 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f973006cd60 0x7f973006d170 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f97300b6110 tx=0x7f972801c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cabd04f4542faafa server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:55:15.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.012+0000 7f972effd640 1 -- 172.21.15.18:0/3637058256 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97280a6500 con 0x7f973006cd60 2024-04-17T19:55:15.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.012+0000 7f972effd640 1 -- 172.21.15.18:0/3637058256 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f97280a66a0 con 0x7f973006cd60 2024-04-17T19:55:15.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.012+0000 7f972effd640 1 -- 172.21.15.18:0/3637058256 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97280a6a90 con 0x7f973006cd60 2024-04-17T19:55:15.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.016+0000 7f97361f2640 1 -- 172.21.15.18:0/3637058256 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f973006cd60 msgr2=0x7f973006d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:15.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.016+0000 7f97361f2640 1 --2- 172.21.15.18:0/3637058256 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f973006cd60 0x7f973006d170 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f97300b6110 tx=0x7f972801c740 comp rx=0 tx=0).stop 2024-04-17T19:55:15.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.016+0000 7f97361f2640 1 -- 172.21.15.18:0/3637058256 shutdown_connections 2024-04-17T19:55:15.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.016+0000 7f97361f2640 1 --2- 172.21.15.18:0/3637058256 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f973006cd60 0x7f973006d170 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:15.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.016+0000 7f97361f2640 1 --2- 172.21.15.18:0/3637058256 >> v2:172.21.15.173:3300/0 conn(0x7f973015e910 0x7f973015ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:15.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.016+0000 7f97361f2640 1 -- 172.21.15.18:0/3637058256 >> 172.21.15.18:0/3637058256 conn(0x7f9730072bb0 msgr2=0x7f9730072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:55:15.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.016+0000 7f97361f2640 1 -- 172.21.15.18:0/3637058256 shutdown_connections 2024-04-17T19:55:15.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.016+0000 7f97361f2640 1 -- 172.21.15.18:0/3637058256 wait complete. 2024-04-17T19:55:15.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.016+0000 7f97361f2640 1 Processor -- start 2024-04-17T19:55:15.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.016+0000 7f97361f2640 1 -- start start 2024-04-17T19:55:15.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.016+0000 7f97361f2640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f973006cd60 0x7f97301529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:15.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.016+0000 7f97361f2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f973015e1a0 0x7f973015bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:15.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.016+0000 7f97361f2640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f973015e910 0x7f9730155b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:15.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.016+0000 7f97361f2640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f973015e730 con 0x7f973015e1a0 2024-04-17T19:55:15.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.016+0000 7f97361f2640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f973015e5b0 con 0x7f973015e910 2024-04-17T19:55:15.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.016+0000 7f97361f2640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f97300cf0e0 con 0x7f973006cd60 2024-04-17T19:55:15.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.020+0000 7f9727fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f973015e1a0 0x7f973015bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:15.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.020+0000 7f9727fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f973015e1a0 0x7f973015bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46780/0 (socket says 172.21.15.18:46780) 2024-04-17T19:55:15.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.020+0000 7f9727fff640 1 -- 172.21.15.18:0/2362596392 learned_addr learned my addr 172.21.15.18:0/2362596392 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:55:15.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.020+0000 7f972f7fe640 1 --2- 172.21.15.18:0/2362596392 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f973006cd60 0x7f97301529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:15.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.020+0000 7f972ffff640 1 --2- 172.21.15.18:0/2362596392 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f973015e910 0x7f9730155b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:15.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.020+0000 7f9727fff640 1 -- 172.21.15.18:0/2362596392 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f973006cd60 msgr2=0x7f97301529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:15.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.020+0000 7f9727fff640 1 --2- 172.21.15.18:0/2362596392 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f973006cd60 0x7f97301529d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:15.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.020+0000 7f9727fff640 1 -- 172.21.15.18:0/2362596392 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f973015e910 msgr2=0x7f9730155b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:15.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.020+0000 7f9727fff640 1 --2- 172.21.15.18:0/2362596392 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f973015e910 0x7f9730155b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:15.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.020+0000 7f9727fff640 1 -- 172.21.15.18:0/2362596392 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9730152f10 con 0x7f973015e1a0 2024-04-17T19:55:15.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.020+0000 7f9727fff640 1 --2- 172.21.15.18:0/2362596392 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f973015e1a0 0x7f973015bf90 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f971800d830 tx=0x7f971800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:55:15.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.020+0000 7f972cff9640 1 -- 172.21.15.18:0/2362596392 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97180096a0 con 0x7f973015e1a0 2024-04-17T19:55:15.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.020+0000 7f972cff9640 1 -- 172.21.15.18:0/2362596392 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9718019070 con 0x7f973015e1a0 2024-04-17T19:55:15.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.020+0000 7f97361f2640 1 -- 172.21.15.18:0/2362596392 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97301595a0 con 0x7f973015e1a0 2024-04-17T19:55:15.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.020+0000 7f972cff9640 1 -- 172.21.15.18:0/2362596392 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9718009aa0 con 0x7f973015e1a0 2024-04-17T19:55:15.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.020+0000 7f97361f2640 1 -- 172.21.15.18:0/2362596392 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f973015b4b0 con 0x7f973015e1a0 2024-04-17T19:55:15.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.020+0000 7f97361f2640 1 -- 172.21.15.18:0/2362596392 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9730159810 con 0x7f973015e1a0 2024-04-17T19:55:15.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.020+0000 7f972cff9640 1 -- 172.21.15.18:0/2362596392 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f971801e460 con 0x7f973015e1a0 2024-04-17T19:55:15.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.020+0000 7f972cff9640 1 --2- 172.21.15.18:0/2362596392 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f97100683b0 0x7f971006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:15.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.020+0000 7f972cff9640 1 -- 172.21.15.18:0/2362596392 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7f9718087460 con 0x7f973015e1a0 2024-04-17T19:55:15.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.020+0000 7f972f7fe640 1 --2- 172.21.15.18:0/2362596392 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f97100683b0 0x7f971006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:15.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.020+0000 7f972f7fe640 1 --2- 172.21.15.18:0/2362596392 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f97100683b0 0x7f971006a8c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f97300b5f30 tx=0x7f9720009060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:55:15.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.024+0000 7f972cff9640 1 -- 172.21.15.18:0/2362596392 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f97180575c0 con 0x7f973015e1a0 2024-04-17T19:55:15.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.192+0000 7f97361f2640 1 -- 172.21.15.18:0/2362596392 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9730069950 con 0x7f973015e1a0 2024-04-17T19:55:15.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.196+0000 7f972cff9640 1 -- 172.21.15.18:0/2362596392 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+18759 (secure 0 0 0) 0x7f9718056ec0 con 0x7f973015e1a0 2024-04-17T19:55:15.194 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-17T19:55:15.194 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":29,"fsid":"dd480169-5a81-4623-be5f-0499aa244b28","created":"2024-04-17T19:52:39.533760+0000","modified":"2024-04-17T19:53:45.435889+0000","last_up_change":"2024-04-17T19:52:51.229698+0000","last_in_change":"2024-04-17T19:52:42.144259+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-17T19:52:52.391648+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-17T19:53:02.734240+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-17T19:53:03.813028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-17T19:53:07.478812+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e232d577-2508-4ea4-b355-29fbae1ff025","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6801","nonce":2323038417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6803","nonce":2323038417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6807","nonce":2323038417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":2323038417},{"type":"v1","addr":"172.21.15.18:6805","nonce":2323038417}]},"public_addr":"172.21.15.18:6801/2323038417","cluster_addr":"172.21.15.18:6803/2323038417","heartbeat_back_addr":"172.21.15.18:6807/2323038417","heartbeat_front_addr":"172.21.15.18:6805/2323038417","state":["exists","up"]},{"osd":1,"uuid":"31810ef3-2c71-48d6-8748-b74a2968d23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6817","nonce":1283678238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6819","nonce":1283678238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6823","nonce":1283678238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1283678238},{"type":"v1","addr":"172.21.15.18:6821","nonce":1283678238}]},"public_addr":"172.21.15.18:6817/1283678238","cluster_addr":"172.21.15.18:6819/1283678238","heartbeat_back_addr":"172.21.15.18:6823/1283678238","heartbeat_front_addr":"172.21.15.18:6821/1283678238","state":["exists","up"]},{"osd":2,"uuid":"5a783cc5-a41c-4967-9e11-6b8330f97d05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6809","nonce":1212875862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6811","nonce":1212875862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6815","nonce":1212875862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1212875862},{"type":"v1","addr":"172.21.15.18:6813","nonce":1212875862}]},"public_addr":"172.21.15.18:6809/1212875862","cluster_addr":"172.21.15.18:6811/1212875862","heartbeat_back_addr":"172.21.15.18:6815/1212875862","heartbeat_front_addr":"172.21.15.18:6813/1212875862","state":["exists","up"]},{"osd":3,"uuid":"b7e056d9-9da5-46e1-810d-0c3e242fe5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6825","nonce":2428878428}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6827","nonce":2428878428}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6831","nonce":2428878428}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2428878428},{"type":"v1","addr":"172.21.15.18:6829","nonce":2428878428}]},"public_addr":"172.21.15.18:6825/2428878428","cluster_addr":"172.21.15.18:6827/2428878428","heartbeat_back_addr":"172.21.15.18:6831/2428878428","heartbeat_front_addr":"172.21.15.18:6829/2428878428","state":["exists","up"]},{"osd":4,"uuid":"21df023f-bc8b-4abb-93e5-0ecc91acda0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6825","nonce":1421511819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6827","nonce":1421511819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6831","nonce":1421511819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1421511819},{"type":"v1","addr":"172.21.15.173:6829","nonce":1421511819}]},"public_addr":"172.21.15.173:6825/1421511819","cluster_addr":"172.21.15.173:6827/1421511819","heartbeat_back_addr":"172.21.15.173:6831/1421511819","heartbeat_front_addr":"172.21.15.173:6829/1421511819","state":["exists","up"]},{"osd":5,"uuid":"e270098a-6d33-49f8-84ed-94e09a880cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6801","nonce":4221907702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6803","nonce":4221907702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6807","nonce":4221907702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":4221907702},{"type":"v1","addr":"172.21.15.173:6805","nonce":4221907702}]},"public_addr":"172.21.15.173:6801/4221907702","cluster_addr":"172.21.15.173:6803/4221907702","heartbeat_back_addr":"172.21.15.173:6807/4221907702","heartbeat_front_addr":"172.21.15.173:6805/4221907702","state":["exists","up"]},{"osd":6,"uuid":"93c67c8c-268d-4e32-877c-043cd3acd87c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6809","nonce":761678552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6811","nonce":761678552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6815","nonce":761678552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":761678552},{"type":"v1","addr":"172.21.15.173:6813","nonce":761678552}]},"public_addr":"172.21.15.173:6809/761678552","cluster_addr":"172.21.15.173:6811/761678552","heartbeat_back_addr":"172.21.15.173:6815/761678552","heartbeat_front_addr":"172.21.15.173:6813/761678552","state":["exists","up"]},{"osd":7,"uuid":"faf10eea-80de-40f6-abbb-34d07d3f59ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6817","nonce":383724537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6819","nonce":383724537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6823","nonce":383724537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":383724537},{"type":"v1","addr":"172.21.15.173:6821","nonce":383724537}]},"public_addr":"172.21.15.173:6817/383724537","cluster_addr":"172.21.15.173:6819/383724537","heartbeat_back_addr":"172.21.15.173:6823/383724537","heartbeat_front_addr":"172.21.15.173:6821/383724537","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.668924+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.761747+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.768128+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.632252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.742608+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.734327+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.477107+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-17T19:52:47.818292+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.31","mappings":[{"from":0,"to":7}]},{"pgid":"4.5","mappings":[{"from":3,"to":4},{"from":1,"to":5}]},{"pgid":"4.e","mappings":[{"from":1,"to":0}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]},{"pgid":"4.1c","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-17T19:55:15.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.196+0000 7f97361f2640 1 -- 172.21.15.18:0/2362596392 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f97100683b0 msgr2=0x7f971006a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:15.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.196+0000 7f97361f2640 1 --2- 172.21.15.18:0/2362596392 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f97100683b0 0x7f971006a8c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f97300b5f30 tx=0x7f9720009060 comp rx=0 tx=0).stop 2024-04-17T19:55:15.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.196+0000 7f97361f2640 1 -- 172.21.15.18:0/2362596392 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f973015e1a0 msgr2=0x7f973015bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:15.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.196+0000 7f97361f2640 1 --2- 172.21.15.18:0/2362596392 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f973015e1a0 0x7f973015bf90 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f971800d830 tx=0x7f971800dcf0 comp rx=0 tx=0).stop 2024-04-17T19:55:15.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.196+0000 7f97361f2640 1 -- 172.21.15.18:0/2362596392 shutdown_connections 2024-04-17T19:55:15.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.196+0000 7f97361f2640 1 --2- 172.21.15.18:0/2362596392 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f97100683b0 0x7f971006a8c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:15.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.196+0000 7f97361f2640 1 --2- 172.21.15.18:0/2362596392 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f973015e910 0x7f9730155b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:15.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.196+0000 7f97361f2640 1 --2- 172.21.15.18:0/2362596392 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f973015e1a0 0x7f973015bf90 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:15.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.196+0000 7f97361f2640 1 --2- 172.21.15.18:0/2362596392 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f973006cd60 0x7f97301529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:15.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.196+0000 7f97361f2640 1 -- 172.21.15.18:0/2362596392 >> 172.21.15.18:0/2362596392 conn(0x7f9730072bb0 msgr2=0x7f973006e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:55:15.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.196+0000 7f97361f2640 1 -- 172.21.15.18:0/2362596392 shutdown_connections 2024-04-17T19:55:15.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.196+0000 7f97361f2640 1 -- 172.21.15.18:0/2362596392 wait complete. 2024-04-17T19:55:15.217 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-17T19:55:15.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.368+0000 7f57bcd4d640 1 Processor -- start 2024-04-17T19:55:15.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.368+0000 7f57bcd4d640 1 -- start start 2024-04-17T19:55:15.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.368+0000 7f57bcd4d640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f57b8162ac0 0x7f57b80d2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:15.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.368+0000 7f57bcd4d640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57b80d1490 con 0x7f57b81630a0 2024-04-17T19:55:15.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.368+0000 7f57bcd4d640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57b80b2190 con 0x7f57b8070de0 2024-04-17T19:55:15.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.368+0000 7f57bcd4d640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f57b80d1240 con 0x7f57b8162ac0 2024-04-17T19:55:15.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.368+0000 7f57b6d9d640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f57b81630a0 0x7f57b81634b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:42432/0 (socket says 172.21.15.18:42432) 2024-04-17T19:55:15.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.368+0000 7f57b6d9d640 1 -- 172.21.15.18:0/639167407 learned_addr learned my addr 172.21.15.18:0/639167407 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:55:15.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.372+0000 7f57b659c640 1 --2- 172.21.15.18:0/639167407 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f57b8162ac0 0x7f57b80d2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:15.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.372+0000 7f57b559a640 1 -- 172.21.15.18:0/639167407 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1554437202 0 0) 0x7f57b80d1490 con 0x7f57b81630a0 2024-04-17T19:55:15.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.372+0000 7f57b559a640 1 -- 172.21.15.18:0/639167407 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57a4003530 con 0x7f57b81630a0 2024-04-17T19:55:15.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.372+0000 7f57b559a640 1 -- 172.21.15.18:0/639167407 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 828785630 0 0) 0x7f57a4003530 con 0x7f57b81630a0 2024-04-17T19:55:15.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.372+0000 7f57b559a640 1 -- 172.21.15.18:0/639167407 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f57b8162ac0 msgr2=0x7f57b80d2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:55:15.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.372+0000 7f57b559a640 1 --2- 172.21.15.18:0/639167407 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f57b8162ac0 0x7f57b80d2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:15.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.372+0000 7f57b559a640 1 -- 172.21.15.18:0/639167407 >> v1:172.21.15.173:6789/0 conn(0x7f57b8070de0 legacy=0x7f57b80711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:15.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.372+0000 7f57b559a640 1 -- 172.21.15.18:0/639167407 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57b80b2470 con 0x7f57b81630a0 2024-04-17T19:55:15.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.372+0000 7f57b559a640 1 -- 172.21.15.18:0/639167407 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3208559991 0 0) 0x7f57b0001680 con 0x7f57b81630a0 2024-04-17T19:55:15.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.372+0000 7f57b559a640 1 -- 172.21.15.18:0/639167407 >> v1:172.21.15.18:6789/0 conn(0x7f57b81630a0 legacy=0x7f57b81634b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:15.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.372+0000 7f57b559a640 1 --2- 172.21.15.18:0/639167407 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f57b8162ac0 0x7f57a4003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:15.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.372+0000 7f57b559a640 1 --2- 172.21.15.18:0/639167407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57a4003fe0 0x7f57a4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:15.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.372+0000 7f57b559a640 1 --2- 172.21.15.18:0/639167407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57a4004d50 0x7f57a40051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:15.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.372+0000 7f57b559a640 1 -- 172.21.15.18:0/639167407 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f57b80d1240 con 0x7f57a4004d50 2024-04-17T19:55:15.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.372+0000 7f57b559a640 1 -- 172.21.15.18:0/639167407 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f57a400bc80 con 0x7f57a4003fe0 2024-04-17T19:55:15.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.372+0000 7f57b559a640 1 -- 172.21.15.18:0/639167407 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f57a400be80 con 0x7f57b8162ac0 2024-04-17T19:55:15.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.372+0000 7f57b6d9d640 1 --2- 172.21.15.18:0/639167407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57a4004d50 0x7f57a40051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:15.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.372+0000 7f57b5d9b640 1 --2- 172.21.15.18:0/639167407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57a4003fe0 0x7f57a4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:15.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.372+0000 7f57b659c640 1 --2- 172.21.15.18:0/639167407 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f57b8162ac0 0x7f57a4003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:15.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.372+0000 7f57b6d9d640 1 -- 172.21.15.18:0/639167407 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f57b8162ac0 msgr2=0x7f57a4003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:55:15.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.372+0000 7f57b6d9d640 1 --2- 172.21.15.18:0/639167407 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f57b8162ac0 0x7f57a4003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:15.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.372+0000 7f57b6d9d640 1 -- 172.21.15.18:0/639167407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57a4003fe0 msgr2=0x7f57a4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:55:15.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.372+0000 7f57b6d9d640 1 --2- 172.21.15.18:0/639167407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57a4003fe0 0x7f57a4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:15.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.372+0000 7f57b6d9d640 1 -- 172.21.15.18:0/639167407 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57a4003530 con 0x7f57a4004d50 2024-04-17T19:55:15.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.372+0000 7f57b6d9d640 1 --2- 172.21.15.18:0/639167407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57a4004d50 0x7f57a40051e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f57b000c110 tx=0x7f57b001f310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f5ef387084f1d server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:55:15.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.372+0000 7f57b559a640 1 -- 172.21.15.18:0/639167407 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57b0007c50 con 0x7f57a4004d50 2024-04-17T19:55:15.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.372+0000 7f57b559a640 1 -- 172.21.15.18:0/639167407 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f57b0005ae0 con 0x7f57a4004d50 2024-04-17T19:55:15.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.372+0000 7f57b559a640 1 -- 172.21.15.18:0/639167407 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57b0007070 con 0x7f57a4004d50 2024-04-17T19:55:15.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.376+0000 7f57bcd4d640 1 -- 172.21.15.18:0/639167407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57a4004d50 msgr2=0x7f57a40051e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:15.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.376+0000 7f57bcd4d640 1 --2- 172.21.15.18:0/639167407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57a4004d50 0x7f57a40051e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f57b000c110 tx=0x7f57b001f310 comp rx=0 tx=0).stop 2024-04-17T19:55:15.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.376+0000 7f57b6d9d640 1 -- 172.21.15.18:0/639167407 reap_dead start 2024-04-17T19:55:15.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.376+0000 7f57bcd4d640 1 -- 172.21.15.18:0/639167407 shutdown_connections 2024-04-17T19:55:15.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.376+0000 7f57bcd4d640 1 -- 172.21.15.18:0/639167407 >> 172.21.15.18:0/639167407 conn(0x7f57b80cf6e0 msgr2=0x7f57b80cfaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:55:15.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.376+0000 7f57bcd4d640 1 -- 172.21.15.18:0/639167407 shutdown_connections 2024-04-17T19:55:15.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.376+0000 7f57bcd4d640 1 -- 172.21.15.18:0/639167407 wait complete. 2024-04-17T19:55:15.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.376+0000 7f57bcd4d640 1 Processor -- start 2024-04-17T19:55:15.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.376+0000 7f57bcd4d640 1 -- start start 2024-04-17T19:55:15.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.376+0000 7f57bcd4d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57a4004d50 0x7f57b81f5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:15.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.376+0000 7f57bcd4d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57b81e91a0 0x7f57b81e95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:15.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.376+0000 7f57bcd4d640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f57b81e9af0 0x7f57b81f9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:15.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.376+0000 7f57bcd4d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f57b80cf420 con 0x7f57b81e91a0 2024-04-17T19:55:15.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.376+0000 7f57bcd4d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f57b80cf2a0 con 0x7f57a4004d50 2024-04-17T19:55:15.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.376+0000 7f57bcd4d640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f57b80d2670 con 0x7f57b81e9af0 2024-04-17T19:55:15.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.376+0000 7f57b5d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57b81e91a0 0x7f57b81e95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:15.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.376+0000 7f57b5d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57b81e91a0 0x7f57b81e95b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46798/0 (socket says 172.21.15.18:46798) 2024-04-17T19:55:15.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.376+0000 7f57b5d9b640 1 -- 172.21.15.18:0/4132455250 learned_addr learned my addr 172.21.15.18:0/4132455250 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:55:15.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.376+0000 7f57b659c640 1 --2- 172.21.15.18:0/4132455250 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57a4004d50 0x7f57b81f5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:15.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.376+0000 7f57b6d9d640 1 --2- 172.21.15.18:0/4132455250 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f57b81e9af0 0x7f57b81f9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:15.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.376+0000 7f57b5d9b640 1 -- 172.21.15.18:0/4132455250 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f57b81e9af0 msgr2=0x7f57b81f9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:15.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.376+0000 7f57b5d9b640 1 --2- 172.21.15.18:0/4132455250 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f57b81e9af0 0x7f57b81f9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:15.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.376+0000 7f57b5d9b640 1 -- 172.21.15.18:0/4132455250 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57a4004d50 msgr2=0x7f57b81f5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:15.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.376+0000 7f57b5d9b640 1 --2- 172.21.15.18:0/4132455250 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57a4004d50 0x7f57b81f5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:15.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.376+0000 7f57b5d9b640 1 -- 172.21.15.18:0/4132455250 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57b814f510 con 0x7f57b81e91a0 2024-04-17T19:55:15.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.380+0000 7f57b5d9b640 1 --2- 172.21.15.18:0/4132455250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57b81e91a0 0x7f57b81e95b0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f57b80d1f40 tx=0x7f57a000ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:55:15.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.380+0000 7f57aeffd640 1 -- 172.21.15.18:0/4132455250 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a0003980 con 0x7f57b81e91a0 2024-04-17T19:55:15.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.380+0000 7f57aeffd640 1 -- 172.21.15.18:0/4132455250 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f57a0018070 con 0x7f57b81e91a0 2024-04-17T19:55:15.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.380+0000 7f57aeffd640 1 -- 172.21.15.18:0/4132455250 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a0003da0 con 0x7f57b81e91a0 2024-04-17T19:55:15.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.380+0000 7f57bcd4d640 1 -- 172.21.15.18:0/4132455250 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57b8160ff0 con 0x7f57b81e91a0 2024-04-17T19:55:15.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.380+0000 7f57bcd4d640 1 -- 172.21.15.18:0/4132455250 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57b81e89a0 con 0x7f57b81e91a0 2024-04-17T19:55:15.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.380+0000 7f57bcd4d640 1 -- 172.21.15.18:0/4132455250 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57b8069950 con 0x7f57b81e91a0 2024-04-17T19:55:15.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.380+0000 7f57aeffd640 1 -- 172.21.15.18:0/4132455250 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f57a00050d0 con 0x7f57b81e91a0 2024-04-17T19:55:15.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.380+0000 7f57aeffd640 1 --2- 172.21.15.18:0/4132455250 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f5798068380 0x7f579806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:15.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.380+0000 7f57aeffd640 1 -- 172.21.15.18:0/4132455250 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6685+0+0 (secure 0 0 0) 0x7f57a0086d80 con 0x7f57b81e91a0 2024-04-17T19:55:15.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.380+0000 7f57b659c640 1 --2- 172.21.15.18:0/4132455250 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f5798068380 0x7f579806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:15.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.380+0000 7f57b659c640 1 --2- 172.21.15.18:0/4132455250 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f5798068380 0x7f579806a890 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f57a8009a30 tx=0x7f57a8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:55:15.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.384+0000 7f57aeffd640 1 -- 172.21.15.18:0/4132455250 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f57a0056ee0 con 0x7f57b81e91a0 2024-04-17T19:55:15.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.576+0000 7f57bcd4d640 1 -- 172.21.15.18:0/4132455250 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f57b8160d80 con 0x7f57b81e91a0 2024-04-17T19:55:15.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.580+0000 7f57aeffd640 1 -- 172.21.15.18:0/4132455250 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) ==== 161+0+0 (secure 0 0 0) 0x7f57a00567e0 con 0x7f57b81e91a0 2024-04-17T19:55:15.580 INFO:teuthology.orchestra.run.smithi018.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-17T19:55:15.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.584+0000 7f57bcd4d640 1 -- 172.21.15.18:0/4132455250 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f5798068380 msgr2=0x7f579806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:15.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.584+0000 7f57bcd4d640 1 --2- 172.21.15.18:0/4132455250 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f5798068380 0x7f579806a890 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f57a8009a30 tx=0x7f57a8008040 comp rx=0 tx=0).stop 2024-04-17T19:55:15.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.584+0000 7f57bcd4d640 1 -- 172.21.15.18:0/4132455250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57b81e91a0 msgr2=0x7f57b81e95b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:15.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.584+0000 7f57bcd4d640 1 --2- 172.21.15.18:0/4132455250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57b81e91a0 0x7f57b81e95b0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f57b80d1f40 tx=0x7f57a000ec10 comp rx=0 tx=0).stop 2024-04-17T19:55:15.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.584+0000 7f57bcd4d640 1 -- 172.21.15.18:0/4132455250 shutdown_connections 2024-04-17T19:55:15.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.584+0000 7f57bcd4d640 1 --2- 172.21.15.18:0/4132455250 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f5798068380 0x7f579806a890 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:15.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.584+0000 7f57bcd4d640 1 --2- 172.21.15.18:0/4132455250 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f57b81e9af0 0x7f57b81f9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:15.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.584+0000 7f57bcd4d640 1 --2- 172.21.15.18:0/4132455250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57b81e91a0 0x7f57b81e95b0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:15.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.584+0000 7f57bcd4d640 1 --2- 172.21.15.18:0/4132455250 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f57a4004d50 0x7f57b81f5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:15.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.584+0000 7f57bcd4d640 1 -- 172.21.15.18:0/4132455250 >> 172.21.15.18:0/4132455250 conn(0x7f57b80cf6e0 msgr2=0x7f57b80b26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:55:15.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.584+0000 7f57bcd4d640 1 -- 172.21.15.18:0/4132455250 shutdown_connections 2024-04-17T19:55:15.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.584+0000 7f57bcd4d640 1 -- 172.21.15.18:0/4132455250 wait complete. 2024-04-17T19:55:15.594 INFO:tasks.ceph.mds.a.smithi018.stderr: -7071> 2024-04-17T19:53:07.941+0000 7f1ddf4ac640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-17T19:55:15.608 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-17T19:55:15.675 INFO:tasks.ceph.mds.a.smithi018.stdout:starting mds.a at 2024-04-17T19:55:15.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.752+0000 7f81ff7b0640 1 Processor -- start 2024-04-17T19:55:15.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.752+0000 7f81ff7b0640 1 -- start start 2024-04-17T19:55:15.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.756+0000 7f81ff7b0640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f81f80d0480 0x7f81f8142330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:15.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.756+0000 7f81ff7b0640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f81f80b51b0 0x7f81f8142c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:15.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.756+0000 7f81ff7b0640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f81f80b55c0 0x7f81f81431c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:15.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.756+0000 7f81ff7b0640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f81f80b4d20 con 0x7f81f80d0480 2024-04-17T19:55:15.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.756+0000 7f81ff7b0640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7f81f80b4110 con 0x7f81f80b55c0 2024-04-17T19:55:15.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.756+0000 7f81ff7b0640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f81f80b43f0 con 0x7f81f80b51b0 2024-04-17T19:55:15.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.756+0000 7f81fd54c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f81f80d0480 0x7f81f8142330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:15.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.756+0000 7f81fd54c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f81f80d0480 0x7f81f8142330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46808/0 (socket says 172.21.15.18:46808) 2024-04-17T19:55:15.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.756+0000 7f81fd54c640 1 -- 172.21.15.18:0/797722194 learned_addr learned my addr 172.21.15.18:0/797722194 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:55:15.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.756+0000 7f81fcd4b640 1 --2- 172.21.15.18:0/797722194 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f81f80b51b0 0x7f81f8142c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:15.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.756+0000 7f81fdd4d640 1 --2- 172.21.15.18:0/797722194 >> v2:172.21.15.173:3300/0 conn(0x7f81f80b55c0 0x7f81f81431c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:15.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.756+0000 7f81fd54c640 1 -- 172.21.15.18:0/797722194 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f81f80b51b0 msgr2=0x7f81f8142c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:55:15.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.756+0000 7f81fd54c640 1 --2- 172.21.15.18:0/797722194 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f81f80b51b0 0x7f81f8142c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:15.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.756+0000 7f81fd54c640 1 -- 172.21.15.18:0/797722194 >> v2:172.21.15.173:3300/0 conn(0x7f81f80b55c0 msgr2=0x7f81f81431c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:55:15.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.756+0000 7f81fd54c640 1 --2- 172.21.15.18:0/797722194 >> v2:172.21.15.173:3300/0 conn(0x7f81f80b55c0 0x7f81f81431c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:15.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.756+0000 7f81fd54c640 1 -- 172.21.15.18:0/797722194 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81f80b46d0 con 0x7f81f80d0480 2024-04-17T19:55:15.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.756+0000 7f81fcd4b640 1 --2- 172.21.15.18:0/797722194 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f81f80b51b0 0x7f81f8142c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:55:15.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.756+0000 7f81fd54c640 1 --2- 172.21.15.18:0/797722194 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81f80d0480 0x7f81f8142330 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f81f80727d0 tx=0x7f81f401e730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2b13043d2ee8abc server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:55:15.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.760+0000 7f81effff640 1 -- 172.21.15.18:0/797722194 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f40ab670 con 0x7f81f80d0480 2024-04-17T19:55:15.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.760+0000 7f81effff640 1 -- 172.21.15.18:0/797722194 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f81f40ab810 con 0x7f81f80d0480 2024-04-17T19:55:15.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.760+0000 7f81effff640 1 -- 172.21.15.18:0/797722194 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f40abc00 con 0x7f81f80d0480 2024-04-17T19:55:15.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.760+0000 7f81ff7b0640 1 -- 172.21.15.18:0/797722194 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81f80d0480 msgr2=0x7f81f8142330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:15.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.760+0000 7f81ff7b0640 1 --2- 172.21.15.18:0/797722194 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81f80d0480 0x7f81f8142330 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f81f80727d0 tx=0x7f81f401e730 comp rx=0 tx=0).stop 2024-04-17T19:55:15.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.760+0000 7f81ff7b0640 1 -- 172.21.15.18:0/797722194 shutdown_connections 2024-04-17T19:55:15.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.760+0000 7f81ff7b0640 1 --2- 172.21.15.18:0/797722194 >> v2:172.21.15.173:3300/0 conn(0x7f81f80b55c0 0x7f81f81431c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:15.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.760+0000 7f81ff7b0640 1 --2- 172.21.15.18:0/797722194 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f81f80b51b0 0x7f81f8142c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:15.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.760+0000 7f81ff7b0640 1 --2- 172.21.15.18:0/797722194 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81f80d0480 0x7f81f8142330 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:15.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.760+0000 7f81ff7b0640 1 -- 172.21.15.18:0/797722194 >> 172.21.15.18:0/797722194 conn(0x7f81f8073820 msgr2=0x7f81f806bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:55:15.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.760+0000 7f81ff7b0640 1 -- 172.21.15.18:0/797722194 shutdown_connections 2024-04-17T19:55:15.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.760+0000 7f81ff7b0640 1 -- 172.21.15.18:0/797722194 wait complete. 2024-04-17T19:55:15.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.760+0000 7f81ff7b0640 1 Processor -- start 2024-04-17T19:55:15.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.760+0000 7f81ff7b0640 1 -- start start 2024-04-17T19:55:15.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.764+0000 7f81ff7b0640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f81f80b51b0 0x7f81f806cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:15.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.764+0000 7f81ff7b0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81f80b55c0 0x7f81f81445c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:15.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.764+0000 7f81ff7b0640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f81f80d0480 0x7f81f8144b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:15.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.764+0000 7f81ff7b0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f81f8142870 con 0x7f81f80b55c0 2024-04-17T19:55:15.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.764+0000 7f81ff7b0640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f81f815fb70 con 0x7f81f80b51b0 2024-04-17T19:55:15.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.764+0000 7f81ff7b0640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f81f8141f30 con 0x7f81f80d0480 2024-04-17T19:55:15.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.764+0000 7f81fcd4b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81f80b55c0 0x7f81f81445c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:15.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.764+0000 7f81fcd4b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81f80b55c0 0x7f81f81445c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46816/0 (socket says 172.21.15.18:46816) 2024-04-17T19:55:15.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.764+0000 7f81fcd4b640 1 -- 172.21.15.18:0/4098017616 learned_addr learned my addr 172.21.15.18:0/4098017616 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:55:15.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.764+0000 7f81fdd4d640 1 --2- 172.21.15.18:0/4098017616 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f81f80d0480 0x7f81f8144b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:15.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.764+0000 7f81fd54c640 1 --2- 172.21.15.18:0/4098017616 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f81f80b51b0 0x7f81f806cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:15.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.764+0000 7f81fcd4b640 1 -- 172.21.15.18:0/4098017616 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f81f80d0480 msgr2=0x7f81f8144b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:15.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.764+0000 7f81fcd4b640 1 --2- 172.21.15.18:0/4098017616 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f81f80d0480 0x7f81f8144b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:15.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.764+0000 7f81fcd4b640 1 -- 172.21.15.18:0/4098017616 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f81f80b51b0 msgr2=0x7f81f806cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:15.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.764+0000 7f81fcd4b640 1 --2- 172.21.15.18:0/4098017616 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f81f80b51b0 0x7f81f806cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:15.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.764+0000 7f81fcd4b640 1 -- 172.21.15.18:0/4098017616 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81f8163da0 con 0x7f81f80b55c0 2024-04-17T19:55:15.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.764+0000 7f81fd54c640 1 --2- 172.21.15.18:0/4098017616 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f81f80b51b0 0x7f81f806cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:55:15.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.764+0000 7f81fcd4b640 1 --2- 172.21.15.18:0/4098017616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81f80b55c0 0x7f81f81445c0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f81e800d830 tx=0x7f81e800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:55:15.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.764+0000 7f81edffb640 1 -- 172.21.15.18:0/4098017616 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e800b6c0 con 0x7f81f80b55c0 2024-04-17T19:55:15.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.764+0000 7f81edffb640 1 -- 172.21.15.18:0/4098017616 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f81e8019070 con 0x7f81f80b55c0 2024-04-17T19:55:15.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.764+0000 7f81edffb640 1 -- 172.21.15.18:0/4098017616 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e800bac0 con 0x7f81f80b55c0 2024-04-17T19:55:15.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.764+0000 7f81ff7b0640 1 -- 172.21.15.18:0/4098017616 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81f8164080 con 0x7f81f80b55c0 2024-04-17T19:55:15.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.764+0000 7f81ff7b0640 1 -- 172.21.15.18:0/4098017616 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81f8164640 con 0x7f81f80b55c0 2024-04-17T19:55:15.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.764+0000 7f81ff7b0640 1 -- 172.21.15.18:0/4098017616 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81f80698e0 con 0x7f81f80b55c0 2024-04-17T19:55:15.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.764+0000 7f81edffb640 1 -- 172.21.15.18:0/4098017616 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f81e801e460 con 0x7f81f80b55c0 2024-04-17T19:55:15.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.764+0000 7f81edffb640 1 --2- 172.21.15.18:0/4098017616 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f81dc0683b0 0x7f81dc06a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:15.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.764+0000 7f81edffb640 1 -- 172.21.15.18:0/4098017616 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6771+0+0 (secure 0 0 0) 0x7f81e80874a0 con 0x7f81f80b55c0 2024-04-17T19:55:15.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.764+0000 7f81fd54c640 1 --2- 172.21.15.18:0/4098017616 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f81dc0683b0 0x7f81dc06a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:15.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.764+0000 7f81fd54c640 1 --2- 172.21.15.18:0/4098017616 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f81dc0683b0 0x7f81dc06a8c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f81f40b0000 tx=0x7f81f4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:55:15.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.772+0000 7f81edffb640 1 -- 172.21.15.18:0/4098017616 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f81e80575a0 con 0x7f81f80b55c0 2024-04-17T19:55:15.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:15.968+0000 7f81ff7b0640 1 -- 172.21.15.18:0/4098017616 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f81f806d1c0 con 0x7f81f80b55c0 2024-04-17T19:55:16.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.584+0000 7f81edffb640 1 -- 172.21.15.18:0/4098017616 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f81e8056ea0 con 0x7f81f80b55c0 2024-04-17T19:55:16.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.588+0000 7f81ff7b0640 1 -- 172.21.15.18:0/4098017616 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f81dc0683b0 msgr2=0x7f81dc06a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:16.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.588+0000 7f81ff7b0640 1 --2- 172.21.15.18:0/4098017616 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f81dc0683b0 0x7f81dc06a8c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f81f40b0000 tx=0x7f81f4009040 comp rx=0 tx=0).stop 2024-04-17T19:55:16.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.588+0000 7f81ff7b0640 1 -- 172.21.15.18:0/4098017616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81f80b55c0 msgr2=0x7f81f81445c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:16.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.588+0000 7f81ff7b0640 1 --2- 172.21.15.18:0/4098017616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81f80b55c0 0x7f81f81445c0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f81e800d830 tx=0x7f81e800dcf0 comp rx=0 tx=0).stop 2024-04-17T19:55:16.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.588+0000 7f81ff7b0640 1 -- 172.21.15.18:0/4098017616 shutdown_connections 2024-04-17T19:55:16.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.588+0000 7f81ff7b0640 1 --2- 172.21.15.18:0/4098017616 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f81dc0683b0 0x7f81dc06a8c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:16.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.588+0000 7f81ff7b0640 1 --2- 172.21.15.18:0/4098017616 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f81f80d0480 0x7f81f8144b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:16.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.588+0000 7f81ff7b0640 1 --2- 172.21.15.18:0/4098017616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81f80b55c0 0x7f81f81445c0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:16.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.588+0000 7f81ff7b0640 1 --2- 172.21.15.18:0/4098017616 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f81f80b51b0 0x7f81f806cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:16.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.588+0000 7f81ff7b0640 1 -- 172.21.15.18:0/4098017616 >> 172.21.15.18:0/4098017616 conn(0x7f81f8073820 msgr2=0x7f81f80b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:55:16.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.588+0000 7f81ff7b0640 1 -- 172.21.15.18:0/4098017616 shutdown_connections 2024-04-17T19:55:16.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.588+0000 7f81ff7b0640 1 -- 172.21.15.18:0/4098017616 wait complete. 2024-04-17T19:55:16.610 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-17T19:55:16.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.764+0000 7f9d4c137640 1 Processor -- start 2024-04-17T19:55:16.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.764+0000 7f9d4c137640 1 -- start start 2024-04-17T19:55:16.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.768+0000 7f9d4c137640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9d440b1960 0x7f9d4409aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:16.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.768+0000 7f9d4c137640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d440b1d70 con 0x7f9d4415d7e0 2024-04-17T19:55:16.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.768+0000 7f9d4c137640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d4415de30 con 0x7f9d440b1550 2024-04-17T19:55:16.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.768+0000 7f9d4c137640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f9d4415dbf0 con 0x7f9d440b1960 2024-04-17T19:55:16.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.768+0000 7f9d49ed3640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f9d4415d7e0 0x7f9d4406c910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:42444/0 (socket says 172.21.15.18:42444) 2024-04-17T19:55:16.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.768+0000 7f9d49ed3640 1 -- 172.21.15.18:0/2579452718 learned_addr learned my addr 172.21.15.18:0/2579452718 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:55:16.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.768+0000 7f9d4a6d4640 1 --2- 172.21.15.18:0/2579452718 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9d440b1960 0x7f9d4409aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:16.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.768+0000 7f9d48ed1640 1 -- 172.21.15.18:0/2579452718 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2549682788 0 0) 0x7f9d440b1d70 con 0x7f9d4415d7e0 2024-04-17T19:55:16.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.768+0000 7f9d48ed1640 1 -- 172.21.15.18:0/2579452718 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d30003530 con 0x7f9d4415d7e0 2024-04-17T19:55:16.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.768+0000 7f9d48ed1640 1 -- 172.21.15.18:0/2579452718 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3833595064 0 0) 0x7f9d30003530 con 0x7f9d4415d7e0 2024-04-17T19:55:16.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.768+0000 7f9d48ed1640 1 -- 172.21.15.18:0/2579452718 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9d440b1960 msgr2=0x7f9d4409aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:55:16.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.768+0000 7f9d48ed1640 1 --2- 172.21.15.18:0/2579452718 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9d440b1960 0x7f9d4409aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:16.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.768+0000 7f9d48ed1640 1 -- 172.21.15.18:0/2579452718 >> v1:172.21.15.173:6789/0 conn(0x7f9d440b1550 legacy=0x7f9d440d20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:16.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.768+0000 7f9d48ed1640 1 -- 172.21.15.18:0/2579452718 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d4415e110 con 0x7f9d4415d7e0 2024-04-17T19:55:16.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.768+0000 7f9d48ed1640 1 -- 172.21.15.18:0/2579452718 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3208559991 0 0) 0x7f9d40001a20 con 0x7f9d4415d7e0 2024-04-17T19:55:16.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.768+0000 7f9d48ed1640 1 -- 172.21.15.18:0/2579452718 >> v1:172.21.15.18:6789/0 conn(0x7f9d4415d7e0 legacy=0x7f9d4406c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:16.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.768+0000 7f9d48ed1640 1 --2- 172.21.15.18:0/2579452718 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d300039f0 0x7f9d30003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:16.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.768+0000 7f9d48ed1640 1 --2- 172.21.15.18:0/2579452718 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d30004810 0x7f9d30004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:16.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.768+0000 7f9d48ed1640 1 --2- 172.21.15.18:0/2579452718 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9d440b1960 0x7f9d30005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:16.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.768+0000 7f9d48ed1640 1 -- 172.21.15.18:0/2579452718 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9d4415dbf0 con 0x7f9d300039f0 2024-04-17T19:55:16.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.768+0000 7f9d48ed1640 1 -- 172.21.15.18:0/2579452718 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3000bb30 con 0x7f9d30004810 2024-04-17T19:55:16.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.768+0000 7f9d48ed1640 1 -- 172.21.15.18:0/2579452718 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f9d3000bd30 con 0x7f9d440b1960 2024-04-17T19:55:16.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.768+0000 7f9d49ed3640 1 --2- 172.21.15.18:0/2579452718 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d300039f0 0x7f9d30003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:16.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.768+0000 7f9d496d2640 1 --2- 172.21.15.18:0/2579452718 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d30004810 0x7f9d30004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:16.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.768+0000 7f9d4a6d4640 1 --2- 172.21.15.18:0/2579452718 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9d440b1960 0x7f9d30005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:16.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.768+0000 7f9d49ed3640 1 -- 172.21.15.18:0/2579452718 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9d440b1960 msgr2=0x7f9d30005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:55:16.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.768+0000 7f9d49ed3640 1 --2- 172.21.15.18:0/2579452718 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9d440b1960 0x7f9d30005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:16.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.768+0000 7f9d49ed3640 1 -- 172.21.15.18:0/2579452718 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d30004810 msgr2=0x7f9d30004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:55:16.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.768+0000 7f9d49ed3640 1 --2- 172.21.15.18:0/2579452718 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d30004810 0x7f9d30004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:16.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.768+0000 7f9d49ed3640 1 -- 172.21.15.18:0/2579452718 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d30003530 con 0x7f9d300039f0 2024-04-17T19:55:16.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.768+0000 7f9d496d2640 1 --2- 172.21.15.18:0/2579452718 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d30004810 0x7f9d30004c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:55:16.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.772+0000 7f9d49ed3640 1 --2- 172.21.15.18:0/2579452718 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d300039f0 0x7f9d30003e60 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f9d440731a0 tx=0x7f9d4001d300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19847d2f2c5bda0f server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:55:16.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.772+0000 7f9d48ed1640 1 -- 172.21.15.18:0/2579452718 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d4000a480 con 0x7f9d300039f0 2024-04-17T19:55:16.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.772+0000 7f9d48ed1640 1 -- 172.21.15.18:0/2579452718 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9d400ad650 con 0x7f9d300039f0 2024-04-17T19:55:16.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.772+0000 7f9d48ed1640 1 -- 172.21.15.18:0/2579452718 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d400ada60 con 0x7f9d300039f0 2024-04-17T19:55:16.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.772+0000 7f9d4c137640 1 -- 172.21.15.18:0/2579452718 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d300039f0 msgr2=0x7f9d30003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:16.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.772+0000 7f9d4c137640 1 --2- 172.21.15.18:0/2579452718 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d300039f0 0x7f9d30003e60 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f9d440731a0 tx=0x7f9d4001d300 comp rx=0 tx=0).stop 2024-04-17T19:55:16.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.772+0000 7f9d4a6d4640 1 -- 172.21.15.18:0/2579452718 reap_dead start 2024-04-17T19:55:16.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.772+0000 7f9d4c137640 1 -- 172.21.15.18:0/2579452718 shutdown_connections 2024-04-17T19:55:16.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.772+0000 7f9d4c137640 1 -- 172.21.15.18:0/2579452718 >> 172.21.15.18:0/2579452718 conn(0x7f9d440b6990 msgr2=0x7f9d440b6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:55:16.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.772+0000 7f9d4c137640 1 -- 172.21.15.18:0/2579452718 shutdown_connections 2024-04-17T19:55:16.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.772+0000 7f9d4c137640 1 -- 172.21.15.18:0/2579452718 wait complete. 2024-04-17T19:55:16.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.772+0000 7f9d4c137640 1 Processor -- start 2024-04-17T19:55:16.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.772+0000 7f9d4c137640 1 -- start start 2024-04-17T19:55:16.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.776+0000 7f9d4c137640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d300039f0 0x7f9d440af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:16.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.776+0000 7f9d4c137640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9d440b00f0 0x7f9d44156e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:16.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.776+0000 7f9d4c137640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d4414db10 0x7f9d4414e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:16.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.776+0000 7f9d4c137640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9d44169170 con 0x7f9d4414db10 2024-04-17T19:55:16.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.776+0000 7f9d4c137640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9d440d2a00 con 0x7f9d300039f0 2024-04-17T19:55:16.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.776+0000 7f9d4c137640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f9d441692f0 con 0x7f9d440b00f0 2024-04-17T19:55:16.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.776+0000 7f9d4a6d4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d4414db10 0x7f9d4414e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:16.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.776+0000 7f9d4a6d4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d4414db10 0x7f9d4414e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46832/0 (socket says 172.21.15.18:46832) 2024-04-17T19:55:16.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.776+0000 7f9d4a6d4640 1 -- 172.21.15.18:0/3874980091 learned_addr learned my addr 172.21.15.18:0/3874980091 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:55:16.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.776+0000 7f9d496d2640 1 --2- 172.21.15.18:0/3874980091 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9d440b00f0 0x7f9d44156e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:16.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.776+0000 7f9d49ed3640 1 --2- 172.21.15.18:0/3874980091 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d300039f0 0x7f9d440af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:16.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.776+0000 7f9d4a6d4640 1 -- 172.21.15.18:0/3874980091 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9d440b00f0 msgr2=0x7f9d44156e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:16.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.776+0000 7f9d4a6d4640 1 --2- 172.21.15.18:0/3874980091 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9d440b00f0 0x7f9d44156e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:16.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.776+0000 7f9d4a6d4640 1 -- 172.21.15.18:0/3874980091 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d300039f0 msgr2=0x7f9d440af420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:16.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.776+0000 7f9d4a6d4640 1 --2- 172.21.15.18:0/3874980091 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d300039f0 0x7f9d440af420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:16.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.776+0000 7f9d4a6d4640 1 -- 172.21.15.18:0/3874980091 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d44156090 con 0x7f9d4414db10 2024-04-17T19:55:16.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.776+0000 7f9d4a6d4640 1 --2- 172.21.15.18:0/3874980091 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d4414db10 0x7f9d4414e260 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f9d440737d0 tx=0x7f9d3c011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:55:16.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.776+0000 7f9d3a7fc640 1 -- 172.21.15.18:0/3874980091 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d3c003620 con 0x7f9d4414db10 2024-04-17T19:55:16.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.776+0000 7f9d3a7fc640 1 -- 172.21.15.18:0/3874980091 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9d3c01b070 con 0x7f9d4414db10 2024-04-17T19:55:16.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.776+0000 7f9d4c137640 1 -- 172.21.15.18:0/3874980091 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d44156370 con 0x7f9d4414db10 2024-04-17T19:55:16.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.776+0000 7f9d3a7fc640 1 -- 172.21.15.18:0/3874980091 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d3c003a20 con 0x7f9d4414db10 2024-04-17T19:55:16.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.776+0000 7f9d4c137640 1 -- 172.21.15.18:0/3874980091 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d4414eda0 con 0x7f9d4414db10 2024-04-17T19:55:16.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.776+0000 7f9d4c137640 1 -- 172.21.15.18:0/3874980091 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d44069950 con 0x7f9d4414db10 2024-04-17T19:55:16.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.776+0000 7f9d3a7fc640 1 -- 172.21.15.18:0/3874980091 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9d3c003bc0 con 0x7f9d4414db10 2024-04-17T19:55:16.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.780+0000 7f9d3a7fc640 1 --2- 172.21.15.18:0/3874980091 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f9d280683b0 0x7f9d2806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:16.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.780+0000 7f9d3a7fc640 1 -- 172.21.15.18:0/3874980091 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6771+0+0 (secure 0 0 0) 0x7f9d3c086ff0 con 0x7f9d4414db10 2024-04-17T19:55:16.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.780+0000 7f9d49ed3640 1 --2- 172.21.15.18:0/3874980091 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f9d280683b0 0x7f9d2806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:16.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.780+0000 7f9d49ed3640 1 --2- 172.21.15.18:0/3874980091 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f9d280683b0 0x7f9d2806a8c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9d400ad000 tx=0x7f9d4415e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:55:16.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.784+0000 7f9d3a7fc640 1 -- 172.21.15.18:0/3874980091 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9d3c0570b0 con 0x7f9d4414db10 2024-04-17T19:55:16.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:16.940+0000 7f9d4c137640 1 -- 172.21.15.18:0/3874980091 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9d440d1960 con 0x7f9d4414db10 2024-04-17T19:55:17.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.596+0000 7f9d3a7fc640 1 -- 172.21.15.18:0/3874980091 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v31) ==== 181+0+0 (secure 0 0 0) 0x7f9d3c0569b0 con 0x7f9d4414db10 2024-04-17T19:55:17.597 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' removed 2024-04-17T19:55:17.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.604+0000 7f9d4c137640 1 -- 172.21.15.18:0/3874980091 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f9d280683b0 msgr2=0x7f9d2806a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:17.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.604+0000 7f9d4c137640 1 --2- 172.21.15.18:0/3874980091 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f9d280683b0 0x7f9d2806a8c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9d400ad000 tx=0x7f9d4415e000 comp rx=0 tx=0).stop 2024-04-17T19:55:17.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.604+0000 7f9d4c137640 1 -- 172.21.15.18:0/3874980091 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d4414db10 msgr2=0x7f9d4414e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:17.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.604+0000 7f9d4c137640 1 --2- 172.21.15.18:0/3874980091 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d4414db10 0x7f9d4414e260 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f9d440737d0 tx=0x7f9d3c011920 comp rx=0 tx=0).stop 2024-04-17T19:55:17.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.608+0000 7f9d4c137640 1 -- 172.21.15.18:0/3874980091 shutdown_connections 2024-04-17T19:55:17.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.608+0000 7f9d4c137640 1 --2- 172.21.15.18:0/3874980091 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f9d280683b0 0x7f9d2806a8c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:17.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.608+0000 7f9d4c137640 1 --2- 172.21.15.18:0/3874980091 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d4414db10 0x7f9d4414e260 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:17.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.608+0000 7f9d4c137640 1 --2- 172.21.15.18:0/3874980091 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9d440b00f0 0x7f9d44156e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:17.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.608+0000 7f9d4c137640 1 --2- 172.21.15.18:0/3874980091 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d300039f0 0x7f9d440af420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:17.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.608+0000 7f9d4c137640 1 -- 172.21.15.18:0/3874980091 >> 172.21.15.18:0/3874980091 conn(0x7f9d440b6990 msgr2=0x7f9d4406c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:55:17.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.608+0000 7f9d4c137640 1 -- 172.21.15.18:0/3874980091 shutdown_connections 2024-04-17T19:55:17.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.608+0000 7f9d4c137640 1 -- 172.21.15.18:0/3874980091 wait complete. 2024-04-17T19:55:17.629 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-17T19:55:17.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.792+0000 7fc1eb280640 1 Processor -- start 2024-04-17T19:55:17.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.792+0000 7fc1eb280640 1 -- start start 2024-04-17T19:55:17.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.796+0000 7fc1eb280640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc1e406cd60 0x7fc1e406d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:17.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.796+0000 7fc1eb280640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc1e415c7c0 0x7fc1e415cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:17.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.796+0000 7fc1eb280640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1e415fc90 con 0x7fc1e406f9f0 2024-04-17T19:55:17.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.796+0000 7fc1eb280640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fc1e415e7d0 con 0x7fc1e415c7c0 2024-04-17T19:55:17.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.796+0000 7fc1eb280640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 -- 0x7fc1e406d6b0 con 0x7fc1e406cd60 2024-04-17T19:55:17.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.796+0000 7fc1e881b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc1e415c7c0 0x7fc1e415cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:17.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.796+0000 7fc1e881b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc1e415c7c0 0x7fc1e415cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46846/0 (socket says 172.21.15.18:46846) 2024-04-17T19:55:17.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.796+0000 7fc1e881b640 1 -- 172.21.15.18:0/117976802 learned_addr learned my addr 172.21.15.18:0/117976802 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:55:17.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.796+0000 7fc1e901c640 1 --2- 172.21.15.18:0/117976802 >> v2:172.21.15.173:3300/0 conn(0x7fc1e406cd60 0x7fc1e406d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:17.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.796+0000 7fc1e881b640 1 -- 172.21.15.18:0/117976802 >> v2:172.21.15.173:3300/0 conn(0x7fc1e406cd60 msgr2=0x7fc1e406d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:55:17.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.796+0000 7fc1e881b640 1 --2- 172.21.15.18:0/117976802 >> v2:172.21.15.173:3300/0 conn(0x7fc1e406cd60 0x7fc1e406d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:17.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.796+0000 7fc1e881b640 1 -- 172.21.15.18:0/117976802 >> v1:172.21.15.173:6789/0 conn(0x7fc1e406f9f0 legacy=0x7fc1e406fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:55:17.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.796+0000 7fc1e881b640 1 -- 172.21.15.18:0/117976802 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1e4142870 con 0x7fc1e415c7c0 2024-04-17T19:55:17.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.796+0000 7fc1e901c640 1 --2- 172.21.15.18:0/117976802 >> v2:172.21.15.173:3300/0 conn(0x7fc1e406cd60 0x7fc1e406d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-17T19:55:17.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.800+0000 7fc1e881b640 1 --2- 172.21.15.18:0/117976802 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1e415c7c0 0x7fc1e415cbd0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc1e40b48b0 tx=0x7fc1d401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51eff2dcf8a4a587 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:55:17.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.800+0000 7fc1dbfff640 1 -- 172.21.15.18:0/117976802 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d40b1070 con 0x7fc1e415c7c0 2024-04-17T19:55:17.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.800+0000 7fc1dbfff640 1 -- 172.21.15.18:0/117976802 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc1d40a8050 con 0x7fc1e415c7c0 2024-04-17T19:55:17.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.800+0000 7fc1dbfff640 1 -- 172.21.15.18:0/117976802 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d40ac880 con 0x7fc1e415c7c0 2024-04-17T19:55:17.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.800+0000 7fc1eb280640 1 -- 172.21.15.18:0/117976802 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1e415c7c0 msgr2=0x7fc1e415cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:17.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.800+0000 7fc1eb280640 1 --2- 172.21.15.18:0/117976802 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1e415c7c0 0x7fc1e415cbd0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc1e40b48b0 tx=0x7fc1d401c3e0 comp rx=0 tx=0).stop 2024-04-17T19:55:17.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.800+0000 7fc1eb280640 1 -- 172.21.15.18:0/117976802 shutdown_connections 2024-04-17T19:55:17.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.800+0000 7fc1eb280640 1 --2- 172.21.15.18:0/117976802 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1e415c7c0 0x7fc1e415cbd0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:17.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.800+0000 7fc1eb280640 1 --2- 172.21.15.18:0/117976802 >> v2:172.21.15.173:3300/0 conn(0x7fc1e406cd60 0x7fc1e406d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:17.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.800+0000 7fc1eb280640 1 -- 172.21.15.18:0/117976802 >> 172.21.15.18:0/117976802 conn(0x7fc1e4072bb0 msgr2=0x7fc1e4072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:55:17.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.800+0000 7fc1eb280640 1 -- 172.21.15.18:0/117976802 shutdown_connections 2024-04-17T19:55:17.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.800+0000 7fc1eb280640 1 -- 172.21.15.18:0/117976802 wait complete. 2024-04-17T19:55:17.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.804+0000 7fc1eb280640 1 Processor -- start 2024-04-17T19:55:17.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.804+0000 7fc1eb280640 1 -- start start 2024-04-17T19:55:17.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.804+0000 7fc1eb280640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1e406cd60 0x7fc1e4138c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:17.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.804+0000 7fc1eb280640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1e406f9f0 0x7fc1e4136040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:17.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.804+0000 7fc1eb280640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc1e415c7c0 0x7fc1e4131ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:17.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.804+0000 7fc1eb280640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e41609e0 con 0x7fc1e406cd60 2024-04-17T19:55:17.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.804+0000 7fc1eb280640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e415d4f0 con 0x7fc1e406f9f0 2024-04-17T19:55:17.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.804+0000 7fc1eb280640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7fc1e4132bc0 con 0x7fc1e415c7c0 2024-04-17T19:55:17.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.804+0000 7fc1e901c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1e406cd60 0x7fc1e4138c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:17.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.804+0000 7fc1e901c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1e406cd60 0x7fc1e4138c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46852/0 (socket says 172.21.15.18:46852) 2024-04-17T19:55:17.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.804+0000 7fc1e901c640 1 -- 172.21.15.18:0/1425672428 learned_addr learned my addr 172.21.15.18:0/1425672428 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:55:17.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.804+0000 7fc1e881b640 1 --2- 172.21.15.18:0/1425672428 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1e406f9f0 0x7fc1e4136040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:17.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.804+0000 7fc1e901c640 1 -- 172.21.15.18:0/1425672428 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc1e415c7c0 msgr2=0x7fc1e4131ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:17.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.804+0000 7fc1e901c640 1 --2- 172.21.15.18:0/1425672428 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc1e415c7c0 0x7fc1e4131ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:17.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.804+0000 7fc1e901c640 1 -- 172.21.15.18:0/1425672428 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1e406f9f0 msgr2=0x7fc1e4136040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:17.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.804+0000 7fc1e901c640 1 --2- 172.21.15.18:0/1425672428 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1e406f9f0 0x7fc1e4136040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:17.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.804+0000 7fc1e901c640 1 -- 172.21.15.18:0/1425672428 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1e4136c80 con 0x7fc1e406cd60 2024-04-17T19:55:17.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.804+0000 7fc1e881b640 1 --2- 172.21.15.18:0/1425672428 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1e406f9f0 0x7fc1e4136040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:55:17.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.804+0000 7fc1e901c640 1 --2- 172.21.15.18:0/1425672428 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1e406cd60 0x7fc1e4138c70 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fc1e000d800 tx=0x7fc1e000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:55:17.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.804+0000 7fc1d9ffb640 1 -- 172.21.15.18:0/1425672428 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e000b6c0 con 0x7fc1e406cd60 2024-04-17T19:55:17.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.804+0000 7fc1d9ffb640 1 -- 172.21.15.18:0/1425672428 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc1e0019070 con 0x7fc1e406cd60 2024-04-17T19:55:17.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.804+0000 7fc1d9ffb640 1 -- 172.21.15.18:0/1425672428 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e000bac0 con 0x7fc1e406cd60 2024-04-17T19:55:17.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.804+0000 7fc1eb280640 1 -- 172.21.15.18:0/1425672428 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1e4136f60 con 0x7fc1e406cd60 2024-04-17T19:55:17.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.808+0000 7fc1eb280640 1 -- 172.21.15.18:0/1425672428 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1e4138750 con 0x7fc1e406cd60 2024-04-17T19:55:17.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.808+0000 7fc1eb280640 1 -- 172.21.15.18:0/1425672428 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1e4069950 con 0x7fc1e406cd60 2024-04-17T19:55:17.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.808+0000 7fc1d9ffb640 1 -- 172.21.15.18:0/1425672428 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc1e000bc60 con 0x7fc1e406cd60 2024-04-17T19:55:17.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.808+0000 7fc1d9ffb640 1 --2- 172.21.15.18:0/1425672428 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fc1c80683b0 0x7fc1c806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:17.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.808+0000 7fc1e881b640 1 --2- 172.21.15.18:0/1425672428 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fc1c80683b0 0x7fc1c806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:17.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.808+0000 7fc1d9ffb640 1 -- 172.21.15.18:0/1425672428 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6333+0+0 (secure 0 0 0) 0x7fc1e0087bc0 con 0x7fc1e406cd60 2024-04-17T19:55:17.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.808+0000 7fc1e881b640 1 --2- 172.21.15.18:0/1425672428 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fc1c80683b0 0x7fc1c806a8c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc1d40ae000 tx=0x7fc1d4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:55:17.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.812+0000 7fc1d9ffb640 1 -- 172.21.15.18:0/1425672428 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc1e0057810 con 0x7fc1e406cd60 2024-04-17T19:55:17.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:17.976+0000 7fc1eb280640 1 -- 172.21.15.18:0/1425672428 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc1e4137130 con 0x7fc1e406cd60 2024-04-17T19:55:18.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.608+0000 7fc1d9ffb640 1 -- 172.21.15.18:0/1425672428 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v32) ==== 169+0+0 (secure 0 0 0) 0x7fc1e005bb10 con 0x7fc1e406cd60 2024-04-17T19:55:18.606 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' removed 2024-04-17T19:55:18.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.616+0000 7fc1eb280640 1 -- 172.21.15.18:0/1425672428 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fc1c80683b0 msgr2=0x7fc1c806a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:18.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.616+0000 7fc1eb280640 1 --2- 172.21.15.18:0/1425672428 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fc1c80683b0 0x7fc1c806a8c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc1d40ae000 tx=0x7fc1d4008040 comp rx=0 tx=0).stop 2024-04-17T19:55:18.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.616+0000 7fc1eb280640 1 -- 172.21.15.18:0/1425672428 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1e406cd60 msgr2=0x7fc1e4138c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:18.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.616+0000 7fc1eb280640 1 --2- 172.21.15.18:0/1425672428 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1e406cd60 0x7fc1e4138c70 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fc1e000d800 tx=0x7fc1e000dcc0 comp rx=0 tx=0).stop 2024-04-17T19:55:18.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.616+0000 7fc1eb280640 1 -- 172.21.15.18:0/1425672428 shutdown_connections 2024-04-17T19:55:18.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.616+0000 7fc1eb280640 1 --2- 172.21.15.18:0/1425672428 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7fc1c80683b0 0x7fc1c806a8c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:18.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.616+0000 7fc1eb280640 1 --2- 172.21.15.18:0/1425672428 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc1e415c7c0 0x7fc1e4131ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:18.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.616+0000 7fc1eb280640 1 --2- 172.21.15.18:0/1425672428 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1e406f9f0 0x7fc1e4136040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:18.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.616+0000 7fc1eb280640 1 --2- 172.21.15.18:0/1425672428 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1e406cd60 0x7fc1e4138c70 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:18.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.616+0000 7fc1eb280640 1 -- 172.21.15.18:0/1425672428 >> 172.21.15.18:0/1425672428 conn(0x7fc1e4072bb0 msgr2=0x7fc1e40b5180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:55:18.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.616+0000 7fc1eb280640 1 -- 172.21.15.18:0/1425672428 shutdown_connections 2024-04-17T19:55:18.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.616+0000 7fc1eb280640 1 -- 172.21.15.18:0/1425672428 wait complete. 2024-04-17T19:55:18.643 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-04-17T19:55:18.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.808+0000 7f796beeb640 1 Processor -- start 2024-04-17T19:55:18.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.808+0000 7f796beeb640 1 -- start start 2024-04-17T19:55:18.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.812+0000 7f796beeb640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f79640b0120 0x7f796415f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:18.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.812+0000 7f796beeb640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79641607b0 con 0x7f796406cd60 2024-04-17T19:55:18.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.812+0000 7f796beeb640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79640b0530 con 0x7f79640b44b0 2024-04-17T19:55:18.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.812+0000 7f796beeb640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f796415ff10 con 0x7f79640b0120 2024-04-17T19:55:18.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.812+0000 7f7969486640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f796406cd60 0x7f796406d170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:42446/0 (socket says 172.21.15.18:42446) 2024-04-17T19:55:18.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.812+0000 7f7969486640 1 -- 172.21.15.18:0/2280158578 learned_addr learned my addr 172.21.15.18:0/2280158578 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-17T19:55:18.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.812+0000 7f7969c87640 1 --2- 172.21.15.18:0/2280158578 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f79640b0120 0x7f796415f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:18.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.812+0000 7f7968c85640 1 -- 172.21.15.18:0/2280158578 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3281702179 0 0) 0x7f79641607b0 con 0x7f796406cd60 2024-04-17T19:55:18.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.812+0000 7f7968c85640 1 -- 172.21.15.18:0/2280158578 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f794c003530 con 0x7f796406cd60 2024-04-17T19:55:18.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.812+0000 7f7968c85640 1 -- 172.21.15.18:0/2280158578 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1384278027 0 0) 0x7f794c003530 con 0x7f796406cd60 2024-04-17T19:55:18.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.812+0000 7f7968c85640 1 -- 172.21.15.18:0/2280158578 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f79640b0120 msgr2=0x7f796415f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:55:18.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.812+0000 7f7968c85640 1 --2- 172.21.15.18:0/2280158578 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f79640b0120 0x7f796415f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:18.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.812+0000 7f7968c85640 1 -- 172.21.15.18:0/2280158578 >> v1:172.21.15.173:6789/0 conn(0x7f79640b44b0 legacy=0x7f79640b48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:18.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.812+0000 7f7968c85640 1 -- 172.21.15.18:0/2280158578 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79641601f0 con 0x7f796406cd60 2024-04-17T19:55:18.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.812+0000 7f7968c85640 1 -- 172.21.15.18:0/2280158578 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3208559991 0 0) 0x7f7958001a00 con 0x7f796406cd60 2024-04-17T19:55:18.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.812+0000 7f7968c85640 1 -- 172.21.15.18:0/2280158578 >> v1:172.21.15.18:6789/0 conn(0x7f796406cd60 legacy=0x7f796406d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:18.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.812+0000 7f7968c85640 1 --2- 172.21.15.18:0/2280158578 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f794c0039f0 0x7f794c003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:18.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.812+0000 7f7968c85640 1 --2- 172.21.15.18:0/2280158578 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f79640b0120 0x7f794c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:18.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.812+0000 7f7968c85640 1 --2- 172.21.15.18:0/2280158578 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f794c004d50 0x7f794c005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:18.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.812+0000 7f7968c85640 1 -- 172.21.15.18:0/2280158578 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f796415ff10 con 0x7f794c004d50 2024-04-17T19:55:18.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.812+0000 7f7968c85640 1 -- 172.21.15.18:0/2280158578 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f794c00bb00 con 0x7f794c0039f0 2024-04-17T19:55:18.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.812+0000 7f7968c85640 1 -- 172.21.15.18:0/2280158578 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f794c00bd00 con 0x7f79640b0120 2024-04-17T19:55:18.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.812+0000 7f796a488640 1 --2- 172.21.15.18:0/2280158578 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f794c004d50 0x7f794c005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:18.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.812+0000 7f7969486640 1 --2- 172.21.15.18:0/2280158578 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f79640b0120 0x7f794c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:18.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.812+0000 7f7969c87640 1 --2- 172.21.15.18:0/2280158578 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f794c0039f0 0x7f794c003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:18.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.812+0000 7f796a488640 1 -- 172.21.15.18:0/2280158578 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f79640b0120 msgr2=0x7f794c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:55:18.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.812+0000 7f796a488640 1 --2- 172.21.15.18:0/2280158578 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f79640b0120 0x7f794c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:18.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.812+0000 7f796a488640 1 -- 172.21.15.18:0/2280158578 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f794c0039f0 msgr2=0x7f794c003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-17T19:55:18.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.812+0000 7f796a488640 1 --2- 172.21.15.18:0/2280158578 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f794c0039f0 0x7f794c003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:18.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.812+0000 7f796a488640 1 -- 172.21.15.18:0/2280158578 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f794c003530 con 0x7f794c004d50 2024-04-17T19:55:18.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.816+0000 7f796a488640 1 --2- 172.21.15.18:0/2280158578 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f794c004d50 0x7f794c005160 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f7964070880 tx=0x7f795401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2270e1bab8245609 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:55:18.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.816+0000 7f7968c85640 1 -- 172.21.15.18:0/2280158578 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79540013a0 con 0x7f794c004d50 2024-04-17T19:55:18.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.816+0000 7f7968c85640 1 -- 172.21.15.18:0/2280158578 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f79540052f0 con 0x7f794c004d50 2024-04-17T19:55:18.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.816+0000 7f7968c85640 1 -- 172.21.15.18:0/2280158578 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7954003860 con 0x7f794c004d50 2024-04-17T19:55:18.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.816+0000 7f796beeb640 1 -- 172.21.15.18:0/2280158578 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f794c004d50 msgr2=0x7f794c005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:18.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.816+0000 7f796beeb640 1 --2- 172.21.15.18:0/2280158578 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f794c004d50 0x7f794c005160 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f7964070880 tx=0x7f795401c3c0 comp rx=0 tx=0).stop 2024-04-17T19:55:18.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.816+0000 7f796a488640 1 -- 172.21.15.18:0/2280158578 reap_dead start 2024-04-17T19:55:18.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.816+0000 7f796beeb640 1 -- 172.21.15.18:0/2280158578 shutdown_connections 2024-04-17T19:55:18.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.816+0000 7f796beeb640 1 -- 172.21.15.18:0/2280158578 >> 172.21.15.18:0/2280158578 conn(0x7f7964072bb0 msgr2=0x7f7964072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:55:18.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.816+0000 7f796beeb640 1 -- 172.21.15.18:0/2280158578 shutdown_connections 2024-04-17T19:55:18.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.816+0000 7f796beeb640 1 -- 172.21.15.18:0/2280158578 wait complete. 2024-04-17T19:55:18.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.816+0000 7f796beeb640 1 Processor -- start 2024-04-17T19:55:18.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.820+0000 7f796beeb640 1 -- start start 2024-04-17T19:55:18.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.820+0000 7f796beeb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7964150fb0 0x7f796414fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:18.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.820+0000 7f796beeb640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f796414eb60 0x7f79641551b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:18.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.820+0000 7f796beeb640 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f796414ef70 0x7f79641556f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:18.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.820+0000 7f796beeb640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f796415f830 con 0x7f7964150fb0 2024-04-17T19:55:18.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.820+0000 7f796beeb640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f79640b3f90 con 0x7f796414eb60 2024-04-17T19:55:18.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.820+0000 7f796beeb640 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 -- 0x7f796415f9b0 con 0x7f796414ef70 2024-04-17T19:55:18.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.820+0000 7f7969c87640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7964150fb0 0x7f796414fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:18.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.820+0000 7f7969c87640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7964150fb0 0x7f796414fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46868/0 (socket says 172.21.15.18:46868) 2024-04-17T19:55:18.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.820+0000 7f7969c87640 1 -- 172.21.15.18:0/1446975038 learned_addr learned my addr 172.21.15.18:0/1446975038 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-17T19:55:18.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.820+0000 7f7969486640 1 --2- 172.21.15.18:0/1446975038 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f796414eb60 0x7f79641551b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:18.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.820+0000 7f796a488640 1 --2- 172.21.15.18:0/1446975038 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f796414ef70 0x7f79641556f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:18.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.820+0000 7f7969c87640 1 -- 172.21.15.18:0/1446975038 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f796414ef70 msgr2=0x7f79641556f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:18.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.820+0000 7f7969c87640 1 --2- 172.21.15.18:0/1446975038 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f796414ef70 0x7f79641556f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:18.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.820+0000 7f7969c87640 1 -- 172.21.15.18:0/1446975038 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f796414eb60 msgr2=0x7f79641551b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:18.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.820+0000 7f7969c87640 1 --2- 172.21.15.18:0/1446975038 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f796414eb60 0x7f79641551b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:18.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.820+0000 7f7969c87640 1 -- 172.21.15.18:0/1446975038 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79641513c0 con 0x7f7964150fb0 2024-04-17T19:55:18.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.820+0000 7f796a488640 1 --2- 172.21.15.18:0/1446975038 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f796414ef70 0x7f79641556f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-17T19:55:18.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.820+0000 7f7969c87640 1 --2- 172.21.15.18:0/1446975038 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7964150fb0 0x7f796414fea0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f795c011930 tx=0x7f795c011df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:55:18.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.820+0000 7f79627fc640 1 -- 172.21.15.18:0/1446975038 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f795c00faf0 con 0x7f7964150fb0 2024-04-17T19:55:18.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.820+0000 7f79627fc640 1 -- 172.21.15.18:0/1446975038 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f795c00fc90 con 0x7f7964150fb0 2024-04-17T19:55:18.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.820+0000 7f796beeb640 1 -- 172.21.15.18:0/1446975038 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79641505f0 con 0x7f7964150fb0 2024-04-17T19:55:18.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.820+0000 7f79627fc640 1 -- 172.21.15.18:0/1446975038 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f795c014440 con 0x7f7964150fb0 2024-04-17T19:55:18.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.820+0000 7f796beeb640 1 -- 172.21.15.18:0/1446975038 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79641549b0 con 0x7f7964150fb0 2024-04-17T19:55:18.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.820+0000 7f796beeb640 1 -- 172.21.15.18:0/1446975038 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7964069950 con 0x7f7964150fb0 2024-04-17T19:55:18.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.824+0000 7f79627fc640 1 -- 172.21.15.18:0/1446975038 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f795c012040 con 0x7f7964150fb0 2024-04-17T19:55:18.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.824+0000 7f79627fc640 1 --2- 172.21.15.18:0/1446975038 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f7950068380 0x7f795006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-17T19:55:18.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.824+0000 7f79627fc640 1 -- 172.21.15.18:0/1446975038 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5890+0+0 (secure 0 0 0) 0x7f795c087240 con 0x7f7964150fb0 2024-04-17T19:55:18.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.824+0000 7f7969486640 1 --2- 172.21.15.18:0/1446975038 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f7950068380 0x7f795006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-17T19:55:18.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.824+0000 7f7969486640 1 --2- 172.21.15.18:0/1446975038 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f7950068380 0x7f795006a890 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7958004bd0 tx=0x7f7958006040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-17T19:55:18.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.828+0000 7f79627fc640 1 -- 172.21.15.18:0/1446975038 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f79641513c0 con 0x7f7964150fb0 2024-04-17T19:55:18.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:18.992+0000 7f796beeb640 1 -- 172.21.15.18:0/1446975038 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f79640d01f0 con 0x7f7964150fb0 2024-04-17T19:55:19.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:19.616+0000 7f79627fc640 1 -- 172.21.15.18:0/1446975038 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v33) ==== 178+0+0 (secure 0 0 0) 0x7f795c019030 con 0x7f7964150fb0 2024-04-17T19:55:19.618 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data_ec' removed 2024-04-17T19:55:19.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:19.624+0000 7f796beeb640 1 -- 172.21.15.18:0/1446975038 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f7950068380 msgr2=0x7f795006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:19.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:19.624+0000 7f796beeb640 1 --2- 172.21.15.18:0/1446975038 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f7950068380 0x7f795006a890 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7958004bd0 tx=0x7f7958006040 comp rx=0 tx=0).stop 2024-04-17T19:55:19.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:19.624+0000 7f796beeb640 1 -- 172.21.15.18:0/1446975038 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7964150fb0 msgr2=0x7f796414fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-17T19:55:19.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:19.624+0000 7f796beeb640 1 --2- 172.21.15.18:0/1446975038 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7964150fb0 0x7f796414fea0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f795c011930 tx=0x7f795c011df0 comp rx=0 tx=0).stop 2024-04-17T19:55:19.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:19.624+0000 7f796beeb640 1 -- 172.21.15.18:0/1446975038 shutdown_connections 2024-04-17T19:55:19.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:19.624+0000 7f796beeb640 1 --2- 172.21.15.18:0/1446975038 >> [v2:172.21.15.18:6832/751466605,v1:172.21.15.18:6833/751466605] conn(0x7f7950068380 0x7f795006a890 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:19.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:19.624+0000 7f796beeb640 1 --2- 172.21.15.18:0/1446975038 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f796414ef70 0x7f79641556f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:19.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:19.624+0000 7f796beeb640 1 --2- 172.21.15.18:0/1446975038 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f796414eb60 0x7f79641551b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:19.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:19.624+0000 7f796beeb640 1 --2- 172.21.15.18:0/1446975038 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7964150fb0 0x7f796414fea0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-17T19:55:19.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:19.624+0000 7f796beeb640 1 -- 172.21.15.18:0/1446975038 >> 172.21.15.18:0/1446975038 conn(0x7f7964072bb0 msgr2=0x7f7964158550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-17T19:55:19.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:19.624+0000 7f796beeb640 1 -- 172.21.15.18:0/1446975038 shutdown_connections 2024-04-17T19:55:19.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-17T19:55:19.624+0000 7f796beeb640 1 -- 172.21.15.18:0/1446975038 wait complete. 2024-04-17T19:55:19.648 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-17T19:55:19.648 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-17T19:55:19.648 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T19:55:19.663 INFO:tasks.ceph.mds.a:Stopped 2024-04-17T19:55:19.663 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-17T19:55:19.663 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T19:55:19.722 INFO:tasks.ceph.mds.c:Stopped 2024-04-17T19:55:19.723 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-17T19:55:19.723 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T19:55:19.743 INFO:tasks.ceph.mds.b:Stopped 2024-04-17T19:55:19.743 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-17T19:55:19.743 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T19:55:19.802 INFO:tasks.ceph.mds.d:Stopped 2024-04-17T19:55:19.802 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-17T19:55:19.803 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-17T19:55:19.803 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T19:55:19.881 INFO:tasks.ceph.osd.0:Stopped 2024-04-17T19:55:19.881 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-17T19:55:19.882 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T19:55:25.983 INFO:tasks.ceph.osd.1:Stopped 2024-04-17T19:55:25.984 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-17T19:55:25.984 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T19:55:26.062 INFO:tasks.ceph.osd.2:Stopped 2024-04-17T19:55:26.062 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-17T19:55:26.062 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T19:55:26.153 INFO:tasks.ceph.osd.3:Stopped 2024-04-17T19:55:26.153 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-17T19:55:26.153 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T19:55:26.219 INFO:tasks.ceph.osd.4:Stopped 2024-04-17T19:55:26.219 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-17T19:55:26.220 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T19:55:26.293 INFO:tasks.ceph.osd.5:Stopped 2024-04-17T19:55:26.294 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-17T19:55:26.294 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T19:55:26.387 INFO:tasks.ceph.osd.6:Stopped 2024-04-17T19:55:26.388 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-17T19:55:26.388 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T19:55:26.468 INFO:tasks.ceph.osd.7:Stopped 2024-04-17T19:55:26.468 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-17T19:55:26.468 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-17T19:55:26.469 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T19:55:26.501 INFO:tasks.ceph.mgr.y:Stopped 2024-04-17T19:55:26.501 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-17T19:55:26.501 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T19:55:26.533 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-04-17T19:55:26.533 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2024-04-17T19:55:26.533 INFO:tasks.ceph.mgr.x:Stopped 2024-04-17T19:55:26.533 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-17T19:55:26.534 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-17T19:55:26.534 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T19:55:26.570 INFO:tasks.ceph.mon.a:Stopped 2024-04-17T19:55:26.571 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-17T19:55:26.571 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T19:55:26.596 INFO:tasks.ceph.mon.b:Stopped 2024-04-17T19:55:26.596 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-17T19:55:26.596 INFO:teuthology.orchestra.run:waiting for 300 2024-04-17T19:55:26.656 INFO:tasks.ceph.mon.c:Stopped 2024-04-17T19:55:26.656 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-17T19:55:26.656 DEBUG:teuthology.orchestra.run.smithi018:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-04-17T19:55:26.675 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi018.front.sepia.ceph.com 2024-04-17T19:55:26.675 DEBUG:teuthology.orchestra.run.smithi018:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-17T19:55:27.071 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi018.front.sepia.ceph.com 2024-04-17T19:55:27.071 DEBUG:teuthology.orchestra.run.smithi018:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-17T19:55:27.392 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi018.front.sepia.ceph.com 2024-04-17T19:55:27.392 DEBUG:teuthology.orchestra.run.smithi018:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-17T19:55:27.551 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi018.front.sepia.ceph.com 2024-04-17T19:55:27.551 DEBUG:teuthology.orchestra.run.smithi018:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-17T19:55:27.759 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi173.front.sepia.ceph.com 2024-04-17T19:55:27.759 DEBUG:teuthology.orchestra.run.smithi173:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-17T19:55:28.077 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi173.front.sepia.ceph.com 2024-04-17T19:55:28.077 DEBUG:teuthology.orchestra.run.smithi173:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-17T19:55:28.271 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi173.front.sepia.ceph.com 2024-04-17T19:55:28.271 DEBUG:teuthology.orchestra.run.smithi173:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-17T19:55:28.453 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi173.front.sepia.ceph.com 2024-04-17T19:55:28.453 DEBUG:teuthology.orchestra.run.smithi173:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-17T19:55:28.630 INFO:tasks.ceph:Archiving mon data... 2024-04-17T19:55:28.631 DEBUG:teuthology.misc:Transferring archived files from smithi018:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-04-17_17:06:06-fs-wip-pdonnell-testing-20240417.021458-debug-distro-default-smithi/7660584/data/mon.a.tgz 2024-04-17T19:55:28.631 DEBUG:teuthology.orchestra.run.smithi018:> mktemp 2024-04-17T19:55:28.637 INFO:teuthology.orchestra.run.smithi018.stdout:/tmp/tmp.KO8vZ7MdXB 2024-04-17T19:55:28.638 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.KO8vZ7MdXB 2024-04-17T19:55:28.753 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 0666 /tmp/tmp.KO8vZ7MdXB 2024-04-17T19:55:28.818 DEBUG:teuthology.orchestra.remote:smithi018:/tmp/tmp.KO8vZ7MdXB is 289KB 2024-04-17T19:55:28.879 DEBUG:teuthology.orchestra.run.smithi018:> rm -fr /tmp/tmp.KO8vZ7MdXB 2024-04-17T19:55:28.885 DEBUG:teuthology.misc:Transferring archived files from smithi173:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-04-17_17:06:06-fs-wip-pdonnell-testing-20240417.021458-debug-distro-default-smithi/7660584/data/mon.b.tgz 2024-04-17T19:55:28.885 DEBUG:teuthology.orchestra.run.smithi173:> mktemp 2024-04-17T19:55:28.891 INFO:teuthology.orchestra.run.smithi173.stdout:/tmp/tmp.4eidgKW2rc 2024-04-17T19:55:28.891 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.4eidgKW2rc 2024-04-17T19:55:29.023 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 0666 /tmp/tmp.4eidgKW2rc 2024-04-17T19:55:29.085 DEBUG:teuthology.orchestra.remote:smithi173:/tmp/tmp.4eidgKW2rc is 390KB 2024-04-17T19:55:29.143 DEBUG:teuthology.orchestra.run.smithi173:> rm -fr /tmp/tmp.4eidgKW2rc 2024-04-17T19:55:29.148 DEBUG:teuthology.misc:Transferring archived files from smithi173:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-04-17_17:06:06-fs-wip-pdonnell-testing-20240417.021458-debug-distro-default-smithi/7660584/data/mon.c.tgz 2024-04-17T19:55:29.148 DEBUG:teuthology.orchestra.run.smithi173:> mktemp 2024-04-17T19:55:29.192 INFO:teuthology.orchestra.run.smithi173.stdout:/tmp/tmp.LE7cmCZRuM 2024-04-17T19:55:29.193 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.LE7cmCZRuM 2024-04-17T19:55:29.331 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 0666 /tmp/tmp.LE7cmCZRuM 2024-04-17T19:55:29.397 DEBUG:teuthology.orchestra.remote:smithi173:/tmp/tmp.LE7cmCZRuM is 390KB 2024-04-17T19:55:29.455 DEBUG:teuthology.orchestra.run.smithi173:> rm -fr /tmp/tmp.LE7cmCZRuM 2024-04-17T19:55:29.460 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-17T19:55:29.460 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-17T19:55:29.462 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-17T19:55:29.522 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-17T19:55:29.561 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-17T19:55:29.561 INFO:tasks.ceph:Archiving crash dumps... 2024-04-17T19:55:29.563 DEBUG:teuthology.misc:Transferring archived files from smithi018:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-04-17_17:06:06-fs-wip-pdonnell-testing-20240417.021458-debug-distro-default-smithi/7660584/remote/smithi018/crash 2024-04-17T19:55:29.563 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-17T19:55:29.578 DEBUG:teuthology.misc:Transferring archived files from smithi173:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-04-17_17:06:06-fs-wip-pdonnell-testing-20240417.021458-debug-distro-default-smithi/7660584/remote/smithi173/crash 2024-04-17T19:55:29.579 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-17T19:55:29.616 INFO:tasks.ceph:Shutting down logrotate 2024-04-17T19:55:29.616 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T19:55:29.622 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-17T19:55:29.709 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-17T19:55:29.722 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-17T19:55:29.734 INFO:tasks.ceph:Compressing logs... 2024-04-17T19:55:29.734 DEBUG:teuthology.orchestra.run.smithi018:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-17T19:55:29.766 DEBUG:teuthology.orchestra.run.smithi173:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-17T19:55:29.781 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37268.log 2024-04-17T19:55:29.782 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34242.log 2024-04-17T19:55:29.782 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37268.log: gzip -5 88.6% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.37268.log.gz /var/log/ceph/ceph-mgr.y.log 2024-04-17T19:55:29.783 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-04-17T19:55:29.783 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37639.log 2024-04-17T19:55:29.783 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34242.log: /var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33401.log 2024-04-17T19:55:29.784 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37639.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34242.log.gz 2024-04-17T19:55:29.784 INFO:teuthology.orchestra.run.smithi018.stderr: 88.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.37639.log.gz 2024-04-17T19:55:29.784 INFO:teuthology.orchestra.run.smithi018.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.34945.log 2024-04-17T19:55:29.785 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33477.log 2024-04-17T19:55:29.785 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36124.log 2024-04-17T19:55:29.785 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34945.log: /var/log/ceph/ceph-client.admin.33477.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33401.log.gz 2024-04-17T19:55:29.786 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37138.log 2024-04-17T19:55:29.786 INFO:teuthology.orchestra.run.smithi018.stderr: 89.2% 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33477.log.gz -- replaced with /var/log/ceph/ceph-client.admin.34945.log.gz 2024-04-17T19:55:29.786 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-04-17T19:55:29.788 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35778.log 2024-04-17T19:55:29.788 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34290.log 2024-04-17T19:55:29.788 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37138.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36124.log.gz 2024-04-17T19:55:29.788 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35181.log 2024-04-17T19:55:29.789 INFO:teuthology.orchestra.run.smithi018.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37138.log.gz 2024-04-17T19:55:29.789 INFO:teuthology.orchestra.run.smithi018.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35778.log.gz 2024-04-17T19:55:29.789 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32992.log 2024-04-17T19:55:29.789 INFO:teuthology.orchestra.run.smithi018.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34290.log.gz 2024-04-17T19:55:29.789 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34495.log 2024-04-17T19:55:29.789 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35181.log: /var/log/ceph/ceph-client.admin.32992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35830.log 2024-04-17T19:55:29.789 INFO:teuthology.orchestra.run.smithi018.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35181.log.gz 2024-04-17T19:55:29.789 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32992.log.gz 2024-04-17T19:55:29.789 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33070.log 2024-04-17T19:55:29.792 INFO:teuthology.orchestra.run.smithi018.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34495.log.gz 2024-04-17T19:55:29.792 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34486.log 2024-04-17T19:55:29.793 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35830.log: /var/log/ceph/ceph-client.admin.33070.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-17T19:55:29.793 INFO:teuthology.orchestra.run.smithi018.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35830.log.gz 2024-04-17T19:55:29.793 INFO:teuthology.orchestra.run.smithi018.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33070.log.gz 2024-04-17T19:55:29.793 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34712.log 2024-04-17T19:55:29.793 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34486.log.gz 2024-04-17T19:55:29.793 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35103.log 2024-04-17T19:55:29.793 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.34712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34008.log 2024-04-17T19:55:29.793 INFO:teuthology.orchestra.run.smithi018.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34712.log.gz 2024-04-17T19:55:29.793 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33605.log 2024-04-17T19:55:29.793 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36496.log 2024-04-17T19:55:29.793 INFO:teuthology.orchestra.run.smithi018.stderr: 88.5%/var/log/ceph/ceph-client.admin.34008.log: -- replaced with /var/log/ceph/ceph-client.admin.35103.log.gz 2024-04-17T19:55:29.793 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36548.log 2024-04-17T19:55:29.793 INFO:teuthology.orchestra.run.smithi018.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34008.log.gz 2024-04-17T19:55:29.794 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33018.log 2024-04-17T19:55:29.794 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36548.log: 88.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.36496.log.gz -5 2024-04-17T19:55:29.794 INFO:teuthology.orchestra.run.smithi018.stderr: --verbose -- /var/log/ceph/ceph-client.admin.36626.log 2024-04-17T19:55:29.807 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27818.log 2024-04-17T19:55:29.807 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27746.log 2024-04-17T19:55:29.807 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.27818.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-17T19:55:29.807 INFO:teuthology.orchestra.run.smithi173.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.27818.log.gz 2024-04-17T19:55:29.808 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.27746.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-17T19:55:29.808 INFO:teuthology.orchestra.run.smithi173.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.27746.log.gz 2024-04-17T19:55:29.808 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27674.log 2024-04-17T19:55:29.808 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-17T19:55:29.808 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.27674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27770.log 2024-04-17T19:55:29.808 INFO:teuthology.orchestra.run.smithi173.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.27674.log.gz 2024-04-17T19:55:29.808 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.33192.log 2024-04-17T19:55:29.808 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.27770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.33073.log 2024-04-17T19:55:29.808 INFO:teuthology.orchestra.run.smithi173.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.27770.log.gz 2024-04-17T19:55:29.808 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.3.33192.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-17T19:55:29.808 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.1.33073.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-17T19:55:29.808 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27722.log 2024-04-17T19:55:29.808 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27794.log 2024-04-17T19:55:29.808 INFO:teuthology.orchestra.run.smithi173.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.1.33073.log.gz 2024-04-17T19:55:29.809 INFO:teuthology.orchestra.run.smithi173.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.3.33192.log.gz 2024-04-17T19:55:29.809 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-17T19:55:29.809 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.27722.log: /var/log/ceph/ceph-client.admin.27794.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-17T19:55:29.809 INFO:teuthology.orchestra.run.smithi173.stderr: 87.0% 88.1% -- replaced with /var/log/ceph/ceph-client.admin.27794.log.gz 2024-04-17T19:55:29.809 INFO:teuthology.orchestra.run.smithi173.stderr: -- replaced with /var/log/ceph/ceph-client.admin.27722.log.gz 2024-04-17T19:55:29.809 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-17T19:55:29.809 INFO:teuthology.orchestra.run.smithi173.stderr: 91.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-17T19:55:29.809 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-17T19:55:29.809 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-17T19:55:29.809 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-mds.b.log: 92.0% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-17T19:55:29.809 INFO:teuthology.orchestra.run.smithi173.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-17T19:55:29.809 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose 93.8% -- /var/log/ceph/ceph-client.admin.27634.log -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-17T19:55:29.809 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-17T19:55:29.809 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-17T19:55:29.809 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.27634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27698.log 2024-04-17T19:55:29.810 INFO:teuthology.orchestra.run.smithi173.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-17T19:55:29.810 INFO:teuthology.orchestra.run.smithi173.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.27634.log.gz 2024-04-17T19:55:29.810 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.admin.27698.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.27698.log.gz 2024-04-17T19:55:29.821 INFO:teuthology.orchestra.run.smithi018.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36548.log.gz 2024-04-17T19:55:29.821 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37426.log 2024-04-17T19:55:29.821 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33018.log: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.33605.log.gz 2024-04-17T19:55:29.821 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34138.log 2024-04-17T19:55:29.821 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33018.log.gz 2024-04-17T19:55:29.821 INFO:teuthology.orchestra.run.smithi018.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36626.log.gz 2024-04-17T19:55:29.821 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34296.log 2024-04-17T19:55:29.822 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34685.log 2024-04-17T19:55:29.822 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34138.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37426.log.gz 2024-04-17T19:55:29.822 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34278.log 2024-04-17T19:55:29.822 INFO:teuthology.orchestra.run.smithi018.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34138.log.gz 2024-04-17T19:55:29.822 INFO:teuthology.orchestra.run.smithi018.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34296.log.gz 2024-04-17T19:55:29.822 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35285.log 2024-04-17T19:55:29.822 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34278.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34685.log.gz 2024-04-17T19:55:29.822 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35337.log 2024-04-17T19:55:29.822 INFO:teuthology.orchestra.run.smithi018.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34278.log.gz 2024-04-17T19:55:29.822 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36574.log 2024-04-17T19:55:29.822 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35337.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35285.log.gz 2024-04-17T19:55:29.822 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37242.log 2024-04-17T19:55:29.822 INFO:teuthology.orchestra.run.smithi018.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.35337.log.gz 2024-04-17T19:55:29.822 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35233.log 2024-04-17T19:55:29.823 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34034.log 2024-04-17T19:55:29.823 INFO:teuthology.orchestra.run.smithi018.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36574.log.gz 2024-04-17T19:55:29.823 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37242.log: /var/log/ceph/ceph-client.admin.35233.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-17T19:55:29.823 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37242.log.gz 2024-04-17T19:55:29.823 INFO:teuthology.orchestra.run.smithi018.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35233.log.gz 2024-04-17T19:55:29.823 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37452.log 2024-04-17T19:55:29.823 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34034.log.gz 2024-04-17T19:55:29.823 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37767.log 2024-04-17T19:55:29.823 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34919.log 2024-04-17T19:55:29.823 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37767.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37452.log.gz 2024-04-17T19:55:29.823 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37715.log 2024-04-17T19:55:29.823 INFO:teuthology.orchestra.run.smithi018.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37767.log.gz 2024-04-17T19:55:29.823 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36861.log 2024-04-17T19:55:29.823 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37715.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34919.log.gz 2024-04-17T19:55:29.824 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35051.log 2024-04-17T19:55:29.824 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37715.log.gz 2024-04-17T19:55:29.824 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35935.log 2024-04-17T19:55:29.824 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37348.log 2024-04-17T19:55:29.824 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35051.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36861.log.gz 2024-04-17T19:55:29.824 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35935.log: 89.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.35051.log.gz -5 2024-04-17T19:55:29.824 INFO:teuthology.orchestra.run.smithi018.stderr: --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-17T19:55:29.824 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35935.log.gz 2024-04-17T19:55:29.824 INFO:teuthology.orchestra.run.smithi018.stderr:gzip/var/log/ceph/ceph-client.admin.37348.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.36387.log 2024-04-17T19:55:29.824 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33044.log 2024-04-17T19:55:29.824 INFO:teuthology.orchestra.run.smithi018.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37348.log.gz 2024-04-17T19:55:29.824 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37793.log/var/log/ceph/ceph-client.admin.36387.log: 2024-04-17T19:55:29.824 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27506.log 2024-04-17T19:55:29.824 INFO:teuthology.orchestra.run.smithi018.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36387.log.gz 2024-04-17T19:55:29.824 INFO:teuthology.orchestra.run.smithi018.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33044.log.gz 2024-04-17T19:55:29.825 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34973.log 2024-04-17T19:55:29.825 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.27506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32872.log 2024-04-17T19:55:29.825 INFO:teuthology.orchestra.run.smithi018.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37793.log.gz 2024-04-17T19:55:29.825 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36039.log 2024-04-17T19:55:29.825 INFO:teuthology.orchestra.run.smithi018.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.27506.log.gz 2024-04-17T19:55:29.825 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37556.log 2024-04-17T19:55:29.825 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32872.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34973.log.gz 2024-04-17T19:55:29.825 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32872.log.gz 2024-04-17T19:55:29.825 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36652.log 2024-04-17T19:55:29.825 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34502.log 2024-04-17T19:55:29.825 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37556.log: -- replaced with /var/log/ceph/ceph-client.admin.36039.log.gz 2024-04-17T19:55:29.825 INFO:teuthology.orchestra.run.smithi018.stderr:gzip/var/log/ceph/ceph-client.admin.36652.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.33690.log 2024-04-17T19:55:29.825 INFO:teuthology.orchestra.run.smithi018.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37556.log.gz 2024-04-17T19:55:29.825 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34502.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36652.log.gz 2024-04-17T19:55:29.826 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36809.log 2024-04-17T19:55:29.826 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34502.log.gz 2024-04-17T19:55:29.826 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37890.log 2024-04-17T19:55:29.826 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33690.log: /var/log/ceph/ceph-client.admin.36809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36991.log 2024-04-17T19:55:29.826 INFO:teuthology.orchestra.run.smithi018.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33690.log.gz 2024-04-17T19:55:29.826 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36809.log.gz 2024-04-17T19:55:29.826 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34698.log 2024-04-17T19:55:29.826 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36913.log 2024-04-17T19:55:29.826 INFO:teuthology.orchestra.run.smithi018.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37890.log.gz 2024-04-17T19:55:29.826 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36991.log: /var/log/ceph/ceph-client.admin.34698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36522.log 2024-04-17T19:55:29.826 INFO:teuthology.orchestra.run.smithi018.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36991.log.gz 2024-04-17T19:55:29.826 INFO:teuthology.orchestra.run.smithi018.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34698.log.gz 2024-04-17T19:55:29.826 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36913.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36913.log.gz 2024-04-17T19:55:29.826 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33297.log 2024-04-17T19:55:29.827 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34701.log 2024-04-17T19:55:29.827 INFO:teuthology.orchestra.run.smithi018.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36522.log.gz 2024-04-17T19:55:29.827 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36257.log 2024-04-17T19:55:29.827 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35025.log 2024-04-17T19:55:29.827 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33297.log.gz 2024-04-17T19:55:29.827 INFO:teuthology.orchestra.run.smithi018.stderr: 89.3%/var/log/ceph/ceph-client.admin.36257.log: -- replaced with /var/log/ceph/ceph-client.admin.34701.log.gz 2024-04-17T19:55:29.827 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33124.log 2024-04-17T19:55:29.827 INFO:teuthology.orchestra.run.smithi018.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36257.log.gz 2024-04-17T19:55:29.827 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37400.log 2024-04-17T19:55:29.827 INFO:teuthology.orchestra.run.smithi018.stderr: 89.4%/var/log/ceph/ceph-client.admin.33124.log: -- replaced with /var/log/ceph/ceph-client.admin.35025.log.gz 2024-04-17T19:55:29.827 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35398.log 2024-04-17T19:55:29.827 INFO:teuthology.orchestra.run.smithi018.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.33124.log.gz 2024-04-17T19:55:29.827 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34713.log 2024-04-17T19:55:29.827 INFO:teuthology.orchestra.run.smithi018.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37400.log.gz 2024-04-17T19:55:29.828 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37085.log 2024-04-17T19:55:29.828 INFO:teuthology.orchestra.run.smithi018.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35398.log.gz 2024-04-17T19:55:29.828 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35129.log 2024-04-17T19:55:29.828 INFO:teuthology.orchestra.run.smithi018.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34713.log.gz 2024-04-17T19:55:29.828 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34284.log 2024-04-17T19:55:29.828 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37085.log.gz 2024-04-17T19:55:29.828 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34711.log 2024-04-17T19:55:29.828 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7%/var/log/ceph/ceph-client.admin.34284.log: -- replaced with /var/log/ceph/ceph-client.admin.35129.log.gz 2024-04-17T19:55:29.828 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36283.log 2024-04-17T19:55:29.828 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34284.log.gz 2024-04-17T19:55:29.828 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35856.log 2024-04-17T19:55:29.828 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34711.log.gz 2024-04-17T19:55:29.828 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34112.log 2024-04-17T19:55:29.828 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36283.log: /var/log/ceph/ceph-client.admin.35856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36678.log 2024-04-17T19:55:29.829 INFO:teuthology.orchestra.run.smithi018.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36283.log.gz 2024-04-17T19:55:29.829 INFO:teuthology.orchestra.run.smithi018.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35856.log.gz 2024-04-17T19:55:29.829 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34112.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-17T19:55:29.829 INFO:teuthology.orchestra.run.smithi018.stderr: 89.1%/var/log/ceph/ceph-client.admin.36678.log: -- replaced with /var/log/ceph/ceph-client.admin.34112.log.gz 2024-04-17T19:55:29.829 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33794.log 2024-04-17T19:55:29.829 INFO:teuthology.orchestra.run.smithi018.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36678.log.gz 2024-04-17T19:55:29.829 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34999.log 2024-04-17T19:55:29.829 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36309.log 2024-04-17T19:55:29.829 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8%/var/log/ceph/ceph-client.admin.34999.log: -- replaced with /var/log/ceph/ceph-client.admin.33794.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36835.log 2024-04-17T19:55:29.829 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-04-17T19:55:29.829 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34999.log.gz 2024-04-17T19:55:29.829 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36309.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36309.log.gz 2024-04-17T19:55:29.829 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35077.log 2024-04-17T19:55:29.829 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34696.log 2024-04-17T19:55:29.848 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36230.log 2024-04-17T19:55:29.848 INFO:teuthology.orchestra.run.smithi018.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36835.log.gz 2024-04-17T19:55:29.848 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34696.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35077.log.gz 2024-04-17T19:55:29.848 INFO:teuthology.orchestra.run.smithi018.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34696.log.gz 2024-04-17T19:55:29.848 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33217.log 2024-04-17T19:55:29.849 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33096.log 2024-04-17T19:55:29.849 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33217.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36230.log.gz 2024-04-17T19:55:29.849 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34700.log 2024-04-17T19:55:29.849 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36152.log 2024-04-17T19:55:29.849 INFO:teuthology.orchestra.run.smithi018.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33217.log.gz 2024-04-17T19:55:29.849 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33096.log: /var/log/ceph/ceph-client.admin.34700.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.33096.log.gz 2024-04-17T19:55:29.849 INFO:teuthology.orchestra.run.smithi018.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34700.log.gz 2024-04-17T19:55:29.849 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33271.log 2024-04-17T19:55:29.849 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35311.log 2024-04-17T19:55:29.849 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33271.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36152.log.gz 2024-04-17T19:55:29.849 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35573.log 2024-04-17T19:55:29.849 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36470.log 2024-04-17T19:55:29.849 INFO:teuthology.orchestra.run.smithi018.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33271.log.gz/var/log/ceph/ceph-client.admin.35311.log: 2024-04-17T19:55:29.849 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35573.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35311.log.gz 2024-04-17T19:55:29.850 INFO:teuthology.orchestra.run.smithi018.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35573.log.gz 2024-04-17T19:55:29.850 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35207.log 2024-04-17T19:55:29.850 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36600.log 2024-04-17T19:55:29.850 INFO:teuthology.orchestra.run.smithi018.stderr: 89.4%/var/log/ceph/ceph-client.admin.35207.log: -- replaced with /var/log/ceph/ceph-client.admin.36470.log.gz 2024-04-17T19:55:29.850 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33982.log 2024-04-17T19:55:29.850 INFO:teuthology.orchestra.run.smithi018.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35207.log.gz 2024-04-17T19:55:29.850 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36600.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36600.log.gz 2024-04-17T19:55:29.850 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-17T19:55:29.850 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33187.log 2024-04-17T19:55:29.850 INFO:teuthology.orchestra.run.smithi018.stderr: 87.8% 91.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-17T19:55:29.850 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33982.log.gz/var/log/ceph/ceph-osd.1.log: 2024-04-17T19:55:29.850 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37864.log 2024-04-17T19:55:29.850 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.35668.log 2024-04-17T19:55:29.850 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33187.log: /var/log/ceph/ceph-client.admin.37864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35523.log 2024-04-17T19:55:29.851 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.2.35668.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33187.log.gz 2024-04-17T19:55:29.851 INFO:teuthology.orchestra.run.smithi018.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37864.log.gz 2024-04-17T19:55:29.851 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33427.log 2024-04-17T19:55:29.851 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.0.35523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36783.log 2024-04-17T19:55:29.851 INFO:teuthology.orchestra.run.smithi018.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.2.35668.log.gz/var/log/ceph/ceph-client.admin.33427.log: 2024-04-17T19:55:29.851 INFO:teuthology.orchestra.run.smithi018.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.0.35523.log.gz 2024-04-17T19:55:29.851 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33152.log 91.0% 2024-04-17T19:55:29.851 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33427.log.gz 2024-04-17T19:55:29.851 INFO:teuthology.orchestra.run.smithi018.stderr:gzip/var/log/ceph/ceph-client.admin.36783.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.36098.log 2024-04-17T19:55:29.851 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33152.log: 88.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34190.log 2024-04-17T19:55:29.851 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36783.log.gz 2024-04-17T19:55:29.851 INFO:teuthology.orchestra.run.smithi018.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.33152.log.gz 2024-04-17T19:55:29.851 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36098.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36098.log.gz 2024-04-17T19:55:29.851 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33245.log 2024-04-17T19:55:29.851 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35987.log 2024-04-17T19:55:29.852 INFO:teuthology.orchestra.run.smithi018.stderr: 88.2%/var/log/ceph/ceph-client.admin.33245.log: -- replaced with /var/log/ceph/ceph-client.admin.34190.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37663.log 2024-04-17T19:55:29.852 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-04-17T19:55:29.852 INFO:teuthology.orchestra.run.smithi018.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33245.log.gz 2024-04-17T19:55:29.852 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34294.log 2024-04-17T19:55:29.852 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37663.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-17T19:55:29.852 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35987.log.gz 2024-04-17T19:55:29.852 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34294.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37663.log.gz 2024-04-17T19:55:29.852 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34295.log 2024-04-17T19:55:29.852 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34294.log.gz 2024-04-17T19:55:29.852 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32839.log 2024-04-17T19:55:29.852 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37017.log 2024-04-17T19:55:29.852 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32839.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34295.log.gz 2024-04-17T19:55:29.852 INFO:teuthology.orchestra.run.smithi018.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.32839.log.gz 2024-04-17T19:55:29.852 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34293.log 2024-04-17T19:55:29.852 INFO:teuthology.orchestra.run.smithi018.stderr: 85.9% -- replaced with /var/log/ceph/ceph.log.gz/var/log/ceph/ceph-client.admin.37017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36335.log 2024-04-17T19:55:29.852 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-04-17T19:55:29.853 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34293.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37017.log.gz 2024-04-17T19:55:29.853 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34499.log 2024-04-17T19:55:29.853 INFO:teuthology.orchestra.run.smithi018.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34293.log.gz 2024-04-17T19:55:29.853 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36965.log 2024-04-17T19:55:29.853 INFO:teuthology.orchestra.run.smithi018.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36335.log.gz 2024-04-17T19:55:29.853 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34499.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34499.log.gz 2024-04-17T19:55:29.853 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36204.log 2024-04-17T19:55:29.853 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37741.log 2024-04-17T19:55:29.853 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36204.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36965.log.gz 2024-04-17T19:55:29.853 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37320.log 2024-04-17T19:55:29.853 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32772.log 2024-04-17T19:55:29.853 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37741.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36204.log.gz 2024-04-17T19:55:29.853 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37741.log.gz 2024-04-17T19:55:29.853 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35961.log 2024-04-17T19:55:29.853 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37320.log.gz 2024-04-17T19:55:29.854 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37530.log 2024-04-17T19:55:29.854 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32772.log.gz/var/log/ceph/ceph-client.admin.35961.log: 2024-04-17T19:55:29.854 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27725.log 2024-04-17T19:55:29.854 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35961.log.gz 2024-04-17T19:55:29.854 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33899.log 2024-04-17T19:55:29.854 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37530.log: /var/log/ceph/ceph-client.admin.27725.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37530.log.gz 2024-04-17T19:55:29.854 INFO:teuthology.orchestra.run.smithi018.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.27725.log.gz 2024-04-17T19:55:29.854 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36731.log 2024-04-17T19:55:29.854 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36444.log 2024-04-17T19:55:29.854 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36731.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33899.log.gz 2024-04-17T19:55:29.854 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27622.log 2024-04-17T19:55:29.854 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33951.log 2024-04-17T19:55:29.854 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36444.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36731.log.gz 2024-04-17T19:55:29.855 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.27622.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36444.log.gz 2024-04-17T19:55:29.855 INFO:teuthology.orchestra.run.smithi018.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.27622.log.gz 2024-04-17T19:55:29.855 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33925.log 2024-04-17T19:55:29.864 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33664.log 2024-04-17T19:55:29.864 INFO:teuthology.orchestra.run.smithi018.stderr: 89.0%/var/log/ceph/ceph-client.admin.33925.log: -- replaced with /var/log/ceph/ceph-client.admin.33951.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32937.log 2024-04-17T19:55:29.864 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-04-17T19:55:29.864 INFO:teuthology.orchestra.run.smithi018.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33925.log.gz 2024-04-17T19:55:29.864 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33821.log 2024-04-17T19:55:29.864 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32937.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33664.log.gz 2024-04-17T19:55:29.864 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36361.log 2024-04-17T19:55:29.864 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35155.log 2024-04-17T19:55:29.864 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8%/var/log/ceph/ceph-client.admin.33821.log: -- replaced with /var/log/ceph/ceph-client.admin.32937.log.gz 2024-04-17T19:55:29.864 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36361.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33821.log.gz 2024-04-17T19:55:29.864 INFO:teuthology.orchestra.run.smithi018.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36361.log.gz 2024-04-17T19:55:29.865 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36013.log 2024-04-17T19:55:29.865 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33742.log 2024-04-17T19:55:29.865 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36013.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35155.log.gz 2024-04-17T19:55:29.865 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37112.log 2024-04-17T19:55:29.865 INFO:teuthology.orchestra.run.smithi018.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36013.log.gz 2024-04-17T19:55:29.865 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33742.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33742.log.gz 2024-04-17T19:55:29.865 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37504.log 2024-04-17T19:55:29.865 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37112.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-17T19:55:29.865 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37504.log: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34505.log 2024-04-17T19:55:29.865 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37112.log.gz 2024-04-17T19:55:29.865 INFO:teuthology.orchestra.run.smithi018.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37504.log.gz 2024-04-17T19:55:29.865 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph.audit.log: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-17T19:55:29.865 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-17T19:55:29.865 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35259.log 2024-04-17T19:55:29.866 INFO:teuthology.orchestra.run.smithi018.stderr: 87.6%/var/log/ceph/ceph-mds.c.log: -- replaced with /var/log/ceph/ceph-client.admin.34505.log.gz 2024-04-17T19:55:29.866 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-17T19:55:29.866 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37374.log 2024-04-17T19:55:29.866 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35259.log: 92.3% -- replaced with /var/log/ceph/ceph-mds.c.log.gz/var/log/ceph/ceph-mds.a.log: 2024-04-17T19:55:29.866 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35259.log.gz 2024-04-17T19:55:29.866 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37478.log 2024-04-17T19:55:29.866 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37190.log 2024-04-17T19:55:29.866 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6%/var/log/ceph/ceph-client.admin.37478.log: -- replaced with /var/log/ceph/ceph-client.admin.37374.log.gz 2024-04-17T19:55:29.866 INFO:teuthology.orchestra.run.smithi018.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37478.log.gz 2024-04-17T19:55:29.866 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36757.log 2024-04-17T19:55:29.866 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37216.log 2024-04-17T19:55:29.866 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37190.log: /var/log/ceph/ceph-client.admin.36757.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37190.log.gz 2024-04-17T19:55:29.866 INFO:teuthology.orchestra.run.smithi018.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36757.log.gz 2024-04-17T19:55:29.867 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33323.log 2024-04-17T19:55:29.867 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37216.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37216.log.gz 2024-04-17T19:55:29.867 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34164.log 2024-04-17T19:55:29.867 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33768.log 2024-04-17T19:55:29.867 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33323.log: /var/log/ceph/ceph-client.admin.34164.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33323.log.gz 2024-04-17T19:55:29.867 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34164.log.gz 2024-04-17T19:55:29.867 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35744.log 2024-04-17T19:55:29.868 INFO:teuthology.orchestra.run.smithi173.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-17T19:55:29.871 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37059.log 2024-04-17T19:55:29.871 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33768.log: /var/log/ceph/ceph-client.admin.35744.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33768.log.gz 2024-04-17T19:55:29.871 INFO:teuthology.orchestra.run.smithi018.stderr: 88.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.35744.log.gz 2024-04-17T19:55:29.871 INFO:teuthology.orchestra.run.smithi018.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.34060.log 2024-04-17T19:55:29.871 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37059.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37059.log.gz 2024-04-17T19:55:29.871 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36418.log 2024-04-17T19:55:29.871 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33873.log 2024-04-17T19:55:29.871 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34060.log: /var/log/ceph/ceph-client.admin.36418.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34060.log.gz 2024-04-17T19:55:29.871 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36418.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33716.log 2024-04-17T19:55:29.872 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-04-17T19:55:29.872 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33873.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33873.log.gz 2024-04-17T19:55:29.872 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33375.log 2024-04-17T19:55:29.872 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35882.log 2024-04-17T19:55:29.872 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33716.log: /var/log/ceph/ceph-client.admin.33375.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33716.log.gz 2024-04-17T19:55:29.872 INFO:teuthology.orchestra.run.smithi018.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33375.log.gz 2024-04-17T19:55:29.872 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37294.log 2024-04-17T19:55:29.872 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35882.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35882.log.gz 2024-04-17T19:55:29.872 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37838.log 2024-04-17T19:55:29.873 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36704.log 2024-04-17T19:55:29.874 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37294.log: /var/log/ceph/ceph-client.admin.37838.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37294.log.gz 2024-04-17T19:55:29.874 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37582.log 2024-04-17T19:55:29.874 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37838.log.gz 2024-04-17T19:55:29.874 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36704.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36704.log.gz 2024-04-17T19:55:29.874 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34086.log 2024-04-17T19:55:29.875 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37608.log 2024-04-17T19:55:29.875 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37582.log: /var/log/ceph/ceph-client.admin.34086.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37582.log.gz 2024-04-17T19:55:29.875 INFO:teuthology.orchestra.run.smithi018.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.34086.log.gz 2024-04-17T19:55:29.875 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34500.log 2024-04-17T19:55:29.876 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37689.log 2024-04-17T19:55:29.876 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37608.log: /var/log/ceph/ceph-client.admin.34500.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37608.log.gz 2024-04-17T19:55:29.877 INFO:teuthology.orchestra.run.smithi018.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34500.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36939.log 2024-04-17T19:55:29.877 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-04-17T19:55:29.877 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37689.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37689.log.gz 2024-04-17T19:55:29.877 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37164.log 2024-04-17T19:55:29.878 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36065.log 2024-04-17T19:55:29.879 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36939.log: /var/log/ceph/ceph-client.admin.37164.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36939.log.gz 2024-04-17T19:55:29.879 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37164.log.gz 2024-04-17T19:55:29.879 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36178.log 2024-04-17T19:55:29.879 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34286.log 2024-04-17T19:55:29.880 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36065.log: /var/log/ceph/ceph-client.admin.36178.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36065.log.gz 2024-04-17T19:55:29.880 INFO:teuthology.orchestra.run.smithi018.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36178.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36887.log 2024-04-17T19:55:29.881 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-04-17T19:55:29.881 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34286.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34286.log.gz 2024-04-17T19:55:29.881 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35804.log 2024-04-17T19:55:29.882 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33847.log 2024-04-17T19:55:29.882 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36887.log: /var/log/ceph/ceph-client.admin.35804.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36887.log.gz 2024-04-17T19:55:29.883 INFO:teuthology.orchestra.run.smithi018.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35804.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32963.log 2024-04-17T19:55:29.883 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-04-17T19:55:29.883 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33847.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33847.log.gz 2024-04-17T19:55:29.884 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34893.log 2024-04-17T19:55:29.884 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34498.log 2024-04-17T19:55:29.885 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32963.log: /var/log/ceph/ceph-client.admin.34893.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32963.log.gz 2024-04-17T19:55:29.885 INFO:teuthology.orchestra.run.smithi018.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34893.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35718.log 2024-04-17T19:55:29.885 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-04-17T19:55:29.886 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34498.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34498.log.gz 2024-04-17T19:55:29.886 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34216.log 2024-04-17T19:55:29.887 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.22699.log 2024-04-17T19:55:29.887 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35718.log: /var/log/ceph/ceph-client.admin.34216.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35718.log.gz 2024-04-17T19:55:29.888 INFO:teuthology.orchestra.run.smithi018.stderr: 89.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34501.log 2024-04-17T19:55:29.888 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34216.log.gz 2024-04-17T19:55:29.888 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph.tmp-client.admin.22699.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.22699.log.gz 2024-04-17T19:55:29.888 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33349.log 2024-04-17T19:55:29.889 INFO:teuthology.orchestra.run.smithi173.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-17T19:55:29.890 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35908.log 2024-04-17T19:55:29.890 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34501.log: /var/log/ceph/ceph-client.admin.33349.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34501.log.gz 2024-04-17T19:55:29.890 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33349.log.gz 2024-04-17T19:55:29.890 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35908.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35908.log.gz 2024-04-17T19:55:29.898 INFO:teuthology.orchestra.run.smithi018.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-17T19:55:30.067 INFO:teuthology.orchestra.run.smithi018.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-17T19:55:30.400 INFO:teuthology.orchestra.run.smithi173.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-17T19:55:30.441 INFO:teuthology.orchestra.run.smithi173.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-17T19:55:30.465 INFO:teuthology.orchestra.run.smithi173.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-17T19:55:30.483 INFO:teuthology.orchestra.run.smithi173.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-17T19:55:30.484 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-04-17T19:55:30.484 INFO:teuthology.orchestra.run.smithi173.stderr:real 0m0.705s 2024-04-17T19:55:30.485 INFO:teuthology.orchestra.run.smithi173.stderr:user 0m2.722s 2024-04-17T19:55:30.485 INFO:teuthology.orchestra.run.smithi173.stderr:sys 0m0.083s 2024-04-17T19:55:30.501 INFO:teuthology.orchestra.run.smithi018.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-17T19:55:30.537 INFO:teuthology.orchestra.run.smithi018.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-17T19:55:30.579 INFO:teuthology.orchestra.run.smithi018.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-17T19:55:30.582 INFO:teuthology.orchestra.run.smithi018.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-17T19:55:30.583 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-04-17T19:55:30.583 INFO:teuthology.orchestra.run.smithi018.stderr:real 0m0.814s 2024-04-17T19:55:30.583 INFO:teuthology.orchestra.run.smithi018.stderr:user 0m3.391s 2024-04-17T19:55:30.583 INFO:teuthology.orchestra.run.smithi018.stderr:sys 0m0.189s 2024-04-17T19:55:30.584 INFO:tasks.ceph:Archiving logs... 2024-04-17T19:55:30.584 DEBUG:teuthology.misc:Transferring archived files from smithi018:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-04-17_17:06:06-fs-wip-pdonnell-testing-20240417.021458-debug-distro-default-smithi/7660584/remote/smithi018/log 2024-04-17T19:55:30.585 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-17T19:55:31.385 DEBUG:teuthology.misc:Transferring archived files from smithi173:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-04-17_17:06:06-fs-wip-pdonnell-testing-20240417.021458-debug-distro-default-smithi/7660584/remote/smithi173/log 2024-04-17T19:55:31.395 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-17T19:55:31.534 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-04-17T19:55:31.534 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x has been restored 2024-04-17T19:55:31.863 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-17T19:55:31.878 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-17T19:55:31.878 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-17T19:55:31.882 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-17T19:55:31.951 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-17T19:55:31.985 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-17T19:55:31.985 DEBUG:teuthology.orchestra.run.smithi018:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-17T19:55:31.988 DEBUG:teuthology.orchestra.run.smithi173:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-17T19:55:32.002 INFO:teuthology.orchestra.run.smithi018.stdout: remote refid st t when poll reach delay offset jitter 2024-04-17T19:55:32.002 INFO:teuthology.orchestra.run.smithi018.stdout:============================================================================== 2024-04-17T19:55:32.003 INFO:teuthology.orchestra.run.smithi018.stdout:+hv01.front.sepi 67.205.162.81 3 u 22 64 177 0.046 -1.864 0.971 2024-04-17T19:55:32.003 INFO:teuthology.orchestra.run.smithi018.stdout:+hv02.front.sepi 63.231.80.2 3 u 23 64 177 0.080 +1.055 1.078 2024-04-17T19:55:32.003 INFO:teuthology.orchestra.run.smithi018.stdout:*hv03.front.sepi 74.6.168.72 3 u 23 64 177 0.094 -1.261 1.016 2024-04-17T19:55:32.003 INFO:teuthology.orchestra.run.smithi018.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-17T19:55:32.004 INFO:teuthology.orchestra.run.smithi173.stdout: remote refid st t when poll reach delay offset jitter 2024-04-17T19:55:32.004 INFO:teuthology.orchestra.run.smithi173.stdout:============================================================================== 2024-04-17T19:55:32.005 INFO:teuthology.orchestra.run.smithi173.stdout:+hv01.front.sepi 67.205.162.81 3 u 24 64 177 0.058 -3.441 1.196 2024-04-17T19:55:32.005 INFO:teuthology.orchestra.run.smithi173.stdout:+hv02.front.sepi 63.231.80.2 3 u 25 64 177 0.090 +0.255 0.892 2024-04-17T19:55:32.005 INFO:teuthology.orchestra.run.smithi173.stdout:*hv03.front.sepi 74.6.168.72 3 u 24 64 177 0.084 +0.125 1.444 2024-04-17T19:55:32.005 INFO:teuthology.orchestra.run.smithi173.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-17T19:55:32.005 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-17T19:55:32.015 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-17T19:55:32.016 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-17T19:55:32.045 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-17T19:55:32.109 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-17T19:55:32.187 INFO:teuthology.task.internal:Duration was 844.977995 seconds 2024-04-17T19:55:32.187 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-17T19:55:32.255 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-17T19:55:32.256 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-17T19:55:32.259 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-17T19:55:32.296 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-17T19:55:32.296 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi018.front.sepia.ceph.com 2024-04-17T19:55:32.297 DEBUG:teuthology.orchestra.run.smithi018:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-17T19:55:32.356 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi173.front.sepia.ceph.com 2024-04-17T19:55:32.356 DEBUG:teuthology.orchestra.run.smithi173:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-17T19:55:32.367 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-17T19:55:32.367 DEBUG:teuthology.orchestra.run.smithi018:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-17T19:55:32.405 DEBUG:teuthology.orchestra.run.smithi173:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-17T19:55:32.435 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-17T19:55:32.435 DEBUG:teuthology.orchestra.run.smithi018:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-17T19:55:32.476 DEBUG:teuthology.orchestra.run.smithi173:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-17T19:55:32.536 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-17T19:55:32.547 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-17T19:55:32.548 DEBUG:teuthology.orchestra.run.smithi018:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-17T19:55:32.561 DEBUG:teuthology.orchestra.run.smithi173:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-17T19:55:32.572 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-17T19:55:32.587 DEBUG:teuthology.orchestra.run.smithi018:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-17T19:55:32.608 DEBUG:teuthology.orchestra.run.smithi173:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-17T19:55:32.617 INFO:teuthology.orchestra.run.smithi018.stdout:kernel.core_pattern = core 2024-04-17T19:55:32.626 INFO:teuthology.orchestra.run.smithi173.stdout:kernel.core_pattern = core 2024-04-17T19:55:32.639 DEBUG:teuthology.orchestra.run.smithi018:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-17T19:55:32.674 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T19:55:32.675 DEBUG:teuthology.orchestra.run.smithi173:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-17T19:55:32.684 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-17T19:55:32.684 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-17T19:55:32.697 INFO:teuthology.task.internal:Transferring archived files... 2024-04-17T19:55:32.698 DEBUG:teuthology.misc:Transferring archived files from smithi018:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-04-17_17:06:06-fs-wip-pdonnell-testing-20240417.021458-debug-distro-default-smithi/7660584/remote/smithi018 2024-04-17T19:55:32.698 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-17T19:55:32.740 DEBUG:teuthology.misc:Transferring archived files from smithi173:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-04-17_17:06:06-fs-wip-pdonnell-testing-20240417.021458-debug-distro-default-smithi/7660584/remote/smithi173 2024-04-17T19:55:32.740 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-17T19:55:32.762 INFO:teuthology.task.internal:Removing archive directory... 2024-04-17T19:55:32.762 DEBUG:teuthology.orchestra.run.smithi018:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-17T19:55:32.782 DEBUG:teuthology.orchestra.run.smithi173:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-17T19:55:32.805 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-17T19:55:32.818 INFO:teuthology.task.internal:Not uploading archives. 2024-04-17T19:55:32.818 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-17T19:55:32.845 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-17T19:55:32.845 DEBUG:teuthology.orchestra.run.smithi018:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-17T19:55:32.848 DEBUG:teuthology.orchestra.run.smithi173:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-17T19:55:32.852 INFO:teuthology.orchestra.run.smithi018.stdout: 658640 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 17 19:55 /home/ubuntu/cephtest 2024-04-17T19:55:32.853 INFO:teuthology.orchestra.run.smithi173.stdout: 658466 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 17 19:55 /home/ubuntu/cephtest 2024-04-17T19:55:32.855 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-17T19:55:32.878 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-17T19:55:32.971 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/mds_creation_retry} duration: 844.9779946804047 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-04-17T19:55:32.971 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T19:55:33.047 INFO:teuthology.run:pass